2024-05-09T06:08:52.102 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T06:08:52.102 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440 --verbose -- /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/orig.config.yaml 2024-05-09T06:08:52.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T06:08:52.243 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7699440' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e owner: scheduled_pdonnell@teuthology priority: 95 repo: https://github.com/ceph/ceph roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5189 sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ06gKFeyoOSwVrH5wtZOtSqxO+qwAFsLwzoI71QzCRGUOsGKmbXY3RHUQgTlRZcweTqxanW72jTeTjbaFYlI8Y= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBO5w+yPGEJpFSsE4b9cBuYaz9Q/tp8Q4JcEnCLSOVsSGbvkLw5/AYiqFRMx5Wi+lXAT4n3nG+lq/Yq9YlCBLRk= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-09_00:24:17 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-05-09T06:08:52.243 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/qa; will attempt to use it 2024-05-09T06:08:52.243 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/qa/tasks 2024-05-09T06:08:52.243 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T06:08:52.245 INFO:teuthology.task.internal:Checking packages... 2024-05-09T06:08:52.266 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e' 2024-05-09T06:08:52.267 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:08:52.267 INFO:teuthology.packaging:ref: None 2024-05-09T06:08:52.267 INFO:teuthology.packaging:tag: None 2024-05-09T06:08:52.267 INFO:teuthology.packaging:branch: main 2024-05-09T06:08:52.267 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:08:52.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-05-09T06:08:52.689 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3575.g720f8e95 2024-05-09T06:08:52.690 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T06:08:52.698 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T06:08:52.699 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T06:08:52.820 INFO:teuthology.task.internal:Saving configuration 2024-05-09T06:08:52.840 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T06:08:52.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T06:08:52.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 06:03:44.403333', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ06gKFeyoOSwVrH5wtZOtSqxO+qwAFsLwzoI71QzCRGUOsGKmbXY3RHUQgTlRZcweTqxanW72jTeTjbaFYlI8Y='} 2024-05-09T06:08:52.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 06:03:44.404650', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBO5w+yPGEJpFSsE4b9cBuYaz9Q/tp8Q4JcEnCLSOVsSGbvkLw5/AYiqFRMx5Wi+lXAT4n3nG+lq/Yq9YlCBLRk='} 2024-05-09T06:08:52.893 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T06:08:52.901 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-05-09T06:08:52.901 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-05-09T06:08:52.901 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T06:08:52.968 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc59302c160>, signals=[15]) 2024-05-09T06:08:52.968 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T06:08:52.974 INFO:teuthology.task.internal:Opening connections... 2024-05-09T06:08:52.974 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:08:52.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:08:53.048 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-05-09T06:08:53.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:08:53.122 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T06:08:53.128 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-05-09T06:08:53.146 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-05-09T06:08:53.146 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T06:08:53.204 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-05-09T06:08:53.205 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-05-09T06:08:53.205 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T06:08:53.205 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-05-09T06:08:53.205 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T06:08:53.205 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T06:08:53.205 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T06:08:53.205 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-05-09T06:08:53.239 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-05-09T06:08:53.256 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-05-09T06:08:53.256 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-05-09T06:08:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-05-09T06:08:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-05-09T06:08:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-05-09T06:08:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-05-09T06:08:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-05-09T06:08:53.312 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T06:08:53.313 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T06:08:53.313 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-05-09T06:08:53.330 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T06:08:53.338 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T06:08:53.342 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T06:08:53.343 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-05-09T06:08:53.345 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-05-09T06:08:53.367 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T06:08:53.374 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T06:08:53.374 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-05-09T06:08:53.402 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-05-09T06:08:53.431 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T06:08:53.483 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T06:08:53.496 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T06:08:53.496 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T06:08:53.496 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T06:08:53.497 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T06:08:53.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:08:53.512 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-05-09T06:08:53.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:08:53.513 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-05-09T06:08:53.568 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-437.el9.x86_64 2024-05-09T06:08:53.568 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.14.0-437.el9.x86_64 2024-05-09T06:08:53.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum install -y kernel 2024-05-09T06:08:53.571 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-437.el9.x86_64 2024-05-09T06:08:53.571 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-437.el9.x86_64 2024-05-09T06:08:53.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-05-09T06:08:55.601 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-05-09T06:08:57.125 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.1 MB 00:01 2024-05-09T06:09:06.151 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 2.0 MB/s | 19 MB 00:09 2024-05-09T06:09:10.770 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.2 MB 00:00 2024-05-09T06:09:12.419 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-09T06:09:13.806 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-09T06:09:15.807 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-05-09T06:09:18.937 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-09T06:09:20.407 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.2 MB 00:00 2024-05-09T06:09:20.919 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T06:09:20.919 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T06:09:21.014 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:09:21.027 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:09:21.028 INFO:teuthology.orchestra.run.smithi106.stdout:Install 4 Packages 2024-05-09T06:09:21.028 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:09:21.028 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 78 M 2024-05-09T06:09:21.028 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 123 M 2024-05-09T06:09:21.028 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:09:21.747 INFO:teuthology.orchestra.run.smithi106.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 716 kB/s | 484 kB 00:00 2024-05-09T06:09:21.933 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-09T06:09:25.893 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-05-09T06:09:31.193 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-09T06:09:33.291 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T06:09:33.292 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T06:09:33.379 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:09:33.390 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:09:33.390 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-05-09T06:09:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:09:33.392 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 78 M 2024-05-09T06:09:33.392 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 123 M 2024-05-09T06:09:33.392 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:09:33.670 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.2 MB/s | 484 kB 00:00 2024-05-09T06:09:34.036 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 27 MB/s | 15 MB 00:00 2024-05-09T06:09:35.537 INFO:teuthology.orchestra.run.smithi106.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.1 MB/s | 15 MB 00:14 2024-05-09T06:09:35.711 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 14 MB/s | 28 MB 00:02 2024-05-09T06:09:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 13 MB/s | 34 MB 00:02 2024-05-09T06:09:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:09:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:Total 29 MB/s | 78 MB 00:02 2024-05-09T06:09:36.737 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:09:37.139 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:09:37.139 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:09:38.101 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:09:38.102 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:09:39.729 INFO:teuthology.orchestra.run.smithi106.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 1.6 MB/s | 28 MB 00:17 2024-05-09T06:09:40.624 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:09:41.293 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:09:41.378 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:44.182 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:09:44.311 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:49.386 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:09:49.431 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:09:54.533 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:00.552 INFO:teuthology.orchestra.run.smithi106.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 880 kB/s | 34 MB 00:39 2024-05-09T06:10:00.553 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:10:00.553 INFO:teuthology.orchestra.run.smithi106.stdout:Total 2.0 MB/s | 78 MB 00:39 2024-05-09T06:10:01.227 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:10:01.592 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:10:01.593 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:10:02.511 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:10:02.512 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:10:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:10:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:10:05.694 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:10:08.337 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:10:08.465 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:10:13.135 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:10:13.200 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:17.908 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:25.450 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:25.492 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:25.833 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:25.833 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:10:25.834 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:10:25.834 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:10:26.662 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:10:26.995 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:10:27.115 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:27.115 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:10:27.115 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T06:10:27.115 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T06:10:27.115 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T06:10:27.115 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-05-09T06:10:27.116 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T06:10:27.116 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:10:27.167 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:27.168 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:10:27.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T06:10:27.209 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T06:10:27.210 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T06:10:27.211 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T06:10:27.211 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-05-09T06:10:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:10:27.211 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T06:10:27.212 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T06:10:27.212 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-444.el9.x86_64 2024-05-09T06:10:27.212 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T06:10:27.831 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-05-09T06:10:29.352 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T06:10:29.403 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-05-09T06:10:29.405 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-05-09T06:10:29.463 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.XM19OspUTd 2024-05-09T06:10:29.463 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XM19OspUTd 2024-05-09T06:10:29.532 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.XM19OspUTd 2024-05-09T06:10:29.672 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.XM19OspUTd is 6KB 2024-05-09T06:10:29.721 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.XM19OspUTd 2024-05-09T06:10:29.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T06:10:29.797 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T06:10:29.797 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T06:10:29.797 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T06:10:29.797 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T06:10:29.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T06:10:29.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-05-09T06:10:47.200 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:47.239 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:47.638 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:47.638 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T06:10:47.638 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T06:10:47.638 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T06:10:48.406 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T06:10:48.406 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:10:48.406 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:10:48.406 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:48.406 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T06:10:48.406 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T06:10:48.407 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T06:10:48.407 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:10:48.407 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:10:48.745 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:10:48.814 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:48.815 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:10:48.815 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T06:10:48.815 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T06:10:48.815 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T06:10:48.815 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-05-09T06:10:48.815 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T06:10:48.815 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T06:10:48.864 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T06:10:48.865 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T06:10:48.865 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -qi grub2-tools 2024-05-09T06:10:48.899 INFO:teuthology.orchestra.run.smithi106.stdout:Name : grub2-tools 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Epoch : 1 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Version : 2.06 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Release : 68.el9 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: x86_64 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Group : Unspecified 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Size : 8264254 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:License : GPLv3+ 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Packager : builder@centos.org 2024-05-09T06:10:48.900 INFO:teuthology.orchestra.run.smithi106.stdout:Vendor : CentOS 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:Summary : Support tools for GRUB. 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:Description : 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:hardware devices. 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:10:48.901 INFO:teuthology.orchestra.run.smithi106.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T06:10:48.902 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T06:10:48.902 INFO:teuthology.task.kernel:Updating grub on smithi106 to boot 5.14.0-444.el9.x86_64 2024-05-09T06:10:48.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T06:10:49.462 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-05-09T06:10:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T06:10:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-05-09T06:10:50.944 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-09T06:10:50.960 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.cBbHpZG3O1 2024-05-09T06:10:50.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cBbHpZG3O1 2024-05-09T06:10:51.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.cBbHpZG3O1 2024-05-09T06:10:51.157 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.cBbHpZG3O1 is 6KB 2024-05-09T06:10:51.205 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.cBbHpZG3O1 2024-05-09T06:10:51.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T06:10:51.281 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T06:10:51.281 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T06:10:51.281 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T06:10:51.281 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T06:10:51.283 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T06:10:51.430 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-05-09T06:10:59.970 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-05-09T06:10:59.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T06:10:59.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:11:21.454 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-05-09T06:11:21.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-09T06:11:21.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:11:34.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-05-09T06:11:43.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T06:11:43.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:12:01.951 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-05-09T06:12:13.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T06:12:13.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:12:16.227 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-05-09T06:12:16.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T06:12:16.663 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-444.el9.x86_64"... 2024-05-09T06:12:16.663 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-05-09T06:12:16.681 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-444.el9.x86_64 2024-05-09T06:12:16.681 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T06:12:16.682 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T06:12:16.682 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T06:12:17.682 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-05-09T06:12:17.683 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T06:12:17.788 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-05-09T06:12:17.837 DEBUG:teuthology.parallel:result is None 2024-05-09T06:12:21.458 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T06:12:30.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-09T06:12:30.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:12:30.961 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-09T06:12:31.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-09T06:12:31.456 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-444.el9.x86_64"... 2024-05-09T06:12:31.456 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-05-09T06:12:31.471 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-444.el9.x86_64 2024-05-09T06:12:31.471 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T06:12:31.471 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T06:12:31.471 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T06:12:32.472 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-05-09T06:12:32.473 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T06:12:32.565 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-05-09T06:12:32.603 DEBUG:teuthology.parallel:result is None 2024-05-09T06:12:32.603 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T06:12:32.610 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T06:12:32.611 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T06:12:32.614 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T06:12:32.633 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T06:12:32.656 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T06:12:32.667 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T06:12:32.667 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T06:12:32.676 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T06:12:32.708 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T06:12:32.715 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T06:12:32.715 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T06:12:32.747 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T06:12:32.778 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:12:32.778 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:12:32.788 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:12:32.790 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T06:12:32.792 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T06:12:32.799 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T06:12:32.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T06:12:32.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T06:12:32.861 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T06:12:32.870 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T06:12:32.871 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T06:12:32.904 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T06:12:32.920 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:12:33.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:12:33.061 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:12:33.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:12:33.191 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:12:33.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T06:12:33.258 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:12:33.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T06:12:33.348 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:12:33.429 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T06:12:33.471 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:12:33.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T06:12:33.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-05-09T06:12:33.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-05-09T06:12:33.582 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:12:33.626 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:12:34.100 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T06:12:34.107 INFO:teuthology.task.internal:Starting timer... 2024-05-09T06:12:34.107 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T06:12:34.118 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T06:12:34.127 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-09T06:12:34.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-05-09T06:12:34.212 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-05-09T06:12:34.214 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-05-09T06:12:34.282 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-05-09T06:12:34.284 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T06:12:34.284 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-05-09T06:12:34.309 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-05-09T06:12:34.309 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-05-09T06:12:34.331 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-05-09T06:12:34.332 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi106.front.sepia.ceph.com': 'permissive'} 2024-05-09T06:12:34.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:12:34.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:12:34.379 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:12:34.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:12:34.405 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T06:12:34.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-05-09T06:12:34.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-05-09T06:12:34.473 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T06:12:34.484 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T06:12:34.490 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T06:12:34.618 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T06:12:34.635 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T06:12:34.636 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T06:16:38.139 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2024-05-09T06:16:38.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T06:16:38.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:16:38.215 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-05-09T06:16:38.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-09T06:16:38.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-09T06:16:38.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T06:16:38.327 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-09T06:16:38.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-09T06:16:38.406 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T06:16:38.416 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T06:16:38.416 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T06:16:38.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:16:38.419 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T06:16:38.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:16:38.448 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T06:16:38.464 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T06:16:38.474 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T06:16:38.488 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T06:16:38.491 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-05-09T06:16:38.502 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-05-09T06:16:38.512 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-05-09T06:16:38.518 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T06:16:38.523 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-05-09T06:16:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T06:16:38.537 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T06:16:38.551 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T06:16:38.590 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:16:38.593 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:16:38.594 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-05-09T06:16:38.594 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.594 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.594 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.594 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.617 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:16:38.620 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:16:38.621 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-09T06:16:38.621 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.621 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.621 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.621 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:16:38.622 INFO:teuthology.run_tasks:Running task install... 2024-05-09T06:16:38.630 DEBUG:teuthology.task.install:project ceph 2024-05-09T06:16:38.630 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'}} 2024-05-09T06:16:38.630 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'} 2024-05-09T06:16:38.630 INFO:teuthology.task.install:Using flavor: default 2024-05-09T06:16:38.636 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T06:16:38.636 INFO:teuthology.task.install:extra packages: [] 2024-05-09T06:16:38.636 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T06:16:38.636 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:16:38.637 INFO:teuthology.packaging:ref: None 2024-05-09T06:16:38.637 INFO:teuthology.packaging:tag: None 2024-05-09T06:16:38.637 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:16:38.637 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:16:38.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:16:38.639 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T06:16:38.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:16:38.639 INFO:teuthology.packaging:ref: None 2024-05-09T06:16:38.639 INFO:teuthology.packaging:tag: None 2024-05-09T06:16:38.640 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:16:38.640 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:16:38.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:16:38.853 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/ 2024-05-09T06:16:38.853 INFO:teuthology.task.install.rpm:Package version is 17.2.7-933.g4ba5a836 2024-05-09T06:16:39.047 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/ 2024-05-09T06:16:39.048 INFO:teuthology.task.install.rpm:Package version is 17.2.7-933.g4ba5a836 2024-05-09T06:16:39.089 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T06:16:39.089 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:16:39.090 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T06:16:39.116 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T06:16:39.117 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:16:39.117 INFO:teuthology.packaging:ref: None 2024-05-09T06:16:39.117 INFO:teuthology.packaging:tag: None 2024-05-09T06:16:39.117 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:16:39.117 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:16:39.117 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T06:16:39.157 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/4ba5a836bc8be559bfb15d04b24d35764bba0eaf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T06:16:39.157 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:16:39.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T06:16:39.183 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T06:16:39.186 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T06:16:39.186 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:16:39.186 INFO:teuthology.packaging:ref: None 2024-05-09T06:16:39.186 INFO:teuthology.packaging:tag: None 2024-05-09T06:16:39.186 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:16:39.186 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:16:39.187 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T06:16:39.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T06:16:39.259 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T06:16:39.323 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-05-09T06:16:39.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-05-09T06:16:39.332 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T06:16:39.399 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-05-09T06:16:39.401 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-05-09T06:16:39.583 INFO:teuthology.orchestra.run.smithi106.stdout:54 files removed 2024-05-09T06:16:39.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw 2024-05-09T06:16:39.644 INFO:teuthology.orchestra.run.smithi046.stdout:54 files removed 2024-05-09T06:16:39.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw 2024-05-09T06:16:40.461 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 154 kB/s | 77 kB 00:00 2024-05-09T06:16:40.538 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 118 kB/s | 77 kB 00:00 2024-05-09T06:16:41.120 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-05-09T06:16:41.231 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-05-09T06:16:41.723 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 4.0 kB/s | 1.8 kB 00:00 2024-05-09T06:16:41.829 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 2.7 kB/s | 1.8 kB 00:00 2024-05-09T06:16:42.414 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-09T06:16:44.557 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-05-09T06:16:45.704 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.1 MB 00:03 2024-05-09T06:16:48.708 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-09T06:16:50.151 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 16 kB 00:00 2024-05-09T06:16:51.597 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-09T06:16:54.154 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-05-09T06:16:56.686 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-09T06:16:59.094 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 14 M 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.1 M 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 5.0 M 2024-05-09T06:16:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 22 M 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 638 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 457 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 4.9 M 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 45 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 118 k 2024-05-09T06:16:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 156 k 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 320 k 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 293 k 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 99 k 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:Install 22 Packages 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 2 Packages 2024-05-09T06:16:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:16:59.111 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 58 M 2024-05-09T06:16:59.111 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:17:01.179 INFO:teuthology.orchestra.run.smithi106.stdout:(1/24): ceph-base-17.2.7-933.g4ba5a836.el9.x86_ 3.2 MB/s | 5.0 MB 00:01 2024-05-09T06:17:01.263 INFO:teuthology.orchestra.run.smithi106.stdout:(2/24): ceph-selinux-17.2.7-933.g4ba5a836.el9.x 301 kB/s | 25 kB 00:00 2024-05-09T06:17:01.504 INFO:teuthology.orchestra.run.smithi106.stdout:(3/24): ceph-radosgw-17.2.7-933.g4ba5a836.el9.x 7.4 MB/s | 14 MB 00:01 2024-05-09T06:17:01.529 INFO:teuthology.orchestra.run.smithi106.stdout:(4/24): libcephfs2-17.2.7-933.g4ba5a836.el9.x86 2.3 MB/s | 638 kB 00:00 2024-05-09T06:17:01.572 INFO:teuthology.orchestra.run.smithi106.stdout:(5/24): libradosstriper1-17.2.7-933.g4ba5a836.e 6.7 MB/s | 457 kB 00:00 2024-05-09T06:17:01.622 INFO:teuthology.orchestra.run.smithi106.stdout:(6/24): python3-ceph-argparse-17.2.7-933.g4ba5a 901 kB/s | 45 kB 00:00 2024-05-09T06:17:01.672 INFO:teuthology.orchestra.run.smithi106.stdout:(7/24): python3-ceph-common-17.2.7-933.g4ba5a83 2.3 MB/s | 118 kB 00:00 2024-05-09T06:17:01.731 INFO:teuthology.orchestra.run.smithi106.stdout:(8/24): python3-cephfs-17.2.7-933.g4ba5a836.el9 2.6 MB/s | 156 kB 00:00 2024-05-09T06:17:01.806 INFO:teuthology.orchestra.run.smithi106.stdout:(9/24): python3-rados-17.2.7-933.g4ba5a836.el9. 4.2 MB/s | 320 kB 00:00 2024-05-09T06:17:01.873 INFO:teuthology.orchestra.run.smithi106.stdout:(10/24): python3-rbd-17.2.7-933.g4ba5a836.el9.x 4.3 MB/s | 293 kB 00:00 2024-05-09T06:17:01.957 INFO:teuthology.orchestra.run.smithi106.stdout:(11/24): python3-rgw-17.2.7-933.g4ba5a836.el9.x 1.2 MB/s | 99 kB 00:00 2024-05-09T06:17:02.024 INFO:teuthology.orchestra.run.smithi106.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-09T06:17:02.074 INFO:teuthology.orchestra.run.smithi106.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-05-09T06:17:02.158 INFO:teuthology.orchestra.run.smithi106.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-05-09T06:17:02.225 INFO:teuthology.orchestra.run.smithi106.stdout:(15/24): librgw2-17.2.7-933.g4ba5a836.el9.x86_6 7.1 MB/s | 4.9 MB 00:00 2024-05-09T06:17:02.284 INFO:teuthology.orchestra.run.smithi106.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 725 kB/s | 42 kB 00:00 2024-05-09T06:17:02.317 INFO:teuthology.orchestra.run.smithi106.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-05-09T06:17:02.434 INFO:teuthology.orchestra.run.smithi106.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-05-09T06:17:02.484 INFO:teuthology.orchestra.run.smithi106.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.5 MB/s | 309 kB 00:00 2024-05-09T06:17:02.526 INFO:teuthology.orchestra.run.smithi106.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-05-09T06:17:02.610 INFO:teuthology.orchestra.run.smithi106.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-09T06:17:02.977 INFO:teuthology.orchestra.run.smithi106.stdout:(22/24): ceph-common-17.2.7-933.g4ba5a836.el9.x 6.7 MB/s | 22 MB 00:03 2024-05-09T06:17:03.044 INFO:teuthology.orchestra.run.smithi106.stdout:(23/24): librados2-17.2.7-933.g4ba5a836.el9.x86 6.0 MB/s | 3.1 MB 00:00 2024-05-09T06:17:03.094 INFO:teuthology.orchestra.run.smithi106.stdout:(24/24): librbd1-17.2.7-933.g4ba5a836.el9.x86_6 6.1 MB/s | 2.9 MB 00:00 2024-05-09T06:17:03.097 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:03.097 INFO:teuthology.orchestra.run.smithi106.stdout:Total 14 MB/s | 58 MB 00:03 2024-05-09T06:17:03.152 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:17:03.183 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:17:03.183 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:17:03.766 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:17:03.766 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:17:04.188 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 998 kB/s | 6.2 MB 00:06 2024-05-09T06:17:05.115 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:17:05.501 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-05-09T06:17:05.563 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:05.646 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-05-09T06:17:05.725 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:17:05.756 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:05.827 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-05-09T06:17:05.903 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-05-09T06:17:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-05-09T06:17:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:17:06.430 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:17:06.458 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-05-09T06:17:06.501 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 10/26 2024-05-09T06:17:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:17:06.601 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:17:06.628 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:06.694 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-05-09T06:17:06.770 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-05-09T06:17:06.802 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-05-09T06:17:07.096 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-05-09T06:17:07.133 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:17:07.205 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:17:07.278 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 19/26 2024-05-09T06:17:07.302 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 20/26 2024-05-09T06:17:09.674 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:17:09.707 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:17:10.230 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:17:10.268 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:17:10.354 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:17:10.354 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T06:17:10.354 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T06:17:10.355 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:10.395 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:14.534 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 2.4 MB/s | 21 MB 00:08 2024-05-09T06:17:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /root 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-05-09T06:17:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:20.039 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-09T06:17:21.074 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:17:21.153 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:17:21.153 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:21.153 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T06:17:21.153 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:17:21.153 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:17:21.153 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:21.154 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:17:21.252 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:17:21.252 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:22.491 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:17:22.506 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:17:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:17:22.506 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:17:22.506 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:17:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 14 M 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.1 M 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 5.0 M 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 22 M 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 638 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 457 k 2024-05-09T06:17:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 4.9 M 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 45 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 118 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 156 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 320 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 293 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 99 k 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout:Install 22 Packages 2024-05-09T06:17:22.508 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-05-09T06:17:22.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:22.509 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 58 M 2024-05-09T06:17:22.509 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:17:22.565 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:22.565 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 1/26 2024-05-09T06:17:22.565 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:22.565 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:17:22.565 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 5/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 6/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 7/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 8/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 9/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 10/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-05-09T06:17:22.566 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-05-09T06:17:22.567 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 25/26 2024-05-09T06:17:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T06:17:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T06:17:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:23.306 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:23.558 INFO:teuthology.orchestra.run.smithi046.stdout:(1/24): ceph-base-17.2.7-933.g4ba5a836.el9.x86_ 7.6 MB/s | 5.0 MB 00:00 2024-05-09T06:17:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:(2/24): ceph-selinux-17.2.7-933.g4ba5a836.el9.x 764 kB/s | 25 kB 00:00 2024-05-09T06:17:23.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-test 2024-05-09T06:17:23.667 INFO:teuthology.orchestra.run.smithi046.stdout:(3/24): libcephfs2-17.2.7-933.g4ba5a836.el9.x86 8.3 MB/s | 638 kB 00:00 2024-05-09T06:17:23.725 INFO:teuthology.orchestra.run.smithi046.stdout:(4/24): libradosstriper1-17.2.7-933.g4ba5a836.e 7.7 MB/s | 457 kB 00:00 2024-05-09T06:17:24.184 INFO:teuthology.orchestra.run.smithi046.stdout:(5/24): librgw2-17.2.7-933.g4ba5a836.el9.x86_64 11 MB/s | 4.9 MB 00:00 2024-05-09T06:17:24.226 INFO:teuthology.orchestra.run.smithi046.stdout:(6/24): python3-ceph-argparse-17.2.7-933.g4ba5a 1.1 MB/s | 45 kB 00:00 2024-05-09T06:17:24.233 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:28 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:24.284 INFO:teuthology.orchestra.run.smithi046.stdout:(7/24): python3-ceph-common-17.2.7-933.g4ba5a83 2.0 MB/s | 118 kB 00:00 2024-05-09T06:17:24.334 INFO:teuthology.orchestra.run.smithi046.stdout:(8/24): python3-cephfs-17.2.7-933.g4ba5a836.el9 3.0 MB/s | 156 kB 00:00 2024-05-09T06:17:24.355 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 48 M 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:17:24.356 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 163 k 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout:Install 4 Packages 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:24.357 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 48 M 2024-05-09T06:17:24.358 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 192 M 2024-05-09T06:17:24.358 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:17:24.385 INFO:teuthology.orchestra.run.smithi046.stdout:(9/24): python3-rados-17.2.7-933.g4ba5a836.el9. 6.2 MB/s | 320 kB 00:00 2024-05-09T06:17:24.427 INFO:teuthology.orchestra.run.smithi046.stdout:(10/24): python3-rbd-17.2.7-933.g4ba5a836.el9.x 6.9 MB/s | 293 kB 00:00 2024-05-09T06:17:24.477 INFO:teuthology.orchestra.run.smithi046.stdout:(11/24): python3-rgw-17.2.7-933.g4ba5a836.el9.x 1.9 MB/s | 99 kB 00:00 2024-05-09T06:17:24.582 INFO:teuthology.orchestra.run.smithi106.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.7 MB/s | 305 kB 00:00 2024-05-09T06:17:24.624 INFO:teuthology.orchestra.run.smithi106.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-05-09T06:17:24.724 INFO:teuthology.orchestra.run.smithi106.stdout:(3/4): libcephsqlite-17.2.7-933.g4ba5a836.el9.x 504 kB/s | 163 kB 00:00 2024-05-09T06:17:25.377 INFO:teuthology.orchestra.run.smithi046.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 178 kB/s | 160 kB 00:00 2024-05-09T06:17:26.128 INFO:teuthology.orchestra.run.smithi046.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 60 kB/s | 45 kB 00:00 2024-05-09T06:17:27.178 INFO:teuthology.orchestra.run.smithi046.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 631 kB/s | 662 kB 00:01 2024-05-09T06:17:28.120 INFO:teuthology.orchestra.run.smithi046.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 311 kB/s | 292 kB 00:00 2024-05-09T06:17:28.853 INFO:teuthology.orchestra.run.smithi046.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 58 kB/s | 42 kB 00:00 2024-05-09T06:17:29.533 INFO:teuthology.orchestra.run.smithi106.stdout:(4/4): ceph-test-17.2.7-933.g4ba5a836.el9.x86_6 9.3 MB/s | 48 MB 00:05 2024-05-09T06:17:29.535 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:29.535 INFO:teuthology.orchestra.run.smithi106.stdout:Total 9.3 MB/s | 48 MB 00:05 2024-05-09T06:17:29.563 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:17:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:17:29.583 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:17:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:(17/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 417 kB/s | 309 kB 00:00 2024-05-09T06:17:29.737 INFO:teuthology.orchestra.run.smithi046.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2024-05-09T06:17:29.896 INFO:teuthology.orchestra.run.smithi046.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 426 kB/s | 67 kB 00:00 2024-05-09T06:17:29.955 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:17:29.956 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:17:30.279 INFO:teuthology.orchestra.run.smithi046.stdout:(20/24): thrift-0.15.0-2.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-05-09T06:17:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:17:30.543 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T06:17:30.563 INFO:teuthology.orchestra.run.smithi046.stdout:(21/24): librados2-17.2.7-933.g4ba5a836.el9.x86 11 MB/s | 3.1 MB 00:00 2024-05-09T06:17:30.581 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T06:17:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:17:30.755 INFO:teuthology.orchestra.run.smithi046.stdout:(22/24): librbd1-17.2.7-933.g4ba5a836.el9.x86_6 15 MB/s | 2.9 MB 00:00 2024-05-09T06:17:30.946 INFO:teuthology.orchestra.run.smithi046.stdout:(23/24): ceph-radosgw-17.2.7-933.g4ba5a836.el9. 1.8 MB/s | 14 MB 00:08 2024-05-09T06:17:34.313 INFO:teuthology.orchestra.run.smithi046.stdout:(24/24): ceph-common-17.2.7-933.g4ba5a836.el9.x 2.0 MB/s | 22 MB 00:11 2024-05-09T06:17:34.318 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:34.318 INFO:teuthology.orchestra.run.smithi046.stdout:Total 4.9 MB/s | 58 MB 00:11 2024-05-09T06:17:34.384 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:17:34.422 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:17:34.422 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:17:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:17:35.035 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:17:35.035 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:17:35.108 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:17:36.352 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:17:36.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-05-09T06:17:36.807 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:36.901 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:36.981 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:17:37.008 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:37.099 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:37.169 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-05-09T06:17:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:17:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 1/4 2024-05-09T06:17:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2/4 2024-05-09T06:17:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T06:17:37.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:37.580 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:37.772 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-05-09T06:17:37.803 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:17:37.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph 2024-05-09T06:17:37.866 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 8/26 2024-05-09T06:17:37.903 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-05-09T06:17:37.953 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 10/26 2024-05-09T06:17:37.992 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:17:38.055 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:17:38.081 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:38.139 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:38.179 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-05-09T06:17:38.215 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-05-09T06:17:38.247 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-05-09T06:17:38.411 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:42 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:38.538 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 6.5 k 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.1 M 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 1.4 M 2024-05-09T06:17:38.541 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 240 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.9 M 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 15 M 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T06:17:38.542 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T06:17:38.543 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout:Install 33 Packages 2024-05-09T06:17:38.544 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:38.545 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 27 M 2024-05-09T06:17:38.545 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 96 M 2024-05-09T06:17:38.545 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:17:38.560 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-05-09T06:17:38.601 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:17:38.692 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 18/26 2024-05-09T06:17:38.770 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 19/26 2024-05-09T06:17:38.796 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 20/26 2024-05-09T06:17:39.076 INFO:teuthology.orchestra.run.smithi106.stdout:(1/33): ceph-17.2.7-933.g4ba5a836.el9.x86_64.rp 31 kB/s | 6.5 kB 00:00 2024-05-09T06:17:39.210 INFO:teuthology.orchestra.run.smithi106.stdout:(2/33): ceph-mgr-17.2.7-933.g4ba5a836.el9.x86_6 4.1 MB/s | 1.4 MB 00:00 2024-05-09T06:17:39.493 INFO:teuthology.orchestra.run.smithi106.stdout:(3/33): ceph-mds-17.2.7-933.g4ba5a836.el9.x86_6 3.3 MB/s | 2.1 MB 00:00 2024-05-09T06:17:39.577 INFO:teuthology.orchestra.run.smithi106.stdout:(4/33): ceph-mgr-modules-core-17.2.7-933.g4ba5a 2.8 MB/s | 240 kB 00:00 2024-05-09T06:17:39.944 INFO:teuthology.orchestra.run.smithi106.stdout:(5/33): ceph-mon-17.2.7-933.g4ba5a836.el9.x86_6 4.5 MB/s | 3.9 MB 00:00 2024-05-09T06:17:40.144 INFO:teuthology.orchestra.run.smithi106.stdout:(6/33): ceph-osd-17.2.7-933.g4ba5a836.el9.x86_6 16 MB/s | 15 MB 00:00 2024-05-09T06:17:40.219 INFO:teuthology.orchestra.run.smithi106.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 394 kB/s | 253 kB 00:00 2024-05-09T06:17:40.328 INFO:teuthology.orchestra.run.smithi106.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-05-09T06:17:40.436 INFO:teuthology.orchestra.run.smithi106.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-05-09T06:17:40.545 INFO:teuthology.orchestra.run.smithi106.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-05-09T06:17:40.570 INFO:teuthology.orchestra.run.smithi106.stdout:(11/33): python3-ply-3.11-14.el9.noarch.rpm 250 kB/s | 106 kB 00:00 2024-05-09T06:17:40.654 INFO:teuthology.orchestra.run.smithi106.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-05-09T06:17:40.679 INFO:teuthology.orchestra.run.smithi106.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-05-09T06:17:40.763 INFO:teuthology.orchestra.run.smithi106.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-05-09T06:17:40.788 INFO:teuthology.orchestra.run.smithi106.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-05-09T06:17:40.989 INFO:teuthology.orchestra.run.smithi106.stdout:(16/33): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-05-09T06:17:41.358 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:17:41.392 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:17:41.489 INFO:teuthology.orchestra.run.smithi106.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 60 kB/s | 43 kB 00:00 2024-05-09T06:17:41.531 INFO:teuthology.orchestra.run.smithi106.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 231 kB/s | 172 kB 00:00 2024-05-09T06:17:41.556 INFO:teuthology.orchestra.run.smithi106.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-05-09T06:17:41.582 INFO:teuthology.orchestra.run.smithi106.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 605 kB/s | 358 kB 00:00 2024-05-09T06:17:41.607 INFO:teuthology.orchestra.run.smithi106.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-05-09T06:17:41.632 INFO:teuthology.orchestra.run.smithi106.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-05-09T06:17:41.657 INFO:teuthology.orchestra.run.smithi106.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-05-09T06:17:41.682 INFO:teuthology.orchestra.run.smithi106.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-05-09T06:17:41.708 INFO:teuthology.orchestra.run.smithi106.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 616 kB/s | 46 kB 00:00 2024-05-09T06:17:41.733 INFO:teuthology.orchestra.run.smithi106.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-05-09T06:17:41.758 INFO:teuthology.orchestra.run.smithi106.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-05-09T06:17:41.784 INFO:teuthology.orchestra.run.smithi106.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-05-09T06:17:41.809 INFO:teuthology.orchestra.run.smithi106.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-05-09T06:17:41.826 INFO:teuthology.orchestra.run.smithi106.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 533 kB/s | 36 kB 00:00 2024-05-09T06:17:41.851 INFO:teuthology.orchestra.run.smithi106.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-05-09T06:17:41.868 INFO:teuthology.orchestra.run.smithi106.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 477 kB/s | 20 kB 00:00 2024-05-09T06:17:41.893 INFO:teuthology.orchestra.run.smithi106.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-05-09T06:17:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:41.895 INFO:teuthology.orchestra.run.smithi106.stdout:Total 8.1 MB/s | 27 MB 00:03 2024-05-09T06:17:41.934 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 21/26 2024-05-09T06:17:41.971 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:17:42.018 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:17:42.055 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:17:42.055 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:17:42.129 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 22/26 2024-05-09T06:17:42.130 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T06:17:42.130 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T06:17:42.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:42.164 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:42.411 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:17:42.412 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:17:43.594 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:17:43.646 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-09T06:17:43.678 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-09T06:17:43.711 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-09T06:17:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-09T06:17:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-09T06:17:43.921 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-09T06:17:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-09T06:17:43.987 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-09T06:17:44.021 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-09T06:17:44.084 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-09T06:17:44.111 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-09T06:17:44.146 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-09T06:17:44.181 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-09T06:17:44.223 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-09T06:17:44.300 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-09T06:17:44.439 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-09T06:17:44.518 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-09T06:17:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-09T06:17:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-09T06:17:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-09T06:17:44.715 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-09T06:17:44.901 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-09T06:17:44.957 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-09T06:17:45.026 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-09T06:17:45.123 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-09T06:17:45.166 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-09T06:17:45.279 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-09T06:17:45.438 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 28/33 2024-05-09T06:17:45.466 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:17:45.492 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:17:45.492 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:45.492 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T06:17:45.493 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:17:45.493 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:17:45.493 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:46.809 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:17:46.837 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:17:46.837 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:46.837 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T06:17:46.837 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:17:46.837 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:17:46.838 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:47.227 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:17:47.271 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:17:47.271 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:47.271 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T06:17:47.271 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:17:47.272 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:17:47.272 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:47.478 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:17:47.503 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:17:47.503 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:47.503 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T06:17:47.504 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:17:47.504 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:17:47.504 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:47.566 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:17:49.247 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 1/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 3/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 4/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 5/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 6/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-09T06:17:49.248 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-09T06:17:49.249 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-09T06:17:49.250 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-09T06:17:49.250 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-09T06:17:49.250 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-09T06:17:49.250 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-09T06:17:49.250 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-09T06:17:49.250 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-09T06:17:49.251 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-09T06:17:49.999 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-09T06:17:49.999 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T06:17:50.000 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T06:17:50.001 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:50.002 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:50.353 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-base 2024-05-09T06:17:50.923 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:54 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:51.005 INFO:teuthology.orchestra.run.smithi106.stdout:Package ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:17:51.046 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:51.047 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:17:51.047 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:51.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install cephadm 2024-05-09T06:17:51.674 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:55 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:51.795 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 82 k 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 82 k 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 372 k 2024-05-09T06:17:51.796 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-05-09T06:17:52.086 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:52.106 INFO:teuthology.orchestra.run.smithi106.stdout:cephadm-17.2.7-933.g4ba5a836.el9.noarch.rpm 265 kB/s | 82 kB 00:00 2024-05-09T06:17:52.107 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:52.107 INFO:teuthology.orchestra.run.smithi106.stdout:Total 264 kB/s | 82 kB 00:00 2024-05-09T06:17:52.107 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:17:52.112 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:17:52.112 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:17:52.114 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:17:52.114 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:17:52.179 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:17:52.564 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:52.660 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:52.978 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:53.228 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:17:53.228 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:53.228 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:17:53.228 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:17:53.228 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:53.228 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:53.427 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T06:17:53.432 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:17:53.494 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 24/26 2024-05-09T06:17:53.495 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:53.495 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T06:17:53.495 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:17:53.495 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T06:17:53.495 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:53.497 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:17:53.576 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-05-09T06:17:53.576 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:53.998 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:58 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:54.125 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:54.125 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:54.125 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 137 k 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 137 k 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 379 k 2024-05-09T06:17:54.126 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:17:54.438 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-immutable-object-cache-17.2.7-933.g4ba5a83 442 kB/s | 137 kB 00:00 2024-05-09T06:17:54.438 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:54.439 INFO:teuthology.orchestra.run.smithi106.stdout:Total 439 kB/s | 137 kB 00:00 2024-05-09T06:17:54.439 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:17:54.446 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:17:54.446 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:17:54.502 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:17:54.503 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:17:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:17:54.714 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:54.739 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:17:54.739 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T06:17:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 1/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 3/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 4/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 5/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 6/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 7/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x 8/26 2024-05-09T06:17:54.763 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86 9/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 10/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 11/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 12/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 13/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-05-09T06:17:54.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-05-09T06:17:54.765 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 23/26 2024-05-09T06:17:54.765 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-05-09T06:17:54.765 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 25/26 2024-05-09T06:17:55.371 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T06:17:55.372 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.373 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T06:17:55.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:55.374 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:17:55.662 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:17:55.662 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:55.662 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:17:55.662 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:17:55.663 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:55.663 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:55.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-test 2024-05-09T06:17:55.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr 2024-05-09T06:17:56.308 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:36 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:17:56.434 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:17:56.434 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 48 M 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 163 k 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-05-09T06:17:56.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:17:56.436 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 48 M 2024-05-09T06:17:56.436 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 192 M 2024-05-09T06:17:56.436 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:17:56.459 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:00 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:56.541 INFO:teuthology.orchestra.run.smithi106.stdout:Package ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:17:56.585 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:56.586 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:17:56.586 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:17:56.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T06:17:56.880 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): libcephsqlite-17.2.7-933.g4ba5a836.el9.x 433 kB/s | 163 kB 00:00 2024-05-09T06:17:57.181 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 451 kB/s | 305 kB 00:00 2024-05-09T06:17:57.204 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:01 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:17:57.222 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-05-09T06:17:57.326 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:17:57.327 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:57.327 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:17:57.327 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:57.327 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:17:57.327 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 3.4 M 2024-05-09T06:17:57.327 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 24 k 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 15 k 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout:Install 7 Packages 2024-05-09T06:17:57.328 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:17:57.329 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 3.7 M 2024-05-09T06:17:57.329 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 80 M 2024-05-09T06:17:57.329 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:17:57.711 INFO:teuthology.orchestra.run.smithi106.stdout:(1/7): ceph-prometheus-alerts-17.2.7-933.g4ba5a 46 kB/s | 15 kB 00:00 2024-05-09T06:17:57.736 INFO:teuthology.orchestra.run.smithi106.stdout:(2/7): ceph-grafana-dashboards-17.2.7-933.g4ba5 71 kB/s | 24 kB 00:00 2024-05-09T06:17:57.870 INFO:teuthology.orchestra.run.smithi106.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 57 kB/s | 9.0 kB 00:00 2024-05-09T06:17:57.895 INFO:teuthology.orchestra.run.smithi106.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 258 kB/s | 41 kB 00:00 2024-05-09T06:17:57.929 INFO:teuthology.orchestra.run.smithi106.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 526 kB/s | 31 kB 00:00 2024-05-09T06:17:57.987 INFO:teuthology.orchestra.run.smithi106.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-05-09T06:17:59.137 INFO:teuthology.orchestra.run.smithi106.stdout:(7/7): ceph-mgr-dashboard-17.2.7-933.g4ba5a836. 1.9 MB/s | 3.4 MB 00:01 2024-05-09T06:17:59.141 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:59.141 INFO:teuthology.orchestra.run.smithi106.stdout:Total 2.0 MB/s | 3.7 MB 00:01 2024-05-09T06:17:59.141 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:17:59.149 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:17:59.149 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:17:59.198 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): ceph-test-17.2.7-933.g4ba5a836.el9.x86_6 18 MB/s | 48 MB 00:02 2024-05-09T06:17:59.200 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:17:59.200 INFO:teuthology.orchestra.run.smithi046.stdout:Total 18 MB/s | 48 MB 00:02 2024-05-09T06:17:59.211 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:17:59.212 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:17:59.229 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:17:59.250 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:17:59.251 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:17:59.513 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:17:59.589 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-09T06:17:59.623 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-09T06:17:59.635 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:17:59.635 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:17:59.669 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-09T06:17:59.701 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-09T06:17:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 5/7 2024-05-09T06:18:00.183 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:00.250 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T06:18:00.289 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T06:18:00.316 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:18:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 6/7 2024-05-09T06:18:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:18:01.739 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:18:01.740 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 1/7 2024-05-09T06:18:01.740 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2/7 2024-05-09T06:18:01.740 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 3/7 2024-05-09T06:18:01.740 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-09T06:18:01.740 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-09T06:18:01.740 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T06:18:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T06:18:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:02.004 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:02.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T06:18:02.793 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:06 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:02.917 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:02.918 INFO:teuthology.orchestra.run.smithi106.stdout:====================================================================================== 2024-05-09T06:18:02.918 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:18:02.918 INFO:teuthology.orchestra.run.smithi106.stdout:====================================================================================== 2024-05-09T06:18:02.918 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:18:02.918 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 7.4 M 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T06:18:02.919 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout:====================================================================================== 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout:Install 12 Packages 2024-05-09T06:18:02.920 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:02.921 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 38 M 2024-05-09T06:18:02.921 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 209 M 2024-05-09T06:18:02.921 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:18:03.471 INFO:teuthology.orchestra.run.smithi106.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 943 kB/s | 195 kB 00:00 2024-05-09T06:18:03.588 INFO:teuthology.orchestra.run.smithi106.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-05-09T06:18:03.738 INFO:teuthology.orchestra.run.smithi106.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-05-09T06:18:03.822 INFO:teuthology.orchestra.run.smithi106.stdout:(4/12): ceph-mgr-diskprediction-local-17.2.7-93 13 MB/s | 7.4 MB 00:00 2024-05-09T06:18:03.847 INFO:teuthology.orchestra.run.smithi106.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-05-09T06:18:04.089 INFO:teuthology.orchestra.run.smithi106.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 132 kB/s | 35 kB 00:00 2024-05-09T06:18:04.522 INFO:teuthology.orchestra.run.smithi106.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 563 kB/s | 244 kB 00:00 2024-05-09T06:18:04.714 INFO:teuthology.orchestra.run.smithi106.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-05-09T06:18:04.790 INFO:teuthology.orchestra.run.smithi106.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 5.0 MB/s | 4.7 MB 00:00 2024-05-09T06:18:04.824 INFO:teuthology.orchestra.run.smithi106.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-05-09T06:18:04.975 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 3/4 2024-05-09T06:18:05.066 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:18:06.207 INFO:teuthology.orchestra.run.smithi106.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.0 MB/s | 5.1 MB 00:01 2024-05-09T06:18:07.502 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 4/4 2024-05-09T06:18:07.502 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 1/4 2024-05-09T06:18:07.503 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2/4 2024-05-09T06:18:07.503 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T06:18:07.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:07.802 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:08.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph 2024-05-09T06:18:08.690 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:48 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:08.822 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 6.5 k 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.1 M 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 1.4 M 2024-05-09T06:18:08.825 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 240 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 3.9 M 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 15 M 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T06:18:08.826 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T06:18:08.827 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout:Install 33 Packages 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:08.828 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 27 M 2024-05-09T06:18:08.829 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 96 M 2024-05-09T06:18:08.829 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:12.107 INFO:teuthology.orchestra.run.smithi046.stdout:(1/33): ceph-17.2.7-933.g4ba5a836.el9.x86_64.rp 38 kB/s | 6.5 kB 00:00 2024-05-09T06:18:12.283 INFO:teuthology.orchestra.run.smithi046.stdout:(2/33): ceph-mgr-17.2.7-933.g4ba5a836.el9.x86_6 4.0 MB/s | 1.4 MB 00:00 2024-05-09T06:18:12.466 INFO:teuthology.orchestra.run.smithi046.stdout:(3/33): ceph-mds-17.2.7-933.g4ba5a836.el9.x86_6 3.9 MB/s | 2.1 MB 00:00 2024-05-09T06:18:12.558 INFO:teuthology.orchestra.run.smithi046.stdout:(4/33): ceph-mgr-modules-core-17.2.7-933.g4ba5a 2.6 MB/s | 240 kB 00:00 2024-05-09T06:18:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 981 kB/s | 253 kB 00:00 2024-05-09T06:18:12.967 INFO:teuthology.orchestra.run.smithi046.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 8.2 MB/s | 1.2 MB 00:00 2024-05-09T06:18:13.117 INFO:teuthology.orchestra.run.smithi046.stdout:(7/33): ceph-osd-17.2.7-933.g4ba5a836.el9.x86_6 18 MB/s | 15 MB 00:00 2024-05-09T06:18:13.142 INFO:teuthology.orchestra.run.smithi046.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 609 kB/s | 106 kB 00:00 2024-05-09T06:18:13.201 INFO:teuthology.orchestra.run.smithi046.stdout:(9/33): ceph-mon-17.2.7-933.g4ba5a836.el9.x86_6 3.6 MB/s | 3.9 MB 00:01 2024-05-09T06:18:13.226 INFO:teuthology.orchestra.run.smithi046.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-05-09T06:18:13.377 INFO:teuthology.orchestra.run.smithi046.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 522 kB/s | 135 kB 00:00 2024-05-09T06:18:13.452 INFO:teuthology.orchestra.run.smithi046.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 858 kB/s | 215 kB 00:00 2024-05-09T06:18:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 688 kB/s | 172 kB 00:00 2024-05-09T06:18:13.502 INFO:teuthology.orchestra.run.smithi046.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 277 kB/s | 35 kB 00:00 2024-05-09T06:18:13.536 INFO:teuthology.orchestra.run.smithi046.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-05-09T06:18:13.611 INFO:teuthology.orchestra.run.smithi046.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 400 kB/s | 43 kB 00:00 2024-05-09T06:18:13.636 INFO:teuthology.orchestra.run.smithi046.stdout:(17/33): python3-pytz-2021.1-5.el9.noarch.rpm 277 kB/s | 51 kB 00:00 2024-05-09T06:18:13.662 INFO:teuthology.orchestra.run.smithi046.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-09T06:18:13.703 INFO:teuthology.orchestra.run.smithi046.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 3.8 MB/s | 358 kB 00:00 2024-05-09T06:18:13.729 INFO:teuthology.orchestra.run.smithi046.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-05-09T06:18:13.771 INFO:teuthology.orchestra.run.smithi046.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-05-09T06:18:13.796 INFO:teuthology.orchestra.run.smithi046.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 250 kB/s | 23 kB 00:00 2024-05-09T06:18:13.821 INFO:teuthology.orchestra.run.smithi046.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 210 kB/s | 19 kB 00:00 2024-05-09T06:18:13.847 INFO:teuthology.orchestra.run.smithi046.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-05-09T06:18:13.897 INFO:teuthology.orchestra.run.smithi046.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 462 kB/s | 46 kB 00:00 2024-05-09T06:18:13.922 INFO:teuthology.orchestra.run.smithi046.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 785 kB/s | 79 kB 00:00 2024-05-09T06:18:13.947 INFO:teuthology.orchestra.run.smithi046.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-05-09T06:18:13.981 INFO:teuthology.orchestra.run.smithi046.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-05-09T06:18:14.006 INFO:teuthology.orchestra.run.smithi046.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-05-09T06:18:14.031 INFO:teuthology.orchestra.run.smithi046.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 825 kB/s | 90 kB 00:00 2024-05-09T06:18:14.065 INFO:teuthology.orchestra.run.smithi046.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-09T06:18:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 341 kB/s | 20 kB 00:00 2024-05-09T06:18:14.124 INFO:teuthology.orchestra.run.smithi046.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-05-09T06:18:14.125 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:14.126 INFO:teuthology.orchestra.run.smithi046.stdout:Total 5.1 MB/s | 27 MB 00:05 2024-05-09T06:18:14.252 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:14.293 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:14.293 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:14.661 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:14.661 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:18:15.806 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:15.877 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-05-09T06:18:15.910 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-05-09T06:18:15.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-05-09T06:18:16.039 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-05-09T06:18:16.114 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-05-09T06:18:16.162 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-05-09T06:18:16.196 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-05-09T06:18:16.227 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-05-09T06:18:16.269 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-05-09T06:18:16.302 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-05-09T06:18:16.343 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-05-09T06:18:16.386 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-05-09T06:18:16.420 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-05-09T06:18:16.463 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-05-09T06:18:16.545 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-05-09T06:18:16.695 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-05-09T06:18:16.778 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-05-09T06:18:16.838 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-05-09T06:18:16.875 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-05-09T06:18:16.933 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-05-09T06:18:17.081 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-05-09T06:18:17.283 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-05-09T06:18:17.337 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-05-09T06:18:17.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-05-09T06:18:17.658 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-05-09T06:18:17.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-05-09T06:18:17.832 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-05-09T06:18:17.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 28/33 2024-05-09T06:18:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:18:18.040 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 29/33 2024-05-09T06:18:18.040 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:18.040 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T06:18:18.040 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:18:18.040 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T06:18:18.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:19.446 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:18:19.475 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 30/33 2024-05-09T06:18:19.475 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:19.475 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T06:18:19.475 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:18:19.475 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T06:18:19.475 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:19.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:18:19.897 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 31/33 2024-05-09T06:18:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T06:18:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:18:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T06:18:19.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:20.106 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:18:20.131 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 32/33 2024-05-09T06:18:20.131 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:20.131 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T06:18:20.131 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:18:20.131 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T06:18:20.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:20.197 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 33/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 1/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 3/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 4/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 5/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.n 6/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-05-09T06:18:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-05-09T06:18:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-05-09T06:18:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-05-09T06:18:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-05-09T06:18:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:22.682 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T06:18:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T06:18:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:22.685 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:23.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-base 2024-05-09T06:18:23.617 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:03 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:23.700 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-base-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:23.744 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:23.745 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:18:23.746 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:23.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install cephadm 2024-05-09T06:18:24.398 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:04 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:24.524 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:24.525 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:18:24.525 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:24.525 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 82 k 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 82 k 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 372 k 2024-05-09T06:18:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:24.837 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm-17.2.7-933.g4ba5a836.el9.noarch.rpm 264 kB/s | 82 kB 00:00 2024-05-09T06:18:24.838 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:24.838 INFO:teuthology.orchestra.run.smithi046.stdout:Total 262 kB/s | 82 kB 00:00 2024-05-09T06:18:24.838 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:24.844 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:24.844 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:24.846 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:24.846 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:18:24.916 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:25.489 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:18:25.585 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:18:25.931 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:18:26.038 INFO:teuthology.orchestra.run.smithi106.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 783 kB/s | 16 MB 00:21 2024-05-09T06:18:26.039 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:26.040 INFO:teuthology.orchestra.run.smithi106.stdout:Total 1.6 MB/s | 38 MB 00:23 2024-05-09T06:18:26.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/1 2024-05-09T06:18:26.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:26.172 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:26.172 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:26.173 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:26.173 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:26.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T06:18:26.391 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:18:26.418 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:18:26.418 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:18:26.910 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:18:26.911 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:18:26.977 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:06 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:27.105 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 137 k 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:27.106 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:27.107 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:18:27.107 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:27.107 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 137 k 2024-05-09T06:18:27.107 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 379 k 2024-05-09T06:18:27.107 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:27.310 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-immutable-object-cache-17.2.7-933.g4ba5a83 678 kB/s | 137 kB 00:00 2024-05-09T06:18:27.310 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:27.310 INFO:teuthology.orchestra.run.smithi046.stdout:Total 673 kB/s | 137 kB 00:00 2024-05-09T06:18:27.311 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:27.319 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:27.319 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:27.378 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:27.378 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:18:27.649 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:27.733 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:18:27.735 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:18:27.762 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:18:27.762 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:18:27.762 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T06:18:27.762 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T06:18:27.845 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:18:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:18:27.988 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T06:18:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T06:18:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T06:18:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T06:18:28.701 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.e 1/1 2024-05-09T06:18:28.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:28.701 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:28.701 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:28.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:28.701 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:28.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr 2024-05-09T06:18:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T06:18:29.083 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T06:18:29.507 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:09 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:29.590 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-mgr-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:29.634 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:29.635 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:18:29.635 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:29.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T06:18:30.302 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:10 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:30.312 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:18:30.430 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 3.4 M 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 24 k 2024-05-09T06:18:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 15 k 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout:Install 7 Packages 2024-05-09T06:18:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:30.433 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 3.7 M 2024-05-09T06:18:30.433 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 80 M 2024-05-09T06:18:30.433 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:30.664 INFO:teuthology.orchestra.run.smithi046.stdout:(1/7): ceph-grafana-dashboards-17.2.7-933.g4ba5 130 kB/s | 24 kB 00:00 2024-05-09T06:18:30.680 INFO:teuthology.orchestra.run.smithi046.stdout:(2/7): ceph-prometheus-alerts-17.2.7-933.g4ba5a 71 kB/s | 15 kB 00:00 2024-05-09T06:18:30.848 INFO:teuthology.orchestra.run.smithi046.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 49 kB/s | 9.0 kB 00:00 2024-05-09T06:18:30.940 INFO:teuthology.orchestra.run.smithi046.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 158 kB/s | 41 kB 00:00 2024-05-09T06:18:30.973 INFO:teuthology.orchestra.run.smithi046.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 245 kB/s | 31 kB 00:00 2024-05-09T06:18:31.132 INFO:teuthology.orchestra.run.smithi046.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 983 kB/s | 188 kB 00:00 2024-05-09T06:18:31.344 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T06:18:31.386 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:18:31.632 INFO:teuthology.orchestra.run.smithi046.stdout:(7/7): ceph-mgr-dashboard-17.2.7-933.g4ba5a836. 2.9 MB/s | 3.4 MB 00:01 2024-05-09T06:18:31.634 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:31.634 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.0 MB/s | 3.7 MB 00:01 2024-05-09T06:18:31.634 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:31.644 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:31.644 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:31.714 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:31.714 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:18:32.023 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:32.075 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-05-09T06:18:32.110 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-05-09T06:18:32.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-05-09T06:18:32.196 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-05-09T06:18:32.225 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 5/7 2024-05-09T06:18:33.276 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 6/7 2024-05-09T06:18:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:18:33.838 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:18:33.838 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 1/12 2024-05-09T06:18:33.838 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:18:33.838 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T06:18:33.839 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:18:33.840 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T06:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:34.254 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:34.406 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 7/7 2024-05-09T06:18:34.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.n 1/7 2024-05-09T06:18:34.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2/7 2024-05-09T06:18:34.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.no 3/7 2024-05-09T06:18:34.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-05-09T06:18:34.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-05-09T06:18:34.407 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-05-09T06:18:34.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-rook 2024-05-09T06:18:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-05-09T06:18:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:34.685 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:34.686 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:34.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T06:18:35.162 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:39 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:35.284 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:35.285 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 47 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T06:18:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout:Install 13 Packages 2024-05-09T06:18:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:35.288 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 2.2 M 2024-05-09T06:18:35.288 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 26 M 2024-05-09T06:18:35.288 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:18:35.504 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:15 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:35.633 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 7.4 M 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:18:35.634 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-05-09T06:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-05-09T06:18:35.636 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:35.636 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 38 M 2024-05-09T06:18:35.636 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 209 M 2024-05-09T06:18:35.636 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:36.357 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-05-09T06:18:36.398 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-05-09T06:18:36.420 INFO:teuthology.orchestra.run.smithi106.stdout:(1/13): ceph-mgr-rook-17.2.7-933.g4ba5a836.el9. 119 kB/s | 47 kB 00:00 2024-05-09T06:18:36.665 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 106 kB/s | 33 kB 00:00 2024-05-09T06:18:36.704 INFO:teuthology.orchestra.run.smithi106.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 28 kB/s | 19 kB 00:00 2024-05-09T06:18:36.754 INFO:teuthology.orchestra.run.smithi106.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 35 kB/s | 26 kB 00:00 2024-05-09T06:18:36.790 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 145 kB/s | 18 kB 00:00 2024-05-09T06:18:36.883 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-93 11 MB/s | 7.4 MB 00:00 2024-05-09T06:18:36.916 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 281 kB/s | 35 kB 00:00 2024-05-09T06:18:37.274 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 681 kB/s | 244 kB 00:00 2024-05-09T06:18:37.504 INFO:teuthology.orchestra.run.smithi106.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 205 kB/s | 222 kB 00:01 2024-05-09T06:18:37.641 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-05-09T06:18:37.775 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.8 MB/s | 250 kB 00:00 2024-05-09T06:18:37.788 INFO:teuthology.orchestra.run.smithi106.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 150 kB/s | 159 kB 00:01 2024-05-09T06:18:37.872 INFO:teuthology.orchestra.run.smithi106.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 250 kB/s | 279 kB 00:01 2024-05-09T06:18:38.134 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-05-09T06:18:38.189 INFO:teuthology.orchestra.run.smithi106.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 80 kB/s | 32 kB 00:00 2024-05-09T06:18:38.230 INFO:teuthology.orchestra.run.smithi106.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2024-05-09T06:18:38.323 INFO:teuthology.orchestra.run.smithi106.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 66 kB/s | 54 kB 00:00 2024-05-09T06:18:38.481 INFO:teuthology.orchestra.run.smithi106.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 704 kB/s | 206 kB 00:00 2024-05-09T06:18:38.590 INFO:teuthology.orchestra.run.smithi106.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 835 kB/s | 90 kB 00:00 2024-05-09T06:18:38.682 INFO:teuthology.orchestra.run.smithi106.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 2.3 MB/s | 1.0 MB 00:00 2024-05-09T06:18:38.732 INFO:teuthology.orchestra.run.smithi106.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 145 kB/s | 59 kB 00:00 2024-05-09T06:18:38.735 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:38.735 INFO:teuthology.orchestra.run.smithi106.stdout:Total 653 kB/s | 2.2 MB 00:03 2024-05-09T06:18:38.801 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:18:38.816 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:18:38.816 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:18:38.900 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:18:38.900 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:18:39.400 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 1.9 MB/s | 4.7 MB 00:02 2024-05-09T06:18:39.417 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:18:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T06:18:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T06:18:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T06:18:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T06:18:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T06:18:39.868 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T06:18:39.971 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T06:18:40.036 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T06:18:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T06:18:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T06:18:40.825 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T06:18:40.870 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T06:18:40.894 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 1/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T06:18:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T06:18:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T06:18:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T06:18:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T06:18:42.022 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T06:18:42.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:42.022 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:42.022 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:42.022 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T06:18:42.022 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:42.023 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:42.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T06:18:42.750 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-05-09T06:18:42.751 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:42.752 INFO:teuthology.orchestra.run.smithi046.stdout:Total 5.3 MB/s | 38 MB 00:07 2024-05-09T06:18:42.815 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:46 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:42.936 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 123 k 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T06:18:42.937 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout:Install 6 Packages 2024-05-09T06:18:42.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:42.939 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 7.0 M 2024-05-09T06:18:42.939 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 33 M 2024-05-09T06:18:42.939 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:18:43.123 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:43.151 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:43.151 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:43.673 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:43.673 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:18:43.958 INFO:teuthology.orchestra.run.smithi106.stdout:(1/6): ceph-mgr-cephadm-17.2.7-933.g4ba5a836.el 287 kB/s | 123 kB 00:00 2024-05-09T06:18:44.526 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:44.567 INFO:teuthology.orchestra.run.smithi106.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 239 kB/s | 248 kB 00:01 2024-05-09T06:18:44.586 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T06:18:44.601 INFO:teuthology.orchestra.run.smithi106.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 855 kB/s | 548 kB 00:00 2024-05-09T06:18:44.632 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:18:44.718 INFO:teuthology.orchestra.run.smithi106.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 437 kB/s | 51 kB 00:00 2024-05-09T06:18:44.738 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:18:44.783 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T06:18:44.960 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T06:18:44.990 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T06:18:45.034 INFO:teuthology.orchestra.run.smithi106.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-05-09T06:18:45.051 INFO:teuthology.orchestra.run.smithi106.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 119 kB/s | 58 kB 00:00 2024-05-09T06:18:45.053 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:45.053 INFO:teuthology.orchestra.run.smithi106.stdout:Total 3.3 MB/s | 7.0 MB 00:02 2024-05-09T06:18:45.081 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T06:18:45.126 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:18:45.138 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:18:45.138 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:18:45.234 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:18:45.234 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:18:45.538 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:18:45.699 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T06:18:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T06:18:45.786 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T06:18:45.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T06:18:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T06:18:46.357 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T06:18:46.411 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T06:18:46.449 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:18:47.169 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:18:47.169 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/6 2024-05-09T06:18:47.169 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T06:18:47.170 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T06:18:47.170 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T06:18:47.170 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T06:18:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:18:47.422 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:47.423 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:47.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-fuse 2024-05-09T06:18:48.227 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:52 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:48.334 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T06:18:48.346 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:48.346 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-09T06:18:48.346 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:48.346 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:18:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 813 k 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout:Install 2 Packages 2024-05-09T06:18:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:48.348 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 893 k 2024-05-09T06:18:48.348 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 2.6 M 2024-05-09T06:18:48.348 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:18:48.366 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:18:48.703 INFO:teuthology.orchestra.run.smithi106.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 959 kB/s | 80 kB 00:00 2024-05-09T06:18:49.271 INFO:teuthology.orchestra.run.smithi106.stdout:(2/2): ceph-fuse-17.2.7-933.g4ba5a836.el9.x86_6 1.2 MB/s | 813 kB 00:00 2024-05-09T06:18:49.271 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:49.271 INFO:teuthology.orchestra.run.smithi106.stdout:Total 967 kB/s | 893 kB 00:00 2024-05-09T06:18:49.283 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:18:49.304 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:18:49.304 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:18:49.382 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:18:49.382 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:18:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:18:49.716 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T06:18:49.786 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:18:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/2 2024-05-09T06:18:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T06:18:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:50.757 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T06:18:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:50.757 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 12/12 2024-05-09T06:18:50.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a8 1/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T06:18:50.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T06:18:51.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install librados-devel 2024-05-09T06:18:51.266 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T06:18:51.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:51.266 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:51.266 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:51.266 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:51.267 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:51.588 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:51.650 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-rook 2024-05-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2024-05-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 126 k 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:51.711 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 126 k 2024-05-09T06:18:51.712 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 448 k 2024-05-09T06:18:51.712 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:18:51.917 INFO:teuthology.orchestra.run.smithi106.stdout:librados-devel-17.2.7-933.g4ba5a836.el9.x86_64. 615 kB/s | 126 kB 00:00 2024-05-09T06:18:51.917 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:51.918 INFO:teuthology.orchestra.run.smithi106.stdout:Total 611 kB/s | 126 kB 00:00 2024-05-09T06:18:51.918 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:18:51.923 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:18:51.923 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:18:51.986 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:18:51.986 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:18:52.147 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:18:52.246 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:32 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:52.248 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:52.372 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:52.373 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:52.373 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 47 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T06:18:52.374 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout:Install 13 Packages 2024-05-09T06:18:52.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:52.376 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.2 M 2024-05-09T06:18:52.376 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 26 M 2024-05-09T06:18:52.376 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:52.660 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:52.896 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:52.896 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:52.896 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:52.896 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:52.896 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:52.896 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:53.008 INFO:teuthology.orchestra.run.smithi046.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 204 kB/s | 19 kB 00:00 2024-05-09T06:18:53.033 INFO:teuthology.orchestra.run.smithi046.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 215 kB/s | 26 kB 00:00 2024-05-09T06:18:53.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install libcephfs2 2024-05-09T06:18:53.116 INFO:teuthology.orchestra.run.smithi046.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-05-09T06:18:53.142 INFO:teuthology.orchestra.run.smithi046.stdout:(4/13): ceph-mgr-rook-17.2.7-933.g4ba5a836.el9. 208 kB/s | 47 kB 00:00 2024-05-09T06:18:53.167 INFO:teuthology.orchestra.run.smithi046.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-05-09T06:18:53.193 INFO:teuthology.orchestra.run.smithi046.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-05-09T06:18:53.284 INFO:teuthology.orchestra.run.smithi046.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 377 kB/s | 54 kB 00:00 2024-05-09T06:18:53.385 INFO:teuthology.orchestra.run.smithi046.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 148 kB/s | 32 kB 00:00 2024-05-09T06:18:53.444 INFO:teuthology.orchestra.run.smithi046.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-05-09T06:18:53.510 INFO:teuthology.orchestra.run.smithi046.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 916 kB/s | 206 kB 00:00 2024-05-09T06:18:53.544 INFO:teuthology.orchestra.run.smithi046.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 592 kB/s | 59 kB 00:00 2024-05-09T06:18:53.602 INFO:teuthology.orchestra.run.smithi046.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 4.7 MB/s | 1.0 MB 00:00 2024-05-09T06:18:53.636 INFO:teuthology.orchestra.run.smithi046.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 716 kB/s | 90 kB 00:00 2024-05-09T06:18:53.638 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:53.638 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-05-09T06:18:53.689 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:57 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:53.708 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:53.724 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:53.724 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:53.770 INFO:teuthology.orchestra.run.smithi106.stdout:Package libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:53.813 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:53.813 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:18:53.813 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:53.819 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:53.826 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:18:53.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install libcephfs-devel 2024-05-09T06:18:54.344 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:18:54.469 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:58 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:54.527 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T06:18:54.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T06:18:54.594 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:18:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:54.596 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 25 k 2024-05-09T06:18:54.596 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 110 k 2024-05-09T06:18:54.596 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:18:54.637 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T06:18:54.672 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T06:18:54.714 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T06:18:54.812 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T06:18:54.838 INFO:teuthology.orchestra.run.smithi106.stdout:libcephfs-devel-17.2.7-933.g4ba5a836.el9.x86_64 103 kB/s | 25 kB 00:00 2024-05-09T06:18:54.839 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:54.839 INFO:teuthology.orchestra.run.smithi106.stdout:Total 102 kB/s | 25 kB 00:00 2024-05-09T06:18:54.839 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:18:54.843 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:18:54.843 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:18:54.844 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:18:54.844 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:18:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:18:54.924 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T06:18:54.983 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T06:18:55.027 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:55.421 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:55.646 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:18:55.646 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:55.646 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:18:55.647 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:18:55.647 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:18:55.647 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:55.746 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T06:18:55.787 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T06:18:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T06:18:55.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install librados2 2024-05-09T06:18:55.875 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T06:18:55.898 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:18:56.408 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:00 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:56.489 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:56.530 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:56.531 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:18:56.531 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:56.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install librbd1 2024-05-09T06:18:56.715 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 13/13 2024-05-09T06:18:56.715 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 1/13 2024-05-09T06:18:56.716 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T06:18:56.716 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T06:18:56.716 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T06:18:56.716 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T06:18:56.716 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T06:18:56.716 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T06:18:56.717 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T06:18:56.717 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T06:18:56.717 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T06:18:56.717 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T06:18:56.717 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T06:18:57.031 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T06:18:57.031 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:57.031 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:18:57.031 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:18:57.032 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T06:18:57.032 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T06:18:57.032 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T06:18:57.032 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T06:18:57.032 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T06:18:57.032 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T06:18:57.033 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:57.034 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:18:57.155 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:01 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:57.235 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:57.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T06:18:57.276 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:57.277 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:18:57.277 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:57.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-rados 2024-05-09T06:18:57.846 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:37 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:18:57.904 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:01 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:57.974 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:17.2.7-933.g4ba5a836.el9 ceph-noarch 123 k 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T06:18:57.975 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 7.0 M 2024-05-09T06:18:57.976 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 33 M 2024-05-09T06:18:57.977 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:18:57.986 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:58.026 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:58.027 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:18:58.027 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:58.087 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-rgw 2024-05-09T06:18:58.655 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:02 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:58.662 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-05-09T06:18:58.704 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): ceph-mgr-cephadm-17.2.7-933.g4ba5a836.el 537 kB/s | 123 kB 00:00 2024-05-09T06:18:58.735 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:58.775 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:58.777 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:18:58.777 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:58.812 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-05-09T06:18:58.837 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-cephfs 2024-05-09T06:18:59.396 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 83 kB/s | 58 kB 00:00 2024-05-09T06:18:59.400 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:03 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:18:59.481 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:18:59.497 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 80 kB/s | 51 kB 00:00 2024-05-09T06:18:59.522 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:18:59.523 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:18:59.523 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:18:59.586 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-rbd 2024-05-09T06:18:59.747 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 505 kB/s | 548 kB 00:01 2024-05-09T06:18:59.751 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:18:59.751 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.9 MB/s | 7.0 MB 00:01 2024-05-09T06:18:59.827 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:18:59.839 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:18:59.840 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:18:59.943 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:18:59.943 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:00.149 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:04 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:19:00.229 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:00.252 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:00.269 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:19:00.270 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-05-09T06:19:00.270 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:19:00.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install rbd-fuse 2024-05-09T06:19:00.438 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T06:19:00.500 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T06:19:00.906 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:04 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:19:01.028 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 82 k 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:01.029 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:19:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:01.030 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 82 k 2024-05-09T06:19:01.030 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 222 k 2024-05-09T06:19:01.030 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:19:01.063 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T06:19:01.163 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T06:19:01.225 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T06:19:01.252 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:19:01.417 INFO:teuthology.orchestra.run.smithi106.stdout:rbd-fuse-17.2.7-933.g4ba5a836.el9.x86_64.rpm 212 kB/s | 82 kB 00:00 2024-05-09T06:19:01.417 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:01.417 INFO:teuthology.orchestra.run.smithi106.stdout:Total 212 kB/s | 82 kB 00:00 2024-05-09T06:19:01.417 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:19:01.424 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:19:01.424 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:19:01.490 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:19:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:19:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:19:01.748 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:02.028 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 6/6 2024-05-09T06:19:02.028 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 1/6 2024-05-09T06:19:02.028 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T06:19:02.028 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T06:19:02.028 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T06:19:02.029 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T06:19:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:02.276 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T06:19:02.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:02.276 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:02.276 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:17.2.7-933.g4ba5a836.el9.noarch 2024-05-09T06:19:02.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T06:19:02.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T06:19:02.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T06:19:02.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T06:19:02.277 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T06:19:02.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:02.277 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:19:02.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-fuse 2024-05-09T06:19:02.654 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install rbd-mirror 2024-05-09T06:19:03.100 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:43 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:03.226 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:03.227 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:03.227 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-09T06:19:03.227 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 813 k 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 893 k 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 2.6 M 2024-05-09T06:19:03.228 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:19:03.266 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:07 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:19:03.394 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 2.9 M 2024-05-09T06:19:03.395 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 12 M 2024-05-09T06:19:03.396 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:19:03.782 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 232 kB/s | 80 kB 00:00 2024-05-09T06:19:04.271 INFO:teuthology.orchestra.run.smithi106.stdout:rbd-mirror-17.2.7-933.g4ba5a836.el9.x86_64.rpm 3.4 MB/s | 2.9 MB 00:00 2024-05-09T06:19:04.271 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:04.272 INFO:teuthology.orchestra.run.smithi106.stdout:Total 3.4 MB/s | 2.9 MB 00:00 2024-05-09T06:19:04.272 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:19:04.281 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:19:04.281 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:19:04.364 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:19:04.364 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:19:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:19:04.855 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:04.881 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:04.881 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:19:04.882 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T06:19:04.882 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:19:04.882 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:19:04.882 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:06.029 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:06.030 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:06.030 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:19:06.030 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:06.030 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:06.030 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:19:06.240 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): ceph-fuse-17.2.7-933.g4ba5a836.el9.x86_6 290 kB/s | 813 kB 00:02 2024-05-09T06:19:06.241 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:06.241 INFO:teuthology.orchestra.run.smithi046.stdout:Total 296 kB/s | 893 kB 00:03 2024-05-09T06:19:06.256 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:19:06.282 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:19:06.283 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:19:06.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install rbd-nbd 2024-05-09T06:19:06.370 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:19:06.370 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:06.558 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:06.690 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T06:19:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:19:06.871 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:10 ago on Thu 09 May 2024 06:16:56 AM UTC. 2024-05-09T06:19:06.995 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 165 k 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2024-05-09T06:19:06.996 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:06.997 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 165 k 2024-05-09T06:19:06.997 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 477 k 2024-05-09T06:19:06.997 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-09T06:19:07.265 INFO:teuthology.orchestra.run.smithi106.stdout:rbd-nbd-17.2.7-933.g4ba5a836.el9.x86_64.rpm 619 kB/s | 165 kB 00:00 2024-05-09T06:19:07.265 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:07.265 INFO:teuthology.orchestra.run.smithi106.stdout:Total 615 kB/s | 165 kB 00:00 2024-05-09T06:19:07.265 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-09T06:19:07.273 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-09T06:19:07.273 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-09T06:19:07.336 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-09T06:19:07.336 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-09T06:19:07.454 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2/2 2024-05-09T06:19:07.455 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/2 2024-05-09T06:19:07.512 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-09T06:19:07.611 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:07.713 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T06:19:07.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:07.713 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:07.713 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T06:19:07.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:07.713 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:07.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados-devel 2024-05-09T06:19:08.020 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:08.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:08.252 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:08.252 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-09T06:19:08.252 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:08.252 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:19:08.252 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-09T06:19:08.478 DEBUG:teuthology.parallel:result is None 2024-05-09T06:19:08.549 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:48 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:08.676 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 126 k 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:08.677 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:19:08.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:08.678 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 126 k 2024-05-09T06:19:08.678 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 448 k 2024-05-09T06:19:08.678 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:19:08.919 INFO:teuthology.orchestra.run.smithi046.stdout:librados-devel-17.2.7-933.g4ba5a836.el9.x86_64. 524 kB/s | 126 kB 00:00 2024-05-09T06:19:08.919 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:08.920 INFO:teuthology.orchestra.run.smithi046.stdout:Total 521 kB/s | 126 kB 00:00 2024-05-09T06:19:08.920 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:19:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:19:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:19:08.992 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:19:08.993 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:09.158 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:09.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:09.686 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:09.928 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:09.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:09.928 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:09.929 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:09.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:09.929 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:10.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs2 2024-05-09T06:19:10.729 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:50 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:10.813 INFO:teuthology.orchestra.run.smithi046.stdout:Package libcephfs2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:10.857 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:10.858 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:10.858 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:10.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs-devel 2024-05-09T06:19:11.517 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:51 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:11.643 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:11.644 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:11.644 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-09T06:19:11.644 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 25 k 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 25 k 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 110 k 2024-05-09T06:19:11.645 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:19:11.964 INFO:teuthology.orchestra.run.smithi046.stdout:libcephfs-devel-17.2.7-933.g4ba5a836.el9.x86_64 78 kB/s | 25 kB 00:00 2024-05-09T06:19:11.965 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:11.965 INFO:teuthology.orchestra.run.smithi046.stdout:Total 78 kB/s | 25 kB 00:00 2024-05-09T06:19:11.965 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:19:11.969 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:19:11.969 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:19:11.971 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:19:11.971 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:12.050 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:12.173 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:12.527 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:12.752 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:12.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:12.752 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:12.752 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:12.753 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:12.753 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:12.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados2 2024-05-09T06:19:13.524 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:53 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:13.609 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:13.652 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:13.653 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:13.654 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:13.723 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librbd1 2024-05-09T06:19:14.318 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:54 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:14.403 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:14.446 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:14.448 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:14.448 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:14.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rados 2024-05-09T06:19:15.121 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:15.205 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rados-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:15.248 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:15.249 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:15.249 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:15.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rgw 2024-05-09T06:19:15.904 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:15.987 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rgw-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:16.031 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:16.033 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:16.033 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:16.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-cephfs 2024-05-09T06:19:16.696 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:56 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:16.781 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-cephfs-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:16.823 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:16.824 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:16.825 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:16.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rbd 2024-05-09T06:19:17.488 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:57 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:17.570 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rbd-2:17.2.7-933.g4ba5a836.el9.x86_64 is already installed. 2024-05-09T06:19:17.615 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:17.617 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-09T06:19:17.617 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:17.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-fuse 2024-05-09T06:19:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:58 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:18.411 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 82 k 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:19:18.412 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:18.413 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 82 k 2024-05-09T06:19:18.413 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 222 k 2024-05-09T06:19:18.413 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:19:18.627 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-fuse-17.2.7-933.g4ba5a836.el9.x86_64.rpm 382 kB/s | 82 kB 00:00 2024-05-09T06:19:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:Total 380 kB/s | 82 kB 00:00 2024-05-09T06:19:18.628 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:19:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:19:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:19:18.708 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:19:18.709 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:18.877 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:18.968 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:19.401 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:19.660 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:19.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:19.661 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:19.661 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:19.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:19.661 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:19.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-mirror 2024-05-09T06:19:20.485 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:00 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:20.614 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 2.9 M 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:20.615 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:19:20.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:20.616 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.9 M 2024-05-09T06:19:20.616 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 12 M 2024-05-09T06:19:20.616 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:19:21.630 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-mirror-17.2.7-933.g4ba5a836.el9.x86_64.rpm 2.9 MB/s | 2.9 MB 00:01 2024-05-09T06:19:21.631 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:21.631 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.9 MB/s | 2.9 MB 00:01 2024-05-09T06:19:21.632 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:19:21.644 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:19:21.644 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:19:21.738 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:19:21.738 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:22.284 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T06:19:22.284 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T06:19:22.284 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:19:22.284 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T06:19:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:23.354 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:23.355 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:23.355 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:23.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-nbd 2024-05-09T06:19:24.176 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:04 ago on Thu 09 May 2024 06:17:20 AM UTC. 2024-05-09T06:19:24.303 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:17.2.7-933.g4ba5a836.el9 ceph 165 k 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:24.304 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 165 k 2024-05-09T06:19:24.305 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 477 k 2024-05-09T06:19:24.305 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-09T06:19:24.530 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-nbd-17.2.7-933.g4ba5a836.el9.x86_64.rpm 735 kB/s | 165 kB 00:00 2024-05-09T06:19:24.531 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:19:24.531 INFO:teuthology.orchestra.run.smithi046.stdout:Total 730 kB/s | 165 kB 00:00 2024-05-09T06:19:24.531 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-09T06:19:24.539 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-09T06:19:24.539 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-09T06:19:24.606 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-09T06:19:24.606 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-09T06:19:24.780 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-09T06:19:24.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:25.256 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:25.510 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 1/1 2024-05-09T06:19:25.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:25.510 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-09T06:19:25.510 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:17.2.7-933.g4ba5a836.el9.x86_64 2024-05-09T06:19:25.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:19:25.510 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-09T06:19:25.759 DEBUG:teuthology.parallel:result is None 2024-05-09T06:19:25.760 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:19:25.760 INFO:teuthology.packaging:ref: None 2024-05-09T06:19:25.760 INFO:teuthology.packaging:tag: None 2024-05-09T06:19:25.760 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:19:25.760 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:19:25.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:19:26.106 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T06:19:26.129 INFO:teuthology.orchestra.run.smithi046.stdout:17.2.7-933.g4ba5a836.el9 2024-05-09T06:19:26.129 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-933.g4ba5a836.el9 2024-05-09T06:19:26.129 INFO:teuthology.task.install:The correct ceph version 17.2.7-933.g4ba5a836 is installed. 2024-05-09T06:19:26.131 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T06:19:26.131 INFO:teuthology.packaging:ref: None 2024-05-09T06:19:26.132 INFO:teuthology.packaging:tag: None 2024-05-09T06:19:26.132 INFO:teuthology.packaging:branch: quincy 2024-05-09T06:19:26.132 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:19:26.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-05-09T06:19:26.369 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T06:19:26.394 INFO:teuthology.orchestra.run.smithi106.stdout:17.2.7-933.g4ba5a836.el9 2024-05-09T06:19:26.394 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-933.g4ba5a836.el9 2024-05-09T06:19:26.394 INFO:teuthology.task.install:The correct ceph version 17.2.7-933.g4ba5a836 is installed. 2024-05-09T06:19:26.396 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T06:19:26.396 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:19:26.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T06:19:26.424 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:19:26.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T06:19:26.464 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T06:19:26.464 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:19:26.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T06:19:26.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T06:19:26.558 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:19:26.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T06:19:26.586 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T06:19:26.655 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T06:19:26.655 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:19:26.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T06:19:26.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T06:19:26.749 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:19:26.749 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T06:19:26.778 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T06:19:26.847 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T06:19:26.847 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:19:26.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T06:19:26.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T06:19:26.939 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:19:26.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T06:19:26.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T06:19:27.033 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:19:27.043 INFO:teuthology.task.print:**** done install task... 2024-05-09T06:19:27.043 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-09T06:19:27.148 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'} 2024-05-09T06:19:27.149 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-05-09T06:19:27.149 INFO:tasks.cephadm:Cluster fsid is 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:19:27.150 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-09T06:19:27.150 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-05-09T06:19:27.150 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi046': '172.21.15.46', 'mon.smithi106': '172.21.15.106'} 2024-05-09T06:19:27.150 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-09T06:19:27.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-05-09T06:19:27.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname $(hostname -s) 2024-05-09T06:19:27.205 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-05-09T06:19:27.206 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T06:19:27.404 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 May 9 06:19 /home/ubuntu/cephtest/cephadm 2024-05-09T06:19:27.404 DEBUG:teuthology.orchestra.run.smithi106:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T06:19:27.592 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 May 9 06:19 /home/ubuntu/cephtest/cephadm 2024-05-09T06:19:27.593 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T06:19:27.610 DEBUG:teuthology.orchestra.run.smithi106:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T06:19:27.637 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-05-09T06:19:27.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-05-09T06:19:27.653 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-05-09T06:19:29.208 INFO:teuthology.orchestra.run.smithi106.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:19:29.251 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:19:57.797 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:19:57.798 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)", 2024-05-09T06:19:57.798 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4", 2024-05-09T06:19:57.798 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-05-09T06:19:57.798 INFO:teuthology.orchestra.run.smithi046.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228" 2024-05-09T06:19:57.798 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-05-09T06:19:57.798 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:20:15.162 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-09T06:20:15.163 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)", 2024-05-09T06:20:15.163 INFO:teuthology.orchestra.run.smithi106.stdout: "image_id": "b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4", 2024-05-09T06:20:15.163 INFO:teuthology.orchestra.run.smithi106.stdout: "repo_digests": [ 2024-05-09T06:20:15.163 INFO:teuthology.orchestra.run.smithi106.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228" 2024-05-09T06:20:15.163 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-09T06:20:15.163 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-09T06:20:15.183 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-05-09T06:20:15.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph 2024-05-09T06:20:15.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-05-09T06:20:15.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /etc/ceph 2024-05-09T06:20:15.314 INFO:tasks.cephadm:Writing seed config... 2024-05-09T06:20:15.315 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-05-09T06:20:15.315 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-05-09T06:20:15.315 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-09T06:20:15.316 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-09T06:20:15.317 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-09T06:20:15.318 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-09T06:20:15.319 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:20:15.319 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-09T06:20:15.348 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 165d9e0a-0dcc-11ef-bc97-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-09T06:20:15.348 DEBUG:teuthology.orchestra.run.smithi046:mon.smithi046> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service 2024-05-09T06:20:15.391 INFO:tasks.cephadm:Bootstrapping... 2024-05-09T06:20:15.391 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:20:15.610 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-09T06:20:15.610 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '165d9e0a-0dcc-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2024-05-09T06:20:15.637 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T06:20:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-09T06:20:15.638 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2024-05-09T06:20:15.662 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T06:20:15.662 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2024-05-09T06:20:15.662 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2024-05-09T06:20:15.670 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T06:20:15.671 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T06:20:15.678 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T06:20:15.678 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-05-09T06:20:15.684 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-05-09T06:20:15.691 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-05-09T06:20:15.691 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-05-09T06:20:15.691 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2024-05-09T06:20:15.717 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T06:20:15.717 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-09T06:20:15.717 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2024-05-09T06:20:15.717 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2024-05-09T06:20:15.724 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T06:20:15.724 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T06:20:15.730 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T06:20:15.731 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-05-09T06:20:15.738 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-05-09T06:20:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-05-09T06:20:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-05-09T06:20:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2024-05-09T06:20:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 139640251425696 on /run/cephadm/165d9e0a-0dcc-11ef-bc97-c7b262605968.lock 2024-05-09T06:20:15.745 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 139640251425696 acquired on /run/cephadm/165d9e0a-0dcc-11ef-bc97-c7b262605968.lock 2024-05-09T06:20:15.746 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2024-05-09T06:20:15.746 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2024-05-09T06:20:15.746 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-05-09T06:20:15.750 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.46 metric 100 2024-05-09T06:20:15.750 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2024-05-09T06:20:15.753 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-09T06:20:15.753 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-09T06:20:15.753 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T06:20:15.756 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-05-09T06:20:15.757 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-05-09T06:20:15.757 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-09T06:20:15.757 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-09T06:20:15.758 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:20:17.096 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 2024-05-09T06:20:17.096 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-05-09T06:20:17.097 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2024-05-09T06:20:17.097 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:c42dcfa56d26f8ee4099fe660c3358cf18049e7d8f0dc981922308e1a948d8a3 2024-05-09T06:20:17.097 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-09T06:20:17.097 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 2024-05-09T06:20:17.097 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-09T06:20:18.008 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable) 2024-05-09T06:20:18.008 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable) 2024-05-09T06:20:18.008 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2024-05-09T06:20:25.949 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2024-05-09T06:20:25.950 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2024-05-09T06:20:31.985 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAtazxm4+iuBRAAdreTMbHqqXpNL+PQEia9Bg== 2024-05-09T06:20:32.907 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAwazxms4ydFRAAD7iEHjvAed/FB+/FN9R8Eg== 2024-05-09T06:20:33.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAxazxmSoraDRAA7tpy1UlRK/annCbBJUly7Q== 2024-05-09T06:20:33.880 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2024-05-09T06:20:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T06:20:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-05-09T06:20:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T06:20:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for smithi046 [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T06:20:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = octopus 2024-05-09T06:20:34.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:34.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T06:20:34.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:20:34.779 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2024-05-09T06:20:35.608 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.smithi046 on 2024-05-09T06:20:35.834 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T06:20:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-09T06:20:36.211 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968.target. 2024-05-09T06:20:36.211 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968.target. 2024-05-09T06:20:36.393 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046 2024-05-09T06:20:36.394 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service: Unit ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service not loaded. 2024-05-09T06:20:36.570 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968.target.wants/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service → /etc/systemd/system/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@.service. 2024-05-09T06:20:37.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:36 smithi046 podman[26535]: 2024-05-09 06:20:36.734927487 +0000 UTC m=+0.018230435 image pull b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 quay.ceph.io/ceph-ci/ceph:quincy 2024-05-09T06:20:37.759 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 podman[26535]: 2024-05-09 06:20:37.507723598 +0000 UTC m=+0.791026527 container create 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, RELEASE=quincy-4ba5a83, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-09T06:20:37.760 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 podman[26535]: 2024-05-09 06:20:37.694029981 +0000 UTC m=+0.977332910 container init 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=quincy-4ba5a83, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-09T06:20:37.760 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 podman[26535]: 2024-05-09 06:20:37.697682851 +0000 UTC m=+0.980985784 container start 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, io.buildah.version=1.33.5, ceph=True, RELEASE=quincy-4ba5a83, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-09T06:20:37.760 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 ceph-mon[26554]: mkfs 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:37.760 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 ceph-mon[26554]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-05-09T06:20:37.760 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 bash[26535]: 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 2024-05-09T06:20:37.774 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:20:37.774 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-05-09T06:20:37.782 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:20:37.782 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-05-09T06:20:37.782 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-05-09T06:20:37.782 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T06:20:37.783 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2024-05-09T06:20:37.783 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2024-05-09T06:20:38.025 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:37 smithi046 systemd[1]: Started Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:20:38.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi046 (age 0.565736s) 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:38.834 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.220+0000 7f5d6eea5700 1 Processor -- start 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.220+0000 7f5d6eea5700 1 -- start start 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.221+0000 7f5d6eea5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.221+0000 7f5d6eea5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d681031d0 con 0x7f5d68102880 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.221+0000 7f5d6cc41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.221+0000 7f5d6cc41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34328/0 (socket says 172.21.15.46:34328) 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.221+0000 7f5d6cc41700 1 -- 172.21.15.46:0/356632727 learned_addr learned my addr 172.21.15.46:0/356632727 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.221+0000 7f5d6cc41700 1 -- 172.21.15.46:0/356632727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68103310 con 0x7f5d68102880 2024-05-09T06:20:38.835 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6cc41700 1 --2- 172.21.15.46:0/356632727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0098e0 tx=0x7f5d5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f53d0f7722a766c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d677fe700 1 -- 172.21.15.46:0/356632727 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c00b860 con 0x7f5d68102880 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d677fe700 1 -- 172.21.15.46:0/356632727 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00b9c0 con 0x7f5d68102880 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d677fe700 1 -- 172.21.15.46:0/356632727 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c00bc90 con 0x7f5d68102880 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 -- 172.21.15.46:0/356632727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 msgr2=0x7f5d68102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 --2- 172.21.15.46:0/356632727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0098e0 tx=0x7f5d5c009250 comp rx=0 tx=0).stop 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 -- 172.21.15.46:0/356632727 shutdown_connections 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 --2- 172.21.15.46:0/356632727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68102c90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 -- 172.21.15.46:0/356632727 >> 172.21.15.46:0/356632727 conn(0x7f5d680fe060 msgr2=0x7f5d68100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 -- 172.21.15.46:0/356632727 shutdown_connections 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.222+0000 7f5d6eea5700 1 -- 172.21.15.46:0/356632727 wait complete. 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6eea5700 1 Processor -- start 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6eea5700 1 -- start start 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6eea5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:38.836 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6eea5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d681113a0 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6cc41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6cc41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34338/0 (socket says 172.21.15.46:34338) 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.223+0000 7f5d6cc41700 1 -- 172.21.15.46:0/3883905095 learned_addr learned my addr 172.21.15.46:0/3883905095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d6cc41700 1 -- 172.21.15.46:0/3883905095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0094f0 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d6cc41700 1 --2- 172.21.15.46:0/3883905095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68110e60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c003080 tx=0x7f5d5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c01c5c0 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c01c720 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d681115a0 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c01ca30 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d68111fd0 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5d5c01cc60 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.224+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5d5c01ac80 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.225+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6805f5c0 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.227+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f5d5c01a450 con 0x7f5d68102880 2024-05-09T06:20:38.837 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.301+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f5d68112aa0 con 0x7f5d68102880 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.301+0000 7f5d657fa700 1 -- 172.21.15.46:0/3883905095 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f5d5c025440 con 0x7f5d68102880 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 msgr2=0x7f5d68110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 --2- 172.21.15.46:0/3883905095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68110e60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c003080 tx=0x7f5d5c016000 comp rx=0 tx=0).stop 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 shutdown_connections 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 --2- 172.21.15.46:0/3883905095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d68102880 0x7f5d68110e60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 >> 172.21.15.46:0/3883905095 conn(0x7f5d680fe060 msgr2=0x7f5d68105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 shutdown_connections 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:38.302+0000 7f5d6eea5700 1 -- 172.21.15.46:0/3883905095 wait complete. 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2024-05-09T06:20:38.838 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2024-05-09T06:20:38.957 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:38 smithi046 ceph-mon[26554]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-05-09T06:20:38.957 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:38 smithi046 ceph-mon[26554]: monmap e1: 1 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:20:38.957 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:38 smithi046 ceph-mon[26554]: fsmap 2024-05-09T06:20:38.957 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:38 smithi046 ceph-mon[26554]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T06:20:38.957 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:38 smithi046 ceph-mon[26554]: mgrmap e1: no daemons active 2024-05-09T06:20:38.957 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:38 smithi046 ceph-mon[26554]: from='client.? 172.21.15.46:0/3883905095' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-09T06:20:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T06:20:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-05-09T06:20:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T06:20:39.931 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.289+0000 7f98575bb700 1 Processor -- start 2024-05-09T06:20:39.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f98575bb700 1 -- start start 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f98575bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f98575bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98501031d0 con 0x7f9850102880 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f9855357700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f9855357700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34340/0 (socket says 172.21.15.46:34340) 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f9855357700 1 -- 172.21.15.46:0/4256682265 learned_addr learned my addr 172.21.15.46:0/4256682265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.290+0000 7f9855357700 1 -- 172.21.15.46:0/4256682265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850103310 con 0x7f9850102880 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f9855357700 1 --2- 172.21.15.46:0/4256682265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850102c90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f984c0098e0 tx=0x7f984c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4d3dab20e2f2b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f9843fff700 1 -- 172.21.15.46:0/4256682265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f984c00b860 con 0x7f9850102880 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f9843fff700 1 -- 172.21.15.46:0/4256682265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c00b9c0 con 0x7f9850102880 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f9843fff700 1 -- 172.21.15.46:0/4256682265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f984c00bc90 con 0x7f9850102880 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 -- 172.21.15.46:0/4256682265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 msgr2=0x7f9850102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 --2- 172.21.15.46:0/4256682265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850102c90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f984c0098e0 tx=0x7f984c009250 comp rx=0 tx=0).stop 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 -- 172.21.15.46:0/4256682265 shutdown_connections 2024-05-09T06:20:39.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 --2- 172.21.15.46:0/4256682265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850102c90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 -- 172.21.15.46:0/4256682265 >> 172.21.15.46:0/4256682265 conn(0x7f98500fe060 msgr2=0x7f9850100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 -- 172.21.15.46:0/4256682265 shutdown_connections 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.291+0000 7f98575bb700 1 -- 172.21.15.46:0/4256682265 wait complete. 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f98575bb700 1 Processor -- start 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f98575bb700 1 -- start start 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f98575bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f98575bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850079160 con 0x7f9850102880 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f9855357700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f9855357700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34348/0 (socket says 172.21.15.46:34348) 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.292+0000 7f9855357700 1 -- 172.21.15.46:0/2802009874 learned_addr learned my addr 172.21.15.46:0/2802009874 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9855357700 1 -- 172.21.15.46:0/2802009874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c0094f0 con 0x7f9850102880 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9855357700 1 --2- 172.21.15.46:0/2802009874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850078c20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f984c003080 tx=0x7f984c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f984c01c5c0 con 0x7f9850102880 2024-05-09T06:20:39.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c01c720 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98500771d0 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f984c01ca30 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98500776c0 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f984c01cc60 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.293+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f984c01ac80 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.294+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985004bed0 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.296+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f984c01a450 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.366+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9850103b50 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.369+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f984c01ae90 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.369+0000 7f9841ffb700 1 -- 172.21.15.46:0/2802009874 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f984c024520 con 0x7f9850102880 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.370+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 msgr2=0x7f9850078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.370+0000 7f98575bb700 1 --2- 172.21.15.46:0/2802009874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850078c20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f984c003080 tx=0x7f984c016000 comp rx=0 tx=0).stop 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.370+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 shutdown_connections 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.370+0000 7f98575bb700 1 --2- 172.21.15.46:0/2802009874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9850102880 0x7f9850078c20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:39.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.370+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 >> 172.21.15.46:0/2802009874 conn(0x7f98500fe060 msgr2=0x7f9850105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:39.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.371+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 shutdown_connections 2024-05-09T06:20:39.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:39.371+0000 7f98575bb700 1 -- 172.21.15.46:0/2802009874 wait complete. 2024-05-09T06:20:39.936 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2024-05-09T06:20:40.040 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:39 smithi046 ceph-mon[26554]: from='client.? 172.21.15.46:0/2802009874' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T06:20:40.040 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:39 smithi046 ceph-mon[26554]: from='client.? 172.21.15.46:0/2802009874' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-09T06:20:40.962 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:40 smithi046 ceph-mon[26554]: from='client.? 172.21.15.46:0/584339863' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.343+0000 7fe41ec80700 1 Processor -- start 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.343+0000 7fe41ec80700 1 -- start start 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ec80700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe418102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ec80700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418103200 con 0x7fe4181028b0 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ca1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe418102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ca1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe418102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34360/0 (socket says 172.21.15.46:34360) 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ca1c700 1 -- 172.21.15.46:0/4147164695 learned_addr learned my addr 172.21.15.46:0/4147164695 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ca1c700 1 -- 172.21.15.46:0/4147164695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe418103340 con 0x7fe4181028b0 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe41ca1c700 1 --2- 172.21.15.46:0/4147164695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe418102cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0098e0 tx=0x7fe40c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fe4f6f922b6c2e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe4177fe700 1 -- 172.21.15.46:0/4147164695 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe40c00b860 con 0x7fe4181028b0 2024-05-09T06:20:40.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.344+0000 7fe4177fe700 1 -- 172.21.15.46:0/4147164695 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe40c00be50 con 0x7fe4181028b0 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe4177fe700 1 -- 172.21.15.46:0/4147164695 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe40c010380 con 0x7fe4181028b0 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 -- 172.21.15.46:0/4147164695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 msgr2=0x7fe418102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 --2- 172.21.15.46:0/4147164695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe418102cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0098e0 tx=0x7fe40c009250 comp rx=0 tx=0).stop 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 -- 172.21.15.46:0/4147164695 shutdown_connections 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 --2- 172.21.15.46:0/4147164695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe418102cc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 -- 172.21.15.46:0/4147164695 >> 172.21.15.46:0/4147164695 conn(0x7fe4180fdff0 msgr2=0x7fe418100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 -- 172.21.15.46:0/4147164695 shutdown_connections 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.345+0000 7fe41ec80700 1 -- 172.21.15.46:0/4147164695 wait complete. 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ec80700 1 Processor -- start 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ec80700 1 -- start start 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ec80700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe4181115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ec80700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418111af0 con 0x7fe4181028b0 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ca1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe4181115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ca1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe4181115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34374/0 (socket says 172.21.15.46:34374) 2024-05-09T06:20:40.971 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ca1c700 1 -- 172.21.15.46:0/584339863 learned_addr learned my addr 172.21.15.46:0/584339863 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.346+0000 7fe41ca1c700 1 -- 172.21.15.46:0/584339863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0094f0 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe41ca1c700 1 --2- 172.21.15.46:0/584339863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe4181115b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe40c000c00 tx=0x7fe40c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe40c0107c0 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe40c010db0 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe418111cf0 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe40c01ad00 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe418112860 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe40c024440 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.347+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe40c019710 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.348+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe418112180 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.350+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fe40c01a530 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.420+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe41804bed0 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.420+0000 7fe4157fa700 1 -- 172.21.15.46:0/584339863 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fe40c010920 con 0x7fe4181028b0 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 msgr2=0x7fe4181115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 --2- 172.21.15.46:0/584339863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe4181115b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe40c000c00 tx=0x7fe40c009250 comp rx=0 tx=0).stop 2024-05-09T06:20:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 shutdown_connections 2024-05-09T06:20:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 --2- 172.21.15.46:0/584339863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4181028b0 0x7fe4181115b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 >> 172.21.15.46:0/584339863 conn(0x7fe4180fdff0 msgr2=0x7fe4180fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 shutdown_connections 2024-05-09T06:20:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:40.421+0000 7fe41ec80700 1 -- 172.21.15.46:0/584339863 wait complete. 2024-05-09T06:20:40.973 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2024-05-09T06:20:41.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:20:41.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[26550]: 2024-05-09T06:20:41.300+0000 7f3e9e231700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:20:41.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[26550]: 2024-05-09T06:20:41.300+0000 7f3e9e231700 -1 mon.smithi046@0(leader) e1 *** Got Signal Terminated *** 2024-05-09T06:20:41.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 podman[26798]: 2024-05-09 06:20:41.433466379 +0000 UTC m=+0.265716835 container died 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:20:41.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 podman[26798]: 2024-05-09 06:20:41.757805882 +0000 UTC m=+0.590056334 container cleanup 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-4ba5a83) 2024-05-09T06:20:41.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 bash[26798]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046 2024-05-09T06:20:42.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:41 smithi046 podman[26812]: 2024-05-09 06:20:41.95023222 +0000 UTC m=+0.518957892 container remove 064df3590ac8d3c45a52f9a9808f33a74bdc6ad749f713b4162ecdd6ee0ef332 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-4ba5a83, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:20:42.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service: Deactivated successfully. 2024-05-09T06:20:42.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:20:42.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 systemd[1]: Starting Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:20:42.640 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 podman[26905]: 2024-05-09 06:20:42.310734453 +0000 UTC m=+0.018210800 image pull b96134859c769a8952bd08bae830428ee7e7c9e8aec2130d3f91a61449ba04b4 quay.ceph.io/ceph-ci/ceph:quincy 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 podman[26905]: 2024-05-09 06:20:42.418050181 +0000 UTC m=+0.125526516 container create df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=quincy-4ba5a83, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 podman[26905]: 2024-05-09 06:20:42.578429326 +0000 UTC m=+0.285905661 container init df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 podman[26905]: 2024-05-09 06:20:42.581556957 +0000 UTC m=+0.289033293 container start df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=quincy-4ba5a83, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable), process ceph-mon, pid 2 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: pidfile_write: ignore empty --pid-file 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: load: jerasure load: lrc 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: RocksDB version: 6.15.5 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Compile date May 7 2024 2024-05-09T06:20:42.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: DB SUMMARY 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: DB Session ID: BHWQNRIFRX53E6HFLI38 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: CURRENT file: CURRENT 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000008.sst 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000010.log size: 98162 ; 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.error_if_exists: 0 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.create_if_missing: 0 2024-05-09T06:20:42.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.paranoid_checks: 1 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.env: 0x564e720fbb00 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.fs: Posix File System 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.info_log: 0x564e7300f620 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.statistics: (nil) 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.use_fsync: 0 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_log_file_size: 0 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T06:20:42.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.allow_fallocate: 1 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.use_direct_reads: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.db_log_dir: 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi046/store.db 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T06:20:42.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.write_buffer_manager: 0x564e73d02a20 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.unordered_write: 0 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T06:20:42.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.row_cache: None 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.wal_filter: None 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.preserve_deletes: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.two_write_queues: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.atomic_flush: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.log_readahead_size: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T06:20:42.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_background_jobs: 2 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_background_compactions: -1 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_subcompactions: 1 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T06:20:42.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_open_files: -1 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_background_flushes: -1 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Compression algorithms supported: 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kZSTD supported: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kXpressCompression supported: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kZlibCompression supported: 1 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kSnappyCompression supported: 1 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kLZ4Compression supported: 1 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: kBZip2Compression supported: 0 2024-05-09T06:20:42.659 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000009 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.merge_operator: 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_filter: None 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564e72fe2f58) 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-05-09T06:20:42.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: hash_index_allow_collision: 1 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 1 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x564e73015090 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-05-09T06:20:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 4 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-05-09T06:20:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression: NoCompression 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.num_levels: 7 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T06:20:42.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T06:20:42.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.arena_block_size: 4194304 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T06:20:42.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.table_properties_collectors: 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.inplace_update_support: 0 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T06:20:42.666 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.bloom_locality: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.max_successive_merges: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.ttl: 2592000 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.enable_blob_files: false 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.min_blob_size: 0 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T06:20:42.667 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715235642609896, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715235642610853, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93368, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91480, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84044, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1715235642, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "19de92d5-aa05-4a67-adb5-588e7ed3b0ed", "db_session_id": "BHWQNRIFRX53E6HFLI38"}} 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715235642611186, "job": 1, "event": "recovery_finished"} 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x564e72fa9180 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: DB pointer 0x564e7307e000 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-05-09T06:20:42.668 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.669 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 26.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 26.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.5 0.00 0.00 1 0.001 0 0 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:42.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 26.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???) e1 preinit fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).mds e1 new map 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).mds e1 print_map 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e1 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:20:42.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: -1 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: No filesystems configured 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 bash[26905]: df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 systemd[1]: Started Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: monmap e1: 1 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: fsmap 2024-05-09T06:20:42.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T06:20:42.674 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:42 smithi046 ceph-mon[26924]: mgrmap e1: no daemons active 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa430198700 1 Processor -- start 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa430198700 1 -- start start 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa430198700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa428102170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa430198700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281026b0 con 0x7fa428101d60 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa42df34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa428102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa42df34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa428102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50720/0 (socket says 172.21.15.46:50720) 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.093+0000 7fa42df34700 1 -- 172.21.15.46:0/2955550163 learned_addr learned my addr 172.21.15.46:0/2955550163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7fa42df34700 1 -- 172.21.15.46:0/2955550163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4281027f0 con 0x7fa428101d60 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7fa42df34700 1 --2- 172.21.15.46:0/2955550163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa428102170 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098e0 tx=0x7fa424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d950429ae38159 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7fa42cf32700 1 -- 172.21.15.46:0/2955550163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa42400b860 con 0x7fa428101d60 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7fa42cf32700 1 -- 172.21.15.46:0/2955550163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa42400be50 con 0x7fa428101d60 2024-05-09T06:20:43.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.094+0000 7fa42cf32700 1 -- 172.21.15.46:0/2955550163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa424010380 con 0x7fa428101d60 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 -- 172.21.15.46:0/2955550163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 msgr2=0x7fa428102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 --2- 172.21.15.46:0/2955550163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa428102170 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098e0 tx=0x7fa424009250 comp rx=0 tx=0).stop 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 -- 172.21.15.46:0/2955550163 shutdown_connections 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 --2- 172.21.15.46:0/2955550163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa428102170 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 -- 172.21.15.46:0/2955550163 >> 172.21.15.46:0/2955550163 conn(0x7fa4280fc6f0 msgr2=0x7fa4280feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 -- 172.21.15.46:0/2955550163 shutdown_connections 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 -- 172.21.15.46:0/2955550163 wait complete. 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 Processor -- start 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.095+0000 7fa430198700 1 -- start start 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa430198700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa4281104c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa430198700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428110a00 con 0x7fa428101d60 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa42df34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa4281104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa42df34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa4281104c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50736/0 (socket says 172.21.15.46:50736) 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa42df34700 1 -- 172.21.15.46:0/2970158608 learned_addr learned my addr 172.21.15.46:0/2970158608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:43.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa42df34700 1 -- 172.21.15.46:0/2970158608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240094f0 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa42df34700 1 --2- 172.21.15.46:0/2970158608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa4281104c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b440 tx=0x7fa424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa424010760 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa424010d50 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa428110c00 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.096+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa42401ae20 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.097+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa428111770 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.097+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa42402e440 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.097+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa424024740 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.097+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42805f5c0 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.100+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fa424029070 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.169+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa428103660 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.171+0000 7fa41e7fc700 1 -- 172.21.15.46:0/2970158608 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa42401a6a0 con 0x7fa428101d60 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 msgr2=0x7fa4281104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:43.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 --2- 172.21.15.46:0/2970158608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa4281104c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b440 tx=0x7fa424009250 comp rx=0 tx=0).stop 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 shutdown_connections 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 --2- 172.21.15.46:0/2970158608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa428101d60 0x7fa4281104c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 >> 172.21.15.46:0/2970158608 conn(0x7fa4280fc6f0 msgr2=0x7fa4280fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 shutdown_connections 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:43.172+0000 7fa430198700 1 -- 172.21.15.46:0/2970158608 wait complete. 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2024-05-09T06:20:43.687 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 9283 ... 2024-05-09T06:20:43.876 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mgr.smithi046.nvpcui 2024-05-09T06:20:43.876 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mgr.smithi046.nvpcui.service: Unit ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mgr.smithi046.nvpcui.service not loaded. 2024-05-09T06:20:44.034 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968.target.wants/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mgr.smithi046.nvpcui.service → /etc/systemd/system/ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@.service. 2024-05-09T06:20:44.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:44 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2970158608' entity='client.admin' 2024-05-09T06:20:44.604 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:20:44.604 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-05-09T06:20:44.614 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:20:44.614 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-05-09T06:20:44.614 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-05-09T06:20:44.614 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T06:20:44.625 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:20:44.625 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-05-09T06:20:44.634 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:20:44.635 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-05-09T06:20:44.635 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-05-09T06:20:44.635 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-05-09T06:20:44.635 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2024-05-09T06:20:44.635 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2024-05-09T06:20:45.247 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:45 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1736558578' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:45.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:45.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:45.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "165d9e0a-0dcc-11ef-bc97-c7b262605968", 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-09T06:20:45.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:45.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:20:37.737432+0000", 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f231186d700 1 Processor -- start 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f231186d700 1 -- start start 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f231186d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f231186d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1031d0 con 0x7f230c102880 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f230affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f230affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50766/0 (socket says 172.21.15.46:50766) 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.058+0000 7f230affd700 1 -- 172.21.15.46:0/1921345722 learned_addr learned my addr 172.21.15.46:0/1921345722 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.059+0000 7f230affd700 1 -- 172.21.15.46:0/1921345722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c103310 con 0x7f230c102880 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.059+0000 7f230affd700 1 --2- 172.21.15.46:0/1921345722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c102c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0098e0 tx=0x7f22fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e912e8e40ca7bf1e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.059+0000 7f2309ffb700 1 -- 172.21.15.46:0/1921345722 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc00b860 con 0x7f230c102880 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.059+0000 7f2309ffb700 1 -- 172.21.15.46:0/1921345722 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f22fc00be50 con 0x7f230c102880 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.059+0000 7f2309ffb700 1 -- 172.21.15.46:0/1921345722 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc010380 con 0x7f230c102880 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 -- 172.21.15.46:0/1921345722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 msgr2=0x7f230c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 --2- 172.21.15.46:0/1921345722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c102c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0098e0 tx=0x7f22fc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 -- 172.21.15.46:0/1921345722 shutdown_connections 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 --2- 172.21.15.46:0/1921345722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c102c90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 -- 172.21.15.46:0/1921345722 >> 172.21.15.46:0/1921345722 conn(0x7f230c0fe060 msgr2=0x7f230c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 -- 172.21.15.46:0/1921345722 shutdown_connections 2024-05-09T06:20:45.856 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 -- 172.21.15.46:0/1921345722 wait complete. 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.060+0000 7f231186d700 1 Processor -- start 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f231186d700 1 -- start start 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f231186d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c1115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f231186d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c111b30 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f230affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c1115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f230affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c1115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50782/0 (socket says 172.21.15.46:50782) 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f230affd700 1 -- 172.21.15.46:0/1736558578 learned_addr learned my addr 172.21.15.46:0/1736558578 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f230affd700 1 -- 172.21.15.46:0/1736558578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0094f0 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f230affd700 1 --2- 172.21.15.46:0/1736558578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c1115f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f22fc000c00 tx=0x7f22fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.061+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc0107c0 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.062+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f22fc010db0 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.062+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c111d30 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.062+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc01ad00 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.062+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c1128a0 con 0x7f230c102880 2024-05-09T06:20:45.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.062+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f22fc024440 con 0x7f230c102880 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.062+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f22fc019710 con 0x7f230c102880 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.063+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c05f5c0 con 0x7f230c102880 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.065+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f22fc01a530 con 0x7f230c102880 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.138+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f230c104650 con 0x7f230c102880 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.138+0000 7f22f37fe700 1 -- 172.21.15.46:0/1736558578 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f22fc010920 con 0x7f230c102880 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 msgr2=0x7f230c1115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 --2- 172.21.15.46:0/1736558578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c1115f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f22fc000c00 tx=0x7f22fc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:45.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 shutdown_connections 2024-05-09T06:20:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 --2- 172.21.15.46:0/1736558578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f230c102880 0x7f230c1115f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 >> 172.21.15.46:0/1736558578 conn(0x7f230c0fe060 msgr2=0x7f230c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 shutdown_connections 2024-05-09T06:20:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:45.139+0000 7f231186d700 1 -- 172.21.15.46:0/1736558578 wait complete. 2024-05-09T06:20:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2024-05-09T06:20:48.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:48 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/823759851' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:48.961 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:48.961 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "165d9e0a-0dcc-11ef-bc97-c7b262605968", 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:48.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:48.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:48.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:48.965 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:20:37.737432+0000", 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.272+0000 7fd196afe700 1 Processor -- start 2024-05-09T06:20:48.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.272+0000 7fd196afe700 1 -- start start 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd196afe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd196afe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190102090 con 0x7fd190101740 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd19489a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd19489a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50796/0 (socket says 172.21.15.46:50796) 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd19489a700 1 -- 172.21.15.46:0/3924940424 learned_addr learned my addr 172.21.15.46:0/3924940424 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd19489a700 1 -- 172.21.15.46:0/3924940424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1901021d0 con 0x7fd190101740 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.273+0000 7fd19489a700 1 --2- 172.21.15.46:0/3924940424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190101b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd1840098e0 tx=0x7fd184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8aeab942452300 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd18f7fe700 1 -- 172.21.15.46:0/3924940424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd18400b860 con 0x7fd190101740 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd18f7fe700 1 -- 172.21.15.46:0/3924940424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd18400be50 con 0x7fd190101740 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd18f7fe700 1 -- 172.21.15.46:0/3924940424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd184010380 con 0x7fd190101740 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 -- 172.21.15.46:0/3924940424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 msgr2=0x7fd190101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:48.967 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 --2- 172.21.15.46:0/3924940424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190101b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd1840098e0 tx=0x7fd184009250 comp rx=0 tx=0).stop 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 -- 172.21.15.46:0/3924940424 shutdown_connections 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 --2- 172.21.15.46:0/3924940424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190101b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 -- 172.21.15.46:0/3924940424 >> 172.21.15.46:0/3924940424 conn(0x7fd1900fcec0 msgr2=0x7fd1900ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 -- 172.21.15.46:0/3924940424 shutdown_connections 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.274+0000 7fd196afe700 1 -- 172.21.15.46:0/3924940424 wait complete. 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd196afe700 1 Processor -- start 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd196afe700 1 -- start start 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd196afe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd196afe700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190114250 con 0x7fd190101740 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd19489a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd19489a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190071270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50800/0 (socket says 172.21.15.46:50800) 2024-05-09T06:20:48.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.275+0000 7fd19489a700 1 -- 172.21.15.46:0/823759851 learned_addr learned my addr 172.21.15.46:0/823759851 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd19489a700 1 -- 172.21.15.46:0/823759851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1840094f0 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd19489a700 1 --2- 172.21.15.46:0/823759851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190071270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd18400b440 tx=0x7fd184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd184010760 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd184010d50 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd190114390 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd18401ae20 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd190114880 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd18402e440 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.276+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd184024740 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.277+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19004bed0 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.279+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fd184029070 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.353+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd190103510 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.354+0000 7fd18d7fa700 1 -- 172.21.15.46:0/823759851 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fd18401a6a0 con 0x7fd190101740 2024-05-09T06:20:48.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.354+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 msgr2=0x7fd190071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.354+0000 7fd196afe700 1 --2- 172.21.15.46:0/823759851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190071270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd18400b440 tx=0x7fd184009250 comp rx=0 tx=0).stop 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.355+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 shutdown_connections 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.355+0000 7fd196afe700 1 --2- 172.21.15.46:0/823759851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd190101740 0x7fd190071270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.355+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 >> 172.21.15.46:0/823759851 conn(0x7fd1900fcec0 msgr2=0x7fd1900fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.355+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 shutdown_connections 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:48.355+0000 7fd196afe700 1 -- 172.21.15.46:0/823759851 wait complete. 2024-05-09T06:20:48.970 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: mgrmap e2: smithi046.nvpcui(active, starting, since 0.00304724s) 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:20:51.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:20:51.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:20:51.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' 2024-05-09T06:20:51.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' 2024-05-09T06:20:51.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:51 smithi046 ceph-mon[26924]: from='mgr.14100 172.21.15.46:0/239773566' entity='mgr.smithi046.nvpcui' 2024-05-09T06:20:52.126 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "165d9e0a-0dcc-11ef-bc97-c7b262605968", 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:52.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:52.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:52.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:52.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:20:37.737432+0000", 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a43ab9700 1 Processor -- start 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a43ab9700 1 -- start start 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a43ab9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a43ab9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1031d0 con 0x7f8a3c102880 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a41855700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:52.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a41855700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52670/0 (socket says 172.21.15.46:52670) 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.420+0000 7f8a41855700 1 -- 172.21.15.46:0/3290529306 learned_addr learned my addr 172.21.15.46:0/3290529306 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.421+0000 7f8a41855700 1 -- 172.21.15.46:0/3290529306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c103310 con 0x7f8a3c102880 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.421+0000 7f8a41855700 1 --2- 172.21.15.46:0/3290529306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a380098e0 tx=0x7f8a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8281934687d3f74a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.421+0000 7f8a40853700 1 -- 172.21.15.46:0/3290529306 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a3800b860 con 0x7f8a3c102880 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.421+0000 7f8a40853700 1 -- 172.21.15.46:0/3290529306 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8a3800be50 con 0x7f8a3c102880 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.421+0000 7f8a40853700 1 -- 172.21.15.46:0/3290529306 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a38010380 con 0x7f8a3c102880 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 -- 172.21.15.46:0/3290529306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 msgr2=0x7f8a3c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 --2- 172.21.15.46:0/3290529306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a380098e0 tx=0x7f8a38009250 comp rx=0 tx=0).stop 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 -- 172.21.15.46:0/3290529306 shutdown_connections 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 --2- 172.21.15.46:0/3290529306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c102c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 -- 172.21.15.46:0/3290529306 >> 172.21.15.46:0/3290529306 conn(0x7f8a3c0fe060 msgr2=0x7f8a3c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 -- 172.21.15.46:0/3290529306 shutdown_connections 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 -- 172.21.15.46:0/3290529306 wait complete. 2024-05-09T06:20:52.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 Processor -- start 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.422+0000 7f8a43ab9700 1 -- start start 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a43ab9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a43ab9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c079160 con 0x7f8a3c102880 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a41855700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a41855700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52672/0 (socket says 172.21.15.46:52672) 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a41855700 1 -- 172.21.15.46:0/2449571328 learned_addr learned my addr 172.21.15.46:0/2449571328 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a41855700 1 -- 172.21.15.46:0/2449571328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380094f0 con 0x7f8a3c102880 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a41855700 1 --2- 172.21.15.46:0/2449571328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c078c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a380107c0 con 0x7f8a3c102880 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c0771d0 con 0x7f8a3c102880 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8a38010db0 con 0x7f8a3c102880 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a3801ad00 con 0x7f8a3c102880 2024-05-09T06:20:52.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.423+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c0776c0 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.424+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 2) v1 ==== 43132+0+0 (secure 0 0 0) 0x7f8a380193c0 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.424+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c04bed0 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.424+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8a3804a1a0 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.427+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f8a38019670 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.499+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8a3c077c50 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.499+0000 7f8a327fc700 1 -- 172.21.15.46:0/2449571328 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f8a38022340 con 0x7f8a3c102880 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 msgr2=0x7f8a3c078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 --2- 172.21.15.46:0/2449571328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c078c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38009250 comp rx=0 tx=0).stop 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 shutdown_connections 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 --2- 172.21.15.46:0/2449571328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a3c102880 0x7f8a3c078c20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 >> 172.21.15.46:0/2449571328 conn(0x7f8a3c0fe060 msgr2=0x7f8a3c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 shutdown_connections 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:51.500+0000 7f8a43ab9700 1 -- 172.21.15.46:0/2449571328 wait complete. 2024-05-09T06:20:52.144 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (3/15)... 2024-05-09T06:20:52.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:52 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2449571328' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:52.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:52 smithi046 ceph-mon[26924]: mgrmap e3: smithi046.nvpcui(active, since 1.00682s) 2024-05-09T06:20:54.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:54 smithi046 ceph-mon[26924]: mgrmap e4: smithi046.nvpcui(active, since 2s) 2024-05-09T06:20:55.367 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "165d9e0a-0dcc-11ef-bc97-c7b262605968", 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T06:20:55.369 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T06:20:55.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T06:20:55.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T06:20:55.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T06:20:55.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T06:20:37.737432+0000", 2024-05-09T06:20:55.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1f5d7700 1 Processor -- start 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1f5d7700 1 -- start start 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1f5d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b18105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1f5d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18105940 con 0x7f9b18076c50 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1d373700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b18105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1d373700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b18105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52688/0 (socket says 172.21.15.46:52688) 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.559+0000 7f9b1d373700 1 -- 172.21.15.46:0/1118499675 learned_addr learned my addr 172.21.15.46:0/1118499675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1d373700 1 -- 172.21.15.46:0/1118499675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18105a80 con 0x7f9b18076c50 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1d373700 1 --2- 172.21.15.46:0/1118499675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b18105400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b140098e0 tx=0x7f9b14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453974b169539bc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b0ffff700 1 -- 172.21.15.46:0/1118499675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b1400b860 con 0x7f9b18076c50 2024-05-09T06:20:55.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b0ffff700 1 -- 172.21.15.46:0/1118499675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9b1400be50 con 0x7f9b18076c50 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b0ffff700 1 -- 172.21.15.46:0/1118499675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b14010380 con 0x7f9b18076c50 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/1118499675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 msgr2=0x7f9b18105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1f5d7700 1 --2- 172.21.15.46:0/1118499675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b18105400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b140098e0 tx=0x7f9b14009250 comp rx=0 tx=0).stop 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/1118499675 shutdown_connections 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1f5d7700 1 --2- 172.21.15.46:0/1118499675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b18105400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.560+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/1118499675 >> 172.21.15.46:0/1118499675 conn(0x7f9b180fcef0 msgr2=0x7f9b180ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/1118499675 shutdown_connections 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/1118499675 wait complete. 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1f5d7700 1 Processor -- start 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1f5d7700 1 -- start start 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1f5d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b181115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1f5d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18111b20 con 0x7f9b18076c50 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1d373700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b181115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1d373700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b181115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52694/0 (socket says 172.21.15.46:52694) 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.561+0000 7f9b1d373700 1 -- 172.21.15.46:0/3179447817 learned_addr learned my addr 172.21.15.46:0/3179447817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:55.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b1d373700 1 -- 172.21.15.46:0/3179447817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140094f0 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b1d373700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b181115e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b14003080 tx=0x7f9b14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b14010760 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9b14010d50 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b1401ace0 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b18111d20 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.562+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b18112890 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.563+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f9b140108c0 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.563+0000 7f9b0dffb700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f9b04036800 0x7f9b04038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.563+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1805f5c0 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.563+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9b1404a590 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.563+0000 7f9b1cb72700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f9b04036800 0x7f9b04038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.564+0000 7f9b1cb72700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f9b04036800 0x7f9b04038cb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009990 tx=0x7f9b08006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.569+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9b14018b40 con 0x7f9b18076c50 2024-05-09T06:20:55.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.844+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9b1804bed0 con 0x7f9b18076c50 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.844+0000 7f9b0dffb700 1 -- 172.21.15.46:0/3179447817 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f9b14018b40 con 0x7f9b18076c50 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f9b04036800 msgr2=0x7f9b04038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f9b04036800 0x7f9b04038cb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009990 tx=0x7f9b08006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 msgr2=0x7f9b181115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b181115e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b14003080 tx=0x7f9b14009250 comp rx=0 tx=0).stop 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 shutdown_connections 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f9b04036800 0x7f9b04038cb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 --2- 172.21.15.46:0/3179447817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18076c50 0x7f9b181115e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 >> 172.21.15.46:0/3179447817 conn(0x7f9b180fcef0 msgr2=0x7f9b180fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 shutdown_connections 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:54.848+0000 7f9b1f5d7700 1 -- 172.21.15.46:0/3179447817 wait complete. 2024-05-09T06:20:55.383 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2024-05-09T06:20:55.514 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:55 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3179447817' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T06:20:56.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:56 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3647323814' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T06:20:56.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.828+0000 7f08a0b84700 1 Processor -- start 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.828+0000 7f08a0b84700 1 -- start start 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f08a0b84700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:56.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f08a0b84700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c101530 con 0x7f089c100be0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c100ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52706/0 (socket says 172.21.15.46:52706) 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089a59c700 1 -- 172.21.15.46:0/3132902118 learned_addr learned my addr 172.21.15.46:0/3132902118 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089a59c700 1 -- 172.21.15.46:0/3132902118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c101670 con 0x7f089c100be0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089a59c700 1 --2- 172.21.15.46:0/3132902118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c100ff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f088c0098e0 tx=0x7f088c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff90a37ee38611b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089959a700 1 -- 172.21.15.46:0/3132902118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f088c00b860 con 0x7f089c100be0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089959a700 1 -- 172.21.15.46:0/3132902118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f088c00be50 con 0x7f089c100be0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.829+0000 7f089959a700 1 -- 172.21.15.46:0/3132902118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f088c010380 con 0x7f089c100be0 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 -- 172.21.15.46:0/3132902118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 msgr2=0x7f089c100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 --2- 172.21.15.46:0/3132902118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c100ff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f088c0098e0 tx=0x7f088c009250 comp rx=0 tx=0).stop 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 -- 172.21.15.46:0/3132902118 shutdown_connections 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 --2- 172.21.15.46:0/3132902118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c100ff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 -- 172.21.15.46:0/3132902118 >> 172.21.15.46:0/3132902118 conn(0x7f089c0fc6b0 msgr2=0x7f089c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:56.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 -- 172.21.15.46:0/3132902118 shutdown_connections 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.830+0000 7f08a0b84700 1 -- 172.21.15.46:0/3132902118 wait complete. 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f08a0b84700 1 Processor -- start 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f08a0b84700 1 -- start start 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f08a0b84700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c1036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f08a0b84700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c103be0 con 0x7f089c100be0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f089a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c1036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f089a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c1036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52720/0 (socket says 172.21.15.46:52720) 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f089a59c700 1 -- 172.21.15.46:0/3647323814 learned_addr learned my addr 172.21.15.46:0/3647323814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f089a59c700 1 -- 172.21.15.46:0/3647323814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0094f0 con 0x7f089c100be0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.831+0000 7f089a59c700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c1036a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f088c000c00 tx=0x7f088c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.832+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f088c0107c0 con 0x7f089c100be0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.832+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f088c010db0 con 0x7f089c100be0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.832+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089c101c50 con 0x7f089c100be0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.832+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f088c01ad00 con 0x7f089c100be0 2024-05-09T06:20:56.583 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.832+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089c102140 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.832+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f088c0193c0 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.833+0000 7f0892ffd700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0888036850 0x7f0888038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.833+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f088c04a600 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.833+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089c04bed0 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.833+0000 7f0899d9b700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0888036850 0x7f0888038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.833+0000 7f0899d9b700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0888036850 0x7f0888038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0884009990 tx=0x7f0884006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:55.837+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f088c019670 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.033+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f089c106850 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.033+0000 7f0892ffd700 1 -- 172.21.15.46:0/3647323814 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f088c048020 con 0x7f089c100be0 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0888036850 msgr2=0x7f0888038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0888036850 0x7f0888038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0884009990 tx=0x7f0884006e40 comp rx=0 tx=0).stop 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 msgr2=0x7f089c1036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c1036a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f088c000c00 tx=0x7f088c009250 comp rx=0 tx=0).stop 2024-05-09T06:20:56.584 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 shutdown_connections 2024-05-09T06:20:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0888036850 0x7f0888038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 --2- 172.21.15.46:0/3647323814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f089c100be0 0x7f089c1036a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.035+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 >> 172.21.15.46:0/3647323814 conn(0x7f089c0fc6b0 msgr2=0x7f089c0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.036+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 shutdown_connections 2024-05-09T06:20:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.036+0000 7f08a0b84700 1 -- 172.21.15.46:0/3647323814 wait complete. 2024-05-09T06:20:56.585 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2024-05-09T06:20:57.516 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:57 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3875218309' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.978+0000 7ff552d7e700 1 Processor -- start 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.978+0000 7ff552d7e700 1 -- start start 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff552d7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff552d7e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c105980 con 0x7ff54c076c20 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff550b1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff550b1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52736/0 (socket says 172.21.15.46:52736) 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff550b1a700 1 -- 172.21.15.46:0/2937079618 learned_addr learned my addr 172.21.15.46:0/2937079618 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff550b1a700 1 -- 172.21.15.46:0/2937079618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c105ac0 con 0x7ff54c076c20 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff550b1a700 1 --2- 172.21.15.46:0/2937079618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c105440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff5340098e0 tx=0x7ff534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4858cd93dadf37f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff54b7fe700 1 -- 172.21.15.46:0/2937079618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff53400b860 con 0x7ff54c076c20 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff54b7fe700 1 -- 172.21.15.46:0/2937079618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff53400be50 con 0x7ff54c076c20 2024-05-09T06:20:57.884 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.979+0000 7ff54b7fe700 1 -- 172.21.15.46:0/2937079618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff534010380 con 0x7ff54c076c20 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 -- 172.21.15.46:0/2937079618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 msgr2=0x7ff54c105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 --2- 172.21.15.46:0/2937079618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c105440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff5340098e0 tx=0x7ff534009250 comp rx=0 tx=0).stop 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 -- 172.21.15.46:0/2937079618 shutdown_connections 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 --2- 172.21.15.46:0/2937079618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c105440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 -- 172.21.15.46:0/2937079618 >> 172.21.15.46:0/2937079618 conn(0x7ff54c0fced0 msgr2=0x7ff54c0ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 -- 172.21.15.46:0/2937079618 shutdown_connections 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 -- 172.21.15.46:0/2937079618 wait complete. 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.980+0000 7ff552d7e700 1 Processor -- start 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff552d7e700 1 -- start start 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff552d7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c1115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff552d7e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c111b20 con 0x7ff54c076c20 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff550b1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c1115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff550b1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c1115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52746/0 (socket says 172.21.15.46:52746) 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff550b1a700 1 -- 172.21.15.46:0/3875218309 learned_addr learned my addr 172.21.15.46:0/3875218309 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:57.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff550b1a700 1 -- 172.21.15.46:0/3875218309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340094f0 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.981+0000 7ff550b1a700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c1115e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff534003050 tx=0x7ff534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.982+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff534010760 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.982+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c111d20 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.982+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff534010d50 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.982+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff53401ae20 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.982+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c112890 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.982+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7ff53402e440 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.983+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c05f5c0 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.983+0000 7ff5497fa700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff5380367e0 0x7ff538038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.983+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff53404a620 con 0x7ff54c076c20 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.983+0000 7ff54bfff700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff5380367e0 0x7ff538038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:57.886 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.983+0000 7ff54bfff700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff5380367e0 0x7ff538038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00ad90 tx=0x7ff53c009410 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:56.987+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff534018760 con 0x7ff54c076c20 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.236+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ff54c04bed0 con 0x7ff54c076c20 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.368+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff53402ed50 con 0x7ff54c076c20 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.369+0000 7ff5497fa700 1 -- 172.21.15.46:0/3875218309 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ff534018350 con 0x7ff54c076c20 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff5380367e0 msgr2=0x7ff538038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff5380367e0 0x7ff538038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00ad90 tx=0x7ff53c009410 comp rx=0 tx=0).stop 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 msgr2=0x7ff54c1115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c1115e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff534003050 tx=0x7ff534009250 comp rx=0 tx=0).stop 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 shutdown_connections 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff5380367e0 0x7ff538038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 --2- 172.21.15.46:0/3875218309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff54c076c20 0x7ff54c1115e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 >> 172.21.15.46:0/3875218309 conn(0x7ff54c0fced0 msgr2=0x7ff54c0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 shutdown_connections 2024-05-09T06:20:57.887 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:57.371+0000 7ff552d7e700 1 -- 172.21.15.46:0/3875218309 wait complete. 2024-05-09T06:20:58.798 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:58 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3875218309' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-09T06:20:58.799 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:58 smithi046 ceph-mon[26924]: mgrmap e5: smithi046.nvpcui(active, since 6s) 2024-05-09T06:20:59.091 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.nvpcui", 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.314+0000 7ff8e2347700 1 Processor -- start 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.314+0000 7ff8e2347700 1 -- start start 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.314+0000 7ff8e2347700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc107870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.314+0000 7ff8e2347700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc103260 con 0x7ff8dc0712b0 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.314+0000 7ff8dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc107870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.314+0000 7ff8dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc107870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52774/0 (socket says 172.21.15.46:52774) 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.315+0000 7ff8dbfff700 1 -- 172.21.15.46:0/649596607 learned_addr learned my addr 172.21.15.46:0/649596607 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:59.092 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.315+0000 7ff8dbfff700 1 -- 172.21.15.46:0/649596607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc107db0 con 0x7ff8dc0712b0 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.315+0000 7ff8dbfff700 1 --2- 172.21.15.46:0/649596607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc107870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0098e0 tx=0x7ff8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ede0f6fee4c2c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.315+0000 7ff8db7fe700 1 -- 172.21.15.46:0/649596607 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8cc00b860 con 0x7ff8dc0712b0 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.315+0000 7ff8db7fe700 1 -- 172.21.15.46:0/649596607 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff8cc00be50 con 0x7ff8dc0712b0 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.315+0000 7ff8db7fe700 1 -- 172.21.15.46:0/649596607 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8cc010380 con 0x7ff8dc0712b0 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 -- 172.21.15.46:0/649596607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 msgr2=0x7ff8dc107870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 --2- 172.21.15.46:0/649596607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc107870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0098e0 tx=0x7ff8cc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 -- 172.21.15.46:0/649596607 shutdown_connections 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 --2- 172.21.15.46:0/649596607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc107870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 -- 172.21.15.46:0/649596607 >> 172.21.15.46:0/649596607 conn(0x7ff8dc0fcec0 msgr2=0x7ff8dc0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 -- 172.21.15.46:0/649596607 shutdown_connections 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.316+0000 7ff8e2347700 1 -- 172.21.15.46:0/649596607 wait complete. 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8e2347700 1 Processor -- start 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8e2347700 1 -- start start 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8e2347700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:59.093 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8e2347700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc113d50 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52784/0 (socket says 172.21.15.46:52784) 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.317+0000 7ff8dbfff700 1 -- 172.21.15.46:0/4236946920 learned_addr learned my addr 172.21.15.46:0/4236946920 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8dbfff700 1 -- 172.21.15.46:0/4236946920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0094f0 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8dbfff700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc113810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00b440 tx=0x7ff8cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8cc010760 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff8cc010d50 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc113f50 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc114ac0 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.318+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8cc01adc0 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.319+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff8cc019470 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.319+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc0052e0 con 0x7ff8dc0712b0 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.319+0000 7ff8d97fa700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 0x7ff8c8038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:20:59.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.319+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff8cc04af50 con 0x7ff8dc0712b0 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.319+0000 7ff8d3fff700 1 -- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 msgr2=0x7ff8c8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.319+0000 7ff8d3fff700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 0x7ff8c8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.324+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff8cc023940 con 0x7ff8dc0712b0 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.520+0000 7ff8d3fff700 1 -- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 msgr2=0x7ff8c8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.520+0000 7ff8d3fff700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 0x7ff8c8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.579+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff8bc005da0 con 0x7ff8dc0712b0 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.580+0000 7ff8d97fa700 1 -- 172.21.15.46:0/4236946920 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff8cc023350 con 0x7ff8dc0712b0 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 msgr2=0x7ff8c8038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 0x7ff8c8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 msgr2=0x7ff8dc113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc113810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00b440 tx=0x7ff8cc009250 comp rx=0 tx=0).stop 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 shutdown_connections 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7ff8c8036830 0x7ff8c8038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 --2- 172.21.15.46:0/4236946920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8dc0712b0 0x7ff8dc113810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:20:59.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.582+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 >> 172.21.15.46:0/4236946920 conn(0x7ff8dc0fcec0 msgr2=0x7ff8dc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:20:59.096 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.583+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 shutdown_connections 2024-05-09T06:20:59.096 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:58.583+0000 7ff8e2347700 1 -- 172.21.15.46:0/4236946920 wait complete. 2024-05-09T06:20:59.096 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-05-09T06:20:59.096 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2024-05-09T06:20:59.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:20:59 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/4236946920' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T06:21:04.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: Active manager daemon smithi046.nvpcui restarted 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: osdmap e2: 0 total, 0 up, 0 in 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: mgrmap e6: smithi046.nvpcui(active, starting, since 0.00327438s) 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:04.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:04.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:04.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:21:04.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:04 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:21:05.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:05 smithi046 ceph-mon[26924]: Found migration_current of "None". Setting to last migration. 2024-05-09T06:21:05.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:05 smithi046 ceph-mon[26924]: mgrmap e7: smithi046.nvpcui(active, since 1.00518s) 2024-05-09T06:21:05.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:21:05.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-09T06:21:05.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f011bc21700 1 Processor -- start 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f011bc21700 1 -- start start 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f011bc21700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f0114101b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f011bc21700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01141020b0 con 0x7f0114101760 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f01199bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f0114101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f01199bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f0114101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52792/0 (socket says 172.21.15.46:52792) 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.589+0000 7f01199bd700 1 -- 172.21.15.46:0/3782571563 learned_addr learned my addr 172.21.15.46:0/3782571563 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.590+0000 7f01199bd700 1 -- 172.21.15.46:0/3782571563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01141021f0 con 0x7f0114101760 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.590+0000 7f01199bd700 1 --2- 172.21.15.46:0/3782571563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f0114101b70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01100098e0 tx=0x7f0110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c7ed26e427e87b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.590+0000 7f01189bb700 1 -- 172.21.15.46:0/3782571563 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f011000b860 con 0x7f0114101760 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.590+0000 7f01189bb700 1 -- 172.21.15.46:0/3782571563 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f011000be50 con 0x7f0114101760 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.590+0000 7f01189bb700 1 -- 172.21.15.46:0/3782571563 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0110010380 con 0x7f0114101760 2024-05-09T06:21:05.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 -- 172.21.15.46:0/3782571563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 msgr2=0x7f0114101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 --2- 172.21.15.46:0/3782571563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f0114101b70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01100098e0 tx=0x7f0110009250 comp rx=0 tx=0).stop 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 -- 172.21.15.46:0/3782571563 shutdown_connections 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 --2- 172.21.15.46:0/3782571563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f0114101b70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 -- 172.21.15.46:0/3782571563 >> 172.21.15.46:0/3782571563 conn(0x7f01140fcea0 msgr2=0x7f01140ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 -- 172.21.15.46:0/3782571563 shutdown_connections 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 -- 172.21.15.46:0/3782571563 wait complete. 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 Processor -- start 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.591+0000 7f011bc21700 1 -- start start 2024-05-09T06:21:05.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f011bc21700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f01141137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f011bc21700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0114113d00 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f01199bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f01141137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f01199bd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f01141137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52804/0 (socket says 172.21.15.46:52804) 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f01199bd700 1 -- 172.21.15.46:0/3214139366 learned_addr learned my addr 172.21.15.46:0/3214139366 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f01199bd700 1 -- 172.21.15.46:0/3214139366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100094f0 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f01199bd700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f01141137c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f011000b440 tx=0x7f0110009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0110010760 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0110010d50 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f011001ae20 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0114113f00 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.592+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0114114a70 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.594+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f01100108c0 con 0x7f0114101760 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.594+0000 7f010a7fc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.594+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 --> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01000393f0 con 0x7f0100036830 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.594+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f011004a5d0 con 0x7f0114101760 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.594+0000 7f01191bc700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 msgr2=0x7f0100038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.594+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.795+0000 7f01191bc700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 msgr2=0x7f0100038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:20:59.795+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.196+0000 7f01191bc700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 msgr2=0x7f0100038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.196+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.997+0000 7f01191bc700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 msgr2=0x7f0100038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:00.997+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.598+0000 7f01191bc700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 msgr2=0x7f0100038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/544704645 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:02.598+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.125+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7f011002e7c0 con 0x7f0114101760 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.125+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 msgr2=0x7f0100038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:21:05.619 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:04.125+0000 7f010a7fc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.126+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f011002dc70 con 0x7f0114101760 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.126+0000 7f010a7fc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0100039fc0 0x7f010003c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.126+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01000393f0 con 0x7f0100039fc0 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.127+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0100039fc0 0x7f010003c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.127+0000 7f01191bc700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0100039fc0 0x7f010003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01040039d0 tx=0x7f0104009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.128+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f01000393f0 con 0x7f0100039fc0 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0114114390 con 0x7f0100039fc0 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f010a7fc700 1 -- 172.21.15.46:0/3214139366 <== mgr.14120 v2:172.21.15.46:6800/3381519426 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0114114390 con 0x7f0100039fc0 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0100039fc0 msgr2=0x7f010003c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0100039fc0 0x7f010003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01040039d0 tx=0x7f0104009350 comp rx=0 tx=0).stop 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 msgr2=0x7f01141137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f01141137c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f011000b440 tx=0x7f0110009250 comp rx=0 tx=0).stop 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 shutdown_connections 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0100039fc0 0x7f010003c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.620 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0114101760 0x7f01141137c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.621 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 --2- 172.21.15.46:0/3214139366 >> [v2:172.21.15.46:6800/544704645,v1:172.21.15.46:6801/544704645] conn(0x7f0100036830 0x7f0100038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:05.621 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 >> 172.21.15.46:0/3214139366 conn(0x7f01140fcea0 msgr2=0x7f01140fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:05.621 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 shutdown_connections 2024-05-09T06:21:05.621 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:05.134+0000 7f011bc21700 1 -- 172.21.15.46:0/3214139366 wait complete. 2024-05-09T06:21:05.621 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2024-05-09T06:21:05.621 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2024-05-09T06:21:06.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:06 smithi046 ceph-mon[26924]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T06:21:06.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:06 smithi046 ceph-mon[26924]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T06:21:06.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:06 smithi046 ceph-mon[26924]: [09/May/2024:06:21:05] ENGINE Bus STARTING 2024-05-09T06:21:06.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:06 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:06.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:06 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:06.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.081+0000 7fa77deb5700 1 Processor -- start 2024-05-09T06:21:06.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.081+0000 7fa77deb5700 1 -- start start 2024-05-09T06:21:06.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.081+0000 7fa77deb5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa778103080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.081+0000 7fa77deb5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778103650 con 0x7fa778102c70 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.082+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa778103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.082+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa778103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34308/0 (socket says 172.21.15.46:34308) 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.082+0000 7fa7777fe700 1 -- 172.21.15.46:0/3692334424 learned_addr learned my addr 172.21.15.46:0/3692334424 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.082+0000 7fa7777fe700 1 -- 172.21.15.46:0/3692334424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778103790 con 0x7fa778102c70 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.082+0000 7fa7777fe700 1 --2- 172.21.15.46:0/3692334424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa778103080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa768009e50 tx=0x7fa768009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7624f9869261b5cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.082+0000 7fa7767fc700 1 -- 172.21.15.46:0/3692334424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7680092e0 con 0x7fa778102c70 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa7767fc700 1 -- 172.21.15.46:0/3692334424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa768012430 con 0x7fa778102c70 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa7767fc700 1 -- 172.21.15.46:0/3692334424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7680075c0 con 0x7fa778102c70 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 -- 172.21.15.46:0/3692334424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 msgr2=0x7fa778103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 --2- 172.21.15.46:0/3692334424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa778103080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa768009e50 tx=0x7fa768009840 comp rx=0 tx=0).stop 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 -- 172.21.15.46:0/3692334424 shutdown_connections 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 --2- 172.21.15.46:0/3692334424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa778103080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 -- 172.21.15.46:0/3692334424 >> 172.21.15.46:0/3692334424 conn(0x7fa7780fc6b0 msgr2=0x7fa7780feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 -- 172.21.15.46:0/3692334424 shutdown_connections 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.083+0000 7fa77deb5700 1 -- 172.21.15.46:0/3692334424 wait complete. 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa77deb5700 1 Processor -- start 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa77deb5700 1 -- start start 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa77deb5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa7781137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa77deb5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778113d00 con 0x7fa778102c70 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa7781137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa7781137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34320/0 (socket says 172.21.15.46:34320) 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.084+0000 7fa7777fe700 1 -- 172.21.15.46:0/3360168730 learned_addr learned my addr 172.21.15.46:0/3360168730 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa7777fe700 1 -- 172.21.15.46:0/3360168730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009ae0 con 0x7fa778102c70 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa7777fe700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa7781137c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa768009fd0 tx=0x7fa768009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7680092e0 con 0x7fa778102c70 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa778113f00 con 0x7fa778102c70 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa768007d10 con 0x7fa778102c70 2024-05-09T06:21:06.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa76801c880 con 0x7fa778102c70 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.085+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778114a70 con 0x7fa778102c70 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.086+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fa768019070 con 0x7fa778102c70 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.086+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77805f5c0 con 0x7fa778102c70 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.086+0000 7fa76ffff700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fa764036720 0x7fa764038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.086+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa768049c60 con 0x7fa778102c70 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.086+0000 7fa776ffd700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fa764036720 0x7fa764038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.087+0000 7fa776ffd700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fa764036720 0x7fa764038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa760009990 tx=0x7fa760006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.091+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa76800bc30 con 0x7fa778102c70 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.303+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7780fd870 con 0x7fa764036720 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.311+0000 7fa76ffff700 1 -- 172.21.15.46:0/3360168730 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa7780fd870 con 0x7fa764036720 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fa764036720 msgr2=0x7fa764038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fa764036720 0x7fa764038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa760009990 tx=0x7fa760006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 msgr2=0x7fa7781137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa7781137c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa768009fd0 tx=0x7fa768009840 comp rx=0 tx=0).stop 2024-05-09T06:21:06.831 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 shutdown_connections 2024-05-09T06:21:06.832 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fa764036720 0x7fa764038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:06.832 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 --2- 172.21.15.46:0/3360168730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa778102c70 0x7fa7781137c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:06.832 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.313+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 >> 172.21.15.46:0/3360168730 conn(0x7fa7780fc6b0 msgr2=0x7fa7780fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:06.832 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.314+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 shutdown_connections 2024-05-09T06:21:06.832 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:06.314+0000 7fa77deb5700 1 -- 172.21.15.46:0/3360168730 wait complete. 2024-05-09T06:21:07.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:07 smithi046 ceph-mon[26924]: [09/May/2024:06:21:05] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:21:07.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:07 smithi046 ceph-mon[26924]: [09/May/2024:06:21:05] ENGINE Bus STARTED 2024-05-09T06:21:07.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:07 smithi046 ceph-mon[26924]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:07.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:07 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:07.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:07 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:07.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:07 smithi046 ceph-mon[26924]: mgrmap e8: smithi046.nvpcui(active, since 2s) 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ecf6700 1 Processor -- start 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ecf6700 1 -- start start 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ecf6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa581078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ecf6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581032b0 con 0x7faa58076bb0 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ca92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa581078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:08.026 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ca92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa581078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34332/0 (socket says 172.21.15.46:34332) 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.238+0000 7faa5ca92700 1 -- 172.21.15.46:0/3835935949 learned_addr learned my addr 172.21.15.46:0/3835935949 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.239+0000 7faa5ca92700 1 -- 172.21.15.46:0/3835935949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58107e00 con 0x7faa58076bb0 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.239+0000 7faa5ca92700 1 --2- 172.21.15.46:0/3835935949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa581078c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0098e0 tx=0x7faa4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a44c31aa7d0a49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.239+0000 7faa577fe700 1 -- 172.21.15.46:0/3835935949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa4c00b860 con 0x7faa58076bb0 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.239+0000 7faa577fe700 1 -- 172.21.15.46:0/3835935949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faa4c00be50 con 0x7faa58076bb0 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.239+0000 7faa577fe700 1 -- 172.21.15.46:0/3835935949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa4c010380 con 0x7faa58076bb0 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 -- 172.21.15.46:0/3835935949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 msgr2=0x7faa581078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 --2- 172.21.15.46:0/3835935949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa581078c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0098e0 tx=0x7faa4c009250 comp rx=0 tx=0).stop 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 -- 172.21.15.46:0/3835935949 shutdown_connections 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 --2- 172.21.15.46:0/3835935949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa581078c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 -- 172.21.15.46:0/3835935949 >> 172.21.15.46:0/3835935949 conn(0x7faa580fcef0 msgr2=0x7faa580ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 -- 172.21.15.46:0/3835935949 shutdown_connections 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 -- 172.21.15.46:0/3835935949 wait complete. 2024-05-09T06:21:08.027 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 Processor -- start 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.240+0000 7faa5ecf6700 1 -- start start 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ecf6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa58113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ecf6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58113d60 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ca92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa58113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ca92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa58113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34342/0 (socket says 172.21.15.46:34342) 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ca92700 1 -- 172.21.15.46:0/1377040091 learned_addr learned my addr 172.21.15.46:0/1377040091 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ca92700 1 -- 172.21.15.46:0/1377040091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0094f0 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ca92700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa58113820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faa4c006b00 tx=0x7faa4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa4c0107c0 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faa4c010db0 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa58113f60 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.241+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa4c01acf0 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.242+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa58114ad0 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.242+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7faa4c0193c0 con 0x7faa58076bb0 2024-05-09T06:21:08.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.242+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5805f5c0 con 0x7faa58076bb0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.243+0000 7faa557fa700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7faa480368a0 0x7faa48038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.243+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faa4c04a5b0 con 0x7faa58076bb0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.243+0000 7faa57fff700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7faa480368a0 0x7faa48038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.243+0000 7faa57fff700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7faa480368a0 0x7faa48038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa44009990 tx=0x7faa44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.248+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faa4c022700 con 0x7faa58076bb0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.446+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7faa580fe100 con 0x7faa480368a0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.446+0000 7faa557fa700 1 -- 172.21.15.46:0/1377040091 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7faa580fe100 con 0x7faa480368a0 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7faa480368a0 msgr2=0x7faa48038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7faa480368a0 0x7faa48038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa44009990 tx=0x7faa44006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 msgr2=0x7faa58113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa58113820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faa4c006b00 tx=0x7faa4c009250 comp rx=0 tx=0).stop 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 shutdown_connections 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7faa480368a0 0x7faa48038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:08.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 --2- 172.21.15.46:0/1377040091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa58076bb0 0x7faa58113820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:08.030 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 >> 172.21.15.46:0/1377040091 conn(0x7faa580fcef0 msgr2=0x7faa580fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:08.030 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 shutdown_connections 2024-05-09T06:21:08.030 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:07.449+0000 7faa5ecf6700 1 -- 172.21.15.46:0/1377040091 wait complete. 2024-05-09T06:21:08.030 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2024-05-09T06:21:08.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:08 smithi046 ceph-mon[26924]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.435+0000 7f41bc2c7700 1 Processor -- start 2024-05-09T06:21:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.435+0000 7f41bc2c7700 1 -- start start 2024-05-09T06:21:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.435+0000 7f41bc2c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.435+0000 7f41bc2c7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4079090 con 0x7f41b4078c80 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.435+0000 7f41ba063700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41ba063700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34344/0 (socket says 172.21.15.46:34344) 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41ba063700 1 -- 172.21.15.46:0/547477266 learned_addr learned my addr 172.21.15.46:0/547477266 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41ba063700 1 -- 172.21.15.46:0/547477266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4077770 con 0x7f41b4078c80 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41ba063700 1 --2- 172.21.15.46:0/547477266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4077230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009e50 tx=0x7f41a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4871dcb3382352 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41b9061700 1 -- 172.21.15.46:0/547477266 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41a40092e0 con 0x7f41b4078c80 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41b9061700 1 -- 172.21.15.46:0/547477266 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f41a4012430 con 0x7f41b4078c80 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.436+0000 7f41b9061700 1 -- 172.21.15.46:0/547477266 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41a40075c0 con 0x7f41b4078c80 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 -- 172.21.15.46:0/547477266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 msgr2=0x7f41b4077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 --2- 172.21.15.46:0/547477266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4077230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009e50 tx=0x7f41a4009840 comp rx=0 tx=0).stop 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 -- 172.21.15.46:0/547477266 shutdown_connections 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 --2- 172.21.15.46:0/547477266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4077230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 -- 172.21.15.46:0/547477266 >> 172.21.15.46:0/547477266 conn(0x7f41b40fe060 msgr2=0x7f41b4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 -- 172.21.15.46:0/547477266 shutdown_connections 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.437+0000 7f41bc2c7700 1 -- 172.21.15.46:0/547477266 wait complete. 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41bc2c7700 1 Processor -- start 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41bc2c7700 1 -- start start 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41bc2c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41bc2c7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4113d80 con 0x7f41b4078c80 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41ba063700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41ba063700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34358/0 (socket says 172.21.15.46:34358) 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41ba063700 1 -- 172.21.15.46:0/3037256329 learned_addr learned my addr 172.21.15.46:0/3037256329 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41ba063700 1 -- 172.21.15.46:0/3037256329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4009ae0 con 0x7f41b4078c80 2024-05-09T06:21:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41ba063700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4113840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009fd0 tx=0x7f41a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41a40092e0 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f41a4007d10 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.438+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b4113f80 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.439+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41a401c880 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.439+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b4114af0 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.439+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f41a4019070 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.440+0000 7f41b2ffd700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f419c036850 0x7f419c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.440+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b405f5c0 con 0x7f41b4078c80 2024-05-09T06:21:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.440+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f41a4049e20 con 0x7f41b4078c80 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.440+0000 7f41b9862700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f419c036850 0x7f419c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.440+0000 7f41b9862700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f419c036850 0x7f419c038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009990 tx=0x7f41a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.445+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f41a4017080 con 0x7f41b4078c80 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.641+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f41b40ff310 con 0x7f419c036850 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.967+0000 7f41b2ffd700 1 -- 172.21.15.46:0/3037256329 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f41b40ff310 con 0x7f419c036850 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.969+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f419c036850 msgr2=0x7f419c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.969+0000 7f41bc2c7700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f419c036850 0x7f419c038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009990 tx=0x7f41a8006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.969+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 msgr2=0x7f41b4113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.969+0000 7f41bc2c7700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4113840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009fd0 tx=0x7f41a4009840 comp rx=0 tx=0).stop 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.970+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 shutdown_connections 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.970+0000 7f41bc2c7700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f419c036850 0x7f419c038d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.970+0000 7f41bc2c7700 1 --2- 172.21.15.46:0/3037256329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b4078c80 0x7f41b4113840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.970+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 >> 172.21.15.46:0/3037256329 conn(0x7f41b40fe060 msgr2=0x7f41b40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:09.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.970+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 shutdown_connections 2024-05-09T06:21:09.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:08.970+0000 7f41bc2c7700 1 -- 172.21.15.46:0/3037256329 wait complete. 2024-05-09T06:21:10.187 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:09 smithi046 ceph-mon[26924]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:10.187 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:09 smithi046 ceph-mon[26924]: Generating ssh key... 2024-05-09T06:21:10.187 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:09 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:10.187 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:09 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:10.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxO1Xtjor1cJfKpe3YXp/qOtugj7Vo7XThhaV/PGgv/IqLjE3duzlRy9LKUCTTc1IP8uaAMy02o6ibJJO/0OF7ogjfzHK4YfUAuoFajDiJXsGQRPOZdrkPU/EvGDsYExFNJUwGhexg0zB/6zdJnlmt07OCXYTc8vJ1BBMsEjKj9cDKgHjK77LWG0+MvuWGxCEwl4h6K5UAEUTKbIjQjKhN8tBkdDdHOREguwQl9kFdibATW4LfSAAp76Aa2e8LkuC5w2pgkxY2zG2K/6RCJ8ttMUSe8gUcASXjE5bwqlE+0GzHzhImTZx/m9YPI9VujGO7DFolwTQNXsif/XuzEq+F+ThfHTUpr3bIA02y+60h4+srCKW1J46m9kCdO8PyeSP1m3+s5LDhVyT2dT0Cx4+Zszav+DAE846iokpPIzZK5QvjqOzFQPIVyEEpxxS3RXNA39UYAVA+iuw0JAbsis30FHxsw1sTEkJr+gzwAsj/XMVhR3q4Hix8tPGnpEnE/gs= ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:21:10.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f794a1bb700 1 Processor -- start 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f794a1bb700 1 -- start start 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f794a1bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f79441078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f794a1bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944071680 con 0x7f7944071270 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f79437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f79441078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f79437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f79441078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34362/0 (socket says 172.21.15.46:34362) 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.997+0000 7f79437fe700 1 -- 172.21.15.46:0/3989330557 learned_addr learned my addr 172.21.15.46:0/3989330557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.998+0000 7f79437fe700 1 -- 172.21.15.46:0/3989330557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79441032a0 con 0x7f7944071270 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.998+0000 7f79437fe700 1 --2- 172.21.15.46:0/3989330557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f79441078b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79340098e0 tx=0x7f7934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad665b3a80480d77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.998+0000 7f79427fc700 1 -- 172.21.15.46:0/3989330557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793400b860 con 0x7f7944071270 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.998+0000 7f79427fc700 1 -- 172.21.15.46:0/3989330557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f793400be50 con 0x7f7944071270 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.998+0000 7f79427fc700 1 -- 172.21.15.46:0/3989330557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7934010380 con 0x7f7944071270 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 -- 172.21.15.46:0/3989330557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 msgr2=0x7f79441078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 --2- 172.21.15.46:0/3989330557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f79441078b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79340098e0 tx=0x7f7934009250 comp rx=0 tx=0).stop 2024-05-09T06:21:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 -- 172.21.15.46:0/3989330557 shutdown_connections 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 --2- 172.21.15.46:0/3989330557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f79441078b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 -- 172.21.15.46:0/3989330557 >> 172.21.15.46:0/3989330557 conn(0x7f79440fcec0 msgr2=0x7f79440ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 -- 172.21.15.46:0/3989330557 shutdown_connections 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 -- 172.21.15.46:0/3989330557 wait complete. 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 Processor -- start 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:09.999+0000 7f794a1bb700 1 -- start start 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f794a1bb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f7944113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f794a1bb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944113cd0 con 0x7f7944071270 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f79437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f7944113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:10.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f79437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f7944113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34376/0 (socket says 172.21.15.46:34376) 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f79437fe700 1 -- 172.21.15.46:0/1139017889 learned_addr learned my addr 172.21.15.46:0/1139017889 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f79437fe700 1 -- 172.21.15.46:0/1139017889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340094f0 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f79437fe700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f7944113790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7934003050 tx=0x7f7934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7934010760 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7934010d50 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7944113f30 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7944114a40 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.000+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f793401adb0 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.001+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f793402e440 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.002+0000 7f793bfff700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f79300368a0 0x7f7930038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.002+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f793401a430 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.002+0000 7f7942ffd700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f79300368a0 0x7f7930038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.002+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794405f5c0 con 0x7f7944071270 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.002+0000 7f7942ffd700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f79300368a0 0x7f7930038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f792c009990 tx=0x7f792c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:10.767 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.006+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f793404ae60 con 0x7f7944071270 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.204+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f79440fe0b0 con 0x7f79300368a0 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.205+0000 7f793bfff700 1 -- 172.21.15.46:0/1139017889 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f79440fe0b0 con 0x7f79300368a0 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f79300368a0 msgr2=0x7f7930038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f79300368a0 0x7f7930038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f792c009990 tx=0x7f792c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 msgr2=0x7f7944113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f7944113790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7934003050 tx=0x7f7934009250 comp rx=0 tx=0).stop 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 shutdown_connections 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f79300368a0 0x7f7930038d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 --2- 172.21.15.46:0/1139017889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944071270 0x7f7944113790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 >> 172.21.15.46:0/1139017889 conn(0x7f79440fcec0 msgr2=0x7f79440fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:10.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 shutdown_connections 2024-05-09T06:21:10.769 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:10.207+0000 7f794a1bb700 1 -- 172.21.15.46:0/1139017889 wait complete. 2024-05-09T06:21:10.769 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:21:10.769 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2024-05-09T06:21:10.769 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2024-05-09T06:21:11.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:10 smithi046 ceph-mon[26924]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:12.007 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:11 smithi046 ceph-mon[26924]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:12 smithi046 ceph-mon[26924]: Deploying cephadm binary to smithi046 2024-05-09T06:21:13.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2024-05-09T06:21:13.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.181+0000 7f003bef5700 1 Processor -- start 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.181+0000 7f003bef5700 1 -- start start 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.181+0000 7f003bef5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.181+0000 7f003bef5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034105980 con 0x7f0034076c10 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0039c91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0039c91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36164/0 (socket says 172.21.15.46:36164) 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0039c91700 1 -- 172.21.15.46:0/4251954953 learned_addr learned my addr 172.21.15.46:0/4251954953 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0039c91700 1 -- 172.21.15.46:0/4251954953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034105ac0 con 0x7f0034076c10 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0039c91700 1 --2- 172.21.15.46:0/4251954953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034105440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00300098e0 tx=0x7f0030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2600f3a878f6527d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0038c8f700 1 -- 172.21.15.46:0/4251954953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f003000b860 con 0x7f0034076c10 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0038c8f700 1 -- 172.21.15.46:0/4251954953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f003000be50 con 0x7f0034076c10 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.182+0000 7f0038c8f700 1 -- 172.21.15.46:0/4251954953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0030010380 con 0x7f0034076c10 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 -- 172.21.15.46:0/4251954953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 msgr2=0x7f0034105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:13.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 --2- 172.21.15.46:0/4251954953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034105440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00300098e0 tx=0x7f0030009250 comp rx=0 tx=0).stop 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 -- 172.21.15.46:0/4251954953 shutdown_connections 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 --2- 172.21.15.46:0/4251954953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034105440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 -- 172.21.15.46:0/4251954953 >> 172.21.15.46:0/4251954953 conn(0x7f00340fcef0 msgr2=0x7f00340ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 -- 172.21.15.46:0/4251954953 shutdown_connections 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.183+0000 7f003bef5700 1 -- 172.21.15.46:0/4251954953 wait complete. 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f003bef5700 1 Processor -- start 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f003bef5700 1 -- start start 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f003bef5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f003bef5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034111ad0 con 0x7f0034076c10 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f0039c91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f0039c91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36170/0 (socket says 172.21.15.46:36170) 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f0039c91700 1 -- 172.21.15.46:0/4098845823 learned_addr learned my addr 172.21.15.46:0/4098845823 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f0039c91700 1 -- 172.21.15.46:0/4098845823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300094f0 con 0x7f0034076c10 2024-05-09T06:21:13.925 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.184+0000 7f0039c91700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034111590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0030006b00 tx=0x7f0030009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.185+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00300107c0 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.185+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0034111d30 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.185+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0030010db0 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.185+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f003001acf0 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.185+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0034112840 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.186+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f00300193c0 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.186+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003405f5c0 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.186+0000 7f002a7fc700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0020036850 0x7f0020038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.186+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f003004a710 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.186+0000 7f0039490700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0020036850 0x7f0020038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.186+0000 7f0039490700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0020036850 0x7f0020038d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0024009990 tx=0x7f0024006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.191+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0030019be0 con 0x7f0034076c10 2024-05-09T06:21:13.926 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:11.392+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}) v1 -- 0x7f00340fe0e0 con 0x7f0020036850 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.321+0000 7f002a7fc700 1 -- 172.21.15.46:0/4098845823 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f00340fe0e0 con 0x7f0020036850 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0020036850 msgr2=0x7f0020038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0020036850 0x7f0020038d00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0024009990 tx=0x7f0024006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 msgr2=0x7f0034111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034111590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0030006b00 tx=0x7f0030009250 comp rx=0 tx=0).stop 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 shutdown_connections 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f0020036850 0x7f0020038d00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 --2- 172.21.15.46:0/4098845823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0034076c10 0x7f0034111590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 >> 172.21.15.46:0/4098845823 conn(0x7f00340fcef0 msgr2=0x7f00340fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 shutdown_connections 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:13.324+0000 7f003bef5700 1 -- 172.21.15.46:0/4098845823 wait complete. 2024-05-09T06:21:13.927 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mon service with default placement... 2024-05-09T06:21:14.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:14 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:14.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:14 smithi046 ceph-mon[26924]: Added host smithi046 2024-05-09T06:21:14.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:14 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.357+0000 7f9df0ad2700 1 Processor -- start 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.357+0000 7f9df0ad2700 1 -- start start 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9df0ad2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9df0ad2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec103200 con 0x7f9dec1028b0 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9dea59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9dea59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36186/0 (socket says 172.21.15.46:36186) 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9dea59c700 1 -- 172.21.15.46:0/2800116491 learned_addr learned my addr 172.21.15.46:0/2800116491 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9dea59c700 1 -- 172.21.15.46:0/2800116491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec103340 con 0x7f9dec1028b0 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9dea59c700 1 --2- 172.21.15.46:0/2800116491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec102cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0098e0 tx=0x7f9ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5697daeabff70 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:15.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.358+0000 7f9de959a700 1 -- 172.21.15.46:0/2800116491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc00b860 con 0x7f9dec1028b0 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9de959a700 1 -- 172.21.15.46:0/2800116491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9ddc00be50 con 0x7f9dec1028b0 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9de959a700 1 -- 172.21.15.46:0/2800116491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc010380 con 0x7f9dec1028b0 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 -- 172.21.15.46:0/2800116491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 msgr2=0x7f9dec102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 --2- 172.21.15.46:0/2800116491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec102cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0098e0 tx=0x7f9ddc009250 comp rx=0 tx=0).stop 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 -- 172.21.15.46:0/2800116491 shutdown_connections 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 --2- 172.21.15.46:0/2800116491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec102cc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 -- 172.21.15.46:0/2800116491 >> 172.21.15.46:0/2800116491 conn(0x7f9dec0fdff0 msgr2=0x7f9dec100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 -- 172.21.15.46:0/2800116491 shutdown_connections 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.359+0000 7f9df0ad2700 1 -- 172.21.15.46:0/2800116491 wait complete. 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9df0ad2700 1 Processor -- start 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9df0ad2700 1 -- start start 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9df0ad2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec077b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9df0ad2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec078050 con 0x7f9dec1028b0 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9dea59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec077b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9dea59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec077b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36192/0 (socket says 172.21.15.46:36192) 2024-05-09T06:21:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9dea59c700 1 -- 172.21.15.46:0/1690512771 learned_addr learned my addr 172.21.15.46:0/1690512771 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9dea59c700 1 -- 172.21.15.46:0/1690512771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0094f0 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.360+0000 7f9dea59c700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec077b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00b440 tx=0x7f9ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.361+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc010760 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.361+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9ddc010d50 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.361+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec0760c0 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.361+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ddc01ae20 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.361+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec0765b0 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.362+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f9ddc0108c0 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.362+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec04bed0 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.362+0000 7f9ddaffd700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f9dd40368a0 0x7f9dd4038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.362+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9ddc04a570 con 0x7f9dec1028b0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.362+0000 7f9de9d9b700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f9dd40368a0 0x7f9dd4038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.362+0000 7f9de9d9b700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f9dd40368a0 0x7f9dd4038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009990 tx=0x7f9de0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:15.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.367+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9ddc018530 con 0x7f9dec1028b0 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.578+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dec076cb0 con 0x7f9dd40368a0 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.583+0000 7f9ddaffd700 1 -- 172.21.15.46:0/1690512771 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9dec076cb0 con 0x7f9dd40368a0 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f9dd40368a0 msgr2=0x7f9dd4038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f9dd40368a0 0x7f9dd4038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009990 tx=0x7f9de0006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 msgr2=0x7f9dec077b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec077b10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00b440 tx=0x7f9ddc009250 comp rx=0 tx=0).stop 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 shutdown_connections 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f9dd40368a0 0x7f9dd4038d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 --2- 172.21.15.46:0/1690512771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dec1028b0 0x7f9dec077b10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.585+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 >> 172.21.15.46:0/1690512771 conn(0x7f9dec0fdff0 msgr2=0x7f9dec0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.586+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 shutdown_connections 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:14.586+0000 7f9df0ad2700 1 -- 172.21.15.46:0/1690512771 wait complete. 2024-05-09T06:21:15.327 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mgr service with default placement... 2024-05-09T06:21:15.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:15 smithi046 ceph-mon[26924]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:15.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:15 smithi046 ceph-mon[26924]: Saving service mon spec with placement count:5 2024-05-09T06:21:15.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:15 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:17 smithi046 ceph-mon[26924]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:17 smithi046 ceph-mon[26924]: Saving service mgr spec with placement count:2 2024-05-09T06:21:17.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:17 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:17.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:17 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.817+0000 7fd67a029700 1 Processor -- start 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.817+0000 7fd67a029700 1 -- start start 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd67a029700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd67a029700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6741032a0 con 0x7fd674071290 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd6737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd6737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36208/0 (socket says 172.21.15.46:36208) 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd6737fe700 1 -- 172.21.15.46:0/4185602047 learned_addr learned my addr 172.21.15.46:0/4185602047 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd6737fe700 1 -- 172.21.15.46:0/4185602047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674107df0 con 0x7fd674071290 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.818+0000 7fd6737fe700 1 --2- 172.21.15.46:0/4185602047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741078b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6640098e0 tx=0x7fd664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf19afcb628afa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:17.400 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd672ffd700 1 -- 172.21.15.46:0/4185602047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd66400b860 con 0x7fd674071290 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd672ffd700 1 -- 172.21.15.46:0/4185602047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd66400be50 con 0x7fd674071290 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd672ffd700 1 -- 172.21.15.46:0/4185602047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd664010380 con 0x7fd674071290 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 -- 172.21.15.46:0/4185602047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 msgr2=0x7fd6741078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 --2- 172.21.15.46:0/4185602047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741078b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6640098e0 tx=0x7fd664009250 comp rx=0 tx=0).stop 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 -- 172.21.15.46:0/4185602047 shutdown_connections 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 --2- 172.21.15.46:0/4185602047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741078b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 -- 172.21.15.46:0/4185602047 >> 172.21.15.46:0/4185602047 conn(0x7fd6740fcea0 msgr2=0x7fd6740ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 -- 172.21.15.46:0/4185602047 shutdown_connections 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.819+0000 7fd67a029700 1 -- 172.21.15.46:0/4185602047 wait complete. 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd67a029700 1 Processor -- start 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd67a029700 1 -- start start 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd67a029700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd67a029700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd674113d20 con 0x7fd674071290 2024-05-09T06:21:17.401 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd6737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd6737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36210/0 (socket says 172.21.15.46:36210) 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd6737fe700 1 -- 172.21.15.46:0/2067242226 learned_addr learned my addr 172.21.15.46:0/2067242226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.820+0000 7fd6737fe700 1 -- 172.21.15.46:0/2067242226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640094f0 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.821+0000 7fd6737fe700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741137e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd664003050 tx=0x7fd664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.821+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd664010760 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.821+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd664010d50 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.821+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd66401ae20 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.821+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd674113f20 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.822+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd674114a90 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.822+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd66401a430 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.822+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67405f5c0 con 0x7fd674071290 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.823+0000 7fd670ff9700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fd660036520 0x7fd6600389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:17.402 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.823+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd66404a810 con 0x7fd674071290 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.823+0000 7fd66bfff700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fd660036520 0x7fd6600389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.823+0000 7fd66bfff700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fd660036520 0x7fd6600389d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009990 tx=0x7fd65c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:15.828+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd664018920 con 0x7fd674071290 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.041+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6740fe100 con 0x7fd660036520 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.045+0000 7fd670ff9700 1 -- 172.21.15.46:0/2067242226 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd6740fe100 con 0x7fd660036520 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fd660036520 msgr2=0x7fd6600389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fd660036520 0x7fd6600389d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009990 tx=0x7fd65c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 msgr2=0x7fd6741137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741137e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd664003050 tx=0x7fd664009250 comp rx=0 tx=0).stop 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 shutdown_connections 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fd660036520 0x7fd6600389d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 --2- 172.21.15.46:0/2067242226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674071290 0x7fd6741137e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 >> 172.21.15.46:0/2067242226 conn(0x7fd6740fcea0 msgr2=0x7fd6740fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:17.403 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 shutdown_connections 2024-05-09T06:21:17.404 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:16.048+0000 7fd67a029700 1 -- 172.21.15.46:0/2067242226 wait complete. 2024-05-09T06:21:17.404 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying crash service with default placement... 2024-05-09T06:21:18.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:18 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:18.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:18 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.842+0000 7f70d4a5c700 1 Processor -- start 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.842+0000 7f70d4a5c700 1 -- start start 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.842+0000 7f70d4a5c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0102c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.842+0000 7f70d4a5c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d01031a0 con 0x7f70d0102850 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36214/0 (socket says 172.21.15.46:36214) 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70ce59c700 1 -- 172.21.15.46:0/2790465782 learned_addr learned my addr 172.21.15.46:0/2790465782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70ce59c700 1 -- 172.21.15.46:0/2790465782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d01032e0 con 0x7f70d0102850 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70ce59c700 1 --2- 172.21.15.46:0/2790465782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0102c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70c00098e0 tx=0x7f70c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7f5ba5a8ba451f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70cd59a700 1 -- 172.21.15.46:0/2790465782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70c000b860 con 0x7f70d0102850 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70cd59a700 1 -- 172.21.15.46:0/2790465782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70c000be90 con 0x7f70d0102850 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.843+0000 7f70cd59a700 1 -- 172.21.15.46:0/2790465782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70c00103c0 con 0x7f70d0102850 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 -- 172.21.15.46:0/2790465782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 msgr2=0x7f70d0102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 --2- 172.21.15.46:0/2790465782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0102c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70c00098e0 tx=0x7f70c0009250 comp rx=0 tx=0).stop 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 -- 172.21.15.46:0/2790465782 shutdown_connections 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 --2- 172.21.15.46:0/2790465782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0102c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 -- 172.21.15.46:0/2790465782 >> 172.21.15.46:0/2790465782 conn(0x7f70d00fdf90 msgr2=0x7f70d01003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 -- 172.21.15.46:0/2790465782 shutdown_connections 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 -- 172.21.15.46:0/2790465782 wait complete. 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 Processor -- start 2024-05-09T06:21:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.844+0000 7f70d4a5c700 1 -- start start 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70d4a5c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0111610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70d4a5c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0111b50 con 0x7f70d0102850 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0111610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0111610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36230/0 (socket says 172.21.15.46:36230) 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70ce59c700 1 -- 172.21.15.46:0/1229917608 learned_addr learned my addr 172.21.15.46:0/1229917608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70ce59c700 1 -- 172.21.15.46:0/1229917608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00094f0 con 0x7f70d0102850 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70ce59c700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0111610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70c0011680 tx=0x7f70c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70c0010890 con 0x7f70d0102850 2024-05-09T06:21:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70c0010ec0 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0111d50 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70c00243f0 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.845+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d01128c0 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.846+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f70c002d3f0 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.846+0000 7f70beffd700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f70b80368a0 0x7f70b8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.846+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f70c004a210 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.846+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d005f5c0 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.847+0000 7f70cdd9b700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f70b80368a0 0x7f70b8038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.847+0000 7f70cdd9b700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f70b80368a0 0x7f70b8038d50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009990 tx=0x7f70c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:17.851+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f70c002b8e0 con 0x7f70d0102850 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.073+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f70d00ff170 con 0x7f70b80368a0 2024-05-09T06:21:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.078+0000 7f70beffd700 1 -- 172.21.15.46:0/1229917608 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f70d00ff170 con 0x7f70b80368a0 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f70b80368a0 msgr2=0x7f70b8038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f70b80368a0 0x7f70b8038d50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009990 tx=0x7f70c4006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 msgr2=0x7f70d0111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0111610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70c0011680 tx=0x7f70c0009250 comp rx=0 tx=0).stop 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 shutdown_connections 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f70b80368a0 0x7f70b8038d50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 --2- 172.21.15.46:0/1229917608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d0102850 0x7f70d0111610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 >> 172.21.15.46:0/1229917608 conn(0x7f70d00fdf90 msgr2=0x7f70d00fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 shutdown_connections 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:18.080+0000 7f70d4a5c700 1 -- 172.21.15.46:0/1229917608 wait complete. 2024-05-09T06:21:19.101 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying prometheus service with default placement... 2024-05-09T06:21:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:19 smithi046 ceph-mon[26924]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:19 smithi046 ceph-mon[26924]: Saving service crash spec with placement * 2024-05-09T06:21:20.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-05-09T06:21:20.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.554+0000 7f3f81c05700 1 Processor -- start 2024-05-09T06:21:20.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.554+0000 7f3f81c05700 1 -- start start 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.554+0000 7f3f81c05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c105460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.554+0000 7f3f81c05700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1059a0 con 0x7f3f7c076c10 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.554+0000 7f3f7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c105460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.554+0000 7f3f7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c105460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36242/0 (socket says 172.21.15.46:36242) 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.555+0000 7f3f7b7fe700 1 -- 172.21.15.46:0/2455809223 learned_addr learned my addr 172.21.15.46:0/2455809223 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.555+0000 7f3f7b7fe700 1 -- 172.21.15.46:0/2455809223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c105ae0 con 0x7f3f7c076c10 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.555+0000 7f3f7b7fe700 1 --2- 172.21.15.46:0/2455809223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c105460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009e50 tx=0x7f3f6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8735e12127c94cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.555+0000 7f3f7a7fc700 1 -- 172.21.15.46:0/2455809223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c0092e0 con 0x7f3f7c076c10 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.555+0000 7f3f7a7fc700 1 -- 172.21.15.46:0/2455809223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f6c012430 con 0x7f3f7c076c10 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.555+0000 7f3f7a7fc700 1 -- 172.21.15.46:0/2455809223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c0075c0 con 0x7f3f7c076c10 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 -- 172.21.15.46:0/2455809223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 msgr2=0x7f3f7c105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 --2- 172.21.15.46:0/2455809223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c105460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009e50 tx=0x7f3f6c009840 comp rx=0 tx=0).stop 2024-05-09T06:21:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 -- 172.21.15.46:0/2455809223 shutdown_connections 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 --2- 172.21.15.46:0/2455809223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c105460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 -- 172.21.15.46:0/2455809223 >> 172.21.15.46:0/2455809223 conn(0x7f3f7c0fcef0 msgr2=0x7f3f7c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 -- 172.21.15.46:0/2455809223 shutdown_connections 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 -- 172.21.15.46:0/2455809223 wait complete. 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.556+0000 7f3f81c05700 1 Processor -- start 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f81c05700 1 -- start start 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f81c05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c102db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f81c05700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1032f0 con 0x7f3f7c076c10 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36246/0 (socket says 172.21.15.46:36246) 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f7b7fe700 1 -- 172.21.15.46:0/2915267601 learned_addr learned my addr 172.21.15.46:0/2915267601 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f7b7fe700 1 -- 172.21.15.46:0/2915267601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009ae0 con 0x7f3f7c076c10 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f7b7fe700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c102db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009e20 tx=0x7f3f6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c0092e0 con 0x7f3f7c076c10 2024-05-09T06:21:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f6c007d50 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c101360 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.557+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c025970 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.558+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c101850 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.559+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f3f6c019050 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.559+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c04bed0 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.559+0000 7f3f73fff700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f3f68036850 0x7f3f68038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.559+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3f6c04a120 con 0x7f3f7c076c10 2024-05-09T06:21:20.364 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.559+0000 7f3f7affd700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f3f68036850 0x7f3f68038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.559+0000 7f3f7affd700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f3f68036850 0x7f3f68038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009990 tx=0x7f3f64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.564+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3f6c011570 con 0x7f3f7c076c10 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.774+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f7c102010 con 0x7f3f68036850 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.778+0000 7f3f73fff700 1 -- 172.21.15.46:0/2915267601 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f3f7c102010 con 0x7f3f68036850 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f3f68036850 msgr2=0x7f3f68038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f3f68036850 0x7f3f68038d00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009990 tx=0x7f3f64006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 msgr2=0x7f3f7c102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c102db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009e20 tx=0x7f3f6c009840 comp rx=0 tx=0).stop 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 shutdown_connections 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f3f68036850 0x7f3f68038d00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 --2- 172.21.15.46:0/2915267601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f7c076c10 0x7f3f7c102db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 >> 172.21.15.46:0/2915267601 conn(0x7f3f7c0fcef0 msgr2=0x7f3f7c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.780+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 shutdown_connections 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:19.781+0000 7f3f81c05700 1 -- 172.21.15.46:0/2915267601 wait complete. 2024-05-09T06:21:20.365 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying grafana service with default placement... 2024-05-09T06:21:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:20 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:20 smithi046 ceph-mon[26924]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:20 smithi046 ceph-mon[26924]: Saving service prometheus spec with placement count:1 2024-05-09T06:21:20.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:20 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:21.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-05-09T06:21:21.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.943+0000 7ffac769e700 1 Processor -- start 2024-05-09T06:21:21.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.943+0000 7ffac769e700 1 -- start start 2024-05-09T06:21:21.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.943+0000 7ffac769e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac0102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:21.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.943+0000 7ffac769e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0103160 con 0x7ffac0102810 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffac543a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac0102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffac543a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac0102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37540/0 (socket says 172.21.15.46:37540) 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffac543a700 1 -- 172.21.15.46:0/2876902135 learned_addr learned my addr 172.21.15.46:0/2876902135 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffac543a700 1 -- 172.21.15.46:0/2876902135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac01032a0 con 0x7ffac0102810 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffac543a700 1 --2- 172.21.15.46:0/2876902135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac0102c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0098e0 tx=0x7ffabc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f828aa648af9931 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffab7fff700 1 -- 172.21.15.46:0/2876902135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffabc00b860 con 0x7ffac0102810 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffab7fff700 1 -- 172.21.15.46:0/2876902135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffabc00be90 con 0x7ffac0102810 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.944+0000 7ffab7fff700 1 -- 172.21.15.46:0/2876902135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffabc0103c0 con 0x7ffac0102810 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 -- 172.21.15.46:0/2876902135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 msgr2=0x7ffac0102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 --2- 172.21.15.46:0/2876902135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac0102c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0098e0 tx=0x7ffabc009250 comp rx=0 tx=0).stop 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 -- 172.21.15.46:0/2876902135 shutdown_connections 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 --2- 172.21.15.46:0/2876902135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac0102c20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 -- 172.21.15.46:0/2876902135 >> 172.21.15.46:0/2876902135 conn(0x7ffac00fdfd0 msgr2=0x7ffac01003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:21.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 -- 172.21.15.46:0/2876902135 shutdown_connections 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 -- 172.21.15.46:0/2876902135 wait complete. 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.945+0000 7ffac769e700 1 Processor -- start 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac769e700 1 -- start start 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac769e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac01116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac769e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac0111c00 con 0x7ffac0102810 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac543a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac01116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac543a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac01116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37556/0 (socket says 172.21.15.46:37556) 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac543a700 1 -- 172.21.15.46:0/2673285814 learned_addr learned my addr 172.21.15.46:0/2673285814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac543a700 1 -- 172.21.15.46:0/2673285814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0094f0 con 0x7ffac0102810 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac543a700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac01116c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffabc011c10 tx=0x7ffabc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffabc010890 con 0x7ffac0102810 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac0111e00 con 0x7ffac0102810 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffabc010ec0 con 0x7ffac0102810 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.946+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffabc0243f0 con 0x7ffac0102810 2024-05-09T06:21:21.764 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.947+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0112970 con 0x7ffac0102810 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.947+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ffabc0109f0 con 0x7ffac0102810 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.947+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac005f5c0 con 0x7ffac0102810 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.948+0000 7ffab5ffb700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7ffaac036850 0x7ffaac038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.948+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffabc04a210 con 0x7ffac0102810 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.948+0000 7ffac4c39700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7ffaac036850 0x7ffaac038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.948+0000 7ffac4c39700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7ffaac036850 0x7ffaac038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009990 tx=0x7ffab0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:20.952+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffabc01a7a0 con 0x7ffac0102810 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.167+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7ffac00ff230 con 0x7ffaac036850 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.171+0000 7ffab5ffb700 1 -- 172.21.15.46:0/2673285814 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ffac00ff230 con 0x7ffaac036850 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7ffaac036850 msgr2=0x7ffaac038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7ffaac036850 0x7ffaac038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009990 tx=0x7ffab0006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 msgr2=0x7ffac01116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac01116c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffabc011c10 tx=0x7ffabc009250 comp rx=0 tx=0).stop 2024-05-09T06:21:21.765 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 shutdown_connections 2024-05-09T06:21:21.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7ffaac036850 0x7ffaac038d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:21.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 --2- 172.21.15.46:0/2673285814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffac0102810 0x7ffac01116c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:21.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 >> 172.21.15.46:0/2673285814 conn(0x7ffac00fdfd0 msgr2=0x7ffac00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:21.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 shutdown_connections 2024-05-09T06:21:21.766 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:21.173+0000 7ffac769e700 1 -- 172.21.15.46:0/2673285814 wait complete. 2024-05-09T06:21:21.766 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying node-exporter service with default placement... 2024-05-09T06:21:21.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:21 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:21.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:21 smithi046 ceph-mon[26924]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:21.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:21 smithi046 ceph-mon[26924]: Saving service grafana spec with placement count:1 2024-05-09T06:21:21.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:21 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f587d2a9700 1 Processor -- start 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f587d2a9700 1 -- start start 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f587d2a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f5878077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f587d2a9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878079110 con 0x7f5878078d00 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f5876ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f5878077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f5876ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f5878077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37570/0 (socket says 172.21.15.46:37570) 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.541+0000 7f5876ffd700 1 -- 172.21.15.46:0/1890698825 learned_addr learned my addr 172.21.15.46:0/1890698825 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.542+0000 7f5876ffd700 1 -- 172.21.15.46:0/1890698825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878077750 con 0x7f5878078d00 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.542+0000 7f5876ffd700 1 --2- 172.21.15.46:0/1890698825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f5878077210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58680098e0 tx=0x7f5868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add29aa404055ee5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:23.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.542+0000 7f58767fc700 1 -- 172.21.15.46:0/1890698825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f586800b860 con 0x7f5878078d00 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.542+0000 7f58767fc700 1 -- 172.21.15.46:0/1890698825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f586800be90 con 0x7f5878078d00 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.542+0000 7f58767fc700 1 -- 172.21.15.46:0/1890698825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58680103c0 con 0x7f5878078d00 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 -- 172.21.15.46:0/1890698825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 msgr2=0x7f5878077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 --2- 172.21.15.46:0/1890698825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f5878077210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f58680098e0 tx=0x7f5868009250 comp rx=0 tx=0).stop 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 -- 172.21.15.46:0/1890698825 shutdown_connections 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 --2- 172.21.15.46:0/1890698825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f5878077210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 -- 172.21.15.46:0/1890698825 >> 172.21.15.46:0/1890698825 conn(0x7f58780fdfd0 msgr2=0x7f58781003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 -- 172.21.15.46:0/1890698825 shutdown_connections 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 -- 172.21.15.46:0/1890698825 wait complete. 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.543+0000 7f587d2a9700 1 Processor -- start 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f587d2a9700 1 -- start start 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f587d2a9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f58781138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f587d2a9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878113e00 con 0x7f5878078d00 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f5876ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f58781138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:23.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f5876ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f58781138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37580/0 (socket says 172.21.15.46:37580) 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f5876ffd700 1 -- 172.21.15.46:0/1226384483 learned_addr learned my addr 172.21.15.46:0/1226384483 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f5876ffd700 1 -- 172.21.15.46:0/1226384483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680094f0 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f5876ffd700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f58781138c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58680105b0 tx=0x7f5868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5868010840 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.544+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5878114000 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.545+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5868010e70 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.545+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f586801ae30 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.545+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5878114b70 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.546+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f586802d3f0 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.546+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587805f5c0 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.546+0000 7f586ffff700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f5864036850 0x7f5864038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.546+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f586804a310 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.546+0000 7f586e7fc700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f5864036850 0x7f5864038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.546+0000 7f586e7fc700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f5864036850 0x7f5864038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5860009990 tx=0x7f5860006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.551+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f586802b8e0 con 0x7f5878078d00 2024-05-09T06:21:23.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.759+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f58780ff260 con 0x7f5864036850 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.764+0000 7f586ffff700 1 -- 172.21.15.46:0/1226384483 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f58780ff260 con 0x7f5864036850 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f5864036850 msgr2=0x7f5864038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f5864036850 0x7f5864038d00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5860009990 tx=0x7f5860006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 msgr2=0x7f58781138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f58781138c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58680105b0 tx=0x7f5868009250 comp rx=0 tx=0).stop 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 shutdown_connections 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f5864036850 0x7f5864038d00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 --2- 172.21.15.46:0/1226384483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5878078d00 0x7f58781138c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 >> 172.21.15.46:0/1226384483 conn(0x7f58780fdfd0 msgr2=0x7f58780feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 shutdown_connections 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:22.766+0000 7f587d2a9700 1 -- 172.21.15.46:0/1226384483 wait complete. 2024-05-09T06:21:23.442 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying alertmanager service with default placement... 2024-05-09T06:21:23.796 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:23 smithi046 ceph-mon[26924]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:23.796 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:23 smithi046 ceph-mon[26924]: Saving service node-exporter spec with placement * 2024-05-09T06:21:23.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:23 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:24.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b95ec700 1 Processor -- start 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b95ec700 1 -- start start 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b95ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4102c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b95ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b4103160 con 0x7f11b4102810 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4102c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37582/0 (socket says 172.21.15.46:37582) 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b2ffd700 1 -- 172.21.15.46:0/155905738 learned_addr learned my addr 172.21.15.46:0/155905738 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:24.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.813+0000 7f11b2ffd700 1 -- 172.21.15.46:0/155905738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b41032a0 con 0x7f11b4102810 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b2ffd700 1 --2- 172.21.15.46:0/155905738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4102c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11a40098e0 tx=0x7f11a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a1d52898deb685 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b1ffb700 1 -- 172.21.15.46:0/155905738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11a400b860 con 0x7f11b4102810 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b1ffb700 1 -- 172.21.15.46:0/155905738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11a400be90 con 0x7f11b4102810 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b1ffb700 1 -- 172.21.15.46:0/155905738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11a40103c0 con 0x7f11b4102810 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b95ec700 1 -- 172.21.15.46:0/155905738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 msgr2=0x7f11b4102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b95ec700 1 --2- 172.21.15.46:0/155905738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4102c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11a40098e0 tx=0x7f11a4009250 comp rx=0 tx=0).stop 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b95ec700 1 -- 172.21.15.46:0/155905738 shutdown_connections 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b95ec700 1 --2- 172.21.15.46:0/155905738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4102c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.814+0000 7f11b95ec700 1 -- 172.21.15.46:0/155905738 >> 172.21.15.46:0/155905738 conn(0x7f11b40fdfd0 msgr2=0x7f11b41003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.815+0000 7f11b95ec700 1 -- 172.21.15.46:0/155905738 shutdown_connections 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.815+0000 7f11b95ec700 1 -- 172.21.15.46:0/155905738 wait complete. 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.815+0000 7f11b95ec700 1 Processor -- start 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.815+0000 7f11b95ec700 1 -- start start 2024-05-09T06:21:24.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b95ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b95ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b4079160 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37598/0 (socket says 172.21.15.46:37598) 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b2ffd700 1 -- 172.21.15.46:0/1321814464 learned_addr learned my addr 172.21.15.46:0/1321814464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b2ffd700 1 -- 172.21.15.46:0/1321814464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40094f0 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b2ffd700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4078c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11a4011c10 tx=0x7f11a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11a4010890 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11a4010ec0 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b40771d0 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11a40243f0 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.816+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40776c0 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.817+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f11a402d3f0 con 0x7f11b4102810 2024-05-09T06:21:24.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.817+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b404bed0 con 0x7f11b4102810 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.817+0000 7f119b7fe700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f119c0368a0 0x7f119c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.817+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f11a404a450 con 0x7f11b4102810 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.818+0000 7f11b27fc700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f119c0368a0 0x7f119c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.818+0000 7f11b27fc700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f119c0368a0 0x7f119c038d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009990 tx=0x7f11a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:23.822+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f11a402b8e0 con 0x7f11b4102810 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.028+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f11b4077e80 con 0x7f119c0368a0 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.032+0000 7f119b7fe700 1 -- 172.21.15.46:0/1321814464 <== mgr.14120 v2:172.21.15.46:6800/3381519426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f11b4077e80 con 0x7f119c0368a0 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f119c0368a0 msgr2=0x7f119c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f119c0368a0 0x7f119c038d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009990 tx=0x7f11a8006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 msgr2=0x7f11b4078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4078c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11a4011c10 tx=0x7f11a4009250 comp rx=0 tx=0).stop 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 shutdown_connections 2024-05-09T06:21:24.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f119c0368a0 0x7f119c038d50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:24.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 --2- 172.21.15.46:0/1321814464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11b4102810 0x7f11b4078c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:24.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 >> 172.21.15.46:0/1321814464 conn(0x7f11b40fdfd0 msgr2=0x7f11b40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:24.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 shutdown_connections 2024-05-09T06:21:24.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.034+0000 7f11b95ec700 1 -- 172.21.15.46:0/1321814464 wait complete. 2024-05-09T06:21:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:25 smithi046 ceph-mon[26924]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:25 smithi046 ceph-mon[26924]: Saving service alertmanager spec with placement count:1 2024-05-09T06:21:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:25 smithi046 ceph-mon[26924]: from='mgr.14120 172.21.15.46:0/102538923' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:25 smithi046 ceph-mon[26924]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.970+0000 7f6982134700 1 Processor -- start 2024-05-09T06:21:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.970+0000 7f6982134700 1 -- start start 2024-05-09T06:21:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f6982134700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f6982134700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c079020 con 0x7f697c078c10 2024-05-09T06:21:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:25.650 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37602/0 (socket says 172.21.15.46:37602) 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697b7fe700 1 -- 172.21.15.46:0/701594853 learned_addr learned my addr 172.21.15.46:0/701594853 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697b7fe700 1 -- 172.21.15.46:0/701594853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c077750 con 0x7f697c078c10 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697b7fe700 1 --2- 172.21.15.46:0/701594853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c077210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f696c0098e0 tx=0x7f696c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3160565a9209fb9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697a7fc700 1 -- 172.21.15.46:0/701594853 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f696c00b860 con 0x7f697c078c10 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697a7fc700 1 -- 172.21.15.46:0/701594853 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f696c00be90 con 0x7f697c078c10 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.971+0000 7f697a7fc700 1 -- 172.21.15.46:0/701594853 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f696c0103c0 con 0x7f697c078c10 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 -- 172.21.15.46:0/701594853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 msgr2=0x7f697c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 --2- 172.21.15.46:0/701594853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c077210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f696c0098e0 tx=0x7f696c009250 comp rx=0 tx=0).stop 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 -- 172.21.15.46:0/701594853 shutdown_connections 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 --2- 172.21.15.46:0/701594853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c077210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 -- 172.21.15.46:0/701594853 >> 172.21.15.46:0/701594853 conn(0x7f697c0fe030 msgr2=0x7f697c100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:25.651 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 -- 172.21.15.46:0/701594853 shutdown_connections 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.972+0000 7f6982134700 1 -- 172.21.15.46:0/701594853 wait complete. 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f6982134700 1 Processor -- start 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f6982134700 1 -- start start 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f6982134700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f6982134700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c113da0 con 0x7f697c078c10 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37604/0 (socket says 172.21.15.46:37604) 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f697b7fe700 1 -- 172.21.15.46:0/3473258753 learned_addr learned my addr 172.21.15.46:0/3473258753 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.973+0000 7f697b7fe700 1 -- 172.21.15.46:0/3473258753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0094f0 con 0x7f697c078c10 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.974+0000 7f697b7fe700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c113860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f696c006fd0 tx=0x7f696c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.974+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f696c010630 con 0x7f697c078c10 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.974+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f696c010c60 con 0x7f697c078c10 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.974+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c113fa0 con 0x7f697c078c10 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.974+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f696c01ad40 con 0x7f697c078c10 2024-05-09T06:21:25.652 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.974+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c114b10 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.975+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f696c0193c0 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.975+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c05f5c0 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.975+0000 7f6963fff700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f6964036850 0x7f6964038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.975+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f696c04a060 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.975+0000 7f697affd700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f6964036850 0x7f6964038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.975+0000 7f697affd700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f6964036850 0x7f6964038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6970009990 tx=0x7f6970006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:24.980+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f696c018e20 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.176+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f697c04bed0 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.178+0000 7f6963fff700 1 -- 172.21.15.46:0/3473258753 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f696c018e20 con 0x7f697c078c10 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f6964036850 msgr2=0x7f6964038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:25.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f6964036850 0x7f6964038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6970009990 tx=0x7f6970006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 msgr2=0x7f697c113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c113860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f696c006fd0 tx=0x7f696c009250 comp rx=0 tx=0).stop 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 shutdown_connections 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f6964036850 0x7f6964038d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 --2- 172.21.15.46:0/3473258753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f697c078c10 0x7f697c113860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 >> 172.21.15.46:0/3473258753 conn(0x7f697c0fe030 msgr2=0x7f697c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 shutdown_connections 2024-05-09T06:21:25.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:25.181+0000 7f6982134700 1 -- 172.21.15.46:0/3473258753 wait complete. 2024-05-09T06:21:26.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:26 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3473258753' entity='client.admin' 2024-05-09T06:21:26.774 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.041+0000 7f883a1f9700 1 Processor -- start 2024-05-09T06:21:26.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f883a1f9700 1 -- start start 2024-05-09T06:21:26.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f883a1f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f8834102170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:26.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f883a1f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88341026b0 con 0x7f8834101d60 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f88337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f8834102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f88337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f8834102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37610/0 (socket says 172.21.15.46:37610) 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f88337fe700 1 -- 172.21.15.46:0/2186803051 learned_addr learned my addr 172.21.15.46:0/2186803051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f88337fe700 1 -- 172.21.15.46:0/2186803051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88341027f0 con 0x7f8834101d60 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.042+0000 7f88337fe700 1 --2- 172.21.15.46:0/2186803051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f8834102170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88240098e0 tx=0x7f8824009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f027ff01e33299c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f8832ffd700 1 -- 172.21.15.46:0/2186803051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f882400b860 con 0x7f8834101d60 2024-05-09T06:21:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f8832ffd700 1 -- 172.21.15.46:0/2186803051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f882400be90 con 0x7f8834101d60 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f8832ffd700 1 -- 172.21.15.46:0/2186803051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88240103c0 con 0x7f8834101d60 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 -- 172.21.15.46:0/2186803051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 msgr2=0x7f8834102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 --2- 172.21.15.46:0/2186803051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f8834102170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88240098e0 tx=0x7f8824009250 comp rx=0 tx=0).stop 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 -- 172.21.15.46:0/2186803051 shutdown_connections 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 --2- 172.21.15.46:0/2186803051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f8834102170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 -- 172.21.15.46:0/2186803051 >> 172.21.15.46:0/2186803051 conn(0x7f88340fc6f0 msgr2=0x7f88340feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 -- 172.21.15.46:0/2186803051 shutdown_connections 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.043+0000 7f883a1f9700 1 -- 172.21.15.46:0/2186803051 wait complete. 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.044+0000 7f883a1f9700 1 Processor -- start 2024-05-09T06:21:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.044+0000 7f883a1f9700 1 -- start start 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.044+0000 7f883a1f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f88341115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.044+0000 7f883a1f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834111b00 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.044+0000 7f88337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f88341115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.044+0000 7f88337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f88341115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37614/0 (socket says 172.21.15.46:37614) 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f88337fe700 1 -- 172.21.15.46:0/2946097303 learned_addr learned my addr 172.21.15.46:0/2946097303 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f88337fe700 1 -- 172.21.15.46:0/2946097303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240094f0 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f88337fe700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f88341115c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f88240090b0 tx=0x7f8824009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8824010840 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834111d00 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8824010e70 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8824024e40 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.045+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8834112870 con 0x7f8834101d60 2024-05-09T06:21:26.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.046+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f882401a530 con 0x7f8834101d60 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.046+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883405f5c0 con 0x7f8834101d60 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.046+0000 7f8830ff9700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8820036800 0x7f8820038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.046+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f882404a7e0 con 0x7f8834101d60 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.046+0000 7f882affd700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8820036800 0x7f8820038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.047+0000 7f882affd700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8820036800 0x7f8820038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f881c009990 tx=0x7f881c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.051+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8824018940 con 0x7f8834101d60 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.246+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f883404bed0 con 0x7f8834101d60 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.248+0000 7f8830ff9700 1 -- 172.21.15.46:0/2946097303 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f8824018350 con 0x7f8834101d60 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.250+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8820036800 msgr2=0x7f8820038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.250+0000 7f883a1f9700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8820036800 0x7f8820038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f881c009990 tx=0x7f881c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.250+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 msgr2=0x7f88341115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.250+0000 7f883a1f9700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f88341115c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f88240090b0 tx=0x7f8824009250 comp rx=0 tx=0).stop 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.250+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 shutdown_connections 2024-05-09T06:21:26.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.251+0000 7f883a1f9700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8820036800 0x7f8820038cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:26.780 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.251+0000 7f883a1f9700 1 --2- 172.21.15.46:0/2946097303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101d60 0x7f88341115c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:26.780 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.251+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 >> 172.21.15.46:0/2946097303 conn(0x7f88340fc6f0 msgr2=0x7f88340fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:26.780 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.251+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 shutdown_connections 2024-05-09T06:21:26.780 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:26.251+0000 7f883a1f9700 1 -- 172.21.15.46:0/2946097303 wait complete. 2024-05-09T06:21:26.780 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2024-05-09T06:21:27.445 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:27 smithi046 ceph-mon[26924]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:27.445 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:27 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2946097303' entity='client.admin' 2024-05-09T06:21:28.423 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:28 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/627777902' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-09T06:21:28.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.199+0000 7f8b97819700 1 Processor -- start 2024-05-09T06:21:28.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.199+0000 7f8b97819700 1 -- start start 2024-05-09T06:21:28.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b97819700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b90102170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b97819700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b901026b0 con 0x7f8b90101d60 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b955b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b90102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b955b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b90102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37616/0 (socket says 172.21.15.46:37616) 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b955b5700 1 -- 172.21.15.46:0/1611368234 learned_addr learned my addr 172.21.15.46:0/1611368234 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b955b5700 1 -- 172.21.15.46:0/1611368234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b901027f0 con 0x7f8b90101d60 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b955b5700 1 --2- 172.21.15.46:0/1611368234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b90102170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400d0d0 tx=0x7f8b8400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6680cc3309bad121 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b83fff700 1 -- 172.21.15.46:0/1611368234 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8400ddf0 con 0x7f8b90101d60 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b83fff700 1 -- 172.21.15.46:0/1611368234 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b84009610 con 0x7f8b90101d60 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.200+0000 7f8b83fff700 1 -- 172.21.15.46:0/1611368234 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b840146c0 con 0x7f8b90101d60 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 -- 172.21.15.46:0/1611368234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 msgr2=0x7f8b90102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:28.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 --2- 172.21.15.46:0/1611368234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b90102170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400d0d0 tx=0x7f8b8400ba50 comp rx=0 tx=0).stop 2024-05-09T06:21:28.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 -- 172.21.15.46:0/1611368234 shutdown_connections 2024-05-09T06:21:28.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 --2- 172.21.15.46:0/1611368234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b90102170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:28.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 -- 172.21.15.46:0/1611368234 >> 172.21.15.46:0/1611368234 conn(0x7f8b900fc6f0 msgr2=0x7f8b900feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:28.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 -- 172.21.15.46:0/1611368234 shutdown_connections 2024-05-09T06:21:28.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.201+0000 7f8b97819700 1 -- 172.21.15.46:0/1611368234 wait complete. 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b97819700 1 Processor -- start 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b97819700 1 -- start start 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b97819700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b9010f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b97819700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9010f980 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b955b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b9010f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b955b5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b9010f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37622/0 (socket says 172.21.15.46:37622) 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b955b5700 1 -- 172.21.15.46:0/627777902 learned_addr learned my addr 172.21.15.46:0/627777902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.202+0000 7f8b955b5700 1 -- 172.21.15.46:0/627777902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8400bcf0 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.203+0000 7f8b955b5700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b9010f440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009e20 tx=0x7f8b8400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.203+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8400ddf0 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.203+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b84014e50 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.203+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9010fb80 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.203+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b8401eb50 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.203+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b901106f0 con 0x7f8b90101d60 2024-05-09T06:21:28.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.204+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f8b8401e400 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.204+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9005f5c0 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.204+0000 7f8b81ffb700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8b7c036850 0x7f8b7c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.204+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8b8404c080 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.204+0000 7f8b94db4700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8b7c036850 0x7f8b7c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.205+0000 7f8b94db4700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8b7c036850 0x7f8b7c038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009990 tx=0x7f8b8c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.209+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8b84026d40 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:27.461+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f8b90111240 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.252+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f8b8401ed50 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.253+0000 7f8b81ffb700 1 -- 172.21.15.46:0/627777902 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8b8401b8e0 con 0x7f8b90101d60 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8b7c036850 msgr2=0x7f8b7c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8b7c036850 0x7f8b7c038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009990 tx=0x7f8b8c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 msgr2=0x7f8b9010f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b9010f440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009e20 tx=0x7f8b8400ba50 comp rx=0 tx=0).stop 2024-05-09T06:21:28.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 shutdown_connections 2024-05-09T06:21:28.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f8b7c036850 0x7f8b7c038d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:28.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 --2- 172.21.15.46:0/627777902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b90101d60 0x7f8b9010f440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:28.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 >> 172.21.15.46:0/627777902 conn(0x7f8b900fc6f0 msgr2=0x7f8b90105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:28.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 shutdown_connections 2024-05-09T06:21:28.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:28.256+0000 7f8b97819700 1 -- 172.21.15.46:0/627777902 wait complete. 2024-05-09T06:21:29.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:29 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/627777902' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-09T06:21:29.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:29 smithi046 ceph-mon[26924]: mgrmap e9: smithi046.nvpcui(active, since 24s) 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.nvpcui", 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08fe5d9700 1 Processor -- start 2024-05-09T06:21:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08fe5d9700 1 -- start start 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08fe5d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08fe5d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8102090 con 0x7f08f8101740 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08f7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08f7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37646/0 (socket says 172.21.15.46:37646) 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.370+0000 7f08f7fff700 1 -- 172.21.15.46:0/2320132772 learned_addr learned my addr 172.21.15.46:0/2320132772 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.371+0000 7f08f7fff700 1 -- 172.21.15.46:0/2320132772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f81021d0 con 0x7f08f8101740 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.371+0000 7f08f7fff700 1 --2- 172.21.15.46:0/2320132772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8101b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08e800bb80 tx=0x7f08e800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1974f6d4b61eb456 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.371+0000 7f08f6ffd700 1 -- 172.21.15.46:0/2320132772 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08e800dd00 con 0x7f08f8101740 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.371+0000 7f08f6ffd700 1 -- 172.21.15.46:0/2320132772 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08e800de60 con 0x7f08f8101740 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.371+0000 7f08f6ffd700 1 -- 172.21.15.46:0/2320132772 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08e8018920 con 0x7f08f8101740 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 -- 172.21.15.46:0/2320132772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 msgr2=0x7f08f8101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 --2- 172.21.15.46:0/2320132772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8101b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08e800bb80 tx=0x7f08e800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 -- 172.21.15.46:0/2320132772 shutdown_connections 2024-05-09T06:21:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 --2- 172.21.15.46:0/2320132772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8101b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 -- 172.21.15.46:0/2320132772 >> 172.21.15.46:0/2320132772 conn(0x7f08f80fcec0 msgr2=0x7f08f80ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 -- 172.21.15.46:0/2320132772 shutdown_connections 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.372+0000 7f08fe5d9700 1 -- 172.21.15.46:0/2320132772 wait complete. 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08fe5d9700 1 Processor -- start 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08fe5d9700 1 -- start start 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08fe5d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08fe5d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8113ca0 con 0x7f08f8101740 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08f7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08f7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37652/0 (socket says 172.21.15.46:37652) 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08f7fff700 1 -- 172.21.15.46:0/405195018 learned_addr learned my addr 172.21.15.46:0/405195018 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.373+0000 7f08f7fff700 1 -- 172.21.15.46:0/405195018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e800b790 con 0x7f08f8101740 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.374+0000 7f08f7fff700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8113760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f08e80106a0 tx=0x7f08e800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.374+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08e8018e90 con 0x7f08f8101740 2024-05-09T06:21:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.374+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08e8010c30 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.374+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f8113ea0 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.374+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08e8021530 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.374+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f8114a10 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.375+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f08e8021690 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.375+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f805f5c0 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.375+0000 7f08f4ff9700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 0x7f08e0038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.375+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f08e8014070 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.375+0000 7f08f77fe700 1 -- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 msgr2=0x7f08e0038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.375+0000 7f08f77fe700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 0x7f08e0038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.380+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f08e800e950 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.576+0000 7f08f77fe700 1 -- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 msgr2=0x7f08e0038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.576+0000 7f08f77fe700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 0x7f08e0038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.677+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f08f8115520 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.677+0000 7f08f4ff9700 1 -- 172.21.15.46:0/405195018 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f08e8026030 con 0x7f08f8101740 2024-05-09T06:21:30.223 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.679+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 msgr2=0x7f08e0038da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.679+0000 7f08fe5d9700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 0x7f08e0038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 msgr2=0x7f08f8113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8113760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f08e80106a0 tx=0x7f08e800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 shutdown_connections 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7f08e00368f0 0x7f08e0038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 --2- 172.21.15.46:0/405195018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f8101740 0x7f08f8113760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 >> 172.21.15.46:0/405195018 conn(0x7f08f80fcec0 msgr2=0x7f08f8105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 shutdown_connections 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:29.680+0000 7f08fe5d9700 1 -- 172.21.15.46:0/405195018 wait complete. 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-05-09T06:21:30.224 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2024-05-09T06:21:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:30 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/405195018' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: Active manager daemon smithi046.nvpcui restarted 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: osdmap e3: 0 total, 0 up, 0 in 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: mgrmap e10: smithi046.nvpcui(active, starting, since 0.00327555s) 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:21:35.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:21:35.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:21:35.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:35.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:21:35.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:35 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:21:36.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:36 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:21:36.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:36 smithi046 ceph-mon[26924]: mgrmap e11: smithi046.nvpcui(active, since 1.00543s) 2024-05-09T06:21:36.701 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb874d92700 1 Processor -- start 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb874d92700 1 -- start start 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb874d92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb874d92700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870103200 con 0x7fb8701028b0 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42342/0 (socket says 172.21.15.46:42342) 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.711+0000 7fb86e59c700 1 -- 172.21.15.46:0/2678051435 learned_addr learned my addr 172.21.15.46:0/2678051435 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.712+0000 7fb86e59c700 1 -- 172.21.15.46:0/2678051435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870103340 con 0x7fb8701028b0 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.712+0000 7fb86e59c700 1 --2- 172.21.15.46:0/2678051435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870102cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8600098e0 tx=0x7fb860009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e35d0828542d6ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:36.702 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.712+0000 7fb86d59a700 1 -- 172.21.15.46:0/2678051435 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb86000b860 con 0x7fb8701028b0 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.712+0000 7fb86d59a700 1 -- 172.21.15.46:0/2678051435 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb86000be90 con 0x7fb8701028b0 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.712+0000 7fb86d59a700 1 -- 172.21.15.46:0/2678051435 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8600103c0 con 0x7fb8701028b0 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 -- 172.21.15.46:0/2678051435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 msgr2=0x7fb870102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 --2- 172.21.15.46:0/2678051435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870102cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8600098e0 tx=0x7fb860009250 comp rx=0 tx=0).stop 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 -- 172.21.15.46:0/2678051435 shutdown_connections 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 --2- 172.21.15.46:0/2678051435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870102cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 -- 172.21.15.46:0/2678051435 >> 172.21.15.46:0/2678051435 conn(0x7fb8700fdff0 msgr2=0x7fb870100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 -- 172.21.15.46:0/2678051435 shutdown_connections 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 -- 172.21.15.46:0/2678051435 wait complete. 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 Processor -- start 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.713+0000 7fb874d92700 1 -- start start 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb874d92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb874d92700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870111b40 con 0x7fb8701028b0 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:36.703 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42348/0 (socket says 172.21.15.46:42348) 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb86e59c700 1 -- 172.21.15.46:0/137366484 learned_addr learned my addr 172.21.15.46:0/137366484 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb86e59c700 1 -- 172.21.15.46:0/137366484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600094f0 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb86e59c700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870111600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8600090b0 tx=0x7fb860009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb860010840 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb860010e70 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb870111d40 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb860024e40 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.714+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8701128b0 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.715+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fb86001a4e0 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.716+0000 7fb85effd700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.716+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 --> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb858039460 con 0x7fb8580368a0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.716+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb86004aa40 con 0x7fb8701028b0 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.716+0000 7fb86dd9b700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 msgr2=0x7fb858038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.716+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:21:36.704 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.917+0000 7fb86dd9b700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 msgr2=0x7fb858038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:30.917+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:31.318+0000 7fb86dd9b700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 msgr2=0x7fb858038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:31.318+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:32.119+0000 7fb86dd9b700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 msgr2=0x7fb858038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:32.119+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:33.720+0000 7fb86dd9b700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 msgr2=0x7fb858038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3381519426 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:33.720+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:35.085+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7fb860024430 con 0x7fb8701028b0 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:35.085+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 msgr2=0x7fb858038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:35.085+0000 7fb85effd700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.086+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fb860030d80 con 0x7fb8701028b0 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.086+0000 7fb85effd700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fb85803a1d0 0x7fb85803c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.086+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb858039460 con 0x7fb85803a1d0 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.087+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fb85803a1d0 0x7fb85803c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:36.705 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.088+0000 7fb86dd9b700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fb85803a1d0 0x7fb85803c5b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb8640039d0 tx=0x7fb864009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.088+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fb858039460 con 0x7fb85803a1d0 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.094+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fb8701121d0 con 0x7fb85803a1d0 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb85effd700 1 -- 172.21.15.46:0/137366484 <== mgr.14162 v2:172.21.15.46:6800/2570824935 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fb8701121d0 con 0x7fb85803a1d0 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fb85803a1d0 msgr2=0x7fb85803c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fb85803a1d0 0x7fb85803c5b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb8640039d0 tx=0x7fb864009350 comp rx=0 tx=0).stop 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 msgr2=0x7fb870111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870111600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8600090b0 tx=0x7fb860009250 comp rx=0 tx=0).stop 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 shutdown_connections 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fb85803a1d0 0x7fb85803c5b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:36.706 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8701028b0 0x7fb870111600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 --2- 172.21.15.46:0/137366484 >> [v2:172.21.15.46:6800/3381519426,v1:172.21.15.46:6801/3381519426] conn(0x7fb8580368a0 0x7fb858038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 >> 172.21.15.46:0/137366484 conn(0x7fb8700fdff0 msgr2=0x7fb8700feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 shutdown_connections 2024-05-09T06:21:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:36.095+0000 7fb874d92700 1 -- 172.21.15.46:0/137366484 wait complete. 2024-05-09T06:21:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2024-05-09T06:21:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:Generating a dashboard self-signed certificate... 2024-05-09T06:21:37.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:37 smithi046 ceph-mon[26924]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T06:21:37.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:37 smithi046 ceph-mon[26924]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T06:21:37.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:37 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:37.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.099+0000 7f4c302cc700 1 Processor -- start 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.099+0000 7f4c302cc700 1 -- start start 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c302cc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28105450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c302cc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28105990 con 0x7f4c280712d0 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c2e068700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28105450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c2e068700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28105450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42428/0 (socket says 172.21.15.46:42428) 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c2e068700 1 -- 172.21.15.46:0/2232963374 learned_addr learned my addr 172.21.15.46:0/2232963374 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c2e068700 1 -- 172.21.15.46:0/2232963374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28105ad0 con 0x7f4c280712d0 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c2e068700 1 --2- 172.21.15.46:0/2232963374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28105450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c240098e0 tx=0x7f4c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87af3a37e3a864e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.100+0000 7f4c2d066700 1 -- 172.21.15.46:0/2232963374 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c2400b860 con 0x7f4c280712d0 2024-05-09T06:21:38.149 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c2d066700 1 -- 172.21.15.46:0/2232963374 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c2400be90 con 0x7f4c280712d0 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c2d066700 1 -- 172.21.15.46:0/2232963374 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c240103c0 con 0x7f4c280712d0 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 -- 172.21.15.46:0/2232963374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 msgr2=0x7f4c28105450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 --2- 172.21.15.46:0/2232963374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28105450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c240098e0 tx=0x7f4c24009250 comp rx=0 tx=0).stop 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 -- 172.21.15.46:0/2232963374 shutdown_connections 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 --2- 172.21.15.46:0/2232963374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28105450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 -- 172.21.15.46:0/2232963374 >> 172.21.15.46:0/2232963374 conn(0x7f4c280fcec0 msgr2=0x7f4c280ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 -- 172.21.15.46:0/2232963374 shutdown_connections 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.101+0000 7f4c302cc700 1 -- 172.21.15.46:0/2232963374 wait complete. 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c302cc700 1 Processor -- start 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c302cc700 1 -- start start 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c302cc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28111630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:38.150 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c302cc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28111b70 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c2e068700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28111630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c2e068700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28111630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42430/0 (socket says 172.21.15.46:42430) 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c2e068700 1 -- 172.21.15.46:0/798308210 learned_addr learned my addr 172.21.15.46:0/798308210 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c2e068700 1 -- 172.21.15.46:0/798308210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240094f0 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.102+0000 7f4c2e068700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28111630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4c240105b0 tx=0x7f4c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.103+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c24010840 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.103+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c28111d70 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.103+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c24010e70 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.103+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c240243f0 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.103+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c281128e0 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.103+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f4c24024550 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.104+0000 7f4c1affd700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f4c140367d0 0x7f4c14038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.104+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4c2404a4d0 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.104+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2805f5c0 con 0x7f4c280712d0 2024-05-09T06:21:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.104+0000 7f4c2d867700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f4c140367d0 0x7f4c14038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.104+0000 7f4c2d867700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f4c140367d0 0x7f4c14038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009990 tx=0x7f4c1c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.109+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4c24018940 con 0x7f4c280712d0 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.315+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c280fe120 con 0x7f4c140367d0 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.386+0000 7f4c1affd700 1 -- 172.21.15.46:0/798308210 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4c280fe120 con 0x7f4c140367d0 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f4c140367d0 msgr2=0x7f4c14038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f4c140367d0 0x7f4c14038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009990 tx=0x7f4c1c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 msgr2=0x7f4c28111630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28111630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4c240105b0 tx=0x7f4c24009250 comp rx=0 tx=0).stop 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 shutdown_connections 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f4c140367d0 0x7f4c14038c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 --2- 172.21.15.46:0/798308210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c280712d0 0x7f4c28111630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:38.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 >> 172.21.15.46:0/798308210 conn(0x7f4c280fcec0 msgr2=0x7f4c280fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:38.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 shutdown_connections 2024-05-09T06:21:38.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:37.388+0000 7f4c302cc700 1 -- 172.21.15.46:0/798308210 wait complete. 2024-05-09T06:21:38.153 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2024-05-09T06:21:38.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: [09/May/2024:06:21:36] ENGINE Bus STARTING 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: [09/May/2024:06:21:36] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: [09/May/2024:06:21:36] ENGINE Bus STARTED 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: mgrmap e12: smithi046.nvpcui(active, since 2s) 2024-05-09T06:21:38.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:38 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:39.982 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:39 smithi046 ceph-mon[26924]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:39.982 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:39 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$qgfFl6Al4mr1X/cK0Y1srOBULFh9r5K5Cj1rO3zMsNof4EGGasgPO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715235698, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.442+0000 7f26f408b700 1 Processor -- start 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.442+0000 7f26f408b700 1 -- start start 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.442+0000 7f26f408b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.442+0000 7f26f408b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec102090 con 0x7f26ec101740 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f1e27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f1e27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42444/0 (socket says 172.21.15.46:42444) 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f1e27700 1 -- 172.21.15.46:0/2713944169 learned_addr learned my addr 172.21.15.46:0/2713944169 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f1e27700 1 -- 172.21.15.46:0/2713944169 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec1021d0 con 0x7f26ec101740 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f1e27700 1 --2- 172.21.15.46:0/2713944169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec101b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26e800bb80 tx=0x7f26e800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dee6e1349418525 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f0e25700 1 -- 172.21.15.46:0/2713944169 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26e800dd00 con 0x7f26ec101740 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f0e25700 1 -- 172.21.15.46:0/2713944169 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26e800de60 con 0x7f26ec101740 2024-05-09T06:21:39.991 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.443+0000 7f26f0e25700 1 -- 172.21.15.46:0/2713944169 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26e8018920 con 0x7f26ec101740 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 -- 172.21.15.46:0/2713944169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 msgr2=0x7f26ec101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 --2- 172.21.15.46:0/2713944169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec101b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26e800bb80 tx=0x7f26e800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 -- 172.21.15.46:0/2713944169 shutdown_connections 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 --2- 172.21.15.46:0/2713944169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec101b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 -- 172.21.15.46:0/2713944169 >> 172.21.15.46:0/2713944169 conn(0x7f26ec0fcec0 msgr2=0x7f26ec0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 -- 172.21.15.46:0/2713944169 shutdown_connections 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.444+0000 7f26f408b700 1 -- 172.21.15.46:0/2713944169 wait complete. 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f408b700 1 Processor -- start 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f408b700 1 -- start start 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f408b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f408b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec10f8b0 con 0x7f26ec101740 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f1e27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f1e27700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec10f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42452/0 (socket says 172.21.15.46:42452) 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.445+0000 7f26f1e27700 1 -- 172.21.15.46:0/4181879640 learned_addr learned my addr 172.21.15.46:0/4181879640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:39.992 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26f1e27700 1 -- 172.21.15.46:0/4181879640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e800b790 con 0x7f26ec101740 2024-05-09T06:21:39.993 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26f1e27700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec10f370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26e8006b00 tx=0x7f26e800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:39.993 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26e8010bd0 con 0x7f26ec101740 2024-05-09T06:21:39.993 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26e801d050 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec10fab0 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26e8022590 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.446+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec110620 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.447+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f26e80227c0 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.447+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec05f5c0 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.447+0000 7f26e27fc700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f26d8036940 0x7f26d8038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.448+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f26e8014070 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.448+0000 7f26f1626700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f26d8036940 0x7f26d8038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.448+0000 7f26f1626700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f26d8036940 0x7f26d8038df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009990 tx=0x7f26dc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.453+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f26e800e360 con 0x7f26ec101740 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.682+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f26ec05f3b0 con 0x7f26d8036940 2024-05-09T06:21:39.994 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.928+0000 7f26e27fc700 1 -- 172.21.15.46:0/4181879640 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f26ec05f3b0 con 0x7f26d8036940 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f26d8036940 msgr2=0x7f26d8038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f26d8036940 0x7f26d8038df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009990 tx=0x7f26dc006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 msgr2=0x7f26ec10f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec10f370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26e8006b00 tx=0x7f26e800b4f0 comp rx=0 tx=0).stop 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 shutdown_connections 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f26d8036940 0x7f26d8038df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 --2- 172.21.15.46:0/4181879640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec101740 0x7f26ec10f370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 >> 172.21.15.46:0/4181879640 conn(0x7f26ec0fcec0 msgr2=0x7f26ec105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 shutdown_connections 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:38.930+0000 7f26f408b700 1 -- 172.21.15.46:0/4181879640 wait complete. 2024-05-09T06:21:39.995 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2024-05-09T06:21:41.205 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:40 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1783779779' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-09T06:21:41.213 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.419+0000 7f2bb88e5700 1 Processor -- start 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.419+0000 7f2bb88e5700 1 -- start start 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.419+0000 7f2bb88e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.419+0000 7f2bb88e5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4103200 con 0x7f2bb41028b0 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42468/0 (socket says 172.21.15.46:42468) 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb259c700 1 -- 172.21.15.46:0/1300920731 learned_addr learned my addr 172.21.15.46:0/1300920731 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb259c700 1 -- 172.21.15.46:0/1300920731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4103340 con 0x7f2bb41028b0 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb259c700 1 --2- 172.21.15.46:0/1300920731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4102cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009e50 tx=0x7f2ba4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2b17eb7bb4d955 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:41.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb159a700 1 -- 172.21.15.46:0/1300920731 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ba40092e0 con 0x7f2bb41028b0 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb159a700 1 -- 172.21.15.46:0/1300920731 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ba4012430 con 0x7f2bb41028b0 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.420+0000 7f2bb159a700 1 -- 172.21.15.46:0/1300920731 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ba40075a0 con 0x7f2bb41028b0 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1300920731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 msgr2=0x7f2bb4102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 --2- 172.21.15.46:0/1300920731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4102cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009e50 tx=0x7f2ba4009840 comp rx=0 tx=0).stop 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1300920731 shutdown_connections 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 --2- 172.21.15.46:0/1300920731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4102cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1300920731 >> 172.21.15.46:0/1300920731 conn(0x7f2bb40fdff0 msgr2=0x7f2bb4100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1300920731 shutdown_connections 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.421+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1300920731 wait complete. 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb88e5700 1 Processor -- start 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb88e5700 1 -- start start 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb88e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb88e5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4111ba0 con 0x7f2bb41028b0 2024-05-09T06:21:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4111660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42470/0 (socket says 172.21.15.46:42470) 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb259c700 1 -- 172.21.15.46:0/1783779779 learned_addr learned my addr 172.21.15.46:0/1783779779 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb259c700 1 -- 172.21.15.46:0/1783779779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009ae0 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2bb259c700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4111660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009fd0 tx=0x7f2ba4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.422+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ba40092e0 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.423+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ba4007ce0 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.423+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb4111da0 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.423+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ba4025990 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.423+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb4112910 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.423+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f2ba4019050 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.424+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb405f5c0 con 0x7f2bb41028b0 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.424+0000 7f2baaffd700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f2ba00368a0 0x7f2ba0038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:41.216 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.424+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2ba404a1f0 con 0x7f2bb41028b0 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.424+0000 7f2bb1d9b700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f2ba00368a0 0x7f2ba0038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.424+0000 7f2bb1d9b700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f2ba00368a0 0x7f2ba0038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009990 tx=0x7f2b9c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.428+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2ba4007810 con 0x7f2bb41028b0 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.624+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f2bb404bed0 con 0x7f2bb41028b0 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.624+0000 7f2baaffd700 1 -- 172.21.15.46:0/1783779779 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f2ba4020020 con 0x7f2bb41028b0 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.626+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f2ba00368a0 msgr2=0x7f2ba0038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.626+0000 7f2bb88e5700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f2ba00368a0 0x7f2ba0038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009990 tx=0x7f2b9c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.626+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 msgr2=0x7f2bb4111660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.626+0000 7f2bb88e5700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4111660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009fd0 tx=0x7f2ba4009840 comp rx=0 tx=0).stop 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.627+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 shutdown_connections 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.627+0000 7f2bb88e5700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f2ba00368a0 0x7f2ba0038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.627+0000 7f2bb88e5700 1 --2- 172.21.15.46:0/1783779779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb41028b0 0x7f2bb4111660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.627+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 >> 172.21.15.46:0/1783779779 conn(0x7f2bb40fdff0 msgr2=0x7f2bb40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.627+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 shutdown_connections 2024-05-09T06:21:41.217 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:40.627+0000 7f2bb88e5700 1 -- 172.21.15.46:0/1783779779 wait complete. 2024-05-09T06:21:41.223 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T06:21:41.223 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-05-09T06:21:41.232 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T06:21:41.232 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-05-09T06:21:41.233 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-05-09T06:21:41.233 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-09T06:21:41.235 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2024-05-09T06:21:41.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:41.235 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2024-05-09T06:21:41.235 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2024-05-09T06:21:41.235 INFO:teuthology.orchestra.run.smithi046.stdout: Password: d2fj83ho7u 2024-05-09T06:21:41.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:41.236 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config directory 2024-05-09T06:21:41.236 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling autotune for osd_memory_target 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0f75c700 1 Processor -- start 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0f75c700 1 -- start start 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0f75c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0f75c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08101880 con 0x7fcd08100f30 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0d4f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0d4f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38560/0 (socket says 172.21.15.46:38560) 2024-05-09T06:21:42.420 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.688+0000 7fcd0d4f8700 1 -- 172.21.15.46:0/700552846 learned_addr learned my addr 172.21.15.46:0/700552846 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fcd0d4f8700 1 -- 172.21.15.46:0/700552846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd081019c0 con 0x7fcd08100f30 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fcd0d4f8700 1 --2- 172.21.15.46:0/700552846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08101340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400aa80 tx=0x7fcd0400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8d1cca0289731e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fccfffff700 1 -- 172.21.15.46:0/700552846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd0400cba0 con 0x7fcd08100f30 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fccfffff700 1 -- 172.21.15.46:0/700552846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd0400cd00 con 0x7fcd08100f30 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fccfffff700 1 -- 172.21.15.46:0/700552846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd04010720 con 0x7fcd08100f30 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fcd0f75c700 1 -- 172.21.15.46:0/700552846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 msgr2=0x7fcd08101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.689+0000 7fcd0f75c700 1 --2- 172.21.15.46:0/700552846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08101340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400aa80 tx=0x7fcd0400a3f0 comp rx=0 tx=0).stop 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 -- 172.21.15.46:0/700552846 shutdown_connections 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 --2- 172.21.15.46:0/700552846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08101340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 -- 172.21.15.46:0/700552846 >> 172.21.15.46:0/700552846 conn(0x7fcd080fc6f0 msgr2=0x7fcd080feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 -- 172.21.15.46:0/700552846 shutdown_connections 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 -- 172.21.15.46:0/700552846 wait complete. 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 Processor -- start 2024-05-09T06:21:42.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.690+0000 7fcd0f75c700 1 -- start start 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0f75c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08111650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0f75c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd08111b90 con 0x7fcd08100f30 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0d4f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08111650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0d4f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08111650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38562/0 (socket says 172.21.15.46:38562) 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0d4f8700 1 -- 172.21.15.46:0/2492954020 learned_addr learned my addr 172.21.15.46:0/2492954020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0d4f8700 1 -- 172.21.15.46:0/2492954020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0400a690 con 0x7fcd08100f30 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0d4f8700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08111650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd04018fd0 tx=0x7fcd0401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd04018760 con 0x7fcd08100f30 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd040188c0 con 0x7fcd08100f30 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd08111d90 con 0x7fcd08100f30 2024-05-09T06:21:42.422 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.691+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd040205a0 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.692+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd08112900 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.693+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fcd040207d0 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.693+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0805f5c0 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.693+0000 7fccfdffb700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fccf40368f0 0x7fccf4038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.693+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcd0404a690 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.693+0000 7fcd0ccf7700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fccf40368f0 0x7fccf4038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.693+0000 7fcd0ccf7700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fccf40368f0 0x7fccf4038da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009990 tx=0x7fccf8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.698+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcd0400f550 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.894+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fcd0804bed0 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.895+0000 7fccfdffb700 1 -- 172.21.15.46:0/2492954020 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fcd04026030 con 0x7fcd08100f30 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fccf40368f0 msgr2=0x7fccf4038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fccf40368f0 0x7fccf4038da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009990 tx=0x7fccf8006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 msgr2=0x7fcd08111650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:42.423 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08111650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd04018fd0 tx=0x7fcd0401a040 comp rx=0 tx=0).stop 2024-05-09T06:21:42.424 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 shutdown_connections 2024-05-09T06:21:42.424 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fccf40368f0 0x7fccf4038da0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:42.424 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 --2- 172.21.15.46:0/2492954020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd08100f30 0x7fcd08111650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:42.424 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 >> 172.21.15.46:0/2492954020 conn(0x7fcd080fc6f0 msgr2=0x7fcd08105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:42.424 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 shutdown_connections 2024-05-09T06:21:42.424 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:41.897+0000 7fcd0f75c700 1 -- 172.21.15.46:0/2492954020 wait complete. 2024-05-09T06:21:43.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:42 smithi046 ceph-mon[26924]: mgrmap e13: smithi046.nvpcui(active, since 6s) 2024-05-09T06:21:43.662 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f485b1d5700 1 Processor -- start 2024-05-09T06:21:43.662 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f485b1d5700 1 -- start start 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f485b1d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854101060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f485b1d5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48541015a0 con 0x7f4854100c50 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f4858f71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f4858f71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38564/0 (socket says 172.21.15.46:38564) 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f4858f71700 1 -- 172.21.15.46:0/412938574 learned_addr learned my addr 172.21.15.46:0/412938574 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.851+0000 7f4858f71700 1 -- 172.21.15.46:0/412938574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48541016e0 con 0x7f4854100c50 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.852+0000 7f4858f71700 1 --2- 172.21.15.46:0/412938574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854101060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48440098e0 tx=0x7f4844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f08e0446378df server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.852+0000 7f48537fe700 1 -- 172.21.15.46:0/412938574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f484400b860 con 0x7f4854100c50 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.852+0000 7f48537fe700 1 -- 172.21.15.46:0/412938574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f484400be90 con 0x7f4854100c50 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.852+0000 7f48537fe700 1 -- 172.21.15.46:0/412938574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48440103c0 con 0x7f4854100c50 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.852+0000 7f485b1d5700 1 -- 172.21.15.46:0/412938574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 msgr2=0x7f4854101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.852+0000 7f485b1d5700 1 --2- 172.21.15.46:0/412938574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854101060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48440098e0 tx=0x7f4844009250 comp rx=0 tx=0).stop 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 -- 172.21.15.46:0/412938574 shutdown_connections 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 --2- 172.21.15.46:0/412938574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854101060 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 -- 172.21.15.46:0/412938574 >> 172.21.15.46:0/412938574 conn(0x7f48540fc6f0 msgr2=0x7f48540feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 -- 172.21.15.46:0/412938574 shutdown_connections 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 -- 172.21.15.46:0/412938574 wait complete. 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 Processor -- start 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.853+0000 7f485b1d5700 1 -- start start 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f485b1d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f485b1d5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854111b40 con 0x7f4854100c50 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f4858f71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f4858f71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38578/0 (socket says 172.21.15.46:38578) 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f4858f71700 1 -- 172.21.15.46:0/1595187217 learned_addr learned my addr 172.21.15.46:0/1595187217 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f4858f71700 1 -- 172.21.15.46:0/1595187217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440094f0 con 0x7f4854100c50 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f4858f71700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854111600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4844011680 tx=0x7f4844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4844010890 con 0x7f4854100c50 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4844010ec0 con 0x7f4854100c50 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.854+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4854111d40 con 0x7f4854100c50 2024-05-09T06:21:43.664 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.855+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48440243f0 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.855+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48541128b0 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.855+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f48440109f0 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.856+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485405f5c0 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.856+0000 7f48517fa700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f483c036990 0x7f483c038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.856+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f484404a460 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.856+0000 7f4853fff700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f483c036990 0x7f483c038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.856+0000 7f4853fff700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f483c036990 0x7f483c038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4848009990 tx=0x7f4848006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:42.861+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f484402b940 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.167+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f485404bed0 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.170+0000 7f48517fa700 1 -- 172.21.15.46:0/1595187217 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4844006d70 con 0x7f4854100c50 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f483c036990 msgr2=0x7f483c038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:43.665 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f483c036990 0x7f483c038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4848009990 tx=0x7f4848006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 msgr2=0x7f4854111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854111600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4844011680 tx=0x7f4844009250 comp rx=0 tx=0).stop 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 shutdown_connections 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f483c036990 0x7f483c038e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 --2- 172.21.15.46:0/1595187217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4854100c50 0x7f4854111600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 >> 172.21.15.46:0/1595187217 conn(0x7f48540fc6f0 msgr2=0x7f48540fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 shutdown_connections 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-05-09T06:21:43.172+0000 7f485b1d5700 1 -- 172.21.15.46:0/1595187217 wait complete. 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2024-05-09T06:21:43.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:43.667 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2024-05-09T06:21:43.694 INFO:tasks.cephadm:Fetching config... 2024-05-09T06:21:43.694 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:21:43.694 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-09T06:21:43.752 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-09T06:21:43.752 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:21:43.752 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-09T06:21:43.808 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-09T06:21:43.809 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:21:43.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/keyring of=/dev/stdout 2024-05-09T06:21:43.874 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-09T06:21:43.874 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:21:43.875 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-09T06:21:43.930 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-09T06:21:43.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxO1Xtjor1cJfKpe3YXp/qOtugj7Vo7XThhaV/PGgv/IqLjE3duzlRy9LKUCTTc1IP8uaAMy02o6ibJJO/0OF7ogjfzHK4YfUAuoFajDiJXsGQRPOZdrkPU/EvGDsYExFNJUwGhexg0zB/6zdJnlmt07OCXYTc8vJ1BBMsEjKj9cDKgHjK77LWG0+MvuWGxCEwl4h6K5UAEUTKbIjQjKhN8tBkdDdHOREguwQl9kFdibATW4LfSAAp76Aa2e8LkuC5w2pgkxY2zG2K/6RCJ8ttMUSe8gUcASXjE5bwqlE+0GzHzhImTZx/m9YPI9VujGO7DFolwTQNXsif/XuzEq+F+ThfHTUpr3bIA02y+60h4+srCKW1J46m9kCdO8PyeSP1m3+s5LDhVyT2dT0Cx4+Zszav+DAE846iokpPIzZK5QvjqOzFQPIVyEEpxxS3RXNA39UYAVA+iuw0JAbsis30FHxsw1sTEkJr+gzwAsj/XMVhR3q4Hix8tPGnpEnE/gs= ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T06:21:44.017 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxO1Xtjor1cJfKpe3YXp/qOtugj7Vo7XThhaV/PGgv/IqLjE3duzlRy9LKUCTTc1IP8uaAMy02o6ibJJO/0OF7ogjfzHK4YfUAuoFajDiJXsGQRPOZdrkPU/EvGDsYExFNJUwGhexg0zB/6zdJnlmt07OCXYTc8vJ1BBMsEjKj9cDKgHjK77LWG0+MvuWGxCEwl4h6K5UAEUTKbIjQjKhN8tBkdDdHOREguwQl9kFdibATW4LfSAAp76Aa2e8LkuC5w2pgkxY2zG2K/6RCJ8ttMUSe8gUcASXjE5bwqlE+0GzHzhImTZx/m9YPI9VujGO7DFolwTQNXsif/XuzEq+F+ThfHTUpr3bIA02y+60h4+srCKW1J46m9kCdO8PyeSP1m3+s5LDhVyT2dT0Cx4+Zszav+DAE846iokpPIzZK5QvjqOzFQPIVyEEpxxS3RXNA39UYAVA+iuw0JAbsis30FHxsw1sTEkJr+gzwAsj/XMVhR3q4Hix8tPGnpEnE/gs= ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:21:44.029 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxO1Xtjor1cJfKpe3YXp/qOtugj7Vo7XThhaV/PGgv/IqLjE3duzlRy9LKUCTTc1IP8uaAMy02o6ibJJO/0OF7ogjfzHK4YfUAuoFajDiJXsGQRPOZdrkPU/EvGDsYExFNJUwGhexg0zB/6zdJnlmt07OCXYTc8vJ1BBMsEjKj9cDKgHjK77LWG0+MvuWGxCEwl4h6K5UAEUTKbIjQjKhN8tBkdDdHOREguwQl9kFdibATW4LfSAAp76Aa2e8LkuC5w2pgkxY2zG2K/6RCJ8ttMUSe8gUcASXjE5bwqlE+0GzHzhImTZx/m9YPI9VujGO7DFolwTQNXsif/XuzEq+F+ThfHTUpr3bIA02y+60h4+srCKW1J46m9kCdO8PyeSP1m3+s5LDhVyT2dT0Cx4+Zszav+DAE846iokpPIzZK5QvjqOzFQPIVyEEpxxS3RXNA39UYAVA+iuw0JAbsis30FHxsw1sTEkJr+gzwAsj/XMVhR3q4Hix8tPGnpEnE/gs= ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T06:21:44.071 INFO:teuthology.orchestra.run.smithi106.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxO1Xtjor1cJfKpe3YXp/qOtugj7Vo7XThhaV/PGgv/IqLjE3duzlRy9LKUCTTc1IP8uaAMy02o6ibJJO/0OF7ogjfzHK4YfUAuoFajDiJXsGQRPOZdrkPU/EvGDsYExFNJUwGhexg0zB/6zdJnlmt07OCXYTc8vJ1BBMsEjKj9cDKgHjK77LWG0+MvuWGxCEwl4h6K5UAEUTKbIjQjKhN8tBkdDdHOREguwQl9kFdibATW4LfSAAp76Aa2e8LkuC5w2pgkxY2zG2K/6RCJ8ttMUSe8gUcASXjE5bwqlE+0GzHzhImTZx/m9YPI9VujGO7DFolwTQNXsif/XuzEq+F+ThfHTUpr3bIA02y+60h4+srCKW1J46m9kCdO8PyeSP1m3+s5LDhVyT2dT0Cx4+Zszav+DAE846iokpPIzZK5QvjqOzFQPIVyEEpxxS3RXNA39UYAVA+iuw0JAbsis30FHxsw1sTEkJr+gzwAsj/XMVhR3q4Hix8tPGnpEnE/gs= ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:21:44.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-09T06:21:44.247 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:44 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1595187217' entity='client.admin' 2024-05-09T06:21:44.347 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:21:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 -- 172.21.15.46:0/462131200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 msgr2=0x7fac340ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 --2- 172.21.15.46:0/462131200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac340ff630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac240048c0 tx=0x7fac24009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:46.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 -- 172.21.15.46:0/462131200 shutdown_connections 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 --2- 172.21.15.46:0/462131200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac340ff630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 -- 172.21.15.46:0/462131200 >> 172.21.15.46:0/462131200 conn(0x7fac340f70a0 msgr2=0x7fac340f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 -- 172.21.15.46:0/462131200 shutdown_connections 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 -- 172.21.15.46:0/462131200 wait complete. 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.755+0000 7fac39feb700 1 Processor -- start 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac39feb700 1 -- start start 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac39feb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac3410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac39feb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3410d5d0 con 0x7fac34065d30 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac3410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac3410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38586/0 (socket says 172.21.15.46:38586) 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac337fe700 1 -- 172.21.15.46:0/3257243117 learned_addr learned my addr 172.21.15.46:0/3257243117 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac337fe700 1 -- 172.21.15.46:0/3257243117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24005040 con 0x7fac34065d30 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.756+0000 7fac337fe700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac3410d090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac24009680 tx=0x7fac24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:46.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.757+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac2400bed0 con 0x7fac34065d30 2024-05-09T06:21:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.757+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac2400b5c0 con 0x7fac34065d30 2024-05-09T06:21:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.757+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac2401c5b0 con 0x7fac34065d30 2024-05-09T06:21:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.757+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3410d7d0 con 0x7fac34065d30 2024-05-09T06:21:46.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.757+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3410e340 con 0x7fac34065d30 2024-05-09T06:21:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.758+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fac24004d30 con 0x7fac34065d30 2024-05-09T06:21:46.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.758+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac34102f40 con 0x7fac34065d30 2024-05-09T06:21:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.758+0000 7fac2bfff700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fac20036880 0x7fac20038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.758+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fac24049990 con 0x7fac34065d30 2024-05-09T06:21:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.758+0000 7fac32ffd700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fac20036880 0x7fac20038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:46.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.759+0000 7fac32ffd700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fac20036880 0x7fac20038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009990 tx=0x7fac1c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:46.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:46.763+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fac24011550 con 0x7fac34065d30 2024-05-09T06:21:46.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:21:46.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:46 smithi046 ceph-mon[26924]: Deploying daemon crash.smithi046 on smithi046 2024-05-09T06:21:47.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.021+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fac3405f5c0 con 0x7fac34065d30 2024-05-09T06:21:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.025+0000 7fac2bfff700 1 -- 172.21.15.46:0/3257243117 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fac24011370 con 0x7fac34065d30 2024-05-09T06:21:47.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fac20036880 msgr2=0x7fac20038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:47.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fac20036880 0x7fac20038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009990 tx=0x7fac1c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 msgr2=0x7fac3410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac3410d090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac24009680 tx=0x7fac24009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 shutdown_connections 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fac20036880 0x7fac20038d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 --2- 172.21.15.46:0/3257243117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34065d30 0x7fac3410d090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 >> 172.21.15.46:0/3257243117 conn(0x7fac340f70a0 msgr2=0x7fac34103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 shutdown_connections 2024-05-09T06:21:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:47.027+0000 7fac39feb700 1 -- 172.21.15.46:0/3257243117 wait complete. 2024-05-09T06:21:47.782 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-09T06:21:47.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-09T06:21:48.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:48 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3257243117' entity='client.admin' 2024-05-09T06:21:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.636+0000 7f7238f91700 1 -- 172.21.15.46:0/1550441286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 msgr2=0x7f72340fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.636+0000 7f7238f91700 1 --2- 172.21.15.46:0/1550441286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f72340fbd40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7224009c60 tx=0x7f7224004d10 comp rx=0 tx=0).stop 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.637+0000 7f7238f91700 1 -- 172.21.15.46:0/1550441286 shutdown_connections 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.637+0000 7f7238f91700 1 --2- 172.21.15.46:0/1550441286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f72340fbd40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.637+0000 7f7238f91700 1 -- 172.21.15.46:0/1550441286 >> 172.21.15.46:0/1550441286 conn(0x7f72340f7070 msgr2=0x7f72340f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.637+0000 7f7238f91700 1 -- 172.21.15.46:0/1550441286 shutdown_connections 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.637+0000 7f7238f91700 1 -- 172.21.15.46:0/1550441286 wait complete. 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f7238f91700 1 Processor -- start 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f7238f91700 1 -- start start 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f7238f91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f723410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f7238f91700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723410c4c0 con 0x7f72340fb930 2024-05-09T06:21:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f723259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f723410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f723259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f723410bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38600/0 (socket says 172.21.15.46:38600) 2024-05-09T06:21:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f723259c700 1 -- 172.21.15.46:0/4168912187 learned_addr learned my addr 172.21.15.46:0/4168912187 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f723259c700 1 -- 172.21.15.46:0/4168912187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224009940 con 0x7f72340fb930 2024-05-09T06:21:50.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.638+0000 7f723259c700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f723410bf80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7224004e60 tx=0x7f7224004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.639+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7224012410 con 0x7f72340fb930 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.639+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7224012a40 con 0x7f72340fb930 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.639+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723410c6c0 con 0x7f72340fb930 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.639+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f722401ba40 con 0x7f72340fb930 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.639+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723410d230 con 0x7f72340fb930 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.640+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f7224019040 con 0x7f72340fb930 2024-05-09T06:21:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.640+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234101e40 con 0x7f72340fb930 2024-05-09T06:21:50.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.640+0000 7f7222ffd700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f721c036880 0x7f721c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:50.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.640+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7224049c70 con 0x7f72340fb930 2024-05-09T06:21:50.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.640+0000 7f7231d9b700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f721c036880 0x7f721c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:50.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.641+0000 7f7231d9b700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f721c036880 0x7f721c038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:50.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.645+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72240234f0 con 0x7f72340fb930 2024-05-09T06:21:50.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.849+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f723405f660 con 0x7f721c036880 2024-05-09T06:21:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.853+0000 7f7222ffd700 1 -- 172.21.15.46:0/4168912187 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f723405f660 con 0x7f721c036880 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f721c036880 msgr2=0x7f721c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f721c036880 0x7f721c038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 msgr2=0x7f723410bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f723410bf80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7224004e60 tx=0x7f7224004d10 comp rx=0 tx=0).stop 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 shutdown_connections 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f721c036880 0x7f721c038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 --2- 172.21.15.46:0/4168912187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72340fb930 0x7f723410bf80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 >> 172.21.15.46:0/4168912187 conn(0x7f72340f7070 msgr2=0x7f7234102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 shutdown_connections 2024-05-09T06:21:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:50.855+0000 7f7238f91700 1 -- 172.21.15.46:0/4168912187 wait complete. 2024-05-09T06:21:51.545 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi106 2024-05-09T06:21:51.545 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:21:51.545 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.conf 2024-05-09T06:21:51.565 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:21:51.565 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:21:51.624 INFO:tasks.cephadm:Adding host smithi106 to orchestrator... 2024-05-09T06:21:51.624 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch host add smithi106 2024-05-09T06:21:52.028 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:21:52.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:52.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:52.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:52.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:52.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:52.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:52.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:51 smithi046 ceph-mon[26924]: Deploying daemon node-exporter.smithi046 on smithi046 2024-05-09T06:21:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.421+0000 7fa4adf93700 1 -- 172.21.15.46:0/4120601483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 msgr2=0x7fa4a8101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.421+0000 7fa4adf93700 1 --2- 172.21.15.46:0/4120601483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a8101a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4980048c0 tx=0x7fa498009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.421+0000 7fa4adf93700 1 -- 172.21.15.46:0/4120601483 shutdown_connections 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.421+0000 7fa4adf93700 1 --2- 172.21.15.46:0/4120601483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a8101a20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.421+0000 7fa4adf93700 1 -- 172.21.15.46:0/4120601483 >> 172.21.15.46:0/4120601483 conn(0x7fa4a80f7070 msgr2=0x7fa4a80f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.422+0000 7fa4adf93700 1 -- 172.21.15.46:0/4120601483 shutdown_connections 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.422+0000 7fa4adf93700 1 -- 172.21.15.46:0/4120601483 wait complete. 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.422+0000 7fa4adf93700 1 Processor -- start 2024-05-09T06:21:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.422+0000 7fa4adf93700 1 -- start start 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4adf93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a810f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4adf93700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a810f7e0 con 0x7fa4a8066940 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a810f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a810f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57284/0 (socket says 172.21.15.46:57284) 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4a77fe700 1 -- 172.21.15.46:0/670572548 learned_addr learned my addr 172.21.15.46:0/670572548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4a77fe700 1 -- 172.21.15.46:0/670572548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498005040 con 0x7fa4a8066940 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4a77fe700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a810f2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa498009680 tx=0x7fa498009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49800bed0 con 0x7fa4a8066940 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a810f9e0 con 0x7fa4a8066940 2024-05-09T06:21:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa49800b5c0 con 0x7fa4a8066940 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49801c5b0 con 0x7fa4a8066940 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.423+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8110550 con 0x7fa4a8066940 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.424+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa498013420 con 0x7fa4a8066940 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.424+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8105130 con 0x7fa4a8066940 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.425+0000 7fa48ffff700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa490036880 0x7fa490038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.425+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa498049980 con 0x7fa4a8066940 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.425+0000 7fa4a6ffd700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa490036880 0x7fa490038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.425+0000 7fa4a6ffd700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa490036880 0x7fa490038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009990 tx=0x7fa49c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:53.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.429+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa498013a80 con 0x7fa4a8066940 2024-05-09T06:21:53.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:53.631+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a8110790 con 0x7fa490036880 2024-05-09T06:21:54.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:54 smithi046 ceph-mon[26924]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:21:55.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.664+0000 7fa48ffff700 1 -- 172.21.15.46:0/670572548 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa4a8110790 con 0x7fa490036880 2024-05-09T06:21:55.649 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi106' with addr '172.21.15.106' 2024-05-09T06:21:55.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa490036880 msgr2=0x7fa490038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:55.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa490036880 0x7fa490038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009990 tx=0x7fa49c006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:55.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 msgr2=0x7fa4a810f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a810f2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa498009680 tx=0x7fa498009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 shutdown_connections 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa490036880 0x7fa490038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 --2- 172.21.15.46:0/670572548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4a8066940 0x7fa4a810f2a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 >> 172.21.15.46:0/670572548 conn(0x7fa4a80f7070 msgr2=0x7fa4a8105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 shutdown_connections 2024-05-09T06:21:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:55.667+0000 7fa4adf93700 1 -- 172.21.15.46:0/670572548 wait complete. 2024-05-09T06:21:56.397 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:56 smithi046 ceph-mon[26924]: Deploying cephadm binary to smithi106 2024-05-09T06:21:56.397 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:56 smithi046 ceph-mon[26924]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:56.397 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:56 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:56.397 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:56 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:56.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-09T06:21:56.973 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:21:57.375 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:57 smithi046 ceph-mon[26924]: Added host smithi106 2024-05-09T06:21:57.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:57 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:57.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:57 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:57.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:57 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:57.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:57 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:21:58.307 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:58 smithi046 ceph-mon[26924]: Deploying daemon alertmanager.smithi046 on smithi046 2024-05-09T06:21:58.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:21:58 smithi046 ceph-mon[26924]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 -- 172.21.15.46:0/2017089296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 msgr2=0x7f61340fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 --2- 172.21.15.46:0/2017089296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f61340fce40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61240048c0 tx=0x7f6124009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 -- 172.21.15.46:0/2017089296 shutdown_connections 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 --2- 172.21.15.46:0/2017089296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f61340fce40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 -- 172.21.15.46:0/2017089296 >> 172.21.15.46:0/2017089296 conn(0x7f61340f8170 msgr2=0x7f61340fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 -- 172.21.15.46:0/2017089296 shutdown_connections 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.563+0000 7f6138da2700 1 -- 172.21.15.46:0/2017089296 wait complete. 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f6138da2700 1 Processor -- start 2024-05-09T06:21:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f6138da2700 1 -- start start 2024-05-09T06:21:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f6138da2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f6134071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f6138da2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6134072240 con 0x7f61340fca30 2024-05-09T06:21:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f613259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f6134071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f613259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f6134071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57306/0 (socket says 172.21.15.46:57306) 2024-05-09T06:21:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f613259c700 1 -- 172.21.15.46:0/2433994008 learned_addr learned my addr 172.21.15.46:0/2433994008 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f613259c700 1 -- 172.21.15.46:0/2433994008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124005040 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.564+0000 7f613259c700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f6134071d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6124009680 tx=0x7f6124009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.565+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f612400b5c0 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.565+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f612400be70 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.565+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6134070310 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.565+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61240135a0 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.565+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6134070800 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.565+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6124013860 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.566+0000 7f6122ffd700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f611c036880 0x7f611c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.566+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f61240493a0 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.566+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613405f5c0 con 0x7f61340fca30 2024-05-09T06:21:58.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.566+0000 7f6131d9b700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f611c036880 0x7f611c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:21:58.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.566+0000 7f6131d9b700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f611c036880 0x7f611c038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6128009990 tx=0x7f6128006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:21:58.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.571+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6124021020 con 0x7f61340fca30 2024-05-09T06:21:58.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.776+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6134070a40 con 0x7f611c036880 2024-05-09T06:21:58.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.777+0000 7f6122ffd700 1 -- 172.21.15.46:0/2433994008 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f6134070a40 con 0x7f611c036880 2024-05-09T06:21:58.760 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:21:58.761 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.106", "hostname": "smithi106", "labels": [], "status": ""}] 2024-05-09T06:21:58.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f611c036880 msgr2=0x7f611c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:58.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f611c036880 0x7f611c038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6128009990 tx=0x7f6128006e40 comp rx=0 tx=0).stop 2024-05-09T06:21:58.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 msgr2=0x7f6134071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:21:58.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f6134071d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6124009680 tx=0x7f6124009e30 comp rx=0 tx=0).stop 2024-05-09T06:21:58.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 shutdown_connections 2024-05-09T06:21:58.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f611c036880 0x7f611c038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:58.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 --2- 172.21.15.46:0/2433994008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61340fca30 0x7f6134071d00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:21:58.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 >> 172.21.15.46:0/2433994008 conn(0x7f61340f8170 msgr2=0x7f6134103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:21:58.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 shutdown_connections 2024-05-09T06:21:58.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:21:58.779+0000 7f6138da2700 1 -- 172.21.15.46:0/2433994008 wait complete. 2024-05-09T06:21:59.719 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-09T06:21:59.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-09T06:22:00.192 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:22:00.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:00 smithi046 ceph-mon[26924]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:22:00.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:00 smithi046 ceph-mon[26924]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:01.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:01 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 -- 172.21.15.46:0/2601921497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 msgr2=0x7f63300fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 --2- 172.21.15.46:0/2601921497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f63300fbd50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f632c0048c0 tx=0x7f632c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 -- 172.21.15.46:0/2601921497 shutdown_connections 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 --2- 172.21.15.46:0/2601921497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f63300fbd50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 -- 172.21.15.46:0/2601921497 >> 172.21.15.46:0/2601921497 conn(0x7f63300f70a0 msgr2=0x7f63300f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 -- 172.21.15.46:0/2601921497 shutdown_connections 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.030+0000 7f63381d8700 1 -- 172.21.15.46:0/2601921497 wait complete. 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f63381d8700 1 Processor -- start 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f63381d8700 1 -- start start 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f63381d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f633010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f63381d8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633010d5e0 con 0x7f63300fb940 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f6335f74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f633010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f6335f74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f633010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34616/0 (socket says 172.21.15.46:34616) 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f6335f74700 1 -- 172.21.15.46:0/3865582704 learned_addr learned my addr 172.21.15.46:0/3865582704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:22:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f6335f74700 1 -- 172.21.15.46:0/3865582704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c005040 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.031+0000 7f6335f74700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f633010d0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f632c0096b0 tx=0x7f632c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.032+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f632c00bed0 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.032+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633010d7e0 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.032+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f632c00b5c0 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.032+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f632c01c5b0 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.032+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633010e350 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.032+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f632c01c820 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.033+0000 7f63267fc700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f631c036880 0x7f631c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.033+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f632c049d90 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.033+0000 7f6335773700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f631c036880 0x7f631c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.033+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6330101e50 con 0x7f63300fb940 2024-05-09T06:22:02.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.033+0000 7f6335773700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f631c036880 0x7f631c038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6320009990 tx=0x7f6320006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.038+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f632c023300 con 0x7f63300fb940 2024-05-09T06:22:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:02.249+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f633005f5c0 con 0x7f63300fb940 2024-05-09T06:22:02.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:02 smithi046 ceph-mon[26924]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:03.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.138+0000 7f63267fc700 1 -- 172.21.15.46:0/3865582704 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f633005f5c0 con 0x7f63300fb940 2024-05-09T06:22:03.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f631c036880 msgr2=0x7f631c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f631c036880 0x7f631c038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6320009990 tx=0x7f6320006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 msgr2=0x7f633010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f633010d0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f632c0096b0 tx=0x7f632c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 shutdown_connections 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f631c036880 0x7f631c038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 --2- 172.21.15.46:0/3865582704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63300fb940 0x7f633010d0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 >> 172.21.15.46:0/3865582704 conn(0x7f63300f70a0 msgr2=0x7f6330065050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 shutdown_connections 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:22:03.141+0000 7f63381d8700 1 -- 172.21.15.46:0/3865582704 wait complete. 2024-05-09T06:22:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-05-09T06:22:03.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:03 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3865582704' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T06:22:04.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:04 smithi046 ceph-mon[26924]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:04.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:04 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3865582704' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T06:22:04.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:04 smithi046 ceph-mon[26924]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T06:22:04.377 INFO:tasks.cephadm:Adding mon.smithi046 on smithi046 2024-05-09T06:22:04.378 INFO:tasks.cephadm:Adding mon.smithi106 on smithi106 2024-05-09T06:22:04.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch apply mon '2;smithi046:172.21.15.46=smithi046;smithi106:172.21.15.106=smithi106' 2024-05-09T06:22:04.629 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:04.678 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 -- 172.21.15.106:0/2800892575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 msgr2=0x7f60b00fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 --2- 172.21.15.106:0/2800892575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b00fe4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f60a00048c0 tx=0x7f60a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 -- 172.21.15.106:0/2800892575 shutdown_connections 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 --2- 172.21.15.106:0/2800892575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b00fe4a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 -- 172.21.15.106:0/2800892575 >> 172.21.15.106:0/2800892575 conn(0x7f60b00f6850 msgr2=0x7f60b00f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 -- 172.21.15.106:0/2800892575 shutdown_connections 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 -- 172.21.15.106:0/2800892575 wait complete. 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.290+0000 7f60b6453700 1 Processor -- start 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60b6453700 1 -- start start 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60b6453700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60b6453700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b010d5f0 con 0x7f60b00fe090 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60affff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:60072/0 (socket says 172.21.15.106:60072) 2024-05-09T06:22:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60affff700 1 -- 172.21.15.106:0/730011378 learned_addr learned my addr 172.21.15.106:0/730011378 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.291+0000 7f60affff700 1 -- 172.21.15.106:0/730011378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0005040 con 0x7f60b00fe090 2024-05-09T06:22:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.292+0000 7f60affff700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b010d0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60a00096b0 tx=0x7f60a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.292+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60a000bed0 con 0x7f60b00fe090 2024-05-09T06:22:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.292+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60a000b5c0 con 0x7f60b00fe090 2024-05-09T06:22:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.292+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b010d7f0 con 0x7f60b00fe090 2024-05-09T06:22:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.292+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60a001c5b0 con 0x7f60b00fe090 2024-05-09T06:22:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.292+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b010e360 con 0x7f60b00fe090 2024-05-09T06:22:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.293+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0102f60 con 0x7f60b00fe090 2024-05-09T06:22:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.293+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f60a0013a80 con 0x7f60b00fe090 2024-05-09T06:22:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.293+0000 7f60acff9700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f609c036880 0x7f609c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.293+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f60a0049ae0 con 0x7f60b00fe090 2024-05-09T06:22:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.293+0000 7f60af7fe700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f609c036880 0x7f609c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.294+0000 7f60af7fe700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f609c036880 0x7f609c038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6098009990 tx=0x7f6098006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:06.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.298+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f60a0011940 con 0x7f60b00fe090 2024-05-09T06:22:06.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:06 smithi046 ceph-mon[26924]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:06.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.492+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 --> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi106:172.21.15.106=smithi106", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b010e650 con 0x7f609c036880 2024-05-09T06:22:06.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.501+0000 7f60acff9700 1 -- 172.21.15.106:0/730011378 <== mgr.14162 v2:172.21.15.46:6800/2570824935 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f60b010e650 con 0x7f609c036880 2024-05-09T06:22:06.484 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled mon update... 2024-05-09T06:22:06.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f609c036880 msgr2=0x7f609c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:06.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f609c036880 0x7f609c038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6098009990 tx=0x7f6098006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:06.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 msgr2=0x7f60b010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:06.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b010d0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60a00096b0 tx=0x7f60a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:06.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 shutdown_connections 2024-05-09T06:22:06.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f609c036880 0x7f609c038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:06.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 --2- 172.21.15.106:0/730011378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60b00fe090 0x7f60b010d0b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:06.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 >> 172.21.15.106:0/730011378 conn(0x7f60b00f6850 msgr2=0x7f60b0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:06.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 shutdown_connections 2024-05-09T06:22:06.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:06.503+0000 7f60b6453700 1 -- 172.21.15.106:0/730011378 wait complete. 2024-05-09T06:22:07.053 DEBUG:teuthology.orchestra.run.smithi106:mon.smithi106> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106.service 2024-05-09T06:22:07.056 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:07.056 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:07.332 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:07.380 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:07.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:07 smithi046 ceph-mon[26924]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi106:172.21.15.106=smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:22:07.817 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:07 smithi046 ceph-mon[26924]: Saving service mon spec with placement smithi046:172.21.15.46=smithi046;smithi106:172.21.15.106=smithi106;count:2 2024-05-09T06:22:07.817 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:07 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:07.817 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:07 smithi046 ceph-mon[26924]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:08.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 -- 172.21.15.106:0/1878575385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 msgr2=0x7f74580fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:08.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 --2- 172.21.15.106:0/1878575385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f74580fce40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f744c0048c0 tx=0x7f744c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 -- 172.21.15.106:0/1878575385 shutdown_connections 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 --2- 172.21.15.106:0/1878575385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f74580fce40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 -- 172.21.15.106:0/1878575385 >> 172.21.15.106:0/1878575385 conn(0x7f74580f8170 msgr2=0x7f74580fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 -- 172.21.15.106:0/1878575385 shutdown_connections 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.793+0000 7f745ee60700 1 -- 172.21.15.106:0/1878575385 wait complete. 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745ee60700 1 Processor -- start 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745ee60700 1 -- start start 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745ee60700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f745810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745ee60700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745810d5d0 con 0x7f74580fca30 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745cbfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f745810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745cbfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f745810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:60094/0 (socket says 172.21.15.106:60094) 2024-05-09T06:22:08.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.794+0000 7f745cbfc700 1 -- 172.21.15.106:0/3734313115 learned_addr learned my addr 172.21.15.106:0/3734313115 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f745cbfc700 1 -- 172.21.15.106:0/3734313115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c005040 con 0x7f74580fca30 2024-05-09T06:22:08.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f745cbfc700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f745810d090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f744c0096b0 tx=0x7f744c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f744c00bed0 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745810d7d0 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f744c00b5c0 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f744c01c5b0 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.795+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745810e340 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.796+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7458102f40 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.796+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f744c013a80 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.796+0000 7f74557fa700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7448036880 0x7f7448038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.796+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f744c049a20 con 0x7f74580fca30 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.796+0000 7f7457fff700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7448036880 0x7f7448038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:08.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.797+0000 7f7457fff700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7448036880 0x7f7448038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7444009990 tx=0x7f7444006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:08.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:08.801+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f744c011940 con 0x7f74580fca30 2024-05-09T06:22:09.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.060+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f745810ed50 con 0x7f74580fca30 2024-05-09T06:22:09.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.060+0000 7f74557fa700 1 -- 172.21.15.106:0/3734313115 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f744c011370 con 0x7f74580fca30 2024-05-09T06:22:09.044 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:09.044 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.062+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7448036880 msgr2=0x7f7448038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.062+0000 7f745ee60700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7448036880 0x7f7448038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7444009990 tx=0x7f7444006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.062+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 msgr2=0x7f745810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.062+0000 7f745ee60700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f745810d090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f744c0096b0 tx=0x7f744c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.063+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 shutdown_connections 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.063+0000 7f745ee60700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7448036880 0x7f7448038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.063+0000 7f745ee60700 1 --2- 172.21.15.106:0/3734313115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74580fca30 0x7f745810d090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.063+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 >> 172.21.15.106:0/3734313115 conn(0x7f74580f8170 msgr2=0x7f7458103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:09.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.063+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 shutdown_connections 2024-05-09T06:22:09.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:09.063+0000 7f745ee60700 1 -- 172.21.15.106:0/3734313115 wait complete. 2024-05-09T06:22:09.047 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:09.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:09.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:09 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/3734313115' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:10.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:10 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-09T06:22:10.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:10 smithi046 ceph-mon[26924]: Deploying daemon grafana.smithi046 on smithi046 2024-05-09T06:22:10.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:10 smithi046 ceph-mon[26924]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:10.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:10 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:10.656 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:10.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:10.908 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:10.955 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:12.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- 172.21.15.106:0/2413267155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 msgr2=0x7f76ac0ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:12.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 --2- 172.21.15.106:0/2413267155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac0ff6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f769c0048c0 tx=0x7f769c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- 172.21.15.106:0/2413267155 shutdown_connections 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 --2- 172.21.15.106:0/2413267155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac0ff6d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- 172.21.15.106:0/2413267155 >> 172.21.15.106:0/2413267155 conn(0x7f76ac0f70a0 msgr2=0x7f76ac0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- 172.21.15.106:0/2413267155 shutdown_connections 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- 172.21.15.106:0/2413267155 wait complete. 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 Processor -- start 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- start start 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.309+0000 7f76b1ac4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac10d640 con 0x7f76ac066920 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76ab7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:60122/0 (socket says 172.21.15.106:60122) 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76ab7fe700 1 -- 172.21.15.106:0/1948259315 learned_addr learned my addr 172.21.15.106:0/1948259315 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:12.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76ab7fe700 1 -- 172.21.15.106:0/1948259315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c005040 con 0x7f76ac066920 2024-05-09T06:22:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76ab7fe700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac10d100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f769c00b880 tx=0x7f769c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f769c00bbc0 con 0x7f76ac066920 2024-05-09T06:22:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac10d840 con 0x7f76ac066920 2024-05-09T06:22:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f769c00bd20 con 0x7f76ac066920 2024-05-09T06:22:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f769c01c690 con 0x7f76ac066920 2024-05-09T06:22:12.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.310+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac10e3b0 con 0x7f76ac066920 2024-05-09T06:22:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.311+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f769c013420 con 0x7f76ac066920 2024-05-09T06:22:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.311+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac102f50 con 0x7f76ac066920 2024-05-09T06:22:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.311+0000 7f7693fff700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7694036880 0x7f7694038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.311+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f769c049b50 con 0x7f76ac066920 2024-05-09T06:22:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.312+0000 7f76aaffd700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7694036880 0x7f7694038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:12.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.312+0000 7f76aaffd700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7694036880 0x7f7694038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009990 tx=0x7f76a0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:12.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.317+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f769c013b10 con 0x7f76ac066920 2024-05-09T06:22:12.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.576+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f76ac10edc0 con 0x7f76ac066920 2024-05-09T06:22:12.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.577+0000 7f7693fff700 1 -- 172.21.15.106:0/1948259315 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f769c011370 con 0x7f76ac066920 2024-05-09T06:22:12.560 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:12.560 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7694036880 msgr2=0x7f7694038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7694036880 0x7f7694038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009990 tx=0x7f76a0006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 msgr2=0x7f76ac10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac10d100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f769c00b880 tx=0x7f769c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 shutdown_connections 2024-05-09T06:22:12.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f7694036880 0x7f7694038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 --2- 172.21.15.106:0/1948259315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76ac066920 0x7f76ac10d100 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 >> 172.21.15.106:0/1948259315 conn(0x7f76ac0f70a0 msgr2=0x7f76ac103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 shutdown_connections 2024-05-09T06:22:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:12.579+0000 7f76b1ac4700 1 -- 172.21.15.106:0/1948259315 wait complete. 2024-05-09T06:22:12.563 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:12 smithi046 ceph-mon[26924]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:13.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:13 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1948259315' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:14.158 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:14.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:14.417 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:14.466 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:14.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:14 smithi046 ceph-mon[26924]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 -- 172.21.15.106:0/3926693542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 msgr2=0x7fa6180fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 --2- 172.21.15.106:0/3926693542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa6180fbd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0048c0 tx=0x7fa60c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 -- 172.21.15.106:0/3926693542 shutdown_connections 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 --2- 172.21.15.106:0/3926693542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa6180fbd50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 -- 172.21.15.106:0/3926693542 >> 172.21.15.106:0/3926693542 conn(0x7fa6180f70a0 msgr2=0x7fa6180f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 -- 172.21.15.106:0/3926693542 shutdown_connections 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 -- 172.21.15.106:0/3926693542 wait complete. 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 Processor -- start 2024-05-09T06:22:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.925+0000 7fa61eb9a700 1 -- start start 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61eb9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa618065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61eb9a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61810fdb0 con 0x7fa6180fb940 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61c936700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa618065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61c936700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa618065bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:37506/0 (socket says 172.21.15.106:37506) 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61c936700 1 -- 172.21.15.106:0/1974017780 learned_addr learned my addr 172.21.15.106:0/1974017780 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61c936700 1 -- 172.21.15.106:0/1974017780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c005040 con 0x7fa6180fb940 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.926+0000 7fa61c936700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa618065bb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0096b0 tx=0x7fa60c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.927+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa60c00bed0 con 0x7fa6180fb940 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.927+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa60c00b5c0 con 0x7fa6180fb940 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.927+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61810fef0 con 0x7fa6180fb940 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.927+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa60c01c5b0 con 0x7fa6180fb940 2024-05-09T06:22:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.927+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6181103e0 con 0x7fa6180fb940 2024-05-09T06:22:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.928+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa60c01c820 con 0x7fa6180fb940 2024-05-09T06:22:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.928+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa618105900 con 0x7fa6180fb940 2024-05-09T06:22:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.928+0000 7fa6157fa700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa608036880 0x7fa608038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.928+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa60c049bd0 con 0x7fa6180fb940 2024-05-09T06:22:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.928+0000 7fa617fff700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa608036880 0x7fa608038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.928+0000 7fa617fff700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa608036880 0x7fa608038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa604009990 tx=0x7fa604006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:15.933+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa60c023300 con 0x7fa6180fb940 2024-05-09T06:22:16.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.194+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa61805f5c0 con 0x7fa6180fb940 2024-05-09T06:22:16.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.195+0000 7fa6157fa700 1 -- 172.21.15.106:0/1974017780 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa60c011b60 con 0x7fa6180fb940 2024-05-09T06:22:16.178 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:16.178 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa608036880 msgr2=0x7fa608038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa608036880 0x7fa608038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa604009990 tx=0x7fa604006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 msgr2=0x7fa618065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa618065bb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0096b0 tx=0x7fa60c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 shutdown_connections 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fa608036880 0x7fa608038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 --2- 172.21.15.106:0/1974017780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6180fb940 0x7fa618065bb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 >> 172.21.15.106:0/1974017780 conn(0x7fa6180f70a0 msgr2=0x7fa618102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 shutdown_connections 2024-05-09T06:22:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:16.197+0000 7fa61eb9a700 1 -- 172.21.15.106:0/1974017780 wait complete. 2024-05-09T06:22:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:16.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:16 smithi046 ceph-mon[26924]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:16.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:16 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1974017780' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:17.754 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:17.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:18.005 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:18.054 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:18.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:18 smithi046 ceph-mon[26924]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1286999215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 msgr2=0x7ff4f80fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 --2- 172.21.15.106:0/1286999215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f80fbd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00048c0 tx=0x7ff4f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1286999215 shutdown_connections 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 --2- 172.21.15.106:0/1286999215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f80fbd50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1286999215 >> 172.21.15.106:0/1286999215 conn(0x7ff4f80f70a0 msgr2=0x7ff4f80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1286999215 shutdown_connections 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.433+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1286999215 wait complete. 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fee8c700 1 Processor -- start 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fee8c700 1 -- start start 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fee8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f8065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fee8c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f810fdb0 con 0x7ff4f80fb940 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fcc28700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f8065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fcc28700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f8065bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:37528/0 (socket says 172.21.15.106:37528) 2024-05-09T06:22:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.434+0000 7ff4fcc28700 1 -- 172.21.15.106:0/1143052473 learned_addr learned my addr 172.21.15.106:0/1143052473 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4fcc28700 1 -- 172.21.15.106:0/1143052473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0005040 con 0x7ff4f80fb940 2024-05-09T06:22:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4fcc28700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f8065bb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009680 tx=0x7ff4f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f000b5c0 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f810fef0 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4f000be70 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4f00135a0 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.435+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f81103e0 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.436+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7ff4f001c430 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.436+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8105900 con 0x7ff4f80fb940 2024-05-09T06:22:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.436+0000 7ff4f57fa700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7ff4e4036880 0x7ff4e4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.436+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff4f0049460 con 0x7ff4f80fb940 2024-05-09T06:22:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.436+0000 7ff4f7fff700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7ff4e4036880 0x7ff4e4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.437+0000 7ff4f7fff700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7ff4e4036880 0x7ff4e4038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800ad90 tx=0x7ff4e8009410 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.442+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff4f001c7d0 con 0x7ff4f80fb940 2024-05-09T06:22:19.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.703+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff4f805f5c0 con 0x7ff4f80fb940 2024-05-09T06:22:19.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.703+0000 7ff4f57fa700 1 -- 172.21.15.106:0/1143052473 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff4f0021070 con 0x7ff4f80fb940 2024-05-09T06:22:19.686 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:19.686 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:19.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7ff4e4036880 msgr2=0x7ff4e4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:19.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7ff4e4036880 0x7ff4e4038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800ad90 tx=0x7ff4e8009410 comp rx=0 tx=0).stop 2024-05-09T06:22:19.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 msgr2=0x7ff4f8065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:19.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f8065bb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009680 tx=0x7ff4f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:19.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 shutdown_connections 2024-05-09T06:22:19.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7ff4e4036880 0x7ff4e4038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:19.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 --2- 172.21.15.106:0/1143052473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4f80fb940 0x7ff4f8065bb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:19.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 >> 172.21.15.106:0/1143052473 conn(0x7ff4f80f70a0 msgr2=0x7ff4f8102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:19.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 shutdown_connections 2024-05-09T06:22:19.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:19.705+0000 7ff4fee8c700 1 -- 172.21.15.106:0/1143052473 wait complete. 2024-05-09T06:22:19.689 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:20 smithi046 ceph-mon[26924]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:20 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1143052473' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:21.289 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:21.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:22.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:22 smithi046 ceph-mon[26924]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:22.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 -- 172.21.15.106:0/20557944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 msgr2=0x7fbaf80fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 --2- 172.21.15.106:0/20557944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf80fbd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40048c0 tx=0x7fbaf4009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 -- 172.21.15.106:0/20557944 shutdown_connections 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 --2- 172.21.15.106:0/20557944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf80fbd50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 -- 172.21.15.106:0/20557944 >> 172.21.15.106:0/20557944 conn(0x7fbaf80f70a0 msgr2=0x7fbaf80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 -- 172.21.15.106:0/20557944 shutdown_connections 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 -- 172.21.15.106:0/20557944 wait complete. 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.960+0000 7fbb0017a700 1 Processor -- start 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbb0017a700 1 -- start start 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbb0017a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf8065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbb0017a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf810fdb0 con 0x7fbaf80fb940 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbafdf16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf8065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbafdf16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf8065bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:37540/0 (socket says 172.21.15.106:37540) 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbafdf16700 1 -- 172.21.15.106:0/2360813722 learned_addr learned my addr 172.21.15.106:0/2360813722 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbafdf16700 1 -- 172.21.15.106:0/2360813722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4005040 con 0x7fbaf80fb940 2024-05-09T06:22:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.961+0000 7fbafdf16700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf8065bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40096b0 tx=0x7fbaf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.962+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf400bed0 con 0x7fbaf80fb940 2024-05-09T06:22:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.962+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbaf400b5c0 con 0x7fbaf80fb940 2024-05-09T06:22:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.962+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf810fef0 con 0x7fbaf80fb940 2024-05-09T06:22:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.962+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaf401c5b0 con 0x7fbaf80fb940 2024-05-09T06:22:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.962+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf81103e0 con 0x7fbaf80fb940 2024-05-09T06:22:22.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.963+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf8105900 con 0x7fbaf80fb940 2024-05-09T06:22:22.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.963+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fbaf4004d30 con 0x7fbaf80fb940 2024-05-09T06:22:22.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.963+0000 7fbaee7fc700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fbae4036880 0x7fbae4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:22.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.963+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbaf4049ab0 con 0x7fbaf80fb940 2024-05-09T06:22:22.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.963+0000 7fbafd715700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fbae4036880 0x7fbae4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:22.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.963+0000 7fbafd715700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fbae4036880 0x7fbae4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009990 tx=0x7fbae8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:22.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:22.968+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbaf4011960 con 0x7fbaf80fb940 2024-05-09T06:22:23.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.229+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbaf805f5c0 con 0x7fbaf80fb940 2024-05-09T06:22:23.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.229+0000 7fbaee7fc700 1 -- 172.21.15.106:0/2360813722 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fbaf4011370 con 0x7fbaf80fb940 2024-05-09T06:22:23.213 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:23.213 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fbae4036880 msgr2=0x7fbae4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fbae4036880 0x7fbae4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009990 tx=0x7fbae8006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 msgr2=0x7fbaf8065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf8065bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40096b0 tx=0x7fbaf4009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 shutdown_connections 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fbae4036880 0x7fbae4038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 --2- 172.21.15.106:0/2360813722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaf80fb940 0x7fbaf8065bb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 >> 172.21.15.106:0/2360813722 conn(0x7fbaf80f70a0 msgr2=0x7fbaf8102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.231+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 shutdown_connections 2024-05-09T06:22:23.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:23.232+0000 7fbb0017a700 1 -- 172.21.15.106:0/2360813722 wait complete. 2024-05-09T06:22:23.216 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:23.567 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:23 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2360813722' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:24.377 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:24 smithi046 ceph-mon[26924]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:24.834 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:24.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:25.141 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:26.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:26.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:26.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:26.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:26.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:26.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:26.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:26 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 -- 172.21.15.106:0/2421406112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 msgr2=0x7f42ec0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 --2- 172.21.15.106:0/2421406112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec0ff6b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0048c0 tx=0x7f42dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 -- 172.21.15.106:0/2421406112 shutdown_connections 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 --2- 172.21.15.106:0/2421406112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec0ff6b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 -- 172.21.15.106:0/2421406112 >> 172.21.15.106:0/2421406112 conn(0x7f42ec0f70a0 msgr2=0x7f42ec0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 -- 172.21.15.106:0/2421406112 shutdown_connections 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.672+0000 7f42f1300700 1 -- 172.21.15.106:0/2421406112 wait complete. 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42f1300700 1 Processor -- start 2024-05-09T06:22:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42f1300700 1 -- start start 2024-05-09T06:22:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42f1300700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42f1300700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec10d650 con 0x7f42ec0669a0 2024-05-09T06:22:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42eaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42eaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec10d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:45550/0 (socket says 172.21.15.106:45550) 2024-05-09T06:22:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.673+0000 7f42eaffd700 1 -- 172.21.15.106:0/2482419697 learned_addr learned my addr 172.21.15.106:0/2482419697 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42eaffd700 1 -- 172.21.15.106:0/2482419697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc005040 con 0x7f42ec0669a0 2024-05-09T06:22:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42eaffd700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec10d110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00b900 tx=0x7f42dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f42dc00b5c0 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42dc00be70 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec10d850 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f42dc01c590 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.674+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec10e3c0 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.675+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f42dc01c800 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.675+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec102f40 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.675+0000 7f42e37fe700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f42d80368d0 0x7f42d8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.675+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f42dc049580 con 0x7f42ec0669a0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.675+0000 7f42ea7fc700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f42d80368d0 0x7f42d8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.676+0000 7f42ea7fc700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f42d80368d0 0x7f42d8038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009990 tx=0x7f42d4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.680+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f42dc011960 con 0x7f42ec0669a0 2024-05-09T06:22:26.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.936+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f42ec10edd0 con 0x7f42ec0669a0 2024-05-09T06:22:26.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.936+0000 7f42e37fe700 1 -- 172.21.15.106:0/2482419697 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f42dc011370 con 0x7f42ec0669a0 2024-05-09T06:22:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:26.920 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f42d80368d0 msgr2=0x7f42d8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f42d80368d0 0x7f42d8038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009990 tx=0x7f42d4006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 msgr2=0x7f42ec10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec10d110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00b900 tx=0x7f42dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 shutdown_connections 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f42d80368d0 0x7f42d8038d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 --2- 172.21.15.106:0/2482419697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec0669a0 0x7f42ec10d110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.938+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 >> 172.21.15.106:0/2482419697 conn(0x7f42ec0f70a0 msgr2=0x7f42ec103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.939+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 shutdown_connections 2024-05-09T06:22:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:26.939+0000 7f42f1300700 1 -- 172.21.15.106:0/2482419697 wait complete. 2024-05-09T06:22:26.923 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:27.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:27 smithi046 ceph-mon[26924]: Deploying daemon prometheus.smithi046 on smithi046 2024-05-09T06:22:27.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:27 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2482419697' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:28.504 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:28.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:28.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:28 smithi046 ceph-mon[26924]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:28.753 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:28.801 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:30.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 -- 172.21.15.106:0/211174867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 msgr2=0x7f5bf80fe2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 --2- 172.21.15.106:0/211174867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fe2b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00048c0 tx=0x7f5bf0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 -- 172.21.15.106:0/211174867 shutdown_connections 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 --2- 172.21.15.106:0/211174867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fe2b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 -- 172.21.15.106:0/211174867 >> 172.21.15.106:0/211174867 conn(0x7f5bf80f6660 msgr2=0x7f5bf80f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 -- 172.21.15.106:0/211174867 shutdown_connections 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.276+0000 7f5bfc99f700 1 -- 172.21.15.106:0/211174867 wait complete. 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bfc99f700 1 Processor -- start 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bfc99f700 1 -- start start 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bfc99f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bfc99f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80fdaf0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:45564/0 (socket says 172.21.15.106:45564) 2024-05-09T06:22:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.277+0000 7f5bf77fe700 1 -- 172.21.15.106:0/656848331 learned_addr learned my addr 172.21.15.106:0/656848331 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5bf77fe700 1 -- 172.21.15.106:0/656848331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0005040 con 0x7f5bf80fdea0 2024-05-09T06:22:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5bf77fe700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fd5b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009680 tx=0x7f5bf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bf000b5c0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf80fbbc0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bf000be70 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bf00135a0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.278+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf80fc0b0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.279+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf805f5c0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.279+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f5bf001ca90 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.279+0000 7f5beffff700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f5be40368d0 0x7f5be4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.279+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5bf0049360 con 0x7f5bf80fdea0 2024-05-09T06:22:30.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.279+0000 7f5bf6ffd700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f5be40368d0 0x7f5be4038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:30.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.280+0000 7f5bf6ffd700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f5be40368d0 0x7f5be4038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009990 tx=0x7f5be0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:30.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.284+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5bf0011960 con 0x7f5bf80fdea0 2024-05-09T06:22:30.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.542+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5bf804bed0 con 0x7f5bf80fdea0 2024-05-09T06:22:30.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.543+0000 7f5beffff700 1 -- 172.21.15.106:0/656848331 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5bf0021020 con 0x7f5bf80fdea0 2024-05-09T06:22:30.526 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:30.526 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.545+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f5be40368d0 msgr2=0x7f5be4038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.545+0000 7f5bfc99f700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f5be40368d0 0x7f5be4038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009990 tx=0x7f5be0006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.545+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 msgr2=0x7f5bf80fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.545+0000 7f5bfc99f700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fd5b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009680 tx=0x7f5bf0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.546+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 shutdown_connections 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.546+0000 7f5bfc99f700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f5be40368d0 0x7f5be4038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.546+0000 7f5bfc99f700 1 --2- 172.21.15.106:0/656848331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bf80fdea0 0x7f5bf80fd5b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.546+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 >> 172.21.15.106:0/656848331 conn(0x7f5bf80f6660 msgr2=0x7f5bf81039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.546+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 shutdown_connections 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:30.546+0000 7f5bfc99f700 1 -- 172.21.15.106:0/656848331 wait complete. 2024-05-09T06:22:30.529 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:30.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:30 smithi046 ceph-mon[26924]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:30.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:30 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:31.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:31 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/656848331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:32.123 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:32.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:32.373 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:32.420 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:32.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:32 smithi046 ceph-mon[26924]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.852+0000 7f03ad5f4700 1 -- 172.21.15.106:0/492749429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 msgr2=0x7f03a80fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.852+0000 7f03ad5f4700 1 --2- 172.21.15.106:0/492749429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80fbd40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03980048c0 tx=0x7f0398009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.852+0000 7f03ad5f4700 1 -- 172.21.15.106:0/492749429 shutdown_connections 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.852+0000 7f03ad5f4700 1 --2- 172.21.15.106:0/492749429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80fbd40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.852+0000 7f03ad5f4700 1 -- 172.21.15.106:0/492749429 >> 172.21.15.106:0/492749429 conn(0x7f03a80f7070 msgr2=0x7f03a80f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.853+0000 7f03ad5f4700 1 -- 172.21.15.106:0/492749429 shutdown_connections 2024-05-09T06:22:33.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.853+0000 7f03ad5f4700 1 -- 172.21.15.106:0/492749429 wait complete. 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.853+0000 7f03ad5f4700 1 Processor -- start 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.853+0000 7f03ad5f4700 1 -- start start 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.853+0000 7f03ad5f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.853+0000 7f03ad5f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a810fda0 con 0x7f03a80fb930 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03a6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03a6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80667c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:40008/0 (socket says 172.21.15.106:40008) 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03a6ffd700 1 -- 172.21.15.106:0/2755086313 learned_addr learned my addr 172.21.15.106:0/2755086313 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03a6ffd700 1 -- 172.21.15.106:0/2755086313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398005040 con 0x7f03a80fb930 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03a6ffd700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80667c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f03980096b0 tx=0x7f0398009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f039800bed0 con 0x7f03a80fb930 2024-05-09T06:22:33.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f039800b5c0 con 0x7f03a80fb930 2024-05-09T06:22:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a810fee0 con 0x7f03a80fb930 2024-05-09T06:22:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f039801c5b0 con 0x7f03a80fb930 2024-05-09T06:22:33.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.854+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a81103d0 con 0x7f03a80fb930 2024-05-09T06:22:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.855+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f039801c820 con 0x7f03a80fb930 2024-05-09T06:22:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.855+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a81058f0 con 0x7f03a80fb930 2024-05-09T06:22:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.856+0000 7f038f7fe700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f0390036880 0x7f0390038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.856+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0398049af0 con 0x7f03a80fb930 2024-05-09T06:22:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.856+0000 7f03a67fc700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f0390036880 0x7f0390038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:33.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.856+0000 7f03a67fc700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f0390036880 0x7f0390038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f039c009990 tx=0x7f039c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:33.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:33.861+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0398025400 con 0x7f03a80fb930 2024-05-09T06:22:34.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.120+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03a81017f0 con 0x7f03a80fb930 2024-05-09T06:22:34.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.120+0000 7f038f7fe700 1 -- 172.21.15.106:0/2755086313 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0398011370 con 0x7f03a80fb930 2024-05-09T06:22:34.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:34.104 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.122+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f0390036880 msgr2=0x7f0390038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.122+0000 7f03ad5f4700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f0390036880 0x7f0390038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f039c009990 tx=0x7f039c006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 msgr2=0x7f03a80667c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80667c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f03980096b0 tx=0x7f0398009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 shutdown_connections 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f0390036880 0x7f0390038d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 --2- 172.21.15.106:0/2755086313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03a80fb930 0x7f03a80667c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 >> 172.21.15.106:0/2755086313 conn(0x7f03a80f7070 msgr2=0x7f03a8102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:34.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 shutdown_connections 2024-05-09T06:22:34.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:34.123+0000 7f03ad5f4700 1 -- 172.21.15.106:0/2755086313 wait complete. 2024-05-09T06:22:34.107 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:34.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:34 smithi046 ceph-mon[26924]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:34.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:34 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2755086313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:35.666 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:35.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:35.917 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:35.965 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:36.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:36 smithi046 ceph-mon[26924]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.497+0000 7f9d2264a700 1 -- 172.21.15.106:0/2875714193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 msgr2=0x7f9d1c0fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.497+0000 7f9d2264a700 1 --2- 172.21.15.106:0/2875714193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c0fbce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0048c0 tx=0x7f9d0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.497+0000 7f9d2264a700 1 -- 172.21.15.106:0/2875714193 shutdown_connections 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.497+0000 7f9d2264a700 1 --2- 172.21.15.106:0/2875714193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c0fbce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.497+0000 7f9d2264a700 1 -- 172.21.15.106:0/2875714193 >> 172.21.15.106:0/2875714193 conn(0x7f9d1c0f7030 msgr2=0x7f9d1c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.497+0000 7f9d2264a700 1 -- 172.21.15.106:0/2875714193 shutdown_connections 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.498+0000 7f9d2264a700 1 -- 172.21.15.106:0/2875714193 wait complete. 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.498+0000 7f9d2264a700 1 Processor -- start 2024-05-09T06:22:37.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.498+0000 7f9d2264a700 1 -- start start 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.498+0000 7f9d2264a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.498+0000 7f9d2264a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c10c460 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:40030/0 (socket says 172.21.15.106:40030) 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d1bfff700 1 -- 172.21.15.106:0/3932867884 learned_addr learned my addr 172.21.15.106:0/3932867884 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d1bfff700 1 -- 172.21.15.106:0/3932867884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c005040 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d1bfff700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c10bf20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0096b0 tx=0x7f9d0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d0c00bed0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c10c660 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d0c00b5c0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d0c01c5b0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.499+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c10d1d0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.500+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c101de0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.500+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f9d0c013a80 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.500+0000 7f9d18ff9700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f9d04038a90 0x7f9d0403af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:37.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.501+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9d0c049aa0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.501+0000 7f9d1b7fe700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f9d04038a90 0x7f9d0403af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:37.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.501+0000 7f9d1b7fe700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f9d04038a90 0x7f9d0403af40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009990 tx=0x7f9d10006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:37.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.506+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9d0c011940 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.765+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9d1c05f5c0 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.766+0000 7f9d18ff9700 1 -- 172.21.15.106:0/3932867884 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9d0c011370 con 0x7f9d1c0fb8d0 2024-05-09T06:22:37.749 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:37.749 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:37.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f9d04038a90 msgr2=0x7f9d0403af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:37.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f9d04038a90 0x7f9d0403af40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009990 tx=0x7f9d10006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:37.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 msgr2=0x7f9d1c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:37.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c10bf20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0096b0 tx=0x7f9d0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 shutdown_connections 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f9d04038a90 0x7f9d0403af40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 --2- 172.21.15.106:0/3932867884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c0fb8d0 0x7f9d1c10bf20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 >> 172.21.15.106:0/3932867884 conn(0x7f9d1c0f7030 msgr2=0x7f9d1c102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 shutdown_connections 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:37.768+0000 7f9d2264a700 1 -- 172.21.15.106:0/3932867884 wait complete. 2024-05-09T06:22:37.752 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:38.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:38 smithi046 ceph-mon[26924]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:38.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:38 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/3932867884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:39.286 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:39.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:39.534 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:39.583 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:40.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:40 smithi046 ceph-mon[26924]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 -- 172.21.15.106:0/4204058503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 msgr2=0x7f8ef40fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 --2- 172.21.15.106:0/4204058503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef40fce40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40048c0 tx=0x7f8ee4009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 -- 172.21.15.106:0/4204058503 shutdown_connections 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 --2- 172.21.15.106:0/4204058503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef40fce40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 -- 172.21.15.106:0/4204058503 >> 172.21.15.106:0/4204058503 conn(0x7f8ef40f8170 msgr2=0x7f8ef40fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 -- 172.21.15.106:0/4204058503 shutdown_connections 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.000+0000 7f8ef908c700 1 -- 172.21.15.106:0/4204058503 wait complete. 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.001+0000 7f8ef908c700 1 Processor -- start 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.001+0000 7f8ef908c700 1 -- start start 2024-05-09T06:22:40.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.001+0000 7f8ef908c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:40.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.001+0000 7f8ef908c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef410d5f0 con 0x7f8ef40fca30 2024-05-09T06:22:40.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.001+0000 7f8ef2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:40.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8ef2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:40052/0 (socket says 172.21.15.106:40052) 2024-05-09T06:22:40.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8ef2d9d700 1 -- 172.21.15.106:0/1377055618 learned_addr learned my addr 172.21.15.106:0/1377055618 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:40.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8ef2d9d700 1 -- 172.21.15.106:0/1377055618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4005040 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8ef2d9d700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef410d0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40096b0 tx=0x7f8ee4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ee400bed0 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ee400b5c0 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef410d7f0 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ee401c5b0 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.002+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef410e360 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.003+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef4102f40 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.003+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f8ee4013a80 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.003+0000 7f8eebfff700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f8ee00368d0 0x7f8ee0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.003+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8ee4049980 con 0x7f8ef40fca30 2024-05-09T06:22:40.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.004+0000 7f8eea59c700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f8ee00368d0 0x7f8ee0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:40.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.004+0000 7f8eea59c700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f8ee00368d0 0x7f8ee0038d80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009990 tx=0x7f8edc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:40.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.009+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8ee4011960 con 0x7f8ef40fca30 2024-05-09T06:22:41.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.269+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8ef410ed70 con 0x7f8ef40fca30 2024-05-09T06:22:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.270+0000 7f8eebfff700 1 -- 172.21.15.106:0/1377055618 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8ee4011370 con 0x7f8ef40fca30 2024-05-09T06:22:41.253 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:41.253 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f8ee00368d0 msgr2=0x7f8ee0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f8ee00368d0 0x7f8ee0038d80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009990 tx=0x7f8edc006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 msgr2=0x7f8ef410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef410d0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40096b0 tx=0x7f8ee4009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 shutdown_connections 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f8ee00368d0 0x7f8ee0038d80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 --2- 172.21.15.106:0/1377055618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ef40fca30 0x7f8ef410d0b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 >> 172.21.15.106:0/1377055618 conn(0x7f8ef40f8170 msgr2=0x7f8ef4103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 shutdown_connections 2024-05-09T06:22:41.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:41.272+0000 7f8ef908c700 1 -- 172.21.15.106:0/1377055618 wait complete. 2024-05-09T06:22:41.256 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:41.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:41 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1377055618' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:42.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:42 smithi046 ceph-mon[26924]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:42.857 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:42.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:43.109 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:43.157 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:44.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:44 smithi046 ceph-mon[26924]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.764+0000 7fe556cc5700 1 -- 172.21.15.106:0/1180017105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 msgr2=0x7fe5500fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.764+0000 7fe556cc5700 1 --2- 172.21.15.106:0/1180017105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe5500fe4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5480048c0 tx=0x7fe548009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 -- 172.21.15.106:0/1180017105 shutdown_connections 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 --2- 172.21.15.106:0/1180017105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe5500fe4a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 -- 172.21.15.106:0/1180017105 >> 172.21.15.106:0/1180017105 conn(0x7fe5500f6850 msgr2=0x7fe5500f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 -- 172.21.15.106:0/1180017105 shutdown_connections 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 -- 172.21.15.106:0/1180017105 wait complete. 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 Processor -- start 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 -- start start 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe55010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.765+0000 7fe556cc5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55010d5f0 con 0x7fe5500fe090 2024-05-09T06:22:44.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe554a61700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe55010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:44.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe554a61700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe55010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:45368/0 (socket says 172.21.15.106:45368) 2024-05-09T06:22:44.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe554a61700 1 -- 172.21.15.106:0/565050486 learned_addr learned my addr 172.21.15.106:0/565050486 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:44.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe554a61700 1 -- 172.21.15.106:0/565050486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548005040 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe554a61700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe55010d0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe548009680 tx=0x7fe548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe54800b5c0 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55010d7f0 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe54800be70 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5480135a0 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.766+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55010e360 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.767+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe550102f60 con 0x7fe5500fe090 2024-05-09T06:22:44.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.767+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe548004d30 con 0x7fe5500fe090 2024-05-09T06:22:44.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.768+0000 7fe54d7fa700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fe53c036880 0x7fe53c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:44.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.768+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe5480493a0 con 0x7fe5500fe090 2024-05-09T06:22:44.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.768+0000 7fe54ffff700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fe53c036880 0x7fe53c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:44.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.768+0000 7fe54ffff700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fe53c036880 0x7fe53c038d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe54000ad90 tx=0x7fe540009410 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:44.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:44.773+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe548011960 con 0x7fe5500fe090 2024-05-09T06:22:45.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.030+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe55010ed70 con 0x7fe5500fe090 2024-05-09T06:22:45.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.030+0000 7fe54d7fa700 1 -- 172.21.15.106:0/565050486 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe548021070 con 0x7fe5500fe090 2024-05-09T06:22:45.013 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:45.013 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:45.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fe53c036880 msgr2=0x7fe53c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:45.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fe53c036880 0x7fe53c038d30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe54000ad90 tx=0x7fe540009410 comp rx=0 tx=0).stop 2024-05-09T06:22:45.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 msgr2=0x7fe55010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe55010d0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe548009680 tx=0x7fe548009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 shutdown_connections 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fe53c036880 0x7fe53c038d30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 --2- 172.21.15.106:0/565050486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5500fe090 0x7fe55010d0b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 >> 172.21.15.106:0/565050486 conn(0x7fe5500f6850 msgr2=0x7fe550103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 shutdown_connections 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:45.032+0000 7fe556cc5700 1 -- 172.21.15.106:0/565050486 wait complete. 2024-05-09T06:22:45.015 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:45.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:45 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/565050486' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:46.560 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:46.561 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:46.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:46 smithi046 ceph-mon[26924]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:22:46.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:46.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:46.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:46.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:46 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-09T06:22:46.803 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:48.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:48 smithi046 ceph-mon[26924]: from='mgr.14162 172.21.15.46:0/2357703965' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-09T06:22:48.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:48 smithi046 ceph-mon[26924]: mgrmap e14: smithi046.nvpcui(active, since 71s) 2024-05-09T06:22:48.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 -- 172.21.15.106:0/2325762798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 msgr2=0x7f79f00ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:48.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 --2- 172.21.15.106:0/2325762798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f00ff630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79e00048c0 tx=0x7f79e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:48.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 -- 172.21.15.106:0/2325762798 shutdown_connections 2024-05-09T06:22:48.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 --2- 172.21.15.106:0/2325762798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f00ff630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:48.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 -- 172.21.15.106:0/2325762798 >> 172.21.15.106:0/2325762798 conn(0x7f79f00f70a0 msgr2=0x7f79f00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 -- 172.21.15.106:0/2325762798 shutdown_connections 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.466+0000 7f79f5d17700 1 -- 172.21.15.106:0/2325762798 wait complete. 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79f5d17700 1 Processor -- start 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79f5d17700 1 -- start start 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79f5d17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79f5d17700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f010d5d0 con 0x7f79f0065d30 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:45382/0 (socket says 172.21.15.106:45382) 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.467+0000 7f79ef7fe700 1 -- 172.21.15.106:0/2287491031 learned_addr learned my addr 172.21.15.106:0/2287491031 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79ef7fe700 1 -- 172.21.15.106:0/2287491031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0005040 con 0x7f79f0065d30 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79ef7fe700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f010d090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009680 tx=0x7f79e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79e000bed0 con 0x7f79f0065d30 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f010d7d0 con 0x7f79f0065d30 2024-05-09T06:22:48.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79e000b5c0 con 0x7f79f0065d30 2024-05-09T06:22:48.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79e001c5b0 con 0x7f79f0065d30 2024-05-09T06:22:48.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.468+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f010e340 con 0x7f79f0065d30 2024-05-09T06:22:48.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.469+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f79e0013420 con 0x7f79f0065d30 2024-05-09T06:22:48.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.469+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f0102f40 con 0x7f79f0065d30 2024-05-09T06:22:48.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.469+0000 7f79ecff9700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 0x7f79dc038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:48.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.469+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f79e0049a80 con 0x7f79f0065d30 2024-05-09T06:22:48.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.469+0000 7f79e6ffd700 1 -- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 msgr2=0x7f79dc038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2570824935 2024-05-09T06:22:48.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.469+0000 7f79e6ffd700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 0x7f79dc038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:22:48.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.474+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f79e0013a80 con 0x7f79f0065d30 2024-05-09T06:22:48.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.670+0000 7f79e6ffd700 1 -- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 msgr2=0x7f79dc038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2570824935 2024-05-09T06:22:48.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.670+0000 7f79e6ffd700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 0x7f79dc038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:22:48.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.735+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f79f010ed50 con 0x7f79f0065d30 2024-05-09T06:22:48.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.736+0000 7f79ecff9700 1 -- 172.21.15.106:0/2287491031 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f79e0011370 con 0x7f79f0065d30 2024-05-09T06:22:48.719 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:48.719 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 msgr2=0x7f79dc038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 0x7f79dc038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 msgr2=0x7f79f010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f010d090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009680 tx=0x7f79e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 shutdown_connections 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7f79dc0368d0 0x7f79dc038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 --2- 172.21.15.106:0/2287491031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79f0065d30 0x7f79f010d090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 >> 172.21.15.106:0/2287491031 conn(0x7f79f00f70a0 msgr2=0x7f79f0103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 shutdown_connections 2024-05-09T06:22:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:48.738+0000 7f79f5d17700 1 -- 172.21.15.106:0/2287491031 wait complete. 2024-05-09T06:22:48.722 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:49.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:49 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2287491031' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:50.263 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:50.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:50.573 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 -- 172.21.15.106:0/4202068543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 msgr2=0x7fcb2c0fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 --2- 172.21.15.106:0/4202068543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0fbd50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcb280048c0 tx=0x7fcb28009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 -- 172.21.15.106:0/4202068543 shutdown_connections 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 --2- 172.21.15.106:0/4202068543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0fbd50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 -- 172.21.15.106:0/4202068543 >> 172.21.15.106:0/4202068543 conn(0x7fcb2c0f70a0 msgr2=0x7fcb2c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 -- 172.21.15.106:0/4202068543 shutdown_connections 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.131+0000 7fcb336fb700 1 -- 172.21.15.106:0/4202068543 wait complete. 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb336fb700 1 Processor -- start 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb336fb700 1 -- start start 2024-05-09T06:22:52.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb336fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:52.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb336fb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0f9570 con 0x7fcb2c0fb940 2024-05-09T06:22:52.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb31497700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:52.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb31497700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:45392/0 (socket says 172.21.15.106:45392) 2024-05-09T06:22:52.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb31497700 1 -- 172.21.15.106:0/637174612 learned_addr learned my addr 172.21.15.106:0/637174612 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:52.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb31497700 1 -- 172.21.15.106:0/637174612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28005040 con 0x7fcb2c0fb940 2024-05-09T06:22:52.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.132+0000 7fcb31497700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0f9030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009680 tx=0x7fcb28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:52.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.133+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb2800b5c0 con 0x7fcb2c0fb940 2024-05-09T06:22:52.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.133+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb2800be70 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.133+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c0f7640 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.133+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb280135a0 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.133+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c0f7b30 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.134+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7fcb2801c430 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.134+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c05f5c0 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.134+0000 7fcb21ffb700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 0x7fcb18038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.134+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcb280494d0 con 0x7fcb2c0fb940 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.134+0000 7fcb30c96700 1 -- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 msgr2=0x7fcb18038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2570824935 2024-05-09T06:22:52.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.134+0000 7fcb30c96700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 0x7fcb18038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:22:52.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.139+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcb28004d30 con 0x7fcb2c0fb940 2024-05-09T06:22:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.335+0000 7fcb30c96700 1 -- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 msgr2=0x7fcb18038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2570824935 2024-05-09T06:22:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.335+0000 7fcb30c96700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 0x7fcb18038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T06:22:52.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.398+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcb2c04bed0 con 0x7fcb2c0fb940 2024-05-09T06:22:52.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.399+0000 7fcb21ffb700 1 -- 172.21.15.106:0/637174612 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fcb28021070 con 0x7fcb2c0fb940 2024-05-09T06:22:52.382 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:52.382 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 msgr2=0x7fcb18038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 0x7fcb18038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 msgr2=0x7fcb2c0f9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0f9030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009680 tx=0x7fcb28009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 shutdown_connections 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:6800/2570824935,v1:172.21.15.46:6801/2570824935] conn(0x7fcb180368d0 0x7fcb18038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 --2- 172.21.15.106:0/637174612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb2c0fb940 0x7fcb2c0f9030 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:52.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 >> 172.21.15.106:0/637174612 conn(0x7fcb2c0f70a0 msgr2=0x7fcb2c065050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:52.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 shutdown_connections 2024-05-09T06:22:52.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:52.401+0000 7fcb336fb700 1 -- 172.21.15.106:0/637174612 wait complete. 2024-05-09T06:22:52.385 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:52.749 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:52 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/637174612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:53.976 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:53.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:54.234 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:54.284 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:54.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: Active manager daemon smithi046.nvpcui restarted 2024-05-09T06:22:54.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: osdmap e5: 0 total, 0 up, 0 in 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: mgrmap e15: smithi046.nvpcui(active, starting, since 0.00305343s) 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:54.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:22:55.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:22:55.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:22:55.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:55.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:54 smithi046 ceph-mon[26924]: mgrmap e16: smithi046.nvpcui(active, since 1.00537s) 2024-05-09T06:22:55.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- 172.21.15.106:0/675415600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 msgr2=0x7f15180fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 --2- 172.21.15.106:0/675415600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f15180fd410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f15080048c0 tx=0x7f1508009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- 172.21.15.106:0/675415600 shutdown_connections 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 --2- 172.21.15.106:0/675415600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f15180fd410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- 172.21.15.106:0/675415600 >> 172.21.15.106:0/675415600 conn(0x7f15180f7070 msgr2=0x7f15180f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- 172.21.15.106:0/675415600 shutdown_connections 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- 172.21.15.106:0/675415600 wait complete. 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 Processor -- start 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- start start 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f1518113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.820+0000 7f151e226700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518113c40 con 0x7f15180669e0 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f15177fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f1518113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f15177fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f1518113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:33942/0 (socket says 172.21.15.106:33942) 2024-05-09T06:22:55.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f15177fe700 1 -- 172.21.15.106:0/1116519173 learned_addr learned my addr 172.21.15.106:0/1116519173 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:22:55.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f15177fe700 1 -- 172.21.15.106:0/1116519173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508005040 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f15177fe700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f1518113700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1508009680 tx=0x7f1508009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150800bed0 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f150800b5c0 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1518113e40 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150801c5b0 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.821+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1518114960 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.822+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 43297+0+0 (secure 0 0 0) 0x7f150801c710 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.822+0000 7f14fffff700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1500036710 0x7f1500038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.822+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1508013a80 con 0x7f15180669e0 2024-05-09T06:22:55.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.823+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1518100d20 con 0x7f15180669e0 2024-05-09T06:22:55.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.823+0000 7f1516ffd700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1500036710 0x7f1500038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:22:55.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.823+0000 7f1516ffd700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1500036710 0x7f1500038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f150c009990 tx=0x7f150c006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:22:55.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:55.828+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1508025400 con 0x7f15180669e0 2024-05-09T06:22:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.099+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f15181005f0 con 0x7f15180669e0 2024-05-09T06:22:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.100+0000 7f14fffff700 1 -- 172.21.15.106:0/1116519173 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1508048020 con 0x7f15180669e0 2024-05-09T06:22:56.083 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:22:56.083 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1500036710 msgr2=0x7f1500038bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1500036710 0x7f1500038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f150c009990 tx=0x7f150c006e40 comp rx=0 tx=0).stop 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 msgr2=0x7f1518113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f1518113700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1508009680 tx=0x7f1508009e30 comp rx=0 tx=0).stop 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 shutdown_connections 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1500036710 0x7f1500038bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 --2- 172.21.15.106:0/1116519173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15180669e0 0x7f1518113700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 >> 172.21.15.106:0/1116519173 conn(0x7f15180f7070 msgr2=0x7f151810a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:22:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 shutdown_connections 2024-05-09T06:22:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:22:56.102+0000 7f151e226700 1 -- 172.21.15.106:0/1116519173 wait complete. 2024-05-09T06:22:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:22:56.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:56 smithi046 ceph-mon[26924]: [09/May/2024:06:22:55] ENGINE Bus STARTING 2024-05-09T06:22:56.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:56.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:56.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:57.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:57 smithi046 ceph-mon[26924]: [09/May/2024:06:22:55] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:22:57.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:57 smithi046 ceph-mon[26924]: [09/May/2024:06:22:55] ENGINE Bus STARTED 2024-05-09T06:22:57.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:57 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1116519173' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:22:57.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:57 smithi046 ceph-mon[26924]: mgrmap e17: smithi046.nvpcui(active, since 2s) 2024-05-09T06:22:57.770 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:22:57.770 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:22:58.389 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-09T06:22:59.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:59.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:59.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:59.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:22:59.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:22:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 -- 172.21.15.106:0/892723367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 msgr2=0x7f5f380ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 --2- 172.21.15.106:0/892723367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f380ff690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0048c0 tx=0x7f5f2c009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 -- 172.21.15.106:0/892723367 shutdown_connections 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 --2- 172.21.15.106:0/892723367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f380ff690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 -- 172.21.15.106:0/892723367 >> 172.21.15.106:0/892723367 conn(0x7f5f380f70a0 msgr2=0x7f5f380f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 -- 172.21.15.106:0/892723367 shutdown_connections 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.679+0000 7f5f3f262700 1 -- 172.21.15.106:0/892723367 wait complete. 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3f262700 1 Processor -- start 2024-05-09T06:23:00.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3f262700 1 -- start start 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3f262700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f3810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3f262700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3810d5f0 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3cffe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f3810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3cffe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f3810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:33960/0 (socket says 172.21.15.106:33960) 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3cffe700 1 -- 172.21.15.106:0/1807878976 learned_addr learned my addr 172.21.15.106:0/1807878976 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.680+0000 7f5f3cffe700 1 -- 172.21.15.106:0/1807878976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c005040 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.681+0000 7f5f3cffe700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f3810d0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009680 tx=0x7f5f2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.681+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f2c00bed0 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.681+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3810d7f0 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.681+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f2c00b5c0 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.681+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3810e360 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.681+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f2c025560 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.682+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f5f2c0256c0 con 0x7f5f38065cd0 2024-05-09T06:23:00.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.682+0000 7f5f357fa700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5f28036970 0x7f5f28038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:00.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.682+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5f2c049c40 con 0x7f5f38065cd0 2024-05-09T06:23:00.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.682+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38102f40 con 0x7f5f38065cd0 2024-05-09T06:23:00.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.682+0000 7f5f37fff700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5f28036970 0x7f5f28038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:00.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.682+0000 7f5f37fff700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5f28036970 0x7f5f28038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009990 tx=0x7f5f24006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:00.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.687+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5f2c01c3f0 con 0x7f5f38065cd0 2024-05-09T06:23:00.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.952+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5f38102870 con 0x7f5f38065cd0 2024-05-09T06:23:00.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.952+0000 7f5f357fa700 1 -- 172.21.15.106:0/1807878976 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5f2c011370 con 0x7f5f38065cd0 2024-05-09T06:23:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:23:00.935 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5f28036970 msgr2=0x7f5f28038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5f28036970 0x7f5f28038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009990 tx=0x7f5f24006e40 comp rx=0 tx=0).stop 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 msgr2=0x7f5f3810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f3810d0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009680 tx=0x7f5f2c009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 shutdown_connections 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5f28036970 0x7f5f28038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 --2- 172.21.15.106:0/1807878976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f38065cd0 0x7f5f3810d0b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:00.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 >> 172.21.15.106:0/1807878976 conn(0x7f5f380f70a0 msgr2=0x7f5f38103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:00.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 shutdown_connections 2024-05-09T06:23:00.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:00.955+0000 7f5f3f262700 1 -- 172.21.15.106:0/1807878976 wait complete. 2024-05-09T06:23:00.939 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:01.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:01.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:01.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:02.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:23:02.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:23:02.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: Deploying daemon crash.smithi106 on smithi106 2024-05-09T06:23:02.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:01 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1807878976' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:23:02.498 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:23:02.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:23:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:04.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 -- 172.21.15.106:0/198027756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 msgr2=0x7ffbd0102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 --2- 172.21.15.106:0/198027756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0102e80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40048c0 tx=0x7ffbc4009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 -- 172.21.15.106:0/198027756 shutdown_connections 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 --2- 172.21.15.106:0/198027756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0102e80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 -- 172.21.15.106:0/198027756 >> 172.21.15.106:0/198027756 conn(0x7ffbd00f85b0 msgr2=0x7ffbd00fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 -- 172.21.15.106:0/198027756 shutdown_connections 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 -- 172.21.15.106:0/198027756 wait complete. 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 Processor -- start 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.480+0000 7ffbd6e24700 1 -- start start 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd6e24700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd6e24700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0113670 con 0x7ffbd0102ab0 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd4bc0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd4bc0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:52602/0 (socket says 172.21.15.106:52602) 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd4bc0700 1 -- 172.21.15.106:0/3431491642 learned_addr learned my addr 172.21.15.106:0/3431491642 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:23:04.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd4bc0700 1 -- 172.21.15.106:0/3431491642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4005040 con 0x7ffbd0102ab0 2024-05-09T06:23:04.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbd4bc0700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0113130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400b820 tx=0x7ffbc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:04.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.481+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc40093c0 con 0x7ffbd0102ab0 2024-05-09T06:23:04.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.482+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd0113870 con 0x7ffbd0102ab0 2024-05-09T06:23:04.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.482+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbc4013420 con 0x7ffbd0102ab0 2024-05-09T06:23:04.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.482+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc401c5b0 con 0x7ffbd0102ab0 2024-05-09T06:23:04.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.482+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd0113d60 con 0x7ffbd0102ab0 2024-05-09T06:23:04.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.483+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd00fe1b0 con 0x7ffbd0102ab0 2024-05-09T06:23:04.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.483+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7ffbc4009520 con 0x7ffbd0102ab0 2024-05-09T06:23:04.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.483+0000 7ffbcd7fa700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ffbc0036970 0x7ffbc0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:04.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.483+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ffbc4049b60 con 0x7ffbd0102ab0 2024-05-09T06:23:04.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.483+0000 7ffbcffff700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ffbc0036970 0x7ffbc0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:04.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.483+0000 7ffbcffff700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ffbc0036970 0x7ffbc0038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009990 tx=0x7ffbbc006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:04.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.488+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffbc4013a90 con 0x7ffbd0102ab0 2024-05-09T06:23:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.760+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffbd005f5c0 con 0x7ffbd0102ab0 2024-05-09T06:23:04.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.760+0000 7ffbcd7fa700 1 -- 172.21.15.106:0/3431491642 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ffbc4011370 con 0x7ffbd0102ab0 2024-05-09T06:23:04.744 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:23:04.744 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ffbc0036970 msgr2=0x7ffbc0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ffbc0036970 0x7ffbc0038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009990 tx=0x7ffbbc006e40 comp rx=0 tx=0).stop 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 msgr2=0x7ffbd0113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0113130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400b820 tx=0x7ffbc4009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 shutdown_connections 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ffbc0036970 0x7ffbc0038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 --2- 172.21.15.106:0/3431491642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd0102ab0 0x7ffbd0113130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 >> 172.21.15.106:0/3431491642 conn(0x7ffbd00f85b0 msgr2=0x7ffbd00f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 shutdown_connections 2024-05-09T06:23:04.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:04.763+0000 7ffbd6e24700 1 -- 172.21.15.106:0/3431491642 wait complete. 2024-05-09T06:23:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:23:05.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:04 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/3431491642' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:23:06.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:06.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:06.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:06.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:06.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:06 smithi046 ceph-mon[26924]: Deploying daemon node-exporter.smithi106 on smithi106 2024-05-09T06:23:06.563 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:23:06.563 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:23:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:09.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.923+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1614156084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 msgr2=0x7f9e04102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:09.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.923+0000 7f9e09c8b700 1 --2- 172.21.15.106:0/1614156084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e04102f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9df80048c0 tx=0x7f9df8009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:09.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.923+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1614156084 shutdown_connections 2024-05-09T06:23:09.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.923+0000 7f9e09c8b700 1 --2- 172.21.15.106:0/1614156084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e04102f80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:09.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.923+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1614156084 >> 172.21.15.106:0/1614156084 conn(0x7f9e040f85c0 msgr2=0x7f9e040fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:09.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.924+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1614156084 shutdown_connections 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.924+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1614156084 wait complete. 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.924+0000 7f9e09c8b700 1 Processor -- start 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.924+0000 7f9e09c8b700 1 -- start start 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.924+0000 7f9e09c8b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e041131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.924+0000 7f9e09c8b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e04113720 con 0x7f9e04102bb0 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.925+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e041131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.925+0000 7f9e037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e041131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:52618/0 (socket says 172.21.15.106:52618) 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.925+0000 7f9e037fe700 1 -- 172.21.15.106:0/1411062441 learned_addr learned my addr 172.21.15.106:0/1411062441 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:23:09.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.925+0000 7f9e037fe700 1 -- 172.21.15.106:0/1411062441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8005040 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.925+0000 7f9e037fe700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e041131e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b820 tx=0x7f9df8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.925+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df80093c0 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.926+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e04113920 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.926+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9df8013420 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.926+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df801c5b0 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.926+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e04113e10 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.926+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0405f5c0 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.927+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f9df801c7f0 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.927+0000 7f9debfff700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9dec036970 0x7f9dec038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.927+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9df8049ca0 con 0x7f9e04102bb0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.927+0000 7f9e02ffd700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9dec036970 0x7f9dec038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:09.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.927+0000 7f9e02ffd700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9dec036970 0x7f9dec038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009990 tx=0x7f9df4006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:09.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:09.932+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9df8023300 con 0x7f9e04102bb0 2024-05-09T06:23:10.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.216+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9e0410e830 con 0x7f9e04102bb0 2024-05-09T06:23:10.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.217+0000 7f9debfff700 1 -- 172.21.15.106:0/1411062441 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9df8011b60 con 0x7f9e04102bb0 2024-05-09T06:23:10.529 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:23:10.529 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9dec036970 msgr2=0x7f9dec038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9dec036970 0x7f9dec038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009990 tx=0x7f9df4006e40 comp rx=0 tx=0).stop 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 msgr2=0x7f9e041131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e041131e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b820 tx=0x7f9df8009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 shutdown_connections 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9dec036970 0x7f9dec038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 --2- 172.21.15.106:0/1411062441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e04102bb0 0x7f9e041131e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 >> 172.21.15.106:0/1411062441 conn(0x7f9e040f85c0 msgr2=0x7f9e040f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 shutdown_connections 2024-05-09T06:23:10.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:10.219+0000 7f9e09c8b700 1 -- 172.21.15.106:0/1411062441 wait complete. 2024-05-09T06:23:10.531 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T06:23:10.531 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:10.532 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:11.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:10 smithi046 ceph-mon[26924]: Deploying daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:23:11.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:10 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1411062441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:23:12.658 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:23:12.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:23:13.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:13.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:13.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:13.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:13.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:13.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:13.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:13 smithi046 ceph-mon[26924]: Deploying daemon mon.smithi106 on smithi106 2024-05-09T06:23:13.695 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:15.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:14 smithi046 ceph-mon[26924]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:15.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:14 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.137+0000 7f94e77af700 1 -- 172.21.15.106:0/398055840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 msgr2=0x7f94e0101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.137+0000 7f94e77af700 1 --2- 172.21.15.106:0/398055840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e0101dd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94d80048c0 tx=0x7f94d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.137+0000 7f94e77af700 1 -- 172.21.15.106:0/398055840 shutdown_connections 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.137+0000 7f94e77af700 1 --2- 172.21.15.106:0/398055840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e0101dd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.137+0000 7f94e77af700 1 -- 172.21.15.106:0/398055840 >> 172.21.15.106:0/398055840 conn(0x7f94e00f7520 msgr2=0x7f94e00f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.138+0000 7f94e77af700 1 -- 172.21.15.106:0/398055840 shutdown_connections 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.138+0000 7f94e77af700 1 -- 172.21.15.106:0/398055840 wait complete. 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.138+0000 7f94e77af700 1 Processor -- start 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.138+0000 7f94e77af700 1 -- start start 2024-05-09T06:23:16.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.138+0000 7f94e77af700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e01131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:16.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.138+0000 7f94e77af700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0113700 con 0x7f94e0101a00 2024-05-09T06:23:16.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.139+0000 7f94e554b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e01131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:16.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.139+0000 7f94e554b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e01131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.106:39128/0 (socket says 172.21.15.106:39128) 2024-05-09T06:23:16.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.139+0000 7f94e554b700 1 -- 172.21.15.106:0/1029094087 learned_addr learned my addr 172.21.15.106:0/1029094087 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:23:16.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.139+0000 7f94e554b700 1 -- 172.21.15.106:0/1029094087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8005040 con 0x7f94e0101a00 2024-05-09T06:23:16.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.139+0000 7f94e554b700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e01131c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f94d800b820 tx=0x7f94d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:16.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.140+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d80093c0 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.140+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0113900 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.140+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0113d70 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.140+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d8013420 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.140+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d80255c0 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.141+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f94d8025720 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.141+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c40052b0 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.141+0000 7f94d5ffb700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f94cc036970 0x7f94cc038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.141+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f94d8049b30 con 0x7f94e0101a00 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.141+0000 7f94e4d4a700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f94cc036970 0x7f94cc038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:16.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.142+0000 7f94e4d4a700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f94cc036970 0x7f94cc038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009990 tx=0x7f94d0006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:16.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.146+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f94d8024dc0 con 0x7f94e0101a00 2024-05-09T06:23:16.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.430+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f94c4005560 con 0x7f94e0101a00 2024-05-09T06:23:16.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.431+0000 7f94d5ffb700 1 -- 172.21.15.106:0/1029094087 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f94d8024360 con 0x7f94e0101a00 2024-05-09T06:23:16.415 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:23:16.415 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:20:34.219870Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f94cc036970 msgr2=0x7f94cc038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f94cc036970 0x7f94cc038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009990 tx=0x7f94d0006e40 comp rx=0 tx=0).stop 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 msgr2=0x7f94e01131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e01131c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f94d800b820 tx=0x7f94d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 shutdown_connections 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f94cc036970 0x7f94cc038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 --2- 172.21.15.106:0/1029094087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e0101a00 0x7f94e01131c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 >> 172.21.15.106:0/1029094087 conn(0x7f94e00f7520 msgr2=0x7f94e0065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 shutdown_connections 2024-05-09T06:23:16.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:16.434+0000 7f94e77af700 1 -- 172.21.15.106:0/1029094087 wait complete. 2024-05-09T06:23:16.418 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-05-09T06:23:18.477 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-05-09T06:23:18.477 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T06:23:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:23:21.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.738+0000 7f546fdff700 1 -- 172.21.15.106:0/1919129288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 msgr2=0x7f54680fdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:21.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.738+0000 7f546fdff700 1 --2- 172.21.15.106:0/1919129288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54680fdf20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5464009ce0 tx=0x7f546400b040 comp rx=0 tx=0).stop 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.738+0000 7f546fdff700 1 -- 172.21.15.106:0/1919129288 shutdown_connections 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.738+0000 7f546fdff700 1 --2- 172.21.15.106:0/1919129288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54680fdf20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.738+0000 7f546fdff700 1 -- 172.21.15.106:0/1919129288 >> 172.21.15.106:0/1919129288 conn(0x7f54680f75d0 msgr2=0x7f54680f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 -- 172.21.15.106:0/1919129288 shutdown_connections 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 -- 172.21.15.106:0/1919129288 wait complete. 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 Processor -- start 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 -- start start 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54681133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5468113f30 con 0x7f54680fdb50 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.739+0000 7f546fdff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681140a0 con 0x7f5468113920 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44864/0 (socket says 172.21.15.106:44864) 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 -- 172.21.15.106:0/1034988498 learned_addr learned my addr 172.21.15.106:0/1034988498 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546db9b700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54681133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 -- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 msgr2=0x7f546810d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 -- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 msgr2=0x7f546810d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546d39a700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546db9b700 1 -- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 msgr2=0x7f546810d380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546db9b700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546db9b700 1 -- 172.21.15.106:0/1034988498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464005040 con 0x7f54680fdb50 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f546db9b700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54681133e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5464009ce0 tx=0x7f546400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5464010c70 con 0x7f54680fdb50 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.740+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5464010dd0 con 0x7f54680fdb50 2024-05-09T06:23:21.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.741+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546810d980 con 0x7f54680fdb50 2024-05-09T06:23:21.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.741+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5464015710 con 0x7f54680fdb50 2024-05-09T06:23:21.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.741+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546810dec0 con 0x7f54680fdb50 2024-05-09T06:23:21.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.742+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5468102890 con 0x7f54680fdb50 2024-05-09T06:23:21.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.742+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f546401faf0 con 0x7f54680fdb50 2024-05-09T06:23:21.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.742+0000 7f545e7fc700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5454069370 0x7f545406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:21.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.743+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5464087ef0 con 0x7f54680fdb50 2024-05-09T06:23:21.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.743+0000 7f546d39a700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5454069370 0x7f545406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:21.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.743+0000 7f546d39a700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5454069370 0x7f545406b820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5458006fd0 tx=0x7f5458008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:21.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:21.747+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5464055260 con 0x7f54680fdb50 2024-05-09T06:23:22.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.021+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f546810ea70 con 0x7f54680fdb50 2024-05-09T06:23:22.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.022+0000 7f545e7fc700 1 -- 172.21.15.106:0/1034988498 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f5464023410 con 0x7f54680fdb50 2024-05-09T06:23:22.005 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-09T06:23:22.005 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","modified":"2024-05-09T06:23:16.564747Z","created":"2024-05-09T06:20:34.219870Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi106","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-09T06:23:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5454069370 msgr2=0x7f545406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5454069370 0x7f545406b820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5458006fd0 tx=0x7f5458008040 comp rx=0 tx=0).stop 2024-05-09T06:23:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 msgr2=0x7f54681133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54681133e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5464009ce0 tx=0x7f546400b040 comp rx=0 tx=0).stop 2024-05-09T06:23:22.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 shutdown_connections 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5454069370 0x7f545406b820 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54680fdb50 0x7f54681133e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 --2- 172.21.15.106:0/1034988498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5468113920 0x7f546810d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 >> 172.21.15.106:0/1034988498 conn(0x7f54680f75d0 msgr2=0x7f54680f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 shutdown_connections 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:23:22.024+0000 7f546fdff700 1 -- 172.21.15.106:0/1034988498 wait complete. 2024-05-09T06:23:22.008 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 2 2024-05-09T06:23:22.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: mon.smithi046 calling monitor election 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: mon.smithi106 calling monitor election 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/464601480' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:22.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: mon.smithi046 is new leader, mons smithi046,smithi106 in quorum (ranks 0,1) 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: monmap e2: 2 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],smithi106=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: fsmap 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: osdmap e5: 0 total, 0 up, 0 in 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: mgrmap e17: smithi046.nvpcui(active, since 27s) 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: overall HEALTH_OK 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/464601480' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/464601480' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/464601480' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:22.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:22.574 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-09T06:23:22.574 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-09T06:23:22.852 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:23:22.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:22.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: mgrmap e18: smithi046.nvpcui(active, since 27s), standbys: smithi106.nlgnpx 2024-05-09T06:23:22.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:23:22.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:22.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:22.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1034988498' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T06:23:22.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:22 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:23:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.470+0000 7fb90a0e6700 1 -- 172.21.15.46:0/3543620730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb904102ab0 msgr2=0x7fb904102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.470+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/3543620730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb904102ab0 0x7fb904102e80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40048c0 tx=0x7fb8f4009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 -- 172.21.15.46:0/3543620730 shutdown_connections 2024-05-09T06:23:24.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/3543620730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb904102ab0 0x7fb904102e80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:24.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 -- 172.21.15.46:0/3543620730 >> 172.21.15.46:0/3543620730 conn(0x7fb9040f85b0 msgr2=0x7fb9040fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:24.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 -- 172.21.15.46:0/3543620730 shutdown_connections 2024-05-09T06:23:24.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 -- 172.21.15.46:0/3543620730 wait complete. 2024-05-09T06:23:24.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 Processor -- start 2024-05-09T06:23:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.471+0000 7fb90a0e6700 1 -- start start 2024-05-09T06:23:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb90a0e6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 0x7fb904070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb90a0e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 0x7fb904070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb90a0e6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9041195e0 con 0x7fb9040707c0 2024-05-09T06:23:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb90a0e6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb904119720 con 0x7fb904102ab0 2024-05-09T06:23:24.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 0x7fb904070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 0x7fb904070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35772/0 (socket says 172.21.15.46:35772) 2024-05-09T06:23:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 -- 172.21.15.46:0/2495017114 learned_addr learned my addr 172.21.15.46:0/2495017114 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:23:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb9037fe700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 0x7fb904070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb9037fe700 1 -- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 msgr2=0x7fb904070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-09T06:23:24.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb9037fe700 1 -- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 msgr2=0x7fb904070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:23:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 -- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 msgr2=0x7fb904070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb9037fe700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 0x7fb904070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:23:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb9037fe700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 0x7fb904070280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:23:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 0x7fb904070280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:24.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 -- 172.21.15.46:0/2495017114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4005040 con 0x7fb9040707c0 2024-05-09T06:23:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb902ffd700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 0x7fb904070c30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800b7c0 tx=0x7fb8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f8010850 con 0x7fb9040707c0 2024-05-09T06:23:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8f8010e80 con 0x7fb9040707c0 2024-05-09T06:23:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9041198c0 con 0x7fb9040707c0 2024-05-09T06:23:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.472+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f800d370 con 0x7fb9040707c0 2024-05-09T06:23:24.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.473+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb904119e50 con 0x7fb9040707c0 2024-05-09T06:23:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.473+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb904101d20 con 0x7fb9040707c0 2024-05-09T06:23:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.474+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fb8f800f830 con 0x7fb9040707c0 2024-05-09T06:23:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.474+0000 7fb8ebfff700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8ec069360 0x7fb8ec06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.474+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb8f8086570 con 0x7fb9040707c0 2024-05-09T06:23:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.474+0000 7fb9037fe700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8ec069360 0x7fb8ec06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:24.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.475+0000 7fb9037fe700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8ec069360 0x7fb8ec06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400b3b0 tx=0x7fb8f4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:24.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.479+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb8f8057410 con 0x7fb9040707c0 2024-05-09T06:23:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.689+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb9040718b0 con 0x7fb9040707c0 2024-05-09T06:23:24.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.690+0000 7fb8ebfff700 1 -- 172.21.15.46:0/2495017114 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7fb8f8014100 con 0x7fb9040707c0 2024-05-09T06:23:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:23:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-05-09T06:23:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:23:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] 2024-05-09T06:23:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8ec069360 msgr2=0x7fb8ec06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8ec069360 0x7fb8ec06b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400b3b0 tx=0x7fb8f4009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 msgr2=0x7fb904070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 0x7fb904070c30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800b7c0 tx=0x7fb8f8009250 comp rx=0 tx=0).stop 2024-05-09T06:23:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 shutdown_connections 2024-05-09T06:23:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8ec069360 0x7fb8ec06b810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb904102ab0 0x7fb904070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 --2- 172.21.15.46:0/2495017114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9040707c0 0x7fb904070c30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 >> 172.21.15.46:0/2495017114 conn(0x7fb9040f85b0 msgr2=0x7fb9040fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 shutdown_connections 2024-05-09T06:23:24.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:24.692+0000 7fb90a0e6700 1 -- 172.21.15.46:0/2495017114 wait complete. 2024-05-09T06:23:25.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:25.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:23:25.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:25.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:24 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2495017114' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:25.300 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-09T06:23:25.301 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:23:25.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T06:23:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:24 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2495017114' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:25.330 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:23:25.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:23:25.396 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:23:25.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T06:23:25.430 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:23:25.430 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:23:25.498 INFO:tasks.cephadm:Deploying OSDs... 2024-05-09T06:23:25.498 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:23:25.498 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T06:23:25.514 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T06:23:25.515 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 06:22:45.360084627 +0000 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 06:16:19.573761815 +0000 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 06:16:19.573761815 +0000 2024-05-09T06:23:25.572 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 06:16:19.573761815 +0000 2024-05-09T06:23:25.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T06:23:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T06:23:25.637 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T06:23:25.638 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000108692 s, 4.7 MB/s 2024-05-09T06:23:25.639 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T06:23:25.697 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-05-09T06:23:25.753 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T06:23:25.753 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:25.753 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-09T06:23:25.753 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:25.754 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:25.754 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 06:22:45.361084616 +0000 2024-05-09T06:23:25.754 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 06:16:19.929757892 +0000 2024-05-09T06:23:25.754 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 06:16:19.929757892 +0000 2024-05-09T06:23:25.754 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 06:16:19.929757892 +0000 2024-05-09T06:23:25.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T06:23:25.819 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T06:23:25.819 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T06:23:25.819 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000110526 s, 4.6 MB/s 2024-05-09T06:23:25.820 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T06:23:25.878 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-05-09T06:23:25.939 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T06:23:25.939 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-09T06:23:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:25.939 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 06:22:45.361084616 +0000 2024-05-09T06:23:25.940 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 06:16:20.276754069 +0000 2024-05-09T06:23:25.940 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 06:16:20.276754069 +0000 2024-05-09T06:23:25.940 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 06:16:20.276754069 +0000 2024-05-09T06:23:25.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T06:23:26.004 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T06:23:26.005 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T06:23:26.005 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000107219 s, 4.8 MB/s 2024-05-09T06:23:26.006 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T06:23:26.062 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-05-09T06:23:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:25 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:25 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:25 smithi046 ceph-mon[26924]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-05-09T06:23:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:25 smithi046 ceph-mon[26924]: Reconfiguring daemon mon.smithi046 on smithi046 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-09 06:22:45.361084616 +0000 2024-05-09T06:23:26.103 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 06:16:20.616750323 +0000 2024-05-09T06:23:26.104 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 06:16:20.616750323 +0000 2024-05-09T06:23:26.104 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 06:16:20.616750323 +0000 2024-05-09T06:23:26.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T06:23:26.167 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-09T06:23:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-09T06:23:26.168 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000106339 s, 4.8 MB/s 2024-05-09T06:23:26.169 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T06:23:26.225 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:23:26.225 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T06:23:26.245 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T06:23:26.245 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-09 06:23:15.867335044 +0000 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-09 06:16:16.953369986 +0000 2024-05-09T06:23:26.304 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-09 06:16:16.953369986 +0000 2024-05-09T06:23:26.305 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-09 06:16:16.953369986 +0000 2024-05-09T06:23:26.305 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T06:23:26.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:25 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:26.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:25 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:23:26.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:25 smithi106 ceph-mon[34679]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-05-09T06:23:26.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:25 smithi106 ceph-mon[34679]: Reconfiguring daemon mon.smithi046 on smithi046 2024-05-09T06:23:26.351 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-09T06:23:26.351 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-09T06:23:26.351 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.00022944 s, 2.2 MB/s 2024-05-09T06:23:26.353 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T06:23:26.411 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-09 06:23:15.867335044 +0000 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-09 06:16:17.292361891 +0000 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-09 06:16:17.292361891 +0000 2024-05-09T06:23:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-09 06:16:17.292361891 +0000 2024-05-09T06:23:26.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T06:23:26.534 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-09T06:23:26.534 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-09T06:23:26.534 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000268685 s, 1.9 MB/s 2024-05-09T06:23:26.536 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T06:23:26.593 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-05-09T06:23:26.649 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T06:23:26.649 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-09 06:23:15.868335020 +0000 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-09 06:16:17.640353581 +0000 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-09 06:16:17.640353581 +0000 2024-05-09T06:23:26.650 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-09 06:16:17.640353581 +0000 2024-05-09T06:23:26.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T06:23:26.714 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-09T06:23:26.714 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-09T06:23:26.715 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000200629 s, 2.6 MB/s 2024-05-09T06:23:26.716 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T06:23:26.772 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-09 06:23:15.868335020 +0000 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-09 06:16:17.971345677 +0000 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-09 06:16:17.971345677 +0000 2024-05-09T06:23:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-09 06:16:17.971345677 +0000 2024-05-09T06:23:26.830 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T06:23:26.892 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-09T06:23:26.893 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-09T06:23:26.893 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.00017744 s, 2.9 MB/s 2024-05-09T06:23:26.894 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T06:23:26.951 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2024-05-09T06:23:26.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T06:23:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:26 smithi106 ceph-mon[34679]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:27.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:26 smithi046 ceph-mon[26924]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:27.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:27.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:27.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:27.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:27.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:27.407 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:23:28.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:27 smithi046 ceph-mon[26924]: Reconfiguring mgr.smithi046.nvpcui (unknown last config time)... 2024-05-09T06:23:28.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:27 smithi046 ceph-mon[26924]: Reconfiguring daemon mgr.smithi046.nvpcui on smithi046 2024-05-09T06:23:28.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:27 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:28.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:27 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:28.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:27 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:28.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:27 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:28.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:27 smithi106 ceph-mon[34679]: Reconfiguring mgr.smithi046.nvpcui (unknown last config time)... 2024-05-09T06:23:28.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:27 smithi106 ceph-mon[34679]: Reconfiguring daemon mgr.smithi046.nvpcui on smithi046 2024-05-09T06:23:28.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:27 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:28.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:27 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:28.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:27 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:28.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:27 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:28 smithi046 ceph-mon[26924]: Reconfiguring crash.smithi046 (monmap changed)... 2024-05-09T06:23:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:28 smithi046 ceph-mon[26924]: Reconfiguring daemon crash.smithi046 on smithi046 2024-05-09T06:23:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:28 smithi046 ceph-mon[26924]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:28 smithi106 ceph-mon[34679]: Reconfiguring crash.smithi046 (monmap changed)... 2024-05-09T06:23:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:28 smithi106 ceph-mon[34679]: Reconfiguring daemon crash.smithi046 on smithi046 2024-05-09T06:23:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:28 smithi106 ceph-mon[34679]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:30.750 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T06:23:30.751 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T06:23:30.751 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2024-05-09T06:23:30.751 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2024-05-09T06:23:30.751 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00844046 s, 1.2 GB/s 2024-05-09T06:23:30.751 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2024-05-09T06:23:31.278 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:30 smithi046 ceph-mon[26924]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:31.278 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:31.278 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:31.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-05-09T06:23:31.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:30 smithi106 ceph-mon[34679]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:31.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:31.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:32.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:31 smithi046 ceph-mon[26924]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-05-09T06:23:32.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:31 smithi046 ceph-mon[26924]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-05-09T06:23:32.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:31 smithi106 ceph-mon[34679]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-05-09T06:23:32.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:31 smithi106 ceph-mon[34679]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-05-09T06:23:33.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:32 smithi106 ceph-mon[34679]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:33.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:32 smithi046 ceph-mon[26924]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:33.523 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:23:35.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:34 smithi046 ceph-mon[26924]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:34 smithi106 ceph-mon[34679]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:35.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 -- 172.21.15.46:0/472503641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 msgr2=0x7f42200fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:35.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 --2- 172.21.15.46:0/472503641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f42200fd270 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4214004940 tx=0x7f4214009e30 comp rx=0 tx=0).stop 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 -- 172.21.15.46:0/472503641 shutdown_connections 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 --2- 172.21.15.46:0/472503641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42200fdfd0 0x7f42200fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 --2- 172.21.15.46:0/472503641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f42200fd270 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 -- 172.21.15.46:0/472503641 >> 172.21.15.46:0/472503641 conn(0x7f42200f8540 msgr2=0x7f42200fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 -- 172.21.15.46:0/472503641 shutdown_connections 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.169+0000 7f422721d700 1 -- 172.21.15.46:0/472503641 wait complete. 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f422721d700 1 Processor -- start 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f422721d700 1 -- start start 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f422721d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f422010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f422721d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42200fdfd0 0x7f422010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f422721d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422010e500 con 0x7f42200fce60 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f422721d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220112ea0 con 0x7f42200fdfd0 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f4224fb9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f422010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f4224fb9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f422010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50626/0 (socket says 172.21.15.46:50626) 2024-05-09T06:23:35.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f4224fb9700 1 -- 172.21.15.46:0/3450778716 learned_addr learned my addr 172.21.15.46:0/3450778716 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.170+0000 7f421ffff700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42200fdfd0 0x7f422010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f4224fb9700 1 -- 172.21.15.46:0/3450778716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42200fdfd0 msgr2=0x7f422010de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f4224fb9700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42200fdfd0 0x7f422010de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f4224fb9700 1 -- 172.21.15.46:0/3450778716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214005040 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f4224fb9700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f422010d930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f421400b3b0 tx=0x7f4214009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421400e040 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f421400bcc0 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42201130a0 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421401c630 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.171+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220113610 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.172+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422004c710 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.172+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f4214013980 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.173+0000 7f421d7fa700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4210069210 0x7f421006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.173+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4214086ea0 con 0x7f42200fce60 2024-05-09T06:23:35.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.173+0000 7f421ffff700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4210069210 0x7f421006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:23:35.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.173+0000 7f421ffff700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4210069210 0x7f421006b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f420c006fd0 tx=0x7f420c008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:23:35.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.177+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4214057cc0 con 0x7f42200fce60 2024-05-09T06:23:35.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:23:35.382+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f42201022b0 con 0x7f4210069210 2024-05-09T06:23:36.285 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:23:36.285 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:23:36.285 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:36.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:23:36.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:23:36.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:37.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:36 smithi046 ceph-mon[26924]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:23:37.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:36 smithi046 ceph-mon[26924]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:37.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:36 smithi106 ceph-mon[34679]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:23:37.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:36 smithi106 ceph-mon[34679]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:38.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:38.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:38.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:38 smithi106 ceph-mon[34679]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-05-09T06:23:38.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:38 smithi106 ceph-mon[34679]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-05-09T06:23:38.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:38 smithi106 ceph-mon[34679]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:38.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:38.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:38.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:38 smithi046 ceph-mon[26924]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-05-09T06:23:38.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:38 smithi046 ceph-mon[26924]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-05-09T06:23:38.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:38 smithi046 ceph-mon[26924]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:39.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:39 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3091888855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c75339a-4ca8-4d4a-bcf8-609ab48846b5"}]: dispatch 2024-05-09T06:23:39.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:39 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3091888855' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c75339a-4ca8-4d4a-bcf8-609ab48846b5"}]': finished 2024-05-09T06:23:39.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:39 smithi106 ceph-mon[34679]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T06:23:39.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:39 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:39.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:39 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:39.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:39 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3786196209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:23:39.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:39 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3091888855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c75339a-4ca8-4d4a-bcf8-609ab48846b5"}]: dispatch 2024-05-09T06:23:39.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:39 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3091888855' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c75339a-4ca8-4d4a-bcf8-609ab48846b5"}]': finished 2024-05-09T06:23:39.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:39 smithi046 ceph-mon[26924]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T06:23:39.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:39 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:23:39.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:39 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:39.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:39 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3786196209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:23:40.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:40 smithi106 ceph-mon[34679]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:40.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:40 smithi046 ceph-mon[26924]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:43.210 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:42 smithi046 ceph-mon[26924]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:43.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:42 smithi106 ceph-mon[34679]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:45.174 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:44 smithi046 ceph-mon[26924]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:45.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:44 smithi106 ceph-mon[34679]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:47.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:46 smithi106 ceph-mon[34679]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:46 smithi046 ceph-mon[26924]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:48.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:48.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:48.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:48 smithi046 ceph-mon[26924]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-05-09T06:23:48.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:48 smithi046 ceph-mon[26924]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-05-09T06:23:48.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:48 smithi046 ceph-mon[26924]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:49.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:49.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:49.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:48 smithi106 ceph-mon[34679]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-05-09T06:23:49.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:48 smithi106 ceph-mon[34679]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-05-09T06:23:49.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:48 smithi106 ceph-mon[34679]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:49.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:49 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:23:49.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:49 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:49.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:49 smithi046 ceph-mon[26924]: Deploying daemon osd.0 on smithi046 2024-05-09T06:23:50.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:49 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:23:50.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:49 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:50.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:49 smithi106 ceph-mon[34679]: Deploying daemon osd.0 on smithi046 2024-05-09T06:23:50.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:50 smithi046 ceph-mon[26924]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:50 smithi106 ceph-mon[34679]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:53.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:52 smithi046 ceph-mon[26924]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:52 smithi106 ceph-mon[34679]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:54.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:54.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:54.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: Reconfiguring crash.smithi106 (monmap changed)... 2024-05-09T06:23:54.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:54.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:54.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: Reconfiguring daemon crash.smithi106 on smithi106 2024-05-09T06:23:54.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:54.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:54.556 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:54.556 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:54.557 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: Reconfiguring crash.smithi106 (monmap changed)... 2024-05-09T06:23:54.557 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:23:54.557 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:54.557 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: Reconfiguring daemon crash.smithi106 on smithi106 2024-05-09T06:23:54.557 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:54.557 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:23:55.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:55.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:55.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: Reconfiguring mgr.smithi106.nlgnpx (monmap changed)... 2024-05-09T06:23:55.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:55.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:55.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:55.565 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:55 smithi046 ceph-mon[26924]: Reconfiguring daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: Reconfiguring mgr.smithi106.nlgnpx (monmap changed)... 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:55.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:55 smithi106 ceph-mon[34679]: Reconfiguring daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:23:56.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: Reconfiguring mon.smithi106 (monmap changed)... 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: Reconfiguring daemon mon.smithi106 on smithi106 2024-05-09T06:23:56.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:56 smithi106 ceph-mon[34679]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: Reconfiguring mon.smithi106 (monmap changed)... 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: Reconfiguring daemon mon.smithi106 on smithi106 2024-05-09T06:23:56.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:56 smithi046 ceph-mon[26924]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:57.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:57.976 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:57.977 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:57.977 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:58.242 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:58.242 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:58.242 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:58.242 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:58.243 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:23:59.209 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:59 smithi046 ceph-mon[26924]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:59.209 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:59 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.209 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:59 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.209 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:59 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.209 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:23:59 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:59 smithi106 ceph-mon[34679]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:23:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:59 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:59 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:59 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:23:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:23:59 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:01.297 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:01 smithi046 ceph-mon[26924]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:24:01.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:01 smithi106 ceph-mon[34679]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:24:01.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.607+0000 7f421d7fa700 1 -- 172.21.15.46:0/3450778716 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f42201022b0 con 0x7f4210069210 2024-05-09T06:24:01.589 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2024-05-09T06:24:01.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4210069210 msgr2=0x7f421006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:01.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4210069210 0x7f421006b6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f420c006fd0 tx=0x7f420c008040 comp rx=0 tx=0).stop 2024-05-09T06:24:01.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 msgr2=0x7f422010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:01.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f422010d930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f421400b3b0 tx=0x7f4214009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:01.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 shutdown_connections 2024-05-09T06:24:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4210069210 0x7f421006b6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42200fce60 0x7f422010d930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 --2- 172.21.15.46:0/3450778716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42200fdfd0 0x7f422010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 >> 172.21.15.46:0/3450778716 conn(0x7f42200f8540 msgr2=0x7f42200f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 shutdown_connections 2024-05-09T06:24:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:01.609+0000 7f422721d700 1 -- 172.21.15.46:0/3450778716 wait complete. 2024-05-09T06:24:02.163 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.0.service 2024-05-09T06:24:02.165 INFO:tasks.cephadm:Deploying osd.1 on smithi046 with /dev/vg_nvme/lv_3... 2024-05-09T06:24:02.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T06:24:02.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:02 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:02.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:02 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:02.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:02 smithi046 ceph-mon[26924]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:24:02.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:02 smithi046 ceph-mon[26924]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:24:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:24:03.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:02 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:03.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:02 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:03.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:02 smithi106 ceph-mon[34679]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:24:03.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:02 smithi106 ceph-mon[34679]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:24:03.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:03 smithi046 ceph-mon[26924]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:24:03.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:03 smithi046 ceph-mon[26924]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T06:24:03.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:03.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:03 smithi046 ceph-mon[26924]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:24:03.853 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:24:03 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[45100]: 2024-05-09T06:24:03.611+0000 7f746523b700 -1 osd.0 0 waiting for initial osdmap 2024-05-09T06:24:03.854 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:24:03 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[45100]: 2024-05-09T06:24:03.615+0000 7f746203a700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:24:04.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:03 smithi106 ceph-mon[34679]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:24:04.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:03 smithi106 ceph-mon[34679]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T06:24:04.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:04.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:03 smithi106 ceph-mon[34679]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:24:04.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:04 smithi046 ceph-mon[26924]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-05-09T06:24:04.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:04 smithi046 ceph-mon[26924]: osdmap e8: 1 total, 0 up, 1 in 2024-05-09T06:24:04.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:04 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:04.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:04 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:04.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:04 smithi046 ceph-mon[26924]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:24:05.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:04 smithi106 ceph-mon[34679]: from='osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-05-09T06:24:05.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:04 smithi106 ceph-mon[34679]: osdmap e8: 1 total, 0 up, 1 in 2024-05-09T06:24:05.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:04 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:05.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:04 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:05.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:04 smithi106 ceph-mon[34679]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T06:24:05.267 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T06:24:05.267 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T06:24:05.268 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2024-05-09T06:24:05.268 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2024-05-09T06:24:05.268 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0105901 s, 990 MB/s 2024-05-09T06:24:05.268 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2024-05-09T06:24:05.879 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:05 smithi106 ceph-mon[34679]: purged_snaps scrub starts 2024-05-09T06:24:05.879 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:05 smithi106 ceph-mon[34679]: purged_snaps scrub ok 2024-05-09T06:24:05.879 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:05 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:05.879 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:05 smithi106 ceph-mon[34679]: osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] boot 2024-05-09T06:24:05.879 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:05 smithi106 ceph-mon[34679]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T06:24:05.879 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:05 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:05.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:05 smithi046 ceph-mon[26924]: purged_snaps scrub starts 2024-05-09T06:24:05.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:05 smithi046 ceph-mon[26924]: purged_snaps scrub ok 2024-05-09T06:24:05.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:05 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:05.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:05 smithi046 ceph-mon[26924]: osd.0 [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] boot 2024-05-09T06:24:05.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:05 smithi046 ceph-mon[26924]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T06:24:05.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:05 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:24:06.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-05-09T06:24:06.483 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:24:06.877 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:06 smithi046 ceph-mon[26924]: osdmap e10: 1 total, 1 up, 1 in 2024-05-09T06:24:06.877 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:06.877 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:06.877 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:06 smithi046 ceph-mon[26924]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:06 smithi106 ceph-mon[34679]: osdmap e10: 1 total, 1 up, 1 in 2024-05-09T06:24:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:06 smithi106 ceph-mon[34679]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:09.174 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:08 smithi046 ceph-mon[26924]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:09.174 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:08 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:09.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:08 smithi106 ceph-mon[34679]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:09.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:08 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:09.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 -- 172.21.15.46:0/963824608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fdfd0 msgr2=0x7f307c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:09.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 --2- 172.21.15.46:0/963824608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fdfd0 0x7f307c0fe440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f306c004940 tx=0x7f306c009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:09.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 -- 172.21.15.46:0/963824608 shutdown_connections 2024-05-09T06:24:09.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 --2- 172.21.15.46:0/963824608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fdfd0 0x7f307c0fe440 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 --2- 172.21.15.46:0/963824608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f307c0fce60 0x7f307c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 -- 172.21.15.46:0/963824608 >> 172.21.15.46:0/963824608 conn(0x7f307c0f8540 msgr2=0x7f307c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 -- 172.21.15.46:0/963824608 shutdown_connections 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.869+0000 7f3084081700 1 -- 172.21.15.46:0/963824608 wait complete. 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3084081700 1 Processor -- start 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3084081700 1 -- start start 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3084081700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 0x7f307c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3084081700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f307c0fdfd0 0x7f307c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3084081700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0707f0 con 0x7f307c0fce60 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3084081700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c070960 con 0x7f307c0fdfd0 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3081e1d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 0x7f307c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3081e1d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 0x7f307c071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33768/0 (socket says 172.21.15.46:33768) 2024-05-09T06:24:09.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f3081e1d700 1 -- 172.21.15.46:0/4104460551 learned_addr learned my addr 172.21.15.46:0/4104460551 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.870+0000 7f308161c700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f307c0fdfd0 0x7f307c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f3081e1d700 1 -- 172.21.15.46:0/4104460551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f307c0fdfd0 msgr2=0x7f307c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f3081e1d700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f307c0fdfd0 0x7f307c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f3081e1d700 1 -- 172.21.15.46:0/4104460551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c005040 con 0x7f307c0fce60 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f3081e1d700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 0x7f307c071c00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f307800b790 tx=0x7f3078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f307800f770 con 0x7f307c0fce60 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f307800fda0 con 0x7f307c0fce60 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c070c40 con 0x7f307c0fce60 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f307800d310 con 0x7f307c0fce60 2024-05-09T06:24:09.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.871+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c115a30 con 0x7f307c0fce60 2024-05-09T06:24:09.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.872+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c04c710 con 0x7f307c0fce60 2024-05-09T06:24:09.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.873+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f3078010420 con 0x7f307c0fce60 2024-05-09T06:24:09.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.873+0000 7f30727fc700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3068069210 0x7f306806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:09.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.873+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f3078086300 con 0x7f307c0fce60 2024-05-09T06:24:09.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.873+0000 7f308161c700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3068069210 0x7f306806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:09.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.874+0000 7f308161c700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3068069210 0x7f306806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b3b0 tx=0x7f306c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:09.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:09.878+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3078056f40 con 0x7f307c0fce60 2024-05-09T06:24:10.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:10.082+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f307c1022f0 con 0x7f3068069210 2024-05-09T06:24:11.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:11.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:11.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:11.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:11.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:11.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:11.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:11.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:11.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:12.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:11 smithi046 ceph-mon[26924]: Detected new or changed devices on smithi046 2024-05-09T06:24:12.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:11 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi046 to 12869M 2024-05-09T06:24:12.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:11 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi046 2024-05-09T06:24:12.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:11 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi046 to 12869M 2024-05-09T06:24:13.241 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:13.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:13.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:13.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3461896667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3baf559f-bfeb-4070-b6e7-1d4acf6ff434"}]: dispatch 2024-05-09T06:24:13.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3461896667' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3baf559f-bfeb-4070-b6e7-1d4acf6ff434"}]': finished 2024-05-09T06:24:13.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T06:24:13.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:12 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:13.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:13.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:13.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:13.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3461896667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3baf559f-bfeb-4070-b6e7-1d4acf6ff434"}]: dispatch 2024-05-09T06:24:13.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3461896667' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3baf559f-bfeb-4070-b6e7-1d4acf6ff434"}]': finished 2024-05-09T06:24:13.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T06:24:13.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:12 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:14.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:13 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3304303409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:14.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:13 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3304303409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:15.226 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:14 smithi106 ceph-mon[34679]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:15.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:14 smithi046 ceph-mon[26924]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:16 smithi046 ceph-mon[26924]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:17.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:17.175 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:16 smithi106 ceph-mon[34679]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:17.175 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:17.175 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:17.175 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:17.175 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:17.175 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:19.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:18 smithi106 ceph-mon[34679]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:19.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:18 smithi046 ceph-mon[26924]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:20.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:19 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:24:20.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:19 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:20.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:19 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:24:20.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:19 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:21.183 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:20 smithi046 ceph-mon[26924]: Deploying daemon osd.1 on smithi046 2024-05-09T06:24:21.183 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:20 smithi046 ceph-mon[26924]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:21.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:20 smithi106 ceph-mon[34679]: Deploying daemon osd.1 on smithi046 2024-05-09T06:24:21.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:20 smithi106 ceph-mon[34679]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:23.049 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:22 smithi046 ceph-mon[26924]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:23.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:22 smithi106 ceph-mon[34679]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:25.245 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:24 smithi046 ceph-mon[26924]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:25.245 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:25.246 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:25.246 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:25.246 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:24 smithi106 ceph-mon[34679]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:26 smithi106 ceph-mon[34679]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:27.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:26 smithi046 ceph-mon[26924]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:27.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:28.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.934+0000 7f30727fc700 1 -- 172.21.15.46:0/4104460551 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f307c1022f0 con 0x7f3068069210 2024-05-09T06:24:28.918 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 1 on host 'smithi046' 2024-05-09T06:24:28.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3068069210 msgr2=0x7f306806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:28.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3068069210 0x7f306806b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b3b0 tx=0x7f306c009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 msgr2=0x7f307c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 0x7f307c071c00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f307800b790 tx=0x7f3078009250 comp rx=0 tx=0).stop 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 shutdown_connections 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3068069210 0x7f306806b6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c0fce60 0x7f307c071c00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 --2- 172.21.15.46:0/4104460551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f307c0fdfd0 0x7f307c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 >> 172.21.15.46:0/4104460551 conn(0x7f307c0f8540 msgr2=0x7f307c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 shutdown_connections 2024-05-09T06:24:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:28.936+0000 7f3084081700 1 -- 172.21.15.46:0/4104460551 wait complete. 2024-05-09T06:24:29.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:28 smithi046 ceph-mon[26924]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:29.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:28 smithi046 ceph-mon[26924]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:24:29.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:28 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:29.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:28 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:28 smithi106 ceph-mon[34679]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:28 smithi106 ceph-mon[34679]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:24:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:28 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:28 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:29.528 DEBUG:teuthology.orchestra.run.smithi046:osd.1> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.1.service 2024-05-09T06:24:29.531 INFO:tasks.cephadm:Deploying osd.2 on smithi046 with /dev/vg_nvme/lv_2... 2024-05-09T06:24:29.531 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T06:24:30.229 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:24:30.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:24:30.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T06:24:30.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:30.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:24:30.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-05-09T06:24:30.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: osdmap e13: 2 total, 1 up, 2 in 2024-05-09T06:24:30.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:29 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: from='osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: osdmap e13: 2 total, 1 up, 2 in 2024-05-09T06:24:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:29 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:30.338 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:24:29 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[52304]: 2024-05-09T06:24:29.948+0000 7f9d41e49700 -1 osd.1 0 waiting for initial osdmap 2024-05-09T06:24:30.338 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:24:29 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[52304]: 2024-05-09T06:24:29.952+0000 7f9d3bc42700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:24:31.043 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:30 smithi046 ceph-mon[26924]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:31.043 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:31.043 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:31.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:30 smithi106 ceph-mon[34679]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:31.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:31.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:31.997 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:31 smithi046 ceph-mon[26924]: purged_snaps scrub starts 2024-05-09T06:24:31.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:31 smithi046 ceph-mon[26924]: purged_snaps scrub ok 2024-05-09T06:24:31.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:31 smithi046 ceph-mon[26924]: osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] boot 2024-05-09T06:24:31.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:31 smithi046 ceph-mon[26924]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T06:24:31.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:32.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:31 smithi106 ceph-mon[34679]: purged_snaps scrub starts 2024-05-09T06:24:32.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:31 smithi106 ceph-mon[34679]: purged_snaps scrub ok 2024-05-09T06:24:32.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:31 smithi106 ceph-mon[34679]: osd.1 [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] boot 2024-05-09T06:24:32.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:31 smithi106 ceph-mon[34679]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T06:24:32.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:24:33.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:32 smithi046 ceph-mon[26924]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:33.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:32 smithi046 ceph-mon[26924]: osdmap e15: 2 total, 2 up, 2 in 2024-05-09T06:24:33.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:32 smithi106 ceph-mon[34679]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-05-09T06:24:33.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:32 smithi106 ceph-mon[34679]: osdmap e15: 2 total, 2 up, 2 in 2024-05-09T06:24:33.696 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T06:24:33.696 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T06:24:33.696 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2024-05-09T06:24:33.696 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2024-05-09T06:24:33.696 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00873526 s, 1.2 GB/s 2024-05-09T06:24:33.696 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2024-05-09T06:24:34.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-05-09T06:24:34.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:34 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:35.091 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:34 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:35.092 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:34 smithi046 ceph-mon[26924]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:35.092 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:34 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:35.092 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:34 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:35.092 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:34 smithi106 ceph-mon[34679]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:35.537 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:24:37.260 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:36 smithi046 ceph-mon[26924]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:37.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:36 smithi106 ceph-mon[34679]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:37.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 -- 172.21.15.46:0/3114372910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 msgr2=0x7efd2c0ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:37.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 --2- 172.21.15.46:0/3114372910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0ff880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efd28004940 tx=0x7efd28009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 -- 172.21.15.46:0/3114372910 shutdown_connections 2024-05-09T06:24:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 --2- 172.21.15.46:0/3114372910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2c0ffdc0 0x7efd2c1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 --2- 172.21.15.46:0/3114372910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0ff880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 -- 172.21.15.46:0/3114372910 >> 172.21.15.46:0/3114372910 conn(0x7efd2c0f7250 msgr2=0x7efd2c0f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 -- 172.21.15.46:0/3114372910 shutdown_connections 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.822+0000 7efd32da0700 1 -- 172.21.15.46:0/3114372910 wait complete. 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd32da0700 1 Processor -- start 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd32da0700 1 -- start start 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd32da0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd32da0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2c0ffdc0 0x7efd2c0fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd32da0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0fbda0 con 0x7efd2c066220 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd32da0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0fbee0 con 0x7efd2c0ffdc0 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd31d9e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd31d9e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57062/0 (socket says 172.21.15.46:57062) 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd31d9e700 1 -- 172.21.15.46:0/2005098221 learned_addr learned my addr 172.21.15.46:0/2005098221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd3159d700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2c0ffdc0 0x7efd2c0fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd31d9e700 1 -- 172.21.15.46:0/2005098221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2c0ffdc0 msgr2=0x7efd2c0fb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd31d9e700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2c0ffdc0 0x7efd2c0fb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.823+0000 7efd31d9e700 1 -- 172.21.15.46:0/2005098221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28005040 con 0x7efd2c066220 2024-05-09T06:24:37.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.824+0000 7efd31d9e700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0fd260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd2800b970 tx=0x7efd28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:37.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.824+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2800e040 con 0x7efd2c066220 2024-05-09T06:24:37.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.824+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd2800bbf0 con 0x7efd2c066220 2024-05-09T06:24:37.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.824+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c0fc160 con 0x7efd2c066220 2024-05-09T06:24:37.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.824+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2801c630 con 0x7efd2c066220 2024-05-09T06:24:37.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.824+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c115920 con 0x7efd2c066220 2024-05-09T06:24:37.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.825+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c05f5c0 con 0x7efd2c066220 2024-05-09T06:24:37.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.825+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7efd2800bd60 con 0x7efd2c066220 2024-05-09T06:24:37.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.826+0000 7efd227fc700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7efd18069210 0x7efd1806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:24:37.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.826+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7efd280878b0 con 0x7efd2c066220 2024-05-09T06:24:37.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.826+0000 7efd3159d700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7efd18069210 0x7efd1806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:24:37.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.826+0000 7efd3159d700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7efd18069210 0x7efd1806b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd1c006fd0 tx=0x7efd1c008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:24:37.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:37.830+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efd28054950 con 0x7efd2c066220 2024-05-09T06:24:38.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:38.034+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efd2c0f8d90 con 0x7efd18069210 2024-05-09T06:24:39.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:39.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:39.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:39.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:39.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:40.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:39 smithi046 ceph-mon[26924]: Detected new or changed devices on smithi046 2024-05-09T06:24:40.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:39 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi046 to 6434M 2024-05-09T06:24:40.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:39 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi046 2024-05-09T06:24:40.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:39 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi046 to 6434M 2024-05-09T06:24:41.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:40 smithi046 ceph-mon[26924]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:41.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:40 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1662573078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc886871-1181-45c7-b257-f9eb145936ed"}]: dispatch 2024-05-09T06:24:41.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:40 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1662573078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc886871-1181-45c7-b257-f9eb145936ed"}]': finished 2024-05-09T06:24:41.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:40 smithi046 ceph-mon[26924]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T06:24:41.219 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:40 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:41.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:40 smithi106 ceph-mon[34679]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:41.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:40 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1662573078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc886871-1181-45c7-b257-f9eb145936ed"}]: dispatch 2024-05-09T06:24:41.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:40 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1662573078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc886871-1181-45c7-b257-f9eb145936ed"}]': finished 2024-05-09T06:24:41.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:40 smithi106 ceph-mon[34679]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T06:24:41.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:40 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:41.981 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:41 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/339057305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:42.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:41 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/339057305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:24:43.237 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:42 smithi046 ceph-mon[26924]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:43.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:42 smithi106 ceph-mon[34679]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:44.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:44.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:44.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:44.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:44.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:44.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:44 smithi046 ceph-mon[26924]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:45.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:45.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:45.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:45.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:24:45.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:45.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:44 smithi106 ceph-mon[34679]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:47.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:46 smithi046 ceph-mon[26924]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:47.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:46 smithi106 ceph-mon[34679]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:48.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:24:48.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:48.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:24:48.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:24:49.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:48 smithi046 ceph-mon[26924]: Deploying daemon osd.2 on smithi046 2024-05-09T06:24:49.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:48 smithi046 ceph-mon[26924]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:49.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:48 smithi106 ceph-mon[34679]: Deploying daemon osd.2 on smithi046 2024-05-09T06:24:49.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:48 smithi106 ceph-mon[34679]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:51.224 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:50 smithi046 ceph-mon[26924]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:51.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:50 smithi106 ceph-mon[34679]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:53.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:52 smithi046 ceph-mon[26924]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:53.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:53.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:53.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:52 smithi106 ceph-mon[34679]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:53.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:53.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:24:54.265 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:53 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:53 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:24:55.069 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:54 smithi046 ceph-mon[26924]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:55.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:54 smithi106 ceph-mon[34679]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:56.071 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 2 on host 'smithi046' 2024-05-09T06:24:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.087+0000 7efd227fc700 1 -- 172.21.15.46:0/2005098221 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efd2c0f8d90 con 0x7efd18069210 2024-05-09T06:24:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7efd18069210 msgr2=0x7efd1806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7efd18069210 0x7efd1806b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd1c006fd0 tx=0x7efd1c008040 comp rx=0 tx=0).stop 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 msgr2=0x7efd2c0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0fd260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd2800b970 tx=0x7efd28009e30 comp rx=0 tx=0).stop 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 shutdown_connections 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7efd18069210 0x7efd1806b6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd2c066220 0x7efd2c0fd260 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.090+0000 7efd32da0700 1 --2- 172.21.15.46:0/2005098221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2c0ffdc0 0x7efd2c0fb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.091+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 >> 172.21.15.46:0/2005098221 conn(0x7efd2c0f7250 msgr2=0x7efd2c0f7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.091+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 shutdown_connections 2024-05-09T06:24:56.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:24:56.091+0000 7efd32da0700 1 -- 172.21.15.46:0/2005098221 wait complete. 2024-05-09T06:24:57.051 DEBUG:teuthology.orchestra.run.smithi046:osd.2> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.2.service 2024-05-09T06:24:57.054 INFO:tasks.cephadm:Deploying osd.3 on smithi106 with /dev/vg_nvme/lv_4... 2024-05-09T06:24:57.054 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T06:24:57.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:57 smithi046 ceph-mon[26924]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:57.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:57.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:57.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:57 smithi046 ceph-mon[26924]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:24:57.315 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:24:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:57 smithi106 ceph-mon[34679]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:24:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:57 smithi106 ceph-mon[34679]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:24:58.244 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:58 smithi046 ceph-mon[26924]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:24:58.244 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:58 smithi046 ceph-mon[26924]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T06:24:58.244 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:58.244 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:58 smithi046 ceph-mon[26924]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:24:58.245 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:24:58 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[60066]: 2024-05-09T06:24:58.058+0000 7fb2a7ddb700 -1 osd.2 0 waiting for initial osdmap 2024-05-09T06:24:58.245 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:24:58 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[60066]: 2024-05-09T06:24:58.063+0000 7fb2a23d5700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:24:58.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:58 smithi106 ceph-mon[34679]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:24:58.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:58 smithi106 ceph-mon[34679]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T06:24:58.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:58 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:58.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:58 smithi106 ceph-mon[34679]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:24:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T06:24:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T06:24:59.156 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-09T06:24:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-09T06:24:59.156 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112111 s, 935 MB/s 2024-05-09T06:24:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-09T06:24:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:59 smithi106 ceph-mon[34679]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:59 smithi106 ceph-mon[34679]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-05-09T06:24:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:59 smithi106 ceph-mon[34679]: osdmap e18: 3 total, 2 up, 3 in 2024-05-09T06:24:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:59 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:59.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:24:59 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:59.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:59 smithi046 ceph-mon[26924]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:24:59.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:59 smithi046 ceph-mon[26924]: from='osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-05-09T06:24:59.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:59 smithi046 ceph-mon[26924]: osdmap e18: 3 total, 2 up, 3 in 2024-05-09T06:24:59.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:59 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:59.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:24:59 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:24:59.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_4 2024-05-09T06:25:00.034 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:25:00.433 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: purged_snaps scrub starts 2024-05-09T06:25:00.433 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: purged_snaps scrub ok 2024-05-09T06:25:00.434 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] boot 2024-05-09T06:25:00.434 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T06:25:00.434 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:25:00.434 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:00.434 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:00.721 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: purged_snaps scrub starts 2024-05-09T06:25:00.721 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: purged_snaps scrub ok 2024-05-09T06:25:00.721 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: osd.2 [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] boot 2024-05-09T06:25:00.721 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T06:25:00.721 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:25:00.722 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:00.722 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:01.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 -- 172.21.15.106:0/1819946460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fed70 msgr2=0x7f17700faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:01.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 --2- 172.21.15.106:0/1819946460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fed70 0x7f17700faeb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1760004940 tx=0x7f1760009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:01.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 -- 172.21.15.106:0/1819946460 shutdown_connections 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 --2- 172.21.15.106:0/1819946460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fed70 0x7f17700faeb0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 --2- 172.21.15.106:0/1819946460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17700fe420 0x7f17700fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 -- 172.21.15.106:0/1819946460 >> 172.21.15.106:0/1819946460 conn(0x7f17700f6be0 msgr2=0x7f17700f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 -- 172.21.15.106:0/1819946460 shutdown_connections 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 -- 172.21.15.106:0/1819946460 wait complete. 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 Processor -- start 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.374+0000 7f177706e700 1 -- start start 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f177706e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 0x7f177010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f177706e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17700fed70 0x7f17701100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f177706e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17701106a0 con 0x7f17700fed70 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f177706e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1770110810 con 0x7f17700fe420 2024-05-09T06:25:01.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 0x7f177010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 0x7f177010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:52372/0 (socket says 172.21.15.106:52372) 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 -- 172.21.15.106:0/1872213450 learned_addr learned my addr 172.21.15.106:0/1872213450 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1767fff700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17700fed70 0x7f17701100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 -- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17700fed70 msgr2=0x7f17701100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17700fed70 0x7f17701100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 -- 172.21.15.106:0/1872213450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760005040 con 0x7f17700fe420 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f1774e0a700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 0x7f177010fb60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f176c002a50 tx=0x7f176c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.375+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f176c007cc0 con 0x7f17700fe420 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.376+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1770115270 con 0x7f17700fe420 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.376+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f176c00f040 con 0x7f17700fe420 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.376+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f176c00da30 con 0x7f17700fe420 2024-05-09T06:25:01.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.376+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1770115830 con 0x7f17700fe420 2024-05-09T06:25:01.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.376+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1770101b60 con 0x7f17700fe420 2024-05-09T06:25:01.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.377+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f176c00db90 con 0x7f17700fe420 2024-05-09T06:25:01.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.377+0000 7f17657fa700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1758069210 0x7f175806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:01.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.378+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f176c086570 con 0x7f17700fe420 2024-05-09T06:25:01.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.378+0000 7f1767fff700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1758069210 0x7f175806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:01.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.378+0000 7f1767fff700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1758069210 0x7f175806b6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1760009fd0 tx=0x7f1760009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:01.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.382+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f176c056c50 con 0x7f17700fe420 2024-05-09T06:25:01.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:01.577+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f177002b340 con 0x7f1758069210 2024-05-09T06:25:01.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:01 smithi106 ceph-mon[34679]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:25:01.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:01 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-09T06:25:01.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:01 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-09T06:25:01.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:01 smithi106 ceph-mon[34679]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T06:25:01.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:01 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:25:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:01 smithi046 ceph-mon[26924]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-05-09T06:25:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-09T06:25:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-09T06:25:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:01 smithi046 ceph-mon[26924]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T06:25:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:25:02.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:25:02.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T06:25:02.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:02.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:02.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:02.514 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:02.514 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:02 smithi046 ceph-mon[26924]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:02.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:25:02.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T06:25:02.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:02.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:02.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:02.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:02.576 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:02 smithi106 ceph-mon[34679]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:02.837 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:02 smithi046 sudo[64600]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:25:02.837 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:02 smithi046 sudo[64600]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:02.837 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:02 smithi046 sudo[64600]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:02.837 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:02 smithi046 sudo[64600]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:03.337 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64732]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:25:03.337 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64732]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:03.337 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64732]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:03.337 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64732]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: osdmap e22: 3 total, 3 up, 3 in 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi046 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi046 to 4289M 2024-05-09T06:25:03.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.576 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:03.576 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:03.576 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.576 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:03.576 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.837 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:25:03.837 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:03.837 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64812]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:03.837 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64812]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: osdmap e22: 3 total, 3 up, 3 in 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: Detected new or changed devices on smithi046 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi046 to 4289M 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:03.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:03.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:03.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:03.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:04.269 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64880]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:25:04.269 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64880]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:04.269 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64880]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:04.269 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:25:03 smithi046 sudo[64880]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:04.434+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f176c053590 con 0x7f17700fe420 2024-05-09T06:25:04.587 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64922]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:25:04.587 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64922]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:04.587 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64922]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:04.587 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64922]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:04.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:04 smithi046 ceph-mon[26924]: pgmap v75: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:04.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:04 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1057949004' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cb725f2-6233-44e6-bb4e-03c46bc4cbe3"}]: dispatch 2024-05-09T06:25:04.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:04 smithi046 ceph-mon[26924]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cb725f2-6233-44e6-bb4e-03c46bc4cbe3"}]: dispatch 2024-05-09T06:25:04.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:04 smithi046 ceph-mon[26924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cb725f2-6233-44e6-bb4e-03c46bc4cbe3"}]': finished 2024-05-09T06:25:04.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:04 smithi046 ceph-mon[26924]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T06:25:04.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:04 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:04.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:04 smithi106 ceph-mon[34679]: pgmap v75: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:04.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:04 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/1057949004' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cb725f2-6233-44e6-bb4e-03c46bc4cbe3"}]: dispatch 2024-05-09T06:25:04.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:04 smithi106 ceph-mon[34679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cb725f2-6233-44e6-bb4e-03c46bc4cbe3"}]: dispatch 2024-05-09T06:25:04.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:04 smithi106 ceph-mon[34679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cb725f2-6233-44e6-bb4e-03c46bc4cbe3"}]': finished 2024-05-09T06:25:04.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:04 smithi106 ceph-mon[34679]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T06:25:04.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:04 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:05.337 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64969]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:25:05.337 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64969]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:05.337 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64969]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:05.337 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:25:04 smithi046 sudo[64969]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65025]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:25:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65025]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65025]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65025]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:05 smithi106 ceph-mon[34679]: mgrmap e19: smithi046.nvpcui(active, since 2m), standbys: smithi106.nlgnpx 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:05 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/341691225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:05 smithi106 ceph-mon[34679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38623]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38623]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38623]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:06.065 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38623]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65076]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 sudo[65076]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 ceph-mon[26924]: mgrmap e19: smithi046.nvpcui(active, since 2m), standbys: smithi106.nlgnpx 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/341691225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:06.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:05 smithi046 ceph-mon[26924]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:25:06.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38811]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T06:25:06.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T06:25:06.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38811]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T06:25:06.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 sudo[38811]: pam_unix(sudo:session): session closed for user root 2024-05-09T06:25:07.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: pgmap v77: 1 pgs: 1 creating+activating; 0 B data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:25:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:06 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: pgmap v77: 1 pgs: 1 creating+activating; 0 B data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T06:25:07.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:06 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:08.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:08.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:08.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:08.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:08.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:08.212 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:08.212 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:08.212 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:08.212 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:08.213 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:09.099 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:08 smithi106 ceph-mon[34679]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:09.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:08 smithi046 ceph-mon[26924]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:10.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:09 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:10.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:10.942 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:10 smithi106 ceph-mon[34679]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:11.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:10 smithi046 ceph-mon[26924]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:12.059 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:25:12.059 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:12.059 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:11 smithi106 ceph-mon[34679]: Deploying daemon osd.3 on smithi106 2024-05-09T06:25:12.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:25:12.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:12.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:11 smithi046 ceph-mon[26924]: Deploying daemon osd.3 on smithi106 2024-05-09T06:25:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:12 smithi106 ceph-mon[34679]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:13.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:12 smithi046 ceph-mon[26924]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:15.295 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:14 smithi106 ceph-mon[34679]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:15.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:14 smithi046 ceph-mon[26924]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:17.221 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:17.221 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:17.221 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:16 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:17.221 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:16 smithi106 ceph-mon[34679]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:16 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:17.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:16 smithi046 ceph-mon[26924]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:19.165 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:18 smithi106 ceph-mon[34679]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:19.223 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 3 on host 'smithi106' 2024-05-09T06:25:19.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.240+0000 7f17657fa700 1 -- 172.21.15.106:0/1872213450 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f177002b340 con 0x7f1758069210 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1758069210 msgr2=0x7f175806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1758069210 0x7f175806b6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1760009fd0 tx=0x7f1760009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 msgr2=0x7f177010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 0x7f177010fb60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f176c002a50 tx=0x7f176c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 shutdown_connections 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1758069210 0x7f175806b6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17700fe420 0x7f177010fb60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:19.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 --2- 172.21.15.106:0/1872213450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17700fed70 0x7f17701100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:19.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.242+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 >> 172.21.15.106:0/1872213450 conn(0x7f17700f6be0 msgr2=0x7f17700f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:19.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.243+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 shutdown_connections 2024-05-09T06:25:19.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:19.243+0000 7f177706e700 1 -- 172.21.15.106:0/1872213450 wait complete. 2024-05-09T06:25:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:18 smithi046 ceph-mon[26924]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:19.948 DEBUG:teuthology.orchestra.run.smithi106:osd.3> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.3.service 2024-05-09T06:25:19.951 INFO:tasks.cephadm:Deploying osd.4 on smithi106 with /dev/vg_nvme/lv_3... 2024-05-09T06:25:19.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T06:25:20.249 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:25:20.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: from='osd.3 [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:20.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:20.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:20.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:20 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: from='osd.3 [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:20.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:20 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:21.538 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:21 smithi106 ceph-mon[34679]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:25:21.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:21 smithi106 ceph-mon[34679]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T06:25:21.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:21 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:21.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:21 smithi106 ceph-mon[34679]: from='osd.3 [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:21.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:21 smithi106 ceph-mon[34679]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:21.539 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:25:21 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[40271]: 2024-05-09T06:25:21.233+0000 7fce795cc700 -1 osd.3 0 waiting for initial osdmap 2024-05-09T06:25:21.539 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:25:21 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[40271]: 2024-05-09T06:25:21.239+0000 7fce743c7700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:25:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:21 smithi046 ceph-mon[26924]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:25:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:21 smithi046 ceph-mon[26924]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T06:25:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:21 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:21 smithi046 ceph-mon[26924]: from='osd.3 [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:21 smithi046 ceph-mon[26924]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:22.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:22 smithi106 ceph-mon[34679]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-09T06:25:22.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:22 smithi106 ceph-mon[34679]: osdmap e25: 4 total, 3 up, 4 in 2024-05-09T06:25:22.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:22 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:22.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:22 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:22.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:22 smithi106 ceph-mon[34679]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:22.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:22 smithi046 ceph-mon[26924]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-09T06:25:22.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:22 smithi046 ceph-mon[26924]: osdmap e25: 4 total, 3 up, 4 in 2024-05-09T06:25:22.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:22 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:22.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:22 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:22.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:22 smithi046 ceph-mon[26924]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-05-09T06:25:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T06:25:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T06:25:22.742 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-09T06:25:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-09T06:25:22.743 INFO:teuthology.orchestra.run.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013582 s, 772 MB/s 2024-05-09T06:25:22.743 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: purged_snaps scrub starts 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: purged_snaps scrub ok 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: osd.3 [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] boot 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:23.400 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:23 smithi106 ceph-mon[34679]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T06:25:23.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_3 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: purged_snaps scrub starts 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: purged_snaps scrub ok 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: osd.3 [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] boot 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:25:23.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:23 smithi046 ceph-mon[26924]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T06:25:23.956 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:25:24.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:24 smithi106 ceph-mon[34679]: osdmap e28: 4 total, 4 up, 4 in 2024-05-09T06:25:24.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:24 smithi106 ceph-mon[34679]: pgmap v91: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:24.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:25.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:24 smithi046 ceph-mon[26924]: osdmap e28: 4 total, 4 up, 4 in 2024-05-09T06:25:25.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:24 smithi046 ceph-mon[26924]: pgmap v91: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:25.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:25.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: osdmap e29: 4 total, 4 up, 4 in 2024-05-09T06:25:25.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:25.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:25 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:26.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 -- 172.21.15.106:0/2242040356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 msgr2=0x7f26040fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 --2- 172.21.15.106:0/2242040356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f26040fd460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f25f8004940 tx=0x7f25f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 -- 172.21.15.106:0/2242040356 shutdown_connections 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 --2- 172.21.15.106:0/2242040356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f26040fd460 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 --2- 172.21.15.106:0/2242040356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26040fbd40 0x7f26040fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 -- 172.21.15.106:0/2242040356 >> 172.21.15.106:0/2242040356 conn(0x7f26040f74c0 msgr2=0x7f26040f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 -- 172.21.15.106:0/2242040356 shutdown_connections 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.077+0000 7f2608836700 1 -- 172.21.15.106:0/2242040356 wait complete. 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2608836700 1 Processor -- start 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2608836700 1 -- start start 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2608836700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26040fbd40 0x7f26041106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2608836700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f2604112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2608836700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2604066bc0 con 0x7f26040fbd40 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2608836700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2604066d00 con 0x7f26040fcff0 2024-05-09T06:25:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2601d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f2604112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2601d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f2604112c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49340/0 (socket says 172.21.15.106:49340) 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2601d9b700 1 -- 172.21.15.106:0/125491115 learned_addr learned my addr 172.21.15.106:0/125491115 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f260259c700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26040fbd40 0x7f26041106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2601d9b700 1 -- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26040fbd40 msgr2=0x7f26041106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2601d9b700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26040fbd40 0x7f26041106b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.078+0000 7f2601d9b700 1 -- 172.21.15.106:0/125491115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8005040 con 0x7f26040fcff0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.079+0000 7f2601d9b700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f2604112c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25f8013870 tx=0x7f25f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.079+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f8021070 con 0x7f26040fcff0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.079+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2604113140 con 0x7f26040fcff0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.079+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25f8009430 con 0x7f26040fcff0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.079+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f800e070 con 0x7f26040fcff0 2024-05-09T06:25:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.079+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2604113680 con 0x7f26040fcff0 2024-05-09T06:25:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.080+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260405f5c0 con 0x7f26040fcff0 2024-05-09T06:25:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.080+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f25f801c750 con 0x7f26040fcff0 2024-05-09T06:25:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.081+0000 7f25f2ffd700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f25ec069230 0x7f25ec06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.081+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f25f8087dc0 con 0x7f26040fcff0 2024-05-09T06:25:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.081+0000 7f260259c700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f25ec069230 0x7f25ec06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:26.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.081+0000 7f260259c700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f25ec069230 0x7f25ec06b6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2604066840 tx=0x7f25f400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:26.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.085+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f25f8054790 con 0x7f26040fcff0 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: osdmap e29: 4 total, 4 up, 4 in 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:26.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:25 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:26.276+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f26041012d0 con 0x7f25ec069230 2024-05-09T06:25:26.988 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: Detected new or changed devices on smithi106 2024-05-09T06:25:26.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi106 to 15936M 2024-05-09T06:25:26.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: osdmap e30: 4 total, 4 up, 4 in 2024-05-09T06:25:26.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:26.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:26.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:26.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:26 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:26.995 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi106 2024-05-09T06:25:26.995 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi106 to 15936M 2024-05-09T06:25:26.995 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: osdmap e30: 4 total, 4 up, 4 in 2024-05-09T06:25:26.995 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:26.996 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:26.996 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:26.996 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:26 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:27.867 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:27 smithi106 ceph-mon[34679]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:28.008 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:27 smithi046 ceph-mon[26924]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:29.031 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:28 smithi106 ceph-mon[34679]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-09T06:25:29.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:28 smithi046 ceph-mon[26924]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-09T06:25:30.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:29 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/1149088561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "206f5143-4312-4124-97d8-85b24bbd293f"}]: dispatch 2024-05-09T06:25:30.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:29 smithi106 ceph-mon[34679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "206f5143-4312-4124-97d8-85b24bbd293f"}]: dispatch 2024-05-09T06:25:30.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:29 smithi106 ceph-mon[34679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "206f5143-4312-4124-97d8-85b24bbd293f"}]': finished 2024-05-09T06:25:30.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:29 smithi106 ceph-mon[34679]: osdmap e31: 5 total, 4 up, 5 in 2024-05-09T06:25:30.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:29 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:30.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:29 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/2583416024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:30.094 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:29 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1149088561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "206f5143-4312-4124-97d8-85b24bbd293f"}]: dispatch 2024-05-09T06:25:30.094 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:29 smithi046 ceph-mon[26924]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "206f5143-4312-4124-97d8-85b24bbd293f"}]: dispatch 2024-05-09T06:25:30.094 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:29 smithi046 ceph-mon[26924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "206f5143-4312-4124-97d8-85b24bbd293f"}]': finished 2024-05-09T06:25:30.094 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:29 smithi046 ceph-mon[26924]: osdmap e31: 5 total, 4 up, 5 in 2024-05-09T06:25:30.094 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:29 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:30.094 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:29 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2583416024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:30 smithi106 ceph-mon[34679]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T06:25:31.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:30 smithi046 ceph-mon[26924]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T06:25:33.131 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:32 smithi106 ceph-mon[34679]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-09T06:25:33.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:32 smithi046 ceph-mon[26924]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-09T06:25:35.161 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:34 smithi106 ceph-mon[34679]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-09T06:25:35.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:34 smithi046 ceph-mon[26924]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-09T06:25:36.143 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:25:36.143 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:36.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:25:36.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:37.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:36 smithi106 ceph-mon[34679]: Deploying daemon osd.4 on smithi106 2024-05-09T06:25:37.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:36 smithi106 ceph-mon[34679]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T06:25:37.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:36 smithi046 ceph-mon[26924]: Deploying daemon osd.4 on smithi106 2024-05-09T06:25:37.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:36 smithi046 ceph-mon[26924]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T06:25:39.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:38 smithi046 ceph-mon[26924]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:39.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:39.286 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:38 smithi106 ceph-mon[34679]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:39.286 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:41.268 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:41 smithi106 ceph-mon[34679]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:41.268 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:41.268 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:41.268 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:41 smithi046 ceph-mon[26924]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:43.295 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:43 smithi106 ceph-mon[34679]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:43.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:43 smithi046 ceph-mon[26924]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:43.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.991+0000 7f25f2ffd700 1 -- 172.21.15.106:0/125491115 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f26041012d0 con 0x7f25ec069230 2024-05-09T06:25:43.975 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 4 on host 'smithi106' 2024-05-09T06:25:43.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f25ec069230 msgr2=0x7f25ec06b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f25ec069230 0x7f25ec06b6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2604066840 tx=0x7f25f400b040 comp rx=0 tx=0).stop 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 msgr2=0x7f2604112c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f2604112c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25f8013870 tx=0x7f25f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 shutdown_connections 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f25ec069230 0x7f25ec06b6e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26040fbd40 0x7f26041106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 --2- 172.21.15.106:0/125491115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26040fcff0 0x7f2604112c00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 >> 172.21.15.106:0/125491115 conn(0x7f26040f74c0 msgr2=0x7f26040f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 shutdown_connections 2024-05-09T06:25:43.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:43.994+0000 7f2608836700 1 -- 172.21.15.106:0/125491115 wait complete. 2024-05-09T06:25:44.537 DEBUG:teuthology.orchestra.run.smithi106:osd.4> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.4.service 2024-05-09T06:25:44.540 INFO:tasks.cephadm:Deploying osd.5 on smithi106 with /dev/vg_nvme/lv_2... 2024-05-09T06:25:44.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T06:25:44.825 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:25:44 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[46816]: 2024-05-09T06:25:44.741+0000 7f92a2a60540 -1 osd.4 0 log_to_monitors true 2024-05-09T06:25:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:25:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:44 smithi106 ceph-mon[34679]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:45.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:44 smithi106 ceph-mon[34679]: from='osd.4 [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:45.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:44 smithi106 ceph-mon[34679]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:45.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:44 smithi046 ceph-mon[26924]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:45.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:45.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:45.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:44 smithi046 ceph-mon[26924]: from='osd.4 [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:45.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:44 smithi046 ceph-mon[26924]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:25:46.190 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:46 smithi106 ceph-mon[34679]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:25:46.190 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:46 smithi106 ceph-mon[34679]: osdmap e32: 5 total, 4 up, 5 in 2024-05-09T06:25:46.190 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:46 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:46.190 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:46 smithi106 ceph-mon[34679]: from='osd.4 [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:46.191 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:46 smithi106 ceph-mon[34679]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:46.191 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:25:46 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[46816]: 2024-05-09T06:25:46.015+0000 7f9299231700 -1 osd.4 0 waiting for initial osdmap 2024-05-09T06:25:46.191 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:25:46 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[46816]: 2024-05-09T06:25:46.022+0000 7f9296030700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:25:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:46 smithi046 ceph-mon[26924]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:25:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:46 smithi046 ceph-mon[26924]: osdmap e32: 5 total, 4 up, 5 in 2024-05-09T06:25:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:46 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:46 smithi046 ceph-mon[26924]: from='osd.4 [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:46 smithi046 ceph-mon[26924]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:25:47.127 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T06:25:47.127 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T06:25:47.128 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-09T06:25:47.128 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-09T06:25:47.128 INFO:teuthology.orchestra.run.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0155341 s, 675 MB/s 2024-05-09T06:25:47.128 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-09T06:25:47.222 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:47.222 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-09T06:25:47.222 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: osdmap e33: 5 total, 4 up, 5 in 2024-05-09T06:25:47.222 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:47.222 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:47.223 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:47.223 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: osdmap e33: 5 total, 4 up, 5 in 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:47.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:48.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_2 2024-05-09T06:25:48.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:48 smithi106 ceph-mon[34679]: purged_snaps scrub starts 2024-05-09T06:25:48.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:48 smithi106 ceph-mon[34679]: purged_snaps scrub ok 2024-05-09T06:25:48.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:48 smithi106 ceph-mon[34679]: osd.4 [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] boot 2024-05-09T06:25:48.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:48 smithi106 ceph-mon[34679]: osdmap e34: 5 total, 5 up, 5 in 2024-05-09T06:25:48.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:48.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:48 smithi046 ceph-mon[26924]: purged_snaps scrub starts 2024-05-09T06:25:48.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:48 smithi046 ceph-mon[26924]: purged_snaps scrub ok 2024-05-09T06:25:48.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:48 smithi046 ceph-mon[26924]: osd.4 [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] boot 2024-05-09T06:25:48.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:48 smithi046 ceph-mon[26924]: osdmap e34: 5 total, 5 up, 5 in 2024-05-09T06:25:48.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:25:48.500 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:25:49.302 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:49 smithi106 ceph-mon[34679]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:49.302 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:49 smithi106 ceph-mon[34679]: osdmap e35: 5 total, 5 up, 5 in 2024-05-09T06:25:49.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:49 smithi046 ceph-mon[26924]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:49.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:49 smithi046 ceph-mon[26924]: osdmap e35: 5 total, 5 up, 5 in 2024-05-09T06:25:50.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 -- 172.21.15.106:0/3903687849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 msgr2=0x7f00b40fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 --2- 172.21.15.106:0/3903687849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40fe450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f00a4004940 tx=0x7f00a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 -- 172.21.15.106:0/3903687849 shutdown_connections 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 --2- 172.21.15.106:0/3903687849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40fe450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 --2- 172.21.15.106:0/3903687849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40fce70 0x7f00b40fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 -- 172.21.15.106:0/3903687849 >> 172.21.15.106:0/3903687849 conn(0x7f00b40f8550 msgr2=0x7f00b40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 -- 172.21.15.106:0/3903687849 shutdown_connections 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 -- 172.21.15.106:0/3903687849 wait complete. 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 Processor -- start 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.969+0000 7f00baab5700 1 -- start start 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00baab5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40fce70 0x7f00b4071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:50.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00baab5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00baab5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4072200 con 0x7f00b40fce70 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00baab5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40707f0 con 0x7f00b40fdfe0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33812/0 (socket says 172.21.15.106:33812) 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 -- 172.21.15.106:0/4133141546 learned_addr learned my addr 172.21.15.106:0/4133141546 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00b8851700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40fce70 0x7f00b4071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 -- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40fce70 msgr2=0x7f00b4071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40fce70 0x7f00b4071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 -- 172.21.15.106:0/4133141546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a4005040 con 0x7f00b40fdfe0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00abfff700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40702b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f00a400b3b0 tx=0x7f00a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a400e040 con 0x7f00b40fdfe0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00a400bbf0 con 0x7f00b40fdfe0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.970+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b4070a40 con 0x7f00b40fdfe0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.971+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00a401c630 con 0x7f00b40fdfe0 2024-05-09T06:25:50.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.971+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b4071000 con 0x7f00b40fdfe0 2024-05-09T06:25:50.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.972+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b404c710 con 0x7f00b40fdfe0 2024-05-09T06:25:50.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.972+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f00a400bd60 con 0x7f00b40fdfe0 2024-05-09T06:25:50.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.973+0000 7f00a97fa700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f009c0692a0 0x7f009c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:25:50.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.973+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f00a40879d0 con 0x7f00b40fdfe0 2024-05-09T06:25:50.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.973+0000 7f00b8851700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f009c0692a0 0x7f009c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:25:50.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.973+0000 7f00b8851700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f009c0692a0 0x7f009c06b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00b0004f40 tx=0x7f00b000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:25:50.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:50.977+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f00a4057c80 con 0x7f00b40fdfe0 2024-05-09T06:25:51.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:51.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:51.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:51 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:25:51.172+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f00b4102350 con 0x7f009c0692a0 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:51.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:51.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:25:51.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:51.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:25:51.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:51 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:25:52.232 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:52 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi106 2024-05-09T06:25:52.232 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:52 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi106 to 7968M 2024-05-09T06:25:52.232 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:52.232 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:52.232 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:52 smithi046 ceph-mon[26924]: Detected new or changed devices on smithi106 2024-05-09T06:25:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:52 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi106 to 7968M 2024-05-09T06:25:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T06:25:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T06:25:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:25:53.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:53 smithi106 ceph-mon[34679]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:53.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:53 smithi106 ceph-mon[34679]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:53.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:53 smithi046 ceph-mon[26924]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:25:53.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:53 smithi046 ceph-mon[26924]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:54.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:54 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2387720461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "075617dd-1b9c-4c82-9bfb-6ed4cb577eef"}]: dispatch 2024-05-09T06:25:54.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:54 smithi046 ceph-mon[26924]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "075617dd-1b9c-4c82-9bfb-6ed4cb577eef"}]: dispatch 2024-05-09T06:25:54.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:54 smithi046 ceph-mon[26924]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "075617dd-1b9c-4c82-9bfb-6ed4cb577eef"}]': finished 2024-05-09T06:25:54.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:54 smithi046 ceph-mon[26924]: osdmap e36: 6 total, 5 up, 6 in 2024-05-09T06:25:54.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:54.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:54.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:54 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/2387720461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "075617dd-1b9c-4c82-9bfb-6ed4cb577eef"}]: dispatch 2024-05-09T06:25:54.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:54 smithi106 ceph-mon[34679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "075617dd-1b9c-4c82-9bfb-6ed4cb577eef"}]: dispatch 2024-05-09T06:25:54.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:54 smithi106 ceph-mon[34679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "075617dd-1b9c-4c82-9bfb-6ed4cb577eef"}]': finished 2024-05-09T06:25:54.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:54 smithi106 ceph-mon[34679]: osdmap e36: 6 total, 5 up, 6 in 2024-05-09T06:25:54.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:25:54.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:25:55.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:55 smithi106 ceph-mon[34679]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:55.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:55 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/1996488866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:55.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:55 smithi046 ceph-mon[26924]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:55.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:55 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/1996488866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T06:25:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:57 smithi106 ceph-mon[34679]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:57.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:57 smithi046 ceph-mon[26924]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:59.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:25:59 smithi106 ceph-mon[34679]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:25:59.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:25:59 smithi046 ceph-mon[26924]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:01.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:01 smithi106 ceph-mon[34679]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:01.251 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:01 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:26:01.251 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:01 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:01.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:01 smithi046 ceph-mon[26924]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:01.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:26:01.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:01 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:02.282 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:02 smithi106 ceph-mon[34679]: Deploying daemon osd.5 on smithi106 2024-05-09T06:26:02.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:02 smithi046 ceph-mon[26924]: Deploying daemon osd.5 on smithi106 2024-05-09T06:26:03.223 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:03 smithi106 ceph-mon[34679]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:03.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:03 smithi046 ceph-mon[26924]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:05.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:05 smithi106 ceph-mon[34679]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:05.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:05 smithi046 ceph-mon[26924]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:07 smithi106 ceph-mon[34679]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:07.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:07 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:26:07.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:07 smithi046 ceph-mon[26924]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:07.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:07.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:07.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:07 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:26:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:09 smithi106 ceph-mon[34679]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:09 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:09.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:09 smithi046 ceph-mon[26924]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:09.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:10.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.340+0000 7f00a97fa700 1 -- 172.21.15.106:0/4133141546 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f00b4102350 con 0x7f009c0692a0 2024-05-09T06:26:10.323 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 5 on host 'smithi106' 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f009c0692a0 msgr2=0x7f009c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f009c0692a0 0x7f009c06b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00b0004f40 tx=0x7f00b000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 msgr2=0x7f00b40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40702b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f00a400b3b0 tx=0x7f00a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 shutdown_connections 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f009c0692a0 0x7f009c06b750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00b40fce70 0x7f00b4071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 --2- 172.21.15.106:0/4133141546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b40fdfe0 0x7f00b40702b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 >> 172.21.15.106:0/4133141546 conn(0x7f00b40f8550 msgr2=0x7f00b40f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.342+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 shutdown_connections 2024-05-09T06:26:10.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:10.343+0000 7f00baab5700 1 -- 172.21.15.106:0/4133141546 wait complete. 2024-05-09T06:26:10.924 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:10.924 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:10.925 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: from='osd.5 [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:26:10.925 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:26:10.925 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:10.925 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:10.925 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:10 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:10.955 DEBUG:teuthology.orchestra.run.smithi106:osd.5> sudo journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.5.service 2024-05-09T06:26:10.999 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-05-09T06:26:10.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T06:26:11.029 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:11.029 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:11.029 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: from='osd.5 [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:26:11.029 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:26:11.029 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:11.030 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:11.030 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:10 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:11.281 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:11.723 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:11 smithi046 ceph-mon[26924]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:26:11.723 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:11 smithi046 ceph-mon[26924]: osdmap e37: 6 total, 5 up, 6 in 2024-05-09T06:26:11.723 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:11.723 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:11 smithi046 ceph-mon[26924]: from='osd.5 [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:26:11.723 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:11 smithi046 ceph-mon[26924]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:26:11.956 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:11 smithi106 ceph-mon[34679]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:26:11.956 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:11 smithi106 ceph-mon[34679]: osdmap e37: 6 total, 5 up, 6 in 2024-05-09T06:26:11.956 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:11.956 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:11 smithi106 ceph-mon[34679]: from='osd.5 [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:26:11.956 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:11 smithi106 ceph-mon[34679]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:26:11.956 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:26:11 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[53529]: 2024-05-09T06:26:11.673+0000 7f5e727ca700 -1 osd.5 0 waiting for initial osdmap 2024-05-09T06:26:11.956 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:26:11 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[53529]: 2024-05-09T06:26:11.681+0000 7f5e6bdc2700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:26:12.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:12 smithi046 ceph-mon[26924]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-09T06:26:12.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:12 smithi046 ceph-mon[26924]: osdmap e38: 6 total, 5 up, 6 in 2024-05-09T06:26:12.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:12 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:12.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:12 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:12.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:12 smithi046 ceph-mon[26924]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:12.977 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:12 smithi106 ceph-mon[34679]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-09T06:26:12.977 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:12 smithi106 ceph-mon[34679]: osdmap e38: 6 total, 5 up, 6 in 2024-05-09T06:26:12.978 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:12 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:12.978 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:12 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:12.978 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:12 smithi106 ceph-mon[34679]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-05-09T06:26:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 -- 172.21.15.46:0/1677823115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fce60 msgr2=0x7fef9c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 --2- 172.21.15.46:0/1677823115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fce60 0x7fef9c0fd270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef8c004940 tx=0x7fef8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 -- 172.21.15.46:0/1677823115 shutdown_connections 2024-05-09T06:26:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 --2- 172.21.15.46:0/1677823115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 --2- 172.21.15.46:0/1677823115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fce60 0x7fef9c0fd270 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 -- 172.21.15.46:0/1677823115 >> 172.21.15.46:0/1677823115 conn(0x7fef9c0f8540 msgr2=0x7fef9c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 -- 172.21.15.46:0/1677823115 shutdown_connections 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.026+0000 7fefa206f700 1 -- 172.21.15.46:0/1677823115 wait complete. 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fefa206f700 1 Processor -- start 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fefa206f700 1 -- start start 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fefa206f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef9c0fce60 0x7fef9c10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fefa206f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fefa206f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10e450 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fefa206f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10e5c0 con 0x7fef9c0fce60 2024-05-09T06:26:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fef9affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fef9b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef9c0fce60 0x7fef9c10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fef9affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60280/0 (socket says 172.21.15.46:60280) 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.027+0000 7fef9affd700 1 -- 172.21.15.46:0/1392056631 learned_addr learned my addr 172.21.15.46:0/1392056631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef9affd700 1 -- 172.21.15.46:0/1392056631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef9c0fce60 msgr2=0x7fef9c10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef9affd700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef9c0fce60 0x7fef9c10d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef9affd700 1 -- 172.21.15.46:0/1392056631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c005040 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef9affd700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c10de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef90002a50 tx=0x7fef900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef90007cc0 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c113020 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef9000f040 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9000da30 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.028+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c1135b0 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.029+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c04c710 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.029+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fef9000db90 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.030+0000 7fef83fff700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef840692a0 0x7fef8406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.030+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fef90086b30 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.030+0000 7fef9b7fe700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef840692a0 0x7fef8406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.030+0000 7fef9b7fe700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef840692a0 0x7fef8406b750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009fd0 tx=0x7fef8c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:13.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.035+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fef90056c30 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.232+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fef9c1058c0 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.233+0000 7fef83fff700 1 -- 172.21.15.46:0/1392056631 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7fef900567c0 con 0x7fef9c0fdfd0 2024-05-09T06:26:13.216 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef840692a0 msgr2=0x7fef8406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef840692a0 0x7fef8406b750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009fd0 tx=0x7fef8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 msgr2=0x7fef9c10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c10de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef90002a50 tx=0x7fef900046b0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 shutdown_connections 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef840692a0 0x7fef8406b750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef9c0fce60 0x7fef9c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 --2- 172.21.15.46:0/1392056631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef9c0fdfd0 0x7fef9c10de50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:13.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 >> 172.21.15.46:0/1392056631 conn(0x7fef9c0f8540 msgr2=0x7fef9c0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:13.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 shutdown_connections 2024-05-09T06:26:13.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:13.235+0000 7fefa206f700 1 -- 172.21.15.46:0/1392056631 wait complete. 2024-05-09T06:26:13.918 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: purged_snaps scrub starts 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: purged_snaps scrub ok 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: osd.5 [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] boot 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: osdmap e39: 6 total, 6 up, 6 in 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1392056631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:13.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:26:13.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:13 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:13.948 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1715235972,"num_in_osds":6,"osd_in_since":1715235953,"num_remapped_pgs":0} 2024-05-09T06:26:13.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:26:14.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: purged_snaps scrub starts 2024-05-09T06:26:14.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: purged_snaps scrub ok 2024-05-09T06:26:14.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:14.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: osd.5 [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] boot 2024-05-09T06:26:14.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: osdmap e39: 6 total, 6 up, 6 in 2024-05-09T06:26:14.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1392056631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:26:14.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:13 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:14.264 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:15.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: Detected new or changed devices on smithi106 2024-05-09T06:26:15.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi106 to 5312M 2024-05-09T06:26:15.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: osdmap e40: 6 total, 6 up, 6 in 2024-05-09T06:26:15.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:26:15.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:15.051 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:15.051 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:26:15.051 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:14 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:15.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi106 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi106 to 5312M 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: osdmap e40: 6 total, 6 up, 6 in 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:26:15.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:14 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:26:15.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 -- 172.21.15.46:0/2708343717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c103780 msgr2=0x7fb53c0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:15.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 --2- 172.21.15.46:0/2708343717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c103780 0x7fb53c0fcdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb530004940 tx=0x7fb530009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 -- 172.21.15.46:0/2708343717 shutdown_connections 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 --2- 172.21.15.46:0/2708343717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c103780 0x7fb53c0fcdf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 --2- 172.21.15.46:0/2708343717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb53c102de0 0x7fb53c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 -- 172.21.15.46:0/2708343717 >> 172.21.15.46:0/2708343717 conn(0x7fb53c0f8950 msgr2=0x7fb53c0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 -- 172.21.15.46:0/2708343717 shutdown_connections 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.894+0000 7fb5427d3700 1 -- 172.21.15.46:0/2708343717 wait complete. 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.895+0000 7fb5427d3700 1 Processor -- start 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.895+0000 7fb5427d3700 1 -- start start 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.895+0000 7fb5427d3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 0x7fb53c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb5427d3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb53c103780 0x7fb53c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb5427d3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c1146a0 con 0x7fb53c102de0 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb5427d3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c10da90 con 0x7fb53c103780 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 0x7fb53c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 0x7fb53c113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60302/0 (socket says 172.21.15.46:60302) 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 -- 172.21.15.46:0/447226872 learned_addr learned my addr 172.21.15.46:0/447226872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53b7fe700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb53c103780 0x7fb53c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 -- 172.21.15.46:0/447226872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb53c103780 msgr2=0x7fb53c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb53c103780 0x7fb53c114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 -- 172.21.15.46:0/447226872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530005040 con 0x7fb53c102de0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb53bfff700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 0x7fb53c113b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00eb40 tx=0x7fb52c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52c007cc0 con 0x7fb53c102de0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb52c00f040 con 0x7fb53c102de0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c10dd10 con 0x7fb53c102de0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.896+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52c00ca10 con 0x7fb53c102de0 2024-05-09T06:26:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.897+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c10e220 con 0x7fb53c102de0 2024-05-09T06:26:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.898+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0fe530 con 0x7fb53c102de0 2024-05-09T06:26:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.898+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb52c00cb70 con 0x7fb53c102de0 2024-05-09T06:26:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.898+0000 7fb538ff9700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb5240692b0 0x7fb52406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.899+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb52c086a10 con 0x7fb53c102de0 2024-05-09T06:26:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.899+0000 7fb53b7fe700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb5240692b0 0x7fb52406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.899+0000 7fb53b7fe700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb5240692b0 0x7fb52406b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb53c10ed70 tx=0x7fb530009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:15.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:15.903+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb52c04e250 con 0x7fb53c102de0 2024-05-09T06:26:16.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.100+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb53c109f10 con 0x7fb53c102de0 2024-05-09T06:26:16.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.101+0000 7fb538ff9700 1 -- 172.21.15.46:0/447226872 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11093 (secure 0 0 0) 0x7fb52c056b20 con 0x7fb53c102de0 2024-05-09T06:26:16.084 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:26:16.084 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","created":"2024-05-09T06:20:37.736942+0000","modified":"2024-05-09T06:26:13.675463+0000","last_up_change":"2024-05-09T06:26:12.671531+0000","last_in_change":"2024-05-09T06:25:53.622843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T06:25:00.416009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1c75339a-4ca8-4d4a-bcf8-609ab48846b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6803","nonce":4210863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6805","nonce":4210863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6809","nonce":4210863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6807","nonce":4210863371}]},"public_addr":"172.21.15.46:6803/4210863371","cluster_addr":"172.21.15.46:6805/4210863371","heartbeat_back_addr":"172.21.15.46:6809/4210863371","heartbeat_front_addr":"172.21.15.46:6807/4210863371","state":["exists","up"]},{"osd":1,"uuid":"3baf559f-bfeb-4070-b6e7-1d4acf6ff434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6811","nonce":3585632843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6813","nonce":3585632843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6817","nonce":3585632843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6815","nonce":3585632843}]},"public_addr":"172.21.15.46:6811/3585632843","cluster_addr":"172.21.15.46:6813/3585632843","heartbeat_back_addr":"172.21.15.46:6817/3585632843","heartbeat_front_addr":"172.21.15.46:6815/3585632843","state":["exists","up"]},{"osd":2,"uuid":"cc886871-1181-45c7-b257-f9eb145936ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6819","nonce":3055476258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6821","nonce":3055476258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6825","nonce":3055476258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6823","nonce":3055476258}]},"public_addr":"172.21.15.46:6819/3055476258","cluster_addr":"172.21.15.46:6821/3055476258","heartbeat_back_addr":"172.21.15.46:6825/3055476258","heartbeat_front_addr":"172.21.15.46:6823/3055476258","state":["exists","up"]},{"osd":3,"uuid":"5cb725f2-6233-44e6-bb4e-03c46bc4cbe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6801","nonce":1639179914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6803","nonce":1639179914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6807","nonce":1639179914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6805","nonce":1639179914}]},"public_addr":"172.21.15.106:6801/1639179914","cluster_addr":"172.21.15.106:6803/1639179914","heartbeat_back_addr":"172.21.15.106:6807/1639179914","heartbeat_front_addr":"172.21.15.106:6805/1639179914","state":["exists","up"]},{"osd":4,"uuid":"206f5143-4312-4124-97d8-85b24bbd293f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6809","nonce":2451991616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6811","nonce":2451991616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6815","nonce":2451991616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6813","nonce":2451991616}]},"public_addr":"172.21.15.106:6809/2451991616","cluster_addr":"172.21.15.106:6811/2451991616","heartbeat_back_addr":"172.21.15.106:6815/2451991616","heartbeat_front_addr":"172.21.15.106:6813/2451991616","state":["exists","up"]},{"osd":5,"uuid":"075617dd-1b9c-4c82-9bfb-6ed4cb577eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6817","nonce":1344304650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6819","nonce":1344304650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6823","nonce":1344304650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6821","nonce":1344304650}]},"public_addr":"172.21.15.106:6817/1344304650","cluster_addr":"172.21.15.106:6819/1344304650","heartbeat_back_addr":"172.21.15.106:6823/1344304650","heartbeat_front_addr":"172.21.15.106:6821/1344304650","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:03.022687+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:29.757436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:57.703393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:20.821741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:45.699885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:26:10.876086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/2570824935":"2024-05-10T06:22:53.905250+0000","172.21.15.46:6800/2570824935":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/2842453392":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/2173261387":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/916656529":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/3104818907":"2024-05-10T06:21:35.084540+0000","172.21.15.46:0/3033779286":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6801/3381519426":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6801/544704645":"2024-05-10T06:21:04.123650+0000","172.21.15.46:6800/3381519426":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6800/544704645":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/103396073":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/4203444221":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/2668707255":"2024-05-10T06:21:35.084540+0000","172.21.15.46:0/3787163390":"2024-05-10T06:21:04.123650+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:26:16.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.103+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb5240692b0 msgr2=0x7fb52406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.103+0000 7fb5427d3700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb5240692b0 0x7fb52406b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb53c10ed70 tx=0x7fb530009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.103+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 msgr2=0x7fb53c113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.103+0000 7fb5427d3700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 0x7fb53c113b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00eb40 tx=0x7fb52c00b040 comp rx=0 tx=0).stop 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 shutdown_connections 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb5240692b0 0x7fb52406b760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb53c102de0 0x7fb53c113b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 --2- 172.21.15.46:0/447226872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb53c103780 0x7fb53c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 >> 172.21.15.46:0/447226872 conn(0x7fb53c0f8950 msgr2=0x7fb53c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 shutdown_connections 2024-05-09T06:26:16.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:16.104+0000 7fb5427d3700 1 -- 172.21.15.46:0/447226872 wait complete. 2024-05-09T06:26:16.873 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T06:25:00.416009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-05-09T06:26:16.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-09T06:26:17.149 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:17.272 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:16 smithi046 ceph-mon[26924]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:17.272 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:16 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/447226872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:17.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:16 smithi106 ceph-mon[34679]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:17.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:16 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/447226872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.605+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/3366283921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 msgr2=0x7f1f680fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.605+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/3366283921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fbd10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f58004940 tx=0x7f1f58009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:18.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.605+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/3366283921 shutdown_connections 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.605+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/3366283921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fbd10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.605+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/3366283921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f68101d00 0x7f1f681020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.605+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/3366283921 >> 172.21.15.46:0/3366283921 conn(0x7f1f680f7870 msgr2=0x7f1f680f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/3366283921 shutdown_connections 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/3366283921 wait complete. 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 Processor -- start 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 -- start start 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f68101d00 0x7f1f680fd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680ff8d0 con 0x7f1f681026a0 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.606+0000 7f1f6f6c7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680fe400 con 0x7f1f68101d00 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:18.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60318/0 (socket says 172.21.15.46:60318) 2024-05-09T06:26:18.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 -- 172.21.15.46:0/940442197 learned_addr learned my addr 172.21.15.46:0/940442197 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:18.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6d463700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f68101d00 0x7f1f680fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:18.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 -- 172.21.15.46:0/940442197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f68101d00 msgr2=0x7f1f680fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:18.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f68101d00 0x7f1f680fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 -- 172.21.15.46:0/940442197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58005040 con 0x7f1f681026a0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6cc62700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fdec0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009100 tx=0x7f1f58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f5800e040 con 0x7f1f681026a0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f58004290 con 0x7f1f681026a0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f5801c3f0 con 0x7f1f681026a0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f680fe680 con 0x7f1f681026a0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.607+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6811a100 con 0x7f1f681026a0 2024-05-09T06:26:18.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.608+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f680fd450 con 0x7f1f681026a0 2024-05-09T06:26:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.609+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1f58013690 con 0x7f1f681026a0 2024-05-09T06:26:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.609+0000 7f1f5dffb700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1f540692a0 0x7f1f5406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.609+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1f58087fd0 con 0x7f1f681026a0 2024-05-09T06:26:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.610+0000 7f1f6d463700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1f540692a0 0x7f1f5406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:18.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.610+0000 7f1f6d463700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1f540692a0 0x7f1f5406b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f640041d0 tx=0x7f1f640043c0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:18.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.614+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1f58054640 con 0x7f1f681026a0 2024-05-09T06:26:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.809+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f68108de0 con 0x7f1f681026a0 2024-05-09T06:26:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.809+0000 7f1f5dffb700 1 -- 172.21.15.46:0/940442197 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f58057c60 con 0x7f1f681026a0 2024-05-09T06:26:18.792 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-05-09T06:26:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1f540692a0 msgr2=0x7f1f5406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1f540692a0 0x7f1f5406b750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f640041d0 tx=0x7f1f640043c0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 msgr2=0x7f1f680fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fdec0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009100 tx=0x7f1f58009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 shutdown_connections 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f1f540692a0 0x7f1f5406b750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f68101d00 0x7f1f680fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 --2- 172.21.15.46:0/940442197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f681026a0 0x7f1f680fdec0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.811+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 >> 172.21.15.46:0/940442197 conn(0x7f1f680f7870 msgr2=0x7f1f680f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.812+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 shutdown_connections 2024-05-09T06:26:18.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:18.812+0000 7f1f6f6c7700 1 -- 172.21.15.46:0/940442197 wait complete. 2024-05-09T06:26:19.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:18 smithi046 ceph-mon[26924]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:19.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:18 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/940442197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:26:19.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:18 smithi106 ceph-mon[34679]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:19.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:18 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/940442197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:26:19.447 INFO:tasks.cephadm:Setting up client nodes... 2024-05-09T06:26:19.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T06:26:19.718 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:21.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:21 smithi046 ceph-mon[26924]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 -- 172.21.15.46:0/3803068920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fcfa0 msgr2=0x7f36c80fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 --2- 172.21.15.46:0/3803068920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fd410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36b0004940 tx=0x7f36b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 -- 172.21.15.46:0/3803068920 shutdown_connections 2024-05-09T06:26:21.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 --2- 172.21.15.46:0/3803068920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fd410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 --2- 172.21.15.46:0/3803068920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fbcf0 0x7f36c80fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 -- 172.21.15.46:0/3803068920 >> 172.21.15.46:0/3803068920 conn(0x7f36c80f7430 msgr2=0x7f36c80f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 -- 172.21.15.46:0/3803068920 shutdown_connections 2024-05-09T06:26:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.269+0000 7f36cdd32700 1 -- 172.21.15.46:0/3803068920 wait complete. 2024-05-09T06:26:21.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36cdd32700 1 Processor -- start 2024-05-09T06:26:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36cdd32700 1 -- start start 2024-05-09T06:26:21.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36cdd32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 0x7f36c80ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36cdd32700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36cdd32700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8100230 con 0x7f36c80fbcf0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36cdd32700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80fe820 con 0x7f36c80fcfa0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 0x7f36c80ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 0x7f36c80ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44422/0 (socket says 172.21.15.46:44422) 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36c77fe700 1 -- 172.21.15.46:0/2919935841 learned_addr learned my addr 172.21.15.46:0/2919935841 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.270+0000 7f36beffd700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c77fe700 1 -- 172.21.15.46:0/2919935841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fcfa0 msgr2=0x7f36c80fe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c77fe700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c77fe700 1 -- 172.21.15.46:0/2919935841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0005040 con 0x7f36c80fbcf0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36beffd700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c77fe700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 0x7f36c80ffc30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c810 tx=0x7f36b8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b8012810 con 0x7f36c80fbcf0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36b8012e40 con 0x7f36c80fbcf0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c80fead0 con 0x7f36c80fbcf0 2024-05-09T06:26:21.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b800a370 con 0x7f36c80fbcf0 2024-05-09T06:26:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.271+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c80ff090 con 0x7f36c80fbcf0 2024-05-09T06:26:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.272+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c8101b30 con 0x7f36c80fbcf0 2024-05-09T06:26:21.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.272+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f36b8012970 con 0x7f36c80fbcf0 2024-05-09T06:26:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.273+0000 7f36c4ff9700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f36b40692a0 0x7f36b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.273+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f36b8087200 con 0x7f36c80fbcf0 2024-05-09T06:26:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.273+0000 7f36beffd700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f36b40692a0 0x7f36b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:21.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.273+0000 7f36beffd700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f36b40692a0 0x7f36b406b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36b000b3b0 tx=0x7f36b0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:21.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.277+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f36b8057300 con 0x7f36c80fbcf0 2024-05-09T06:26:21.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:21 smithi106 ceph-mon[34679]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:21.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.549+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f36c8104800 con 0x7f36c80fbcf0 2024-05-09T06:26:21.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.553+0000 7f36c4ff9700 1 -- 172.21.15.46:0/2919935841 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f36b8056e90 con 0x7f36c80fbcf0 2024-05-09T06:26:21.536 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-05-09T06:26:21.536 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCNbDxmZsXhIBAA60F19WNUySGZAiSwKA4V+w== 2024-05-09T06:26:21.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.555+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f36b40692a0 msgr2=0x7f36b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:21.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.555+0000 7f36cdd32700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f36b40692a0 0x7f36b406b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36b000b3b0 tx=0x7f36b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:21.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.555+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 msgr2=0x7f36c80ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.555+0000 7f36cdd32700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 0x7f36c80ffc30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c810 tx=0x7f36b8004470 comp rx=0 tx=0).stop 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 shutdown_connections 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f36b40692a0 0x7f36b406b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c80fbcf0 0x7f36c80ffc30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 --2- 172.21.15.46:0/2919935841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f36c80fcfa0 0x7f36c80fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 >> 172.21.15.46:0/2919935841 conn(0x7f36c80f7430 msgr2=0x7f36c80f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 shutdown_connections 2024-05-09T06:26:21.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:21.556+0000 7f36cdd32700 1 -- 172.21.15.46:0/2919935841 wait complete. 2024-05-09T06:26:22.210 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:22 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2919935841' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:22.210 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:22 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2919935841' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:22.239 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:26:22.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-09T06:26:22.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T06:26:22.281 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T06:26:22.309 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:22 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2919935841' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:22.309 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:22 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2919935841' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:22.546 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi106/config 2024-05-09T06:26:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:23 smithi106 ceph-mon[34679]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:23 smithi046 ceph-mon[26924]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2651005382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 msgr2=0x7f5ab40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2651005382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab40fd3e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8004940 tx=0x7f5aa8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2651005382 shutdown_connections 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2651005382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab40fd3e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2651005382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ab40fbcc0 0x7f5ab40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2651005382 >> 172.21.15.106:0/2651005382 conn(0x7f5ab40f7420 msgr2=0x7f5ab40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2651005382 shutdown_connections 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.028+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2651005382 wait complete. 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab95d7700 1 Processor -- start 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab95d7700 1 -- start start 2024-05-09T06:26:24.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab95d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ab40fbcc0 0x7f5ab410c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab95d7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab410cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab95d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab410d450 con 0x7f5ab40fbcc0 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab95d7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4111df0 con 0x7f5ab40fcf70 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab27fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab410cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab27fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab410cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:36238/0 (socket says 172.21.15.106:36238) 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.029+0000 7f5ab27fc700 1 -- 172.21.15.106:0/2686123917 learned_addr learned my addr 172.21.15.106:0/2686123917 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab27fc700 1 -- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ab40fbcc0 msgr2=0x7f5ab410c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab2ffd700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ab40fbcc0 0x7f5ab410c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab27fc700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ab40fbcc0 0x7f5ab410c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab27fc700 1 -- 172.21.15.106:0/2686123917 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8005040 con 0x7f5ab40fcf70 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab27fc700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab410cdc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80090d0 tx=0x7f5aa8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa800e040 con 0x7f5ab40fcf70 2024-05-09T06:26:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5aa800bbf0 con 0x7f5ab40fcf70 2024-05-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab4111ff0 con 0x7f5ab40fcf70 2024-05-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa801c3f0 con 0x7f5ab40fcf70 2024-05-09T06:26:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.030+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab4066350 con 0x7f5ab40fcf70 2024-05-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.031+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab404c710 con 0x7f5ab40fcf70 2024-05-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.032+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5aa8013420 con 0x7f5ab40fcf70 2024-05-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.032+0000 7f5a9b7fe700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5a9c0692b0 0x7f5a9c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.032+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5aa8088210 con 0x7f5ab40fcf70 2024-05-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.032+0000 7f5ab2ffd700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5a9c0692b0 0x7f5a9c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.033+0000 7f5ab2ffd700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5a9c0692b0 0x7f5a9c06b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006fd0 tx=0x7f5aa4008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.037+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5aa8058310 con 0x7f5ab40fcf70 2024-05-09T06:26:24.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:24.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.295+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5ab40667c0 con 0x7f5ab40fcf70 2024-05-09T06:26:24.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.302+0000 7f5a9b7fe700 1 -- 172.21.15.106:0/2686123917 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5aa8057ea0 con 0x7f5ab40fcf70 2024-05-09T06:26:24.284 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-05-09T06:26:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCQbDxm8I3AERAAv/PBEbeNl+w0SPphy0bcsA== 2024-05-09T06:26:24.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5a9c0692b0 msgr2=0x7f5a9c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5a9c0692b0 0x7f5a9c06b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006fd0 tx=0x7f5aa4008040 comp rx=0 tx=0).stop 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 msgr2=0x7f5ab410cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab410cdc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80090d0 tx=0x7f5aa8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 shutdown_connections 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f5a9c0692b0 0x7f5a9c06b760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ab40fbcc0 0x7f5ab410c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 --2- 172.21.15.106:0/2686123917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ab40fcf70 0x7f5ab410cdc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 >> 172.21.15.106:0/2686123917 conn(0x7f5ab40f7420 msgr2=0x7f5ab40f89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 shutdown_connections 2024-05-09T06:26:24.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:26:24.304+0000 7f5ab95d7700 1 -- 172.21.15.106:0/2686123917 wait complete. 2024-05-09T06:26:24.866 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:26:24.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-09T06:26:24.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T06:26:24.945 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T06:26:24.945 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-09T06:26:24.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-09T06:26:25.226 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:25.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:25 smithi106 ceph-mon[34679]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:25 smithi106 ceph-mon[34679]: from='client.? 172.21.15.106:0/2686123917' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:25 smithi106 ceph-mon[34679]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:25 smithi106 ceph-mon[34679]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:25.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:25 smithi046 ceph-mon[26924]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:25 smithi046 ceph-mon[26924]: from='client.? 172.21.15.106:0/2686123917' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:25 smithi046 ceph-mon[26924]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T06:26:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:25 smithi046 ceph-mon[26924]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 -- 172.21.15.46:0/1531961370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 msgr2=0x7fee24102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 --2- 172.21.15.46:0/1531961370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee24102160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee14004940 tx=0x7fee14009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 -- 172.21.15.46:0/1531961370 shutdown_connections 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 --2- 172.21.15.46:0/1531961370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee240fbd40 0x7fee240fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 --2- 172.21.15.46:0/1531961370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee24102160 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 -- 172.21.15.46:0/1531961370 >> 172.21.15.46:0/1531961370 conn(0x7fee24071d00 msgr2=0x7fee24072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 -- 172.21.15.46:0/1531961370 shutdown_connections 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.808+0000 7fee2a36d700 1 -- 172.21.15.46:0/1531961370 wait complete. 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee2a36d700 1 Processor -- start 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee2a36d700 1 -- start start 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee2a36d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee240fbd40 0x7fee24113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee2a36d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee241140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee2a36d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24114730 con 0x7fee24101d90 2024-05-09T06:26:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee2a36d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2410db20 con 0x7fee240fbd40 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee241140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee241140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44442/0 (socket says 172.21.15.46:44442) 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee1bfff700 1 -- 172.21.15.46:0/121595693 learned_addr learned my addr 172.21.15.46:0/121595693 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee23fff700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee240fbd40 0x7fee24113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee1bfff700 1 -- 172.21.15.46:0/121595693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee240fbd40 msgr2=0x7fee24113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee1bfff700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee240fbd40 0x7fee24113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.809+0000 7fee1bfff700 1 -- 172.21.15.46:0/121595693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14005040 con 0x7fee24101d90 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.810+0000 7fee1bfff700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee241140e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c8c0 tx=0x7fee0c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.810+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c00a980 con 0x7fee24101d90 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.810+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2410de00 con 0x7fee24101d90 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.810+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee0c00ce60 con 0x7fee24101d90 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.810+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0c0115e0 con 0x7fee24101d90 2024-05-09T06:26:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.810+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2410e3c0 con 0x7fee24101d90 2024-05-09T06:26:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.811+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee240fd430 con 0x7fee24101d90 2024-05-09T06:26:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.811+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fee0c012400 con 0x7fee24101d90 2024-05-09T06:26:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.812+0000 7fee217fa700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fee100692a0 0x7fee1006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.812+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fee0c086f60 con 0x7fee24101d90 2024-05-09T06:26:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.812+0000 7fee23fff700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fee100692a0 0x7fee1006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.812+0000 7fee23fff700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fee100692a0 0x7fee1006b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b3b0 tx=0x7fee14009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:26.816+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fee0c057060 con 0x7fee24101d90 2024-05-09T06:26:27.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.065+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fee24108df0 con 0x7fee24101d90 2024-05-09T06:26:27.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.068+0000 7fee217fa700 1 -- 172.21.15.46:0/121595693 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167175 (secure 0 0 0) 0x7fee0c0126b0 con 0x7fee24101d90 2024-05-09T06:26:27.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:26:27.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fee100692a0 msgr2=0x7fee1006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fee100692a0 0x7fee1006b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b3b0 tx=0x7fee14009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 msgr2=0x7fee241140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee241140e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c8c0 tx=0x7fee0c0044c0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 shutdown_connections 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fee100692a0 0x7fee1006b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee240fbd40 0x7fee24113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 --2- 172.21.15.46:0/121595693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101d90 0x7fee241140e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.070+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 >> 172.21.15.46:0/121595693 conn(0x7fee24071d00 msgr2=0x7fee240fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.071+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 shutdown_connections 2024-05-09T06:26:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:27.071+0000 7fee2a36d700 1 -- 172.21.15.46:0/121595693 wait complete. 2024-05-09T06:26:27.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:27 smithi106 ceph-mon[34679]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:27.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:27 smithi046 ceph-mon[26924]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:27.722 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"flags":0,"active_gid":14218,"active_name":"smithi046.nvpcui","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":394354124},{"type":"v1","addr":"172.21.15.46:6801","nonce":394354124}]},"active_addr":"172.21.15.46:6801/394354124","active_change":"2024-05-09T06:22:53.905406+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14238,"name":"smithi106.nlgnpx","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/","prometheus":"http://172.21.15.46:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":4009844881}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1959473186}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":330461321}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3533277949}]}]} 2024-05-09T06:26:27.728 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-09T06:26:27.728 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-09T06:26:27.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:26:28.011 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:28.262 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:28 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/121595693' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T06:26:28.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:28 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/121595693' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T06:26:29.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:29 smithi046 ceph-mon[26924]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:29 smithi106 ceph-mon[34679]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:29.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2059157957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 msgr2=0x7fe0b00fe220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2059157957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b00fe220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0004940 tx=0x7fe0a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2059157957 shutdown_connections 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2059157957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b00fe7f0 0x7fe0b0106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2059157957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b00fe220 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2059157957 >> 172.21.15.46:0/2059157957 conn(0x7fe0b00f7860 msgr2=0x7fe0b00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2059157957 shutdown_connections 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.715+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2059157957 wait complete. 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0b59aa700 1 Processor -- start 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0b59aa700 1 -- start start 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0b59aa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b01138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0b59aa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b00fe7f0 0x7fe0b0113e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0b59aa700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0114450 con 0x7fe0b00fde50 2024-05-09T06:26:29.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0b59aa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b010da50 con 0x7fe0b00fe7f0 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0aeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b01138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0aeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b01138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44462/0 (socket says 172.21.15.46:44462) 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0aeffd700 1 -- 172.21.15.46:0/2761098603 learned_addr learned my addr 172.21.15.46:0/2761098603 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0ae7fc700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b00fe7f0 0x7fe0b0113e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0aeffd700 1 -- 172.21.15.46:0/2761098603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b00fe7f0 msgr2=0x7fe0b0113e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0aeffd700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b00fe7f0 0x7fe0b0113e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.716+0000 7fe0aeffd700 1 -- 172.21.15.46:0/2761098603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0005040 con 0x7fe0b00fde50 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.717+0000 7fe0aeffd700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b01138c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0000c00 tx=0x7fe0a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.717+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a0021070 con 0x7fe0b00fde50 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.717+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0a0013c00 con 0x7fe0b00fde50 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.717+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b010dcd0 con 0x7fe0b00fde50 2024-05-09T06:26:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.717+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a000e070 con 0x7fe0b00fde50 2024-05-09T06:26:29.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.718+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b010e210 con 0x7fe0b00fde50 2024-05-09T06:26:29.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.718+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe0a001c400 con 0x7fe0b00fde50 2024-05-09T06:26:29.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.719+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b0066b50 con 0x7fe0b00fde50 2024-05-09T06:26:29.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.719+0000 7fe0977fe700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe0980692a0 0x7fe09806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:29.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.719+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe0a0088280 con 0x7fe0b00fde50 2024-05-09T06:26:29.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.719+0000 7fe0ae7fc700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe0980692a0 0x7fe09806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:29.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.719+0000 7fe0ae7fc700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe0980692a0 0x7fe09806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0b010ec10 tx=0x7fe0a400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:29.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.724+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe0a0058380 con 0x7fe0b00fde50 2024-05-09T06:26:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.922+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0b0109e10 con 0x7fe0b00fde50 2024-05-09T06:26:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.923+0000 7fe0977fe700 1 -- 172.21.15.46:0/2761098603 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11093 (secure 0 0 0) 0x7fe0a0057f10 con 0x7fe0b00fde50 2024-05-09T06:26:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:26:29.906 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","created":"2024-05-09T06:20:37.736942+0000","modified":"2024-05-09T06:26:13.675463+0000","last_up_change":"2024-05-09T06:26:12.671531+0000","last_in_change":"2024-05-09T06:25:53.622843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T06:25:00.416009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1c75339a-4ca8-4d4a-bcf8-609ab48846b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6803","nonce":4210863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6805","nonce":4210863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6809","nonce":4210863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6807","nonce":4210863371}]},"public_addr":"172.21.15.46:6803/4210863371","cluster_addr":"172.21.15.46:6805/4210863371","heartbeat_back_addr":"172.21.15.46:6809/4210863371","heartbeat_front_addr":"172.21.15.46:6807/4210863371","state":["exists","up"]},{"osd":1,"uuid":"3baf559f-bfeb-4070-b6e7-1d4acf6ff434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6811","nonce":3585632843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6813","nonce":3585632843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6817","nonce":3585632843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6815","nonce":3585632843}]},"public_addr":"172.21.15.46:6811/3585632843","cluster_addr":"172.21.15.46:6813/3585632843","heartbeat_back_addr":"172.21.15.46:6817/3585632843","heartbeat_front_addr":"172.21.15.46:6815/3585632843","state":["exists","up"]},{"osd":2,"uuid":"cc886871-1181-45c7-b257-f9eb145936ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6819","nonce":3055476258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6821","nonce":3055476258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6825","nonce":3055476258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6823","nonce":3055476258}]},"public_addr":"172.21.15.46:6819/3055476258","cluster_addr":"172.21.15.46:6821/3055476258","heartbeat_back_addr":"172.21.15.46:6825/3055476258","heartbeat_front_addr":"172.21.15.46:6823/3055476258","state":["exists","up"]},{"osd":3,"uuid":"5cb725f2-6233-44e6-bb4e-03c46bc4cbe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6801","nonce":1639179914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6803","nonce":1639179914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6807","nonce":1639179914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6805","nonce":1639179914}]},"public_addr":"172.21.15.106:6801/1639179914","cluster_addr":"172.21.15.106:6803/1639179914","heartbeat_back_addr":"172.21.15.106:6807/1639179914","heartbeat_front_addr":"172.21.15.106:6805/1639179914","state":["exists","up"]},{"osd":4,"uuid":"206f5143-4312-4124-97d8-85b24bbd293f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6809","nonce":2451991616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6811","nonce":2451991616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6815","nonce":2451991616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6813","nonce":2451991616}]},"public_addr":"172.21.15.106:6809/2451991616","cluster_addr":"172.21.15.106:6811/2451991616","heartbeat_back_addr":"172.21.15.106:6815/2451991616","heartbeat_front_addr":"172.21.15.106:6813/2451991616","state":["exists","up"]},{"osd":5,"uuid":"075617dd-1b9c-4c82-9bfb-6ed4cb577eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6817","nonce":1344304650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6819","nonce":1344304650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6823","nonce":1344304650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6821","nonce":1344304650}]},"public_addr":"172.21.15.106:6817/1344304650","cluster_addr":"172.21.15.106:6819/1344304650","heartbeat_back_addr":"172.21.15.106:6823/1344304650","heartbeat_front_addr":"172.21.15.106:6821/1344304650","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:03.022687+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:29.757436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:57.703393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:20.821741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:45.699885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:26:10.876086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/2570824935":"2024-05-10T06:22:53.905250+0000","172.21.15.46:6800/2570824935":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/2842453392":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/2173261387":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/916656529":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/3104818907":"2024-05-10T06:21:35.084540+0000","172.21.15.46:0/3033779286":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6801/3381519426":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6801/544704645":"2024-05-10T06:21:04.123650+0000","172.21.15.46:6800/3381519426":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6800/544704645":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/103396073":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/4203444221":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/2668707255":"2024-05-10T06:21:35.084540+0000","172.21.15.46:0/3787163390":"2024-05-10T06:21:04.123650+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe0980692a0 msgr2=0x7fe09806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe0980692a0 0x7fe09806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0b010ec10 tx=0x7fe0a400b040 comp rx=0 tx=0).stop 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 msgr2=0x7fe0b01138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b01138c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0000c00 tx=0x7fe0a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 shutdown_connections 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe0980692a0 0x7fe09806b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0b00fde50 0x7fe0b01138c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 --2- 172.21.15.46:0/2761098603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b00fe7f0 0x7fe0b0113e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 >> 172.21.15.46:0/2761098603 conn(0x7fe0b00f7860 msgr2=0x7fe0b00f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 shutdown_connections 2024-05-09T06:26:29.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:29.925+0000 7fe0b59aa700 1 -- 172.21.15.46:0/2761098603 wait complete. 2024-05-09T06:26:30.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:30 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2761098603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:30.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:30 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2761098603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:30.557 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-09T06:26:30.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:26:30.829 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:31.267 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:31 smithi046 ceph-mon[26924]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:31.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:31 smithi106 ceph-mon[34679]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 -- 172.21.15.46:0/3961197927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c102de0 msgr2=0x7f447c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 --2- 172.21.15.46:0/3961197927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c102de0 0x7f447c1031b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f446c004940 tx=0x7f446c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 -- 172.21.15.46:0/3961197927 shutdown_connections 2024-05-09T06:26:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 --2- 172.21.15.46:0/3961197927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c103780 0x7f447c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 --2- 172.21.15.46:0/3961197927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c102de0 0x7f447c1031b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 -- 172.21.15.46:0/3961197927 >> 172.21.15.46:0/3961197927 conn(0x7f447c0f8990 msgr2=0x7f447c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 -- 172.21.15.46:0/3961197927 shutdown_connections 2024-05-09T06:26:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 -- 172.21.15.46:0/3961197927 wait complete. 2024-05-09T06:26:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.421+0000 7f448282e700 1 Processor -- start 2024-05-09T06:26:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f448282e700 1 -- start start 2024-05-09T06:26:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f448282e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c102de0 0x7f447c1138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f448282e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 0x7f447c113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f448282e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c114470 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f448282e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c10da70 con 0x7f447c102de0 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 0x7f447c113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 0x7f447c113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60102/0 (socket says 172.21.15.46:60102) 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447b7fe700 1 -- 172.21.15.46:0/4051681930 learned_addr learned my addr 172.21.15.46:0/4051681930 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447bfff700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c102de0 0x7f447c1138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447b7fe700 1 -- 172.21.15.46:0/4051681930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c102de0 msgr2=0x7f447c1138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447b7fe700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c102de0 0x7f447c1138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.422+0000 7f447b7fe700 1 -- 172.21.15.46:0/4051681930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c005040 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.423+0000 7f447b7fe700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 0x7f447c113e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f447000eb40 tx=0x7f447000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.423+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4470007cc0 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.423+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f447000f040 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.423+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c10dcf0 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.423+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44700095e0 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.423+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c10e230 con 0x7f447c103780 2024-05-09T06:26:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.424+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c1000f0 con 0x7f447c103780 2024-05-09T06:26:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.424+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4470009740 con 0x7f447c103780 2024-05-09T06:26:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.425+0000 7f4478ff9700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f44640692a0 0x7f446406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.425+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f44700868a0 con 0x7f447c103780 2024-05-09T06:26:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.425+0000 7f447bfff700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f44640692a0 0x7f446406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:32.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.425+0000 7f447bfff700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f44640692a0 0x7f446406b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f446c00b0d0 tx=0x7f446c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.429+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f447004e250 con 0x7f447c103780 2024-05-09T06:26:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.626+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f447c10ef30 con 0x7f447c103780 2024-05-09T06:26:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.626+0000 7f4478ff9700 1 -- 172.21.15.46:0/4051681930 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11093 (secure 0 0 0) 0x7f4470056a50 con 0x7f447c103780 2024-05-09T06:26:32.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:26:32.610 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"165d9e0a-0dcc-11ef-bc97-c7b262605968","created":"2024-05-09T06:20:37.736942+0000","modified":"2024-05-09T06:26:13.675463+0000","last_up_change":"2024-05-09T06:26:12.671531+0000","last_in_change":"2024-05-09T06:25:53.622843+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T06:25:00.416009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1c75339a-4ca8-4d4a-bcf8-609ab48846b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6803","nonce":4210863371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6805","nonce":4210863371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6809","nonce":4210863371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4210863371},{"type":"v1","addr":"172.21.15.46:6807","nonce":4210863371}]},"public_addr":"172.21.15.46:6803/4210863371","cluster_addr":"172.21.15.46:6805/4210863371","heartbeat_back_addr":"172.21.15.46:6809/4210863371","heartbeat_front_addr":"172.21.15.46:6807/4210863371","state":["exists","up"]},{"osd":1,"uuid":"3baf559f-bfeb-4070-b6e7-1d4acf6ff434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6811","nonce":3585632843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6813","nonce":3585632843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6817","nonce":3585632843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3585632843},{"type":"v1","addr":"172.21.15.46:6815","nonce":3585632843}]},"public_addr":"172.21.15.46:6811/3585632843","cluster_addr":"172.21.15.46:6813/3585632843","heartbeat_back_addr":"172.21.15.46:6817/3585632843","heartbeat_front_addr":"172.21.15.46:6815/3585632843","state":["exists","up"]},{"osd":2,"uuid":"cc886871-1181-45c7-b257-f9eb145936ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6819","nonce":3055476258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6821","nonce":3055476258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6825","nonce":3055476258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3055476258},{"type":"v1","addr":"172.21.15.46:6823","nonce":3055476258}]},"public_addr":"172.21.15.46:6819/3055476258","cluster_addr":"172.21.15.46:6821/3055476258","heartbeat_back_addr":"172.21.15.46:6825/3055476258","heartbeat_front_addr":"172.21.15.46:6823/3055476258","state":["exists","up"]},{"osd":3,"uuid":"5cb725f2-6233-44e6-bb4e-03c46bc4cbe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6801","nonce":1639179914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6803","nonce":1639179914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6807","nonce":1639179914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":1639179914},{"type":"v1","addr":"172.21.15.106:6805","nonce":1639179914}]},"public_addr":"172.21.15.106:6801/1639179914","cluster_addr":"172.21.15.106:6803/1639179914","heartbeat_back_addr":"172.21.15.106:6807/1639179914","heartbeat_front_addr":"172.21.15.106:6805/1639179914","state":["exists","up"]},{"osd":4,"uuid":"206f5143-4312-4124-97d8-85b24bbd293f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6809","nonce":2451991616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6811","nonce":2451991616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6815","nonce":2451991616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":2451991616},{"type":"v1","addr":"172.21.15.106:6813","nonce":2451991616}]},"public_addr":"172.21.15.106:6809/2451991616","cluster_addr":"172.21.15.106:6811/2451991616","heartbeat_back_addr":"172.21.15.106:6815/2451991616","heartbeat_front_addr":"172.21.15.106:6813/2451991616","state":["exists","up"]},{"osd":5,"uuid":"075617dd-1b9c-4c82-9bfb-6ed4cb577eef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6817","nonce":1344304650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6819","nonce":1344304650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6823","nonce":1344304650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1344304650},{"type":"v1","addr":"172.21.15.106:6821","nonce":1344304650}]},"public_addr":"172.21.15.106:6817/1344304650","cluster_addr":"172.21.15.106:6819/1344304650","heartbeat_back_addr":"172.21.15.106:6823/1344304650","heartbeat_front_addr":"172.21.15.106:6821/1344304650","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:03.022687+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:29.757436+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:24:57.703393+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:20.821741+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:25:45.699885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T06:26:10.876086+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/2570824935":"2024-05-10T06:22:53.905250+0000","172.21.15.46:6800/2570824935":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/2842453392":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/2173261387":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/916656529":"2024-05-10T06:22:53.905250+0000","172.21.15.46:0/3104818907":"2024-05-10T06:21:35.084540+0000","172.21.15.46:0/3033779286":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6801/3381519426":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6801/544704645":"2024-05-10T06:21:04.123650+0000","172.21.15.46:6800/3381519426":"2024-05-10T06:21:35.084540+0000","172.21.15.46:6800/544704645":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/103396073":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/4203444221":"2024-05-10T06:21:04.123650+0000","172.21.15.46:0/2668707255":"2024-05-10T06:21:35.084540+0000","172.21.15.46:0/3787163390":"2024-05-10T06:21:04.123650+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:26:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f44640692a0 msgr2=0x7f446406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f44640692a0 0x7f446406b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f446c00b0d0 tx=0x7f446c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 msgr2=0x7f447c113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 0x7f447c113e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f447000eb40 tx=0x7f447000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 shutdown_connections 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f44640692a0 0x7f446406b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c102de0 0x7f447c1138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 --2- 172.21.15.46:0/4051681930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f447c103780 0x7f447c113e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 >> 172.21.15.46:0/4051681930 conn(0x7f447c0f8990 msgr2=0x7f447c0fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 shutdown_connections 2024-05-09T06:26:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:32.629+0000 7f448282e700 1 -- 172.21.15.46:0/4051681930 wait complete. 2024-05-09T06:26:33.231 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:33 smithi046 ceph-mon[26924]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:33.231 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:33 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/4051681930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:33.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-09T06:26:33.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-09T06:26:33.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-09T06:26:33.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-09T06:26:33.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-09T06:26:33.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-09T06:26:33.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:33 smithi106 ceph-mon[34679]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:33.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:33 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/4051681930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:26:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:33.577 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:35.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:35 smithi106 ceph-mon[34679]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:35.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:35 smithi046 ceph-mon[26924]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 -- 172.21.15.46:0/931929352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4103780 msgr2=0x7fb8e40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/931929352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4103780 0x7fb8e40fcdf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4004940 tx=0x7fb8d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 -- 172.21.15.46:0/931929352 shutdown_connections 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/931929352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4103780 0x7fb8e40fcdf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/931929352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e4102de0 0x7fb8e41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 -- 172.21.15.46:0/931929352 >> 172.21.15.46:0/931929352 conn(0x7fb8e40f89b0 msgr2=0x7fb8e40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 -- 172.21.15.46:0/931929352 shutdown_connections 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.833+0000 7fb8ec68b700 1 -- 172.21.15.46:0/931929352 wait complete. 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ec68b700 1 Processor -- start 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ec68b700 1 -- start start 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ec68b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 0x7fb8e4113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ec68b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e4103780 0x7fb8e41141a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ec68b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4114880 con 0x7fb8e4102de0 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ec68b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e410dbc0 con 0x7fb8e4103780 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ea427700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 0x7fb8e4113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ea427700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 0x7fb8e4113c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60126/0 (socket says 172.21.15.46:60126) 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ea427700 1 -- 172.21.15.46:0/3574522678 learned_addr learned my addr 172.21.15.46:0/3574522678 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8e9c26700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e4103780 0x7fb8e41141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ea427700 1 -- 172.21.15.46:0/3574522678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e4103780 msgr2=0x7fb8e41141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ea427700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e4103780 0x7fb8e41141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.834+0000 7fb8ea427700 1 -- 172.21.15.46:0/3574522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4005040 con 0x7fb8e4102de0 2024-05-09T06:26:35.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.835+0000 7fb8ea427700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 0x7fb8e4113c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b790 tx=0x7fb8e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.835+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e000f770 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.835+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8e000fda0 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.835+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e410de40 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.835+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e000d310 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.835+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e410e380 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.836+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8e410e8c0 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.836+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb8e0010420 con 0x7fb8e4102de0 2024-05-09T06:26:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8daffd700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8d00692b0 0x7fb8d006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb8e0086e80 con 0x7fb8e4102de0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8e9c26700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8d00692b0 0x7fb8d006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8daffd700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] conn(0x7fb8d006efd0 0x7fb8d00713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 --> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8d0071a90 con 0x7fb8d006efd0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8e008c480 con 0x7fb8e4102de0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8eac28700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] conn(0x7fb8d006efd0 0x7fb8d00713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.837+0000 7fb8e9c26700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8d00692b0 0x7fb8d006b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8e410f500 tx=0x7fb8d4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.838+0000 7fb8eac28700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] conn(0x7fb8d006efd0 0x7fb8d00713e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:35.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.838+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== osd.2 v2:172.21.15.46:6818/3055476258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb8d0071a90 con 0x7fb8d006efd0 2024-05-09T06:26:35.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.853+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 --> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8e40fe530 con 0x7fb8d006efd0 2024-05-09T06:26:35.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.853+0000 7fb8daffd700 1 -- 172.21.15.46:0/3574522678 <== osd.2 v2:172.21.15.46:6818/3055476258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8e40fe530 con 0x7fb8d006efd0 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] conn(0x7fb8d006efd0 msgr2=0x7fb8d00713e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] conn(0x7fb8d006efd0 0x7fb8d00713e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8d00692b0 msgr2=0x7fb8d006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8d00692b0 0x7fb8d006b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8e410f500 tx=0x7fb8d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 msgr2=0x7fb8e4113c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 0x7fb8e4113c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b790 tx=0x7fb8e0009250 comp rx=0 tx=0).stop 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 shutdown_connections 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6818/3055476258,v1:172.21.15.46:6819/3055476258] conn(0x7fb8d006efd0 0x7fb8d00713e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fb8d00692b0 0x7fb8d006b760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e4102de0 0x7fb8e4113c60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 --2- 172.21.15.46:0/3574522678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e4103780 0x7fb8e41141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:35.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 >> 172.21.15.46:0/3574522678 conn(0x7fb8e40f89b0 msgr2=0x7fb8e4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:35.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 shutdown_connections 2024-05-09T06:26:35.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:35.854+0000 7fb8ec68b700 1 -- 172.21.15.46:0/3574522678 wait complete. 2024-05-09T06:26:36.285 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:36.286 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:37.065 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:37.065 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:37.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:37 smithi046 ceph-mon[26924]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:37.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:37 smithi106 ceph-mon[34679]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:37.489 INFO:teuthology.orchestra.run.smithi046.stdout:81604378646 2024-05-09T06:26:37.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-09T06:26:37.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 -- 172.21.15.46:0/3036238883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 msgr2=0x7f2fac1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/3036238883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac1031d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c004940 tx=0x7f2f9c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 -- 172.21.15.46:0/3036238883 shutdown_connections 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/3036238883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 0x7f2fac0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/3036238883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac1031d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 -- 172.21.15.46:0/3036238883 >> 172.21.15.46:0/3036238883 conn(0x7f2fac0f89d0 msgr2=0x7f2fac0fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 -- 172.21.15.46:0/3036238883 shutdown_connections 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.994+0000 7f2fb27cf700 1 -- 172.21.15.46:0/3036238883 wait complete. 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fb27cf700 1 Processor -- start 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fb27cf700 1 -- start start 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fb27cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fb27cf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 0x7f2fac113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fb27cf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac114550 con 0x7f2fac102e00 2024-05-09T06:26:37.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fb27cf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac10dac0 con 0x7f2fac1037a0 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac113930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60156/0 (socket says 172.21.15.46:60156) 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.995+0000 7f2fabfff700 1 -- 172.21.15.46:0/394034970 learned_addr learned my addr 172.21.15.46:0/394034970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fab7fe700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 0x7f2fac113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fabfff700 1 -- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 msgr2=0x7f2fac113e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fabfff700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 0x7f2fac113e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fabfff700 1 -- 172.21.15.46:0/394034970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c005040 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fab7fe700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 0x7f2fac113e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fabfff700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac113930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00b3b0 tx=0x7f2f9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9c00e040 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac10dd40 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f9c00bbc0 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9c01c3f0 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.996+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac10e300 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.997+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fac10e8e0 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2f9c00bd30 con 0x7f2fac102e00 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fa8ff9700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2f940692a0 0x7f2f9406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:37.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2f9c088bc0 con 0x7f2fac102e00 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fab7fe700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2f940692a0 0x7f2f9406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fa8ff9700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] conn(0x7f2f9406ef70 0x7f2f94071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 --> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f94071a30 con 0x7f2f9406ef70 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.998+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f9c088fa0 con 0x7f2fac102e00 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.999+0000 7f2fab7fe700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2f940692a0 0x7f2f9406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fac10ec80 tx=0x7f2fa0008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.999+0000 7f2fb0d6c700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] conn(0x7f2f9406ef70 0x7f2f94071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:36.999+0000 7f2fb0d6c700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] conn(0x7f2f9406ef70 0x7f2f94071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.000+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== osd.5 v2:172.21.15.106:6816/1344304650 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2f94071a30 con 0x7f2f9406ef70 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.015+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 --> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fac0fa290 con 0x7f2f9406ef70 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.015+0000 7f2fa8ff9700 1 -- 172.21.15.46:0/394034970 <== osd.5 v2:172.21.15.106:6816/1344304650 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2fac0fa290 con 0x7f2f9406ef70 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] conn(0x7f2f9406ef70 msgr2=0x7f2f94071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] conn(0x7f2f9406ef70 0x7f2f94071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2f940692a0 msgr2=0x7f2f9406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2f940692a0 0x7f2f9406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fac10ec80 tx=0x7f2fa0008040 comp rx=0 tx=0).stop 2024-05-09T06:26:37.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 msgr2=0x7f2fac113930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac113930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00b3b0 tx=0x7f2f9c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 shutdown_connections 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:6816/1344304650,v1:172.21.15.106:6817/1344304650] conn(0x7f2f9406ef70 0x7f2f94071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2f940692a0 0x7f2f9406b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fac102e00 0x7f2fac113930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 --2- 172.21.15.46:0/394034970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fac1037a0 0x7f2fac113e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 >> 172.21.15.46:0/394034970 conn(0x7f2fac0f89d0 msgr2=0x7f2fac0f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 shutdown_connections 2024-05-09T06:26:37.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:37.016+0000 7f2fb27cf700 1 -- 172.21.15.46:0/394034970 wait complete. 2024-05-09T06:26:38.420 INFO:teuthology.orchestra.run.smithi046.stdout:167503724552 2024-05-09T06:26:38.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-09T06:26:39.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:39 smithi046 ceph-mon[26924]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:39.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:39 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:39 smithi106 ceph-mon[34679]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:39 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:41.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:41 smithi106 ceph-mon[34679]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:41 smithi046 ceph-mon[26924]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:42.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.362+0000 7f9f051dc700 1 -- 172.21.15.46:0/3338919535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 msgr2=0x7f9f00103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.362+0000 7f9f051dc700 1 --2- 172.21.15.46:0/3338919535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00103250 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0004940 tx=0x7f9ef0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:42.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.362+0000 7f9f051dc700 1 -- 172.21.15.46:0/3338919535 shutdown_connections 2024-05-09T06:26:42.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.362+0000 7f9f051dc700 1 --2- 172.21.15.46:0/3338919535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f000fb3c0 0x7f9f000fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.362+0000 7f9f051dc700 1 --2- 172.21.15.46:0/3338919535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00103250 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.362+0000 7f9f051dc700 1 -- 172.21.15.46:0/3338919535 >> 172.21.15.46:0/3338919535 conn(0x7f9f00072320 msgr2=0x7f9f00072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:42.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.363+0000 7f9f051dc700 1 -- 172.21.15.46:0/3338919535 shutdown_connections 2024-05-09T06:26:42.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.363+0000 7f9f051dc700 1 -- 172.21.15.46:0/3338919535 wait complete. 2024-05-09T06:26:42.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.363+0000 7f9f051dc700 1 Processor -- start 2024-05-09T06:26:42.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.363+0000 7f9f051dc700 1 -- start start 2024-05-09T06:26:42.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9f051dc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f000fb3c0 0x7f9f00113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:42.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9f051dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:42.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9f051dc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00114510 con 0x7f9f00102e80 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9f051dc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0010db30 con 0x7f9f000fb3c0 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54904/0 (socket says 172.21.15.46:54904) 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 -- 172.21.15.46:0/963127123 learned_addr learned my addr 172.21.15.46:0/963127123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efed9d700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f000fb3c0 0x7f9f00113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 -- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f000fb3c0 msgr2=0x7f9f00113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f000fb3c0 0x7f9f00113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 -- 172.21.15.46:0/963127123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0005040 con 0x7f9f00102e80 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9efe59c700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00113ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4002a50 tx=0x7f9ef40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.364+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef4007cc0 con 0x7f9f00102e80 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.365+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0010de10 con 0x7f9f00102e80 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.365+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ef400f040 con 0x7f9f00102e80 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.365+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef400da30 con 0x7f9f00102e80 2024-05-09T06:26:42.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.365+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0010e350 con 0x7f9f00102e80 2024-05-09T06:26:42.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.365+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f0010e870 con 0x7f9f00102e80 2024-05-09T06:26:42.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.366+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9ef400db90 con 0x7f9f00102e80 2024-05-09T06:26:42.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9ee77fe700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9ee80692a0 0x7f9ee806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:42.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9ef4086bf0 con 0x7f9f00102e80 2024-05-09T06:26:42.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9efed9d700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9ee80692a0 0x7f9ee806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:42.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9ee77fe700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] conn(0x7f9ee806ef70 0x7f9ee8071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:42.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 --> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ee8071a30 con 0x7f9ee806ef70 2024-05-09T06:26:42.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ef408b220 con 0x7f9f00102e80 2024-05-09T06:26:42.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9efed9d700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9ee80692a0 0x7f9ee806b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000b3b0 tx=0x7f9ef0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:42.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.367+0000 7f9eff59e700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] conn(0x7f9ee806ef70 0x7f9ee8071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:42.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.368+0000 7f9eff59e700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] conn(0x7f9ee806ef70 0x7f9ee8071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:42.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.368+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== osd.3 v2:172.21.15.106:6800/1639179914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9ee8071a30 con 0x7f9ee806ef70 2024-05-09T06:26:42.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.383+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 --> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f0005e660 con 0x7f9ee806ef70 2024-05-09T06:26:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9ee77fe700 1 -- 172.21.15.46:0/963127123 <== osd.3 v2:172.21.15.106:6800/1639179914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9f0005e660 con 0x7f9ee806ef70 2024-05-09T06:26:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] conn(0x7f9ee806ef70 msgr2=0x7f9ee8071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] conn(0x7f9ee806ef70 0x7f9ee8071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9ee80692a0 msgr2=0x7f9ee806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9ee80692a0 0x7f9ee806b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000b3b0 tx=0x7f9ef0009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 msgr2=0x7f9f00113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00113ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4002a50 tx=0x7f9ef40046b0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 shutdown_connections 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:6800/1639179914,v1:172.21.15.106:6801/1639179914] conn(0x7f9ee806ef70 0x7f9ee8071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f9ee80692a0 0x7f9ee806b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f000fb3c0 0x7f9f00113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 --2- 172.21.15.46:0/963127123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f00102e80 0x7f9f00113ec0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.384+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 >> 172.21.15.46:0/963127123 conn(0x7f9f00072320 msgr2=0x7f9f001073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.385+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 shutdown_connections 2024-05-09T06:26:42.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:42.385+0000 7f9f051dc700 1 -- 172.21.15.46:0/963127123 wait complete. 2024-05-09T06:26:43.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:43 smithi046 ceph-mon[26924]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:43.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:43 smithi106 ceph-mon[34679]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:43.779 INFO:teuthology.orchestra.run.smithi046.stdout:111669149715 2024-05-09T06:26:43.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.974+0000 7f07b2e7e700 1 -- 172.21.15.46:0/3555418009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 msgr2=0x7f07ac0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.974+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/3555418009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac0fbd80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0798004940 tx=0x7f0798009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.974+0000 7f07b2e7e700 1 -- 172.21.15.46:0/3555418009 shutdown_connections 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.974+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/3555418009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac0fbd80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.974+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/3555418009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07ac101d70 0x7f07ac102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.974+0000 7f07b2e7e700 1 -- 172.21.15.46:0/3555418009 >> 172.21.15.46:0/3555418009 conn(0x7f07ac0f78e0 msgr2=0x7f07ac0f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.975+0000 7f07b2e7e700 1 -- 172.21.15.46:0/3555418009 shutdown_connections 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.975+0000 7f07b2e7e700 1 -- 172.21.15.46:0/3555418009 wait complete. 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.975+0000 7f07b2e7e700 1 Processor -- start 2024-05-09T06:26:43.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.975+0000 7f07b2e7e700 1 -- start start 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07b2e7e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07ac101d70 0x7f07ac10c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07b2e7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac10ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07b2e7e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0670c0 con 0x7f07ac102710 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07b2e7e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac10d3c0 con 0x7f07ac101d70 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac10ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac10ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54918/0 (socket says 172.21.15.46:54918) 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 -- 172.21.15.46:0/4116318150 learned_addr learned my addr 172.21.15.46:0/4116318150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07b0c1a700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07ac101d70 0x7f07ac10c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 -- 172.21.15.46:0/4116318150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07ac101d70 msgr2=0x7f07ac10c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07ac101d70 0x7f07ac10c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 -- 172.21.15.46:0/4116318150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798005040 con 0x7f07ac102710 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07abfff700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac10ce80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0798009100 tx=0x7f0798009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079800e040 con 0x7f07ac102710 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac10d640 con 0x7f07ac102710 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.976+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0798013420 con 0x7f07ac102710 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.977+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079801c610 con 0x7f07ac102710 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.977+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac11a170 con 0x7f07ac102710 2024-05-09T06:26:43.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.977+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07ac05e660 con 0x7f07ac102710 2024-05-09T06:26:43.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.978+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0798013590 con 0x7f07ac102710 2024-05-09T06:26:43.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07a97fa700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f079c0692a0 0x7f079c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0798088b70 con 0x7f07ac102710 2024-05-09T06:26:43.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07b0c1a700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f079c0692a0 0x7f079c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07a97fa700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] conn(0x7f079c06ef70 0x7f079c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 --> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f079c071a30 con 0x7f079c06ef70 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0798088f50 con 0x7f07ac102710 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07b141b700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] conn(0x7f079c06ef70 0x7f079c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07b0c1a700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f079c0692a0 0x7f079c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006fd0 tx=0x7f07a0008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.979+0000 7f07b141b700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] conn(0x7f079c06ef70 0x7f079c071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:43.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.980+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== osd.1 v2:172.21.15.46:6810/3585632843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f079c071a30 con 0x7f079c06ef70 2024-05-09T06:26:43.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 --> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07ac05ead0 con 0x7f079c06ef70 2024-05-09T06:26:43.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07a97fa700 1 -- 172.21.15.46:0/4116318150 <== osd.1 v2:172.21.15.46:6810/3585632843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f07ac05ead0 con 0x7f079c06ef70 2024-05-09T06:26:43.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] conn(0x7f079c06ef70 msgr2=0x7f079c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] conn(0x7f079c06ef70 0x7f079c071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f079c0692a0 msgr2=0x7f079c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f079c0692a0 0x7f079c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006fd0 tx=0x7f07a0008040 comp rx=0 tx=0).stop 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 msgr2=0x7f07ac10ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.996+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac10ce80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0798009100 tx=0x7f0798009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 shutdown_connections 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f079c0692a0 0x7f079c06b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:6810/3585632843,v1:172.21.15.46:6811/3585632843] conn(0x7f079c06ef70 0x7f079c071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07ac101d70 0x7f07ac10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 --2- 172.21.15.46:0/4116318150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07ac102710 0x7f07ac10ce80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 >> 172.21.15.46:0/4116318150 conn(0x7f07ac0f78e0 msgr2=0x7f07ac0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 shutdown_connections 2024-05-09T06:26:43.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:43.997+0000 7f07b2e7e700 1 -- 172.21.15.46:0/4116318150 wait complete. 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 -- 172.21.15.46:0/1522007519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 msgr2=0x7ff548065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 --2- 172.21.15.46:0/1522007519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548065ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff53c004940 tx=0x7ff53c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 -- 172.21.15.46:0/1522007519 shutdown_connections 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 --2- 172.21.15.46:0/1522007519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548065ab0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 --2- 172.21.15.46:0/1522007519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff548102e50 0x7ff548103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 -- 172.21.15.46:0/1522007519 >> 172.21.15.46:0/1522007519 conn(0x7ff548071d00 msgr2=0x7ff548072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:45.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 -- 172.21.15.46:0/1522007519 shutdown_connections 2024-05-09T06:26:45.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.044+0000 7ff54d09d700 1 -- 172.21.15.46:0/1522007519 wait complete. 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.045+0000 7ff54d09d700 1 Processor -- start 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.045+0000 7ff54d09d700 1 -- start start 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.045+0000 7ff54d09d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.045+0000 7ff54d09d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff548102e50 0x7ff548116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.045+0000 7ff54d09d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548116870 con 0x7ff548065640 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.045+0000 7ff54d09d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54810fc40 con 0x7ff548102e50 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54950/0 (socket says 172.21.15.46:54950) 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 -- 172.21.15.46:0/2097684058 learned_addr learned my addr 172.21.15.46:0/2097684058 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff54659c700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff548102e50 0x7ff548116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 -- 172.21.15.46:0/2097684058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff548102e50 msgr2=0x7ff548116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff548102e50 0x7ff548116220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 -- 172.21.15.46:0/2097684058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c005040 con 0x7ff548065640 2024-05-09T06:26:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff546d9d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548115ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff53800eb40 tx=0x7ff53800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff538007cc0 con 0x7ff548065640 2024-05-09T06:26:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54810fec0 con 0x7ff548065640 2024-05-09T06:26:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff53800f040 con 0x7ff548065640 2024-05-09T06:26:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff53800ca10 con 0x7ff548065640 2024-05-09T06:26:45.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.046+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5481103d0 con 0x7ff548065640 2024-05-09T06:26:45.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.047+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5481108b0 con 0x7ff548065640 2024-05-09T06:26:45.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff53800cc80 con 0x7ff548065640 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff52f7fe700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff5300692a0 0x7ff53006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff538086a50 con 0x7ff548065640 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff54659c700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff5300692a0 0x7ff53006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff52f7fe700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] conn(0x7ff53006ef70 0x7ff530071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 --> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff530071a30 con 0x7ff53006ef70 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff53808b220 con 0x7ff548065640 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff54759e700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] conn(0x7ff53006ef70 0x7ff530071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff54659c700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff5300692a0 0x7ff53006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009b30 tx=0x7ff53c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.049+0000 7ff54759e700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] conn(0x7ff53006ef70 0x7ff530071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:45.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.050+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== osd.0 v2:172.21.15.46:6802/4210863371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff530071a30 con 0x7ff53006ef70 2024-05-09T06:26:45.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.081+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 --> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5480fe540 con 0x7ff53006ef70 2024-05-09T06:26:45.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.081+0000 7ff52f7fe700 1 -- 172.21.15.46:0/2097684058 <== osd.0 v2:172.21.15.46:6802/4210863371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff5480fe540 con 0x7ff53006ef70 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.081+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] conn(0x7ff53006ef70 msgr2=0x7ff530071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] conn(0x7ff53006ef70 0x7ff530071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff5300692a0 msgr2=0x7ff53006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff5300692a0 0x7ff53006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009b30 tx=0x7ff53c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 msgr2=0x7ff548115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548115ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff53800eb40 tx=0x7ff53800b040 comp rx=0 tx=0).stop 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 shutdown_connections 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6802/4210863371,v1:172.21.15.46:6803/4210863371] conn(0x7ff53006ef70 0x7ff530071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff5300692a0 0x7ff53006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff548065640 0x7ff548115ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 --2- 172.21.15.46:0/2097684058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff548102e50 0x7ff548116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 >> 172.21.15.46:0/2097684058 conn(0x7ff548071d00 msgr2=0x7ff5480face0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 shutdown_connections 2024-05-09T06:26:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:45.082+0000 7ff54d09d700 1 -- 172.21.15.46:0/2097684058 wait complete. 2024-05-09T06:26:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 -- 172.21.15.46:0/1925540262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0102e50 msgr2=0x7f62b0103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/1925540262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0102e50 0x7f62b0103220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f62ac004940 tx=0x7f62ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 -- 172.21.15.46:0/1925540262 shutdown_connections 2024-05-09T06:26:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/1925540262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62b0065640 0x7f62b0065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/1925540262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0102e50 0x7f62b0103220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 -- 172.21.15.46:0/1925540262 >> 172.21.15.46:0/1925540262 conn(0x7f62b0071d00 msgr2=0x7f62b0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 -- 172.21.15.46:0/1925540262 shutdown_connections 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 -- 172.21.15.46:0/1925540262 wait complete. 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.941+0000 7f62b7a9f700 1 Processor -- start 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b7a9f700 1 -- start start 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b7a9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 0x7f62b00fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b7a9f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62b0102e50 0x7f62b00fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b7a9f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00fc880 con 0x7f62b0065640 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b7a9f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00fc9c0 con 0x7f62b0102e50 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 0x7f62b00fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 0x7f62b00fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54936/0 (socket says 172.21.15.46:54936) 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 -- 172.21.15.46:0/3343219838 learned_addr learned my addr 172.21.15.46:0/3343219838 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b503a700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62b0102e50 0x7f62b00fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 -- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62b0102e50 msgr2=0x7f62b00fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62b0102e50 0x7f62b00fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 -- 172.21.15.46:0/3343219838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac005040 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.942+0000 7f62b583b700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 0x7f62b00fbdb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00b3b0 tx=0x7f62ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.943+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ac00e040 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.943+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b00fcc10 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.943+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62ac013420 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.943+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ac01c630 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.943+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b011a210 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.944+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62b00fe540 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.944+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f62ac00baf0 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62a67fc700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f629c0692a0 0x7f629c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f62ac088ab0 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62b503a700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f629c0692a0 0x7f629c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62a67fc700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] conn(0x7f629c06ef70 0x7f629c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 --> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f629c071a30 con 0x7f629c06ef70 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62ac088e90 con 0x7f62b0065640 2024-05-09T06:26:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62b503a700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f629c0692a0 0x7f629c06b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f62b00fd6f0 tx=0x7f62a000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.945+0000 7f62b603c700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] conn(0x7f629c06ef70 0x7f629c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.946+0000 7f62b603c700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] conn(0x7f629c06ef70 0x7f629c071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.947+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== osd.4 v2:172.21.15.106:6808/2451991616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f629c071a30 con 0x7f629c06ef70 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.962+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 --> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62b005e620 con 0x7f629c06ef70 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62a67fc700 1 -- 172.21.15.46:0/3343219838 <== osd.4 v2:172.21.15.106:6808/2451991616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f62b005e620 con 0x7f629c06ef70 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] conn(0x7f629c06ef70 msgr2=0x7f629c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] conn(0x7f629c06ef70 0x7f629c071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f629c0692a0 msgr2=0x7f629c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f629c0692a0 0x7f629c06b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f62b00fd6f0 tx=0x7f62a000b040 comp rx=0 tx=0).stop 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 msgr2=0x7f62b00fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 0x7f62b00fbdb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00b3b0 tx=0x7f62ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 shutdown_connections 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:6808/2451991616,v1:172.21.15.106:6809/2451991616] conn(0x7f629c06ef70 0x7f629c071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f629c0692a0 0x7f629c06b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62b0065640 0x7f62b00fbdb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 --2- 172.21.15.46:0/3343219838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62b0102e50 0x7f62b00fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 >> 172.21.15.46:0/3343219838 conn(0x7f62b0071d00 msgr2=0x7f62b00faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 shutdown_connections 2024-05-09T06:26:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:44.963+0000 7f62b7a9f700 1 -- 172.21.15.46:0/3343219838 wait complete. 2024-05-09T06:26:45.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:45 smithi046 ceph-mon[26924]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:45 smithi106 ceph-mon[34679]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:45.728 INFO:teuthology.orchestra.run.smithi046.stdout:146028888078 2024-05-09T06:26:45.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-09T06:26:46.416 INFO:teuthology.orchestra.run.smithi046.stdout:38654705699 2024-05-09T06:26:46.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-09T06:26:46.496 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:46.880 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:46.884 INFO:teuthology.orchestra.run.smithi046.stdout:60129542174 2024-05-09T06:26:46.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-09T06:26:47.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:47 smithi046 ceph-mon[26924]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:47.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:47 smithi106 ceph-mon[34679]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:47.596 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:49.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:49 smithi046 ceph-mon[26924]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:49.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:49 smithi106 ceph-mon[34679]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:50.700 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:26:51.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 -- 172.21.15.46:0/4215952422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 msgr2=0x7f64c40fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:51.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4215952422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c40fe230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64b8004940 tx=0x7f64b8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 -- 172.21.15.46:0/4215952422 shutdown_connections 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4215952422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64c40fe800 0x7f64c4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4215952422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c40fe230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 -- 172.21.15.46:0/4215952422 >> 172.21.15.46:0/4215952422 conn(0x7f64c40f78d0 msgr2=0x7f64c40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 -- 172.21.15.46:0/4215952422 shutdown_connections 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.265+0000 7f64cadd9700 1 -- 172.21.15.46:0/4215952422 wait complete. 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64cadd9700 1 Processor -- start 2024-05-09T06:26:51.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64cadd9700 1 -- start start 2024-05-09T06:26:51.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64cadd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c4113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:51.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64cadd9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64c40fe800 0x7f64c4114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:51.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64cadd9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41146c0 con 0x7f64c40fde60 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64cadd9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c410dab0 con 0x7f64c40fe800 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64c8b75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c4113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64c8b75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c4113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60468/0 (socket says 172.21.15.46:60468) 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.266+0000 7f64c8b75700 1 -- 172.21.15.46:0/4021339548 learned_addr learned my addr 172.21.15.46:0/4021339548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c3fff700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64c40fe800 0x7f64c4114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c8b75700 1 -- 172.21.15.46:0/4021339548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64c40fe800 msgr2=0x7f64c4114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c8b75700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64c40fe800 0x7f64c4114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c8b75700 1 -- 172.21.15.46:0/4021339548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8005040 con 0x7f64c40fde60 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c8b75700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c4113b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009380 tx=0x7f64b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64b800e040 con 0x7f64c40fde60 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c410dd90 con 0x7f64c40fde60 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64b8009af0 con 0x7f64c40fde60 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64b801c630 con 0x7f64c40fde60 2024-05-09T06:26:51.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.267+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c410e2d0 con 0x7f64c40fde60 2024-05-09T06:26:51.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.268+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c40666f0 con 0x7f64c40fde60 2024-05-09T06:26:51.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.269+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f64b800bbc0 con 0x7f64c40fde60 2024-05-09T06:26:51.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.269+0000 7f64c17fa700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f64b40692a0 0x7f64b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:51.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.269+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f64b8088160 con 0x7f64c40fde60 2024-05-09T06:26:51.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.269+0000 7f64c3fff700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f64b40692a0 0x7f64b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.270+0000 7f64c3fff700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f64b40692a0 0x7f64b406b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007fd0 tx=0x7f64b0009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:51.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.274+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f64b8058260 con 0x7f64c40fde60 2024-05-09T06:26:51.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:51 smithi106 ceph-mon[34679]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:51.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:51 smithi046 ceph-mon[26924]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.473+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64c4109e70 con 0x7f64c40fde60 2024-05-09T06:26:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.474+0000 7f64c17fa700 1 -- 172.21.15.46:0/4021339548 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64b8057df0 con 0x7f64c40fde60 2024-05-09T06:26:51.456 INFO:teuthology.orchestra.run.smithi046.stdout:111669149717 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f64b40692a0 msgr2=0x7f64b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f64b40692a0 0x7f64b406b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007fd0 tx=0x7f64b0009040 comp rx=0 tx=0).stop 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 msgr2=0x7f64c4113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c4113b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009380 tx=0x7f64b8009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 shutdown_connections 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f64b40692a0 0x7f64b406b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64c40fde60 0x7f64c4113b30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 --2- 172.21.15.46:0/4021339548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64c40fe800 0x7f64c4114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 >> 172.21.15.46:0/4021339548 conn(0x7f64c40f78d0 msgr2=0x7f64c40f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 shutdown_connections 2024-05-09T06:26:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:51.476+0000 7f64cadd9700 1 -- 172.21.15.46:0/4021339548 wait complete. 2024-05-09T06:26:52.295 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:52 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/4021339548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T06:26:52.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:52 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/4021339548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 -- 172.21.15.46:0/624699751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19801026a0 msgr2=0x7f19800fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 --2- 172.21.15.46:0/624699751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19801026a0 0x7f19800fbd10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f196c004940 tx=0x7f196c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 -- 172.21.15.46:0/624699751 shutdown_connections 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 --2- 172.21.15.46:0/624699751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19801026a0 0x7f19800fbd10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 --2- 172.21.15.46:0/624699751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1980101d00 0x7f19801020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 -- 172.21.15.46:0/624699751 >> 172.21.15.46:0/624699751 conn(0x7f19800f7870 msgr2=0x7f19800f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 -- 172.21.15.46:0/624699751 shutdown_connections 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 -- 172.21.15.46:0/624699751 wait complete. 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 Processor -- start 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.536+0000 7f1986d03700 1 -- start start 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1986d03700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 0x7f1980113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1986d03700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19801026a0 0x7f1980113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1986d03700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801144f0 con 0x7f1980101d00 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1986d03700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198010daf0 con 0x7f19801026a0 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 0x7f1980113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 0x7f1980113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60480/0 (socket says 172.21.15.46:60480) 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 -- 172.21.15.46:0/1780401665 learned_addr learned my addr 172.21.15.46:0/1780401665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f197ffff700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19801026a0 0x7f1980113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 -- 172.21.15.46:0/1780401665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19801026a0 msgr2=0x7f1980113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19801026a0 0x7f1980113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 -- 172.21.15.46:0/1780401665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c005040 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1984a9f700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 0x7f1980113960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f197400c830 tx=0x7f1974004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f197400a760 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f197400ad90 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198010ddd0 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.537+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19740113a0 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.538+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198010e390 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.538+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19800fd450 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.539+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1974012400 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.540+0000 7f197d7fa700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f19700692a0 0x7f197006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.540+0000 7f197ffff700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f19700692a0 0x7f197006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.540+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1974086e10 con 0x7f1980101d00 2024-05-09T06:26:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.540+0000 7f197ffff700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f19700692a0 0x7f197006b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f196c009fd0 tx=0x7f196c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.544+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1974056fb0 con 0x7f1980101d00 2024-05-09T06:26:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.744+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1980108de0 con 0x7f1980101d00 2024-05-09T06:26:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.745+0000 7f197d7fa700 1 -- 172.21.15.46:0/1780401665 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f197405c020 con 0x7f1980101d00 2024-05-09T06:26:52.727 INFO:teuthology.orchestra.run.smithi046.stdout:38654705701 2024-05-09T06:26:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f19700692a0 msgr2=0x7f197006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f19700692a0 0x7f197006b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f196c009fd0 tx=0x7f196c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 msgr2=0x7f1980113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 0x7f1980113960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f197400c830 tx=0x7f1974004470 comp rx=0 tx=0).stop 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 shutdown_connections 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f19700692a0 0x7f197006b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1980101d00 0x7f1980113960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 --2- 172.21.15.46:0/1780401665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19801026a0 0x7f1980113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 >> 172.21.15.46:0/1780401665 conn(0x7f19800f7870 msgr2=0x7f1980066250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 shutdown_connections 2024-05-09T06:26:52.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:52.747+0000 7f1986d03700 1 -- 172.21.15.46:0/1780401665 wait complete. 2024-05-09T06:26:53.213 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:53 smithi046 ceph-mon[26924]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:53.213 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:53 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1780401665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T06:26:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:53 smithi106 ceph-mon[34679]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:53 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1780401665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T06:26:53.569 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-05-09T06:26:53.569 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:54.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:26:54.624 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149717 for osd.3 2024-05-09T06:26:54.624 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:55.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 -- 172.21.15.46:0/55857110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c102f60 msgr2=0x7fe24c103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:55.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 --2- 172.21.15.46:0/55857110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c102f60 0x7fe24c103330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe248004940 tx=0x7fe248009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:55.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 -- 172.21.15.46:0/55857110 shutdown_connections 2024-05-09T06:26:55.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 --2- 172.21.15.46:0/55857110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c0fb520 0x7fe24c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:55.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 --2- 172.21.15.46:0/55857110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c102f60 0x7fe24c103330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:55.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 -- 172.21.15.46:0/55857110 >> 172.21.15.46:0/55857110 conn(0x7fe24c0714d0 msgr2=0x7fe24c0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:55.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 -- 172.21.15.46:0/55857110 shutdown_connections 2024-05-09T06:26:55.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 -- 172.21.15.46:0/55857110 wait complete. 2024-05-09T06:26:55.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.070+0000 7fe25364f700 1 Processor -- start 2024-05-09T06:26:55.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe25364f700 1 -- start start 2024-05-09T06:26:55.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe25364f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 0x7fe24c113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe25364f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c102f60 0x7fe24c113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe25364f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c114510 con 0x7fe24c0fb520 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe25364f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c10db30 con 0x7fe24c102f60 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe2513eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 0x7fe24c113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe2513eb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 0x7fe24c113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60498/0 (socket says 172.21.15.46:60498) 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe2513eb700 1 -- 172.21.15.46:0/255535911 learned_addr learned my addr 172.21.15.46:0/255535911 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe250bea700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c102f60 0x7fe24c113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe2513eb700 1 -- 172.21.15.46:0/255535911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c102f60 msgr2=0x7fe24c113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe2513eb700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c102f60 0x7fe24c113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe2513eb700 1 -- 172.21.15.46:0/255535911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248005040 con 0x7fe24c0fb520 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.071+0000 7fe250bea700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c102f60 0x7fe24c113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:55.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.072+0000 7fe2513eb700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 0x7fe24c113980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b8b0 tx=0x7fe248009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:55.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.072+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24800e040 con 0x7fe24c0fb520 2024-05-09T06:26:55.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.072+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe248004290 con 0x7fe24c0fb520 2024-05-09T06:26:55.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.072+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c10ddb0 con 0x7fe24c0fb520 2024-05-09T06:26:55.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.072+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24801c3f0 con 0x7fe24c0fb520 2024-05-09T06:26:55.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.072+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c10e2f0 con 0x7fe24c0fb520 2024-05-09T06:26:55.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.073+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c100250 con 0x7fe24c0fb520 2024-05-09T06:26:55.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.074+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe2480137b0 con 0x7fe24c0fb520 2024-05-09T06:26:55.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.074+0000 7fe23dffb700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe2380692a0 0x7fe23806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:55.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.074+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe2480880a0 con 0x7fe24c0fb520 2024-05-09T06:26:55.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.074+0000 7fe250bea700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe2380692a0 0x7fe23806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:55.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.075+0000 7fe250bea700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe2380692a0 0x7fe23806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe240007fd0 tx=0x7fe240009f60 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:55.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.078+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe2480547b0 con 0x7fe24c0fb520 2024-05-09T06:26:55.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:55 smithi046 ceph-mon[26924]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.278+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe24c109fe0 con 0x7fe24c0fb520 2024-05-09T06:26:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.278+0000 7fe23dffb700 1 -- 172.21.15.46:0/255535911 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe248057dd0 con 0x7fe24c0fb520 2024-05-09T06:26:55.260 INFO:teuthology.orchestra.run.smithi046.stdout:81604378649 2024-05-09T06:26:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe2380692a0 msgr2=0x7fe23806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe2380692a0 0x7fe23806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe240007fd0 tx=0x7fe240009f60 comp rx=0 tx=0).stop 2024-05-09T06:26:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 msgr2=0x7fe24c113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 0x7fe24c113980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b8b0 tx=0x7fe248009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 shutdown_connections 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe2380692a0 0x7fe23806b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe24c0fb520 0x7fe24c113980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 --2- 172.21.15.46:0/255535911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe24c102f60 0x7fe24c113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 >> 172.21.15.46:0/255535911 conn(0x7fe24c0714d0 msgr2=0x7fe24c0fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 shutdown_connections 2024-05-09T06:26:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:55.280+0000 7fe25364f700 1 -- 172.21.15.46:0/255535911 wait complete. 2024-05-09T06:26:55.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:55 smithi106 ceph-mon[34679]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:56.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:56 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/255535911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T06:26:56.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:56 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/255535911' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T06:26:56.399 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378649 for osd.2 2024-05-09T06:26:56.399 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 -- 172.21.15.46:0/4100967855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e10101d90 msgr2=0x7f0e10102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/4100967855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e10101d90 0x7f0e10102160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e04004940 tx=0x7f0e04009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 -- 172.21.15.46:0/4100967855 shutdown_connections 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/4100967855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e100fbd40 0x7f0e100fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/4100967855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e10101d90 0x7f0e10102160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 -- 172.21.15.46:0/4100967855 >> 172.21.15.46:0/4100967855 conn(0x7f0e10071d00 msgr2=0x7f0e10072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 -- 172.21.15.46:0/4100967855 shutdown_connections 2024-05-09T06:26:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.860+0000 7f0e17d7a700 1 -- 172.21.15.46:0/4100967855 wait complete. 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e17d7a700 1 Processor -- start 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e17d7a700 1 -- start start 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e17d7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 0x7f0e10102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e17d7a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101d90 0x7f0e10103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e17d7a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e10103680 con 0x7f0e100fbd40 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e17d7a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e101037c0 con 0x7f0e10101d90 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e15b16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 0x7f0e10102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e15b16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 0x7f0e10102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60512/0 (socket says 172.21.15.46:60512) 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e15b16700 1 -- 172.21.15.46:0/786683432 learned_addr learned my addr 172.21.15.46:0/786683432 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e15315700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101d90 0x7f0e10103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e15b16700 1 -- 172.21.15.46:0/786683432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101d90 msgr2=0x7f0e10103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.861+0000 7f0e15b16700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101d90 0x7f0e10103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e15b16700 1 -- 172.21.15.46:0/786683432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04005040 con 0x7f0e100fbd40 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e15315700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101d90 0x7f0e10103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:26:56.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e15b16700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 0x7f0e10102b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400b3b0 tx=0x7f0e04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0400e040 con 0x7f0e100fbd40 2024-05-09T06:26:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e0400bbc0 con 0x7f0e100fbd40 2024-05-09T06:26:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e10119e90 con 0x7f0e100fbd40 2024-05-09T06:26:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0401c3f0 con 0x7f0e100fbd40 2024-05-09T06:26:56.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.862+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1011a370 con 0x7f0e100fbd40 2024-05-09T06:26:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.863+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100fd430 con 0x7f0e100fbd40 2024-05-09T06:26:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.863+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0e0400bd30 con 0x7f0e100fbd40 2024-05-09T06:26:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.864+0000 7f0e027fc700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0dfc0692a0 0x7f0dfc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.864+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0e040881a0 con 0x7f0e100fbd40 2024-05-09T06:26:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.864+0000 7f0e15315700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0dfc0692a0 0x7f0dfc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:56.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.864+0000 7f0e15315700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0dfc0692a0 0x7f0dfc06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e10104460 tx=0x7f0e0c008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:56.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:56.869+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0e04054790 con 0x7f0e100fbd40 2024-05-09T06:26:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.069+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e1004bf00 con 0x7f0e100fbd40 2024-05-09T06:26:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.069+0000 7f0e027fc700 1 -- 172.21.15.46:0/786683432 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e04057db0 con 0x7f0e100fbd40 2024-05-09T06:26:57.051 INFO:teuthology.orchestra.run.smithi046.stdout:60129542176 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0dfc0692a0 msgr2=0x7f0dfc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0dfc0692a0 0x7f0dfc06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e10104460 tx=0x7f0e0c008040 comp rx=0 tx=0).stop 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 msgr2=0x7f0e10102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 0x7f0e10102b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400b3b0 tx=0x7f0e04009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 shutdown_connections 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0dfc0692a0 0x7f0dfc06b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e100fbd40 0x7f0e10102b20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 --2- 172.21.15.46:0/786683432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101d90 0x7f0e10103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 >> 172.21.15.46:0/786683432 conn(0x7f0e10071d00 msgr2=0x7f0e100fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 shutdown_connections 2024-05-09T06:26:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.071+0000 7f0e17d7a700 1 -- 172.21.15.46:0/786683432 wait complete. 2024-05-09T06:26:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 -- 172.21.15.46:0/2808202474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 msgr2=0x7fd350109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 --2- 172.21.15.46:0/2808202474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd350109170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd33c004970 tx=0x7fd33c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 -- 172.21.15.46:0/2808202474 shutdown_connections 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 --2- 172.21.15.46:0/2808202474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd350109170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 --2- 172.21.15.46:0/2808202474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd350070350 0x7fd350070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 -- 172.21.15.46:0/2808202474 >> 172.21.15.46:0/2808202474 conn(0x7fd3500f89b0 msgr2=0x7fd3500fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 -- 172.21.15.46:0/2808202474 shutdown_connections 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.170+0000 7fd356eee700 1 -- 172.21.15.46:0/2808202474 wait complete. 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd356eee700 1 Processor -- start 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd356eee700 1 -- start start 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd356eee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd350070350 0x7fd350115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd356eee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd3501160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd356eee700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd350116710 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd356eee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35010fcf0 con 0x7fd350070350 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd34ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd3501160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd34ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd3501160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60526/0 (socket says 172.21.15.46:60526) 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd34ffff700 1 -- 172.21.15.46:0/1383943211 learned_addr learned my addr 172.21.15.46:0/1383943211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.171+0000 7fd354c8a700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd350070350 0x7fd350115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34ffff700 1 -- 172.21.15.46:0/1383943211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd350070350 msgr2=0x7fd350115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34ffff700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd350070350 0x7fd350115b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34ffff700 1 -- 172.21.15.46:0/1383943211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c005040 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34ffff700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd3501160c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd33c004f50 tx=0x7fd33c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c00e040 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35010ff70 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd33c00bbb0 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c01c630 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.172+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3501104b0 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.173+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3500719e0 con 0x7fd350070c60 2024-05-09T06:26:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.174+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd33c00bd20 con 0x7fd350070c60 2024-05-09T06:26:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.174+0000 7fd34d7fa700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3400692a0 0x7fd34006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.174+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd33c088230 con 0x7fd350070c60 2024-05-09T06:26:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.174+0000 7fd354c8a700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3400692a0 0x7fd34006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.175+0000 7fd354c8a700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3400692a0 0x7fd34006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd344007fd0 tx=0x7fd344009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.178+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd33c058330 con 0x7fd350070c60 2024-05-09T06:26:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:57 smithi106 ceph-mon[34679]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:57 smithi046 ceph-mon[26924]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:57.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.378+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd35004c710 con 0x7fd350070c60 2024-05-09T06:26:57.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.378+0000 7fd34d7fa700 1 -- 172.21.15.46:0/1383943211 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd33c054020 con 0x7fd350070c60 2024-05-09T06:26:57.360 INFO:teuthology.orchestra.run.smithi046.stdout:146028888080 2024-05-09T06:26:57.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3400692a0 msgr2=0x7fd34006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3400692a0 0x7fd34006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd344007fd0 tx=0x7fd344009040 comp rx=0 tx=0).stop 2024-05-09T06:26:57.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 msgr2=0x7fd3501160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd3501160c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd33c004f50 tx=0x7fd33c009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 shutdown_connections 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3400692a0 0x7fd34006b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd350070350 0x7fd350115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 --2- 172.21.15.46:0/1383943211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd350070c60 0x7fd3501160c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.380+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 >> 172.21.15.46:0/1383943211 conn(0x7fd3500f89b0 msgr2=0x7fd3500f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.381+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 shutdown_connections 2024-05-09T06:26:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:57.381+0000 7fd356eee700 1 -- 172.21.15.46:0/1383943211 wait complete. 2024-05-09T06:26:58.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:58 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/786683432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T06:26:58.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:58 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1383943211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T06:26:58.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-05-09T06:26:58.289 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:58.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:58 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/786683432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T06:26:58.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:58 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1383943211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T06:26:58.679 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888080 for osd.4 2024-05-09T06:26:58.679 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 -- 172.21.15.46:0/1158302211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0024102e10 msgr2=0x7f00241031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 --2- 172.21.15.46:0/1158302211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0024102e10 0x7f00241031e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0014004940 tx=0x7f0014009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 -- 172.21.15.46:0/1158302211 shutdown_connections 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 --2- 172.21.15.46:0/1158302211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00241037b0 0x7f00240fb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 --2- 172.21.15.46:0/1158302211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0024102e10 0x7f00241031e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 -- 172.21.15.46:0/1158302211 >> 172.21.15.46:0/1158302211 conn(0x7f0024073350 msgr2=0x7f0024073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 -- 172.21.15.46:0/1158302211 shutdown_connections 2024-05-09T06:26:59.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 -- 172.21.15.46:0/1158302211 wait complete. 2024-05-09T06:26:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:26:59 smithi046 ceph-mon[26924]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:59.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.180+0000 7f0029273700 1 Processor -- start 2024-05-09T06:26:59.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f0029273700 1 -- start start 2024-05-09T06:26:59.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f0029273700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024102e10 0x7f0024113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:59.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f0029273700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 0x7f0024113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:59.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f0029273700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0024114590 con 0x7f00241037b0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f0029273700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002410db90 con 0x7f0024102e10 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 0x7f0024113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 0x7f0024113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60538/0 (socket says 172.21.15.46:60538) 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 -- 172.21.15.46:0/3310188133 learned_addr learned my addr 172.21.15.46:0/3310188133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f0022ffd700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024102e10 0x7f0024113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 -- 172.21.15.46:0/3310188133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024102e10 msgr2=0x7f0024113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024102e10 0x7f0024113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 -- 172.21.15.46:0/3310188133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0014005040 con 0x7f00241037b0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.181+0000 7f00227fc700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 0x7f0024113f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f001800c890 tx=0x7f00180044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.182+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f001800a700 con 0x7f00241037b0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.182+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f001800ad30 con 0x7f00241037b0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.182+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002410de70 con 0x7f00241037b0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.182+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002410e3b0 con 0x7f00241037b0 2024-05-09T06:26:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.182+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00180113a0 con 0x7f00241037b0 2024-05-09T06:26:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.183+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100052b0 con 0x7f00241037b0 2024-05-09T06:26:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.183+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f001800a860 con 0x7f00241037b0 2024-05-09T06:26:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.184+0000 7f000b7fe700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f000c0692a0 0x7f000c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:26:59.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.184+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0018086df0 con 0x7f00241037b0 2024-05-09T06:26:59.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.184+0000 7f0022ffd700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f000c0692a0 0x7f000c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:26:59.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.184+0000 7f0022ffd700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f000c0692a0 0x7f000c06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0014004890 tx=0x7f0014009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:26:59.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.188+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0018056f90 con 0x7f00241037b0 2024-05-09T06:26:59.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:26:59 smithi106 ceph-mon[34679]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:26:59.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.383+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0010005560 con 0x7f00241037b0 2024-05-09T06:26:59.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.383+0000 7f000b7fe700 1 -- 172.21.15.46:0/3310188133 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0018056b20 con 0x7f00241037b0 2024-05-09T06:26:59.365 INFO:teuthology.orchestra.run.smithi046.stdout:167503724556 2024-05-09T06:26:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f000c0692a0 msgr2=0x7f000c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f000c0692a0 0x7f000c06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0014004890 tx=0x7f0014009e30 comp rx=0 tx=0).stop 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 msgr2=0x7f0024113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 0x7f0024113f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f001800c890 tx=0x7f00180044c0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 shutdown_connections 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f000c0692a0 0x7f000c06b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0024102e10 0x7f0024113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 --2- 172.21.15.46:0/3310188133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00241037b0 0x7f0024113f40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 >> 172.21.15.46:0/3310188133 conn(0x7f0024073350 msgr2=0x7f00240fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 shutdown_connections 2024-05-09T06:26:59.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:26:59.386+0000 7f0029273700 1 -- 172.21.15.46:0/3310188133 wait complete. 2024-05-09T06:26:59.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724552 got 167503724556 for osd.5 2024-05-09T06:26:59.960 DEBUG:teuthology.parallel:result is None 2024-05-09T06:26:59.961 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T06:26:59.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T06:27:00.235 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:00.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:00 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3310188133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T06:27:00.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:00 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3310188133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T06:27:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:01 smithi106 ceph-mon[34679]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:01 smithi046 ceph-mon[26924]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 -- 172.21.15.46:0/3692605707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 msgr2=0x7f93f81020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 --2- 172.21.15.46:0/3692605707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f81020d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f93e8004940 tx=0x7f93e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 -- 172.21.15.46:0/3692605707 shutdown_connections 2024-05-09T06:27:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 --2- 172.21.15.46:0/3692605707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93f81026a0 0x7f93f80fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 --2- 172.21.15.46:0/3692605707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f81020d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 -- 172.21.15.46:0/3692605707 >> 172.21.15.46:0/3692605707 conn(0x7f93f80f7870 msgr2=0x7f93f80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 -- 172.21.15.46:0/3692605707 shutdown_connections 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 -- 172.21.15.46:0/3692605707 wait complete. 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 Processor -- start 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.993+0000 7f93fd567700 1 -- start start 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93fd567700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f8102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93fd567700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93f81026a0 0x7f93f81030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93fd567700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8104ab0 con 0x7f93f8101d00 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93fd567700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f81035e0 con 0x7f93f81026a0 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f8102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f8102b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58956/0 (socket says 172.21.15.46:58956) 2024-05-09T06:27:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 -- 172.21.15.46:0/233350045 learned_addr learned my addr 172.21.15.46:0/233350045 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93effff700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93f81026a0 0x7f93f81030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 -- 172.21.15.46:0/233350045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93f81026a0 msgr2=0x7f93f81030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93f81026a0 0x7f93f81030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 -- 172.21.15.46:0/233350045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e8005040 con 0x7f93f8101d00 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93f6ffd700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f8102b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93e800b3b0 tx=0x7f93e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e800e040 con 0x7f93f8101d00 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93e800bbc0 con 0x7f93f8101d00 2024-05-09T06:27:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f8103860 con 0x7f93f8101d00 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.994+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e801c3f0 con 0x7f93f8101d00 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.995+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f811a0e0 con 0x7f93f8101d00 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.995+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f80fd450 con 0x7f93f8101d00 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.996+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f93e800bd30 con 0x7f93f8101d00 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.996+0000 7f93ef7fe700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93e40692a0 0x7f93e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.997+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f93e8088040 con 0x7f93f8101d00 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.997+0000 7f93effff700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93e40692a0 0x7f93e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:01.997+0000 7f93effff700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93e40692a0 0x7f93e406b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93e0007fd0 tx=0x7f93e0009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:01.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.001+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f93e80546b0 con 0x7f93f8101d00 2024-05-09T06:27:02.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.191+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93f80f9600 con 0x7f93e40692a0 2024-05-09T06:27:02.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.192+0000 7f93ef7fe700 1 -- 172.21.15.46:0/233350045 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28177 (secure 0 0 0) 0x7f93f80f9600 con 0x7f93e40692a0 2024-05-09T06:27:02.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93e40692a0 msgr2=0x7f93e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93e40692a0 0x7f93e406b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93e0007fd0 tx=0x7f93e0009040 comp rx=0 tx=0).stop 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 msgr2=0x7f93f8102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f8102b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93e800b3b0 tx=0x7f93e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 shutdown_connections 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93e40692a0 0x7f93e406b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f8101d00 0x7f93f8102b60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 --2- 172.21.15.46:0/233350045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93f81026a0 0x7f93f81030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 >> 172.21.15.46:0/233350045 conn(0x7f93f80f7870 msgr2=0x7f93f80f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 shutdown_connections 2024-05-09T06:27:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:02.195+0000 7f93fd567700 1 -- 172.21.15.46:0/233350045 wait complete. 2024-05-09T06:27:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T06:27:02.799 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-05-09T06:27:01.951247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788028,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682884,"statfs":{"total":575970213888,"available":574139273216,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002175"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-09T06:26:12.677006+0000","last_change":"2024-05-09T06:25:47.015699+0000","last_active":"2024-05-09T06:26:12.677006+0000","last_peered":"2024-05-09T06:26:12.677006+0000","last_clean":"2024-05-09T06:26:12.677006+0000","last_became_active":"2024-05-09T06:25:47.015287+0000","last_became_peered":"2024-05-09T06:25:47.015287+0000","last_unstale":"2024-05-09T06:26:12.677006+0000","last_undegraded":"2024-05-09T06:26:12.677006+0000","last_fullsized":"2024-05-09T06:26:12.677006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T06:25:00.416458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T06:25:00.416458+0000","last_clean_scrub_stamp":"2024-05-09T06:25:00.416458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:51.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447436,"statfs":{"total":95995035648,"available":95690174464,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.498}]},{"osd":1,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.434}]},{"osd":4,"last update":"Thu May 9 06:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:25:59 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu May 9 06:25:59 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.437}]},{"osd":3,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu May 9 06:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 06:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.215,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50800000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu May 9 06:26:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.44},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu May 9 06:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu May 9 06:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu May 9 06:26:01 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.499},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu May 9 06:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu May 9 06:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T06:27:02.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T06:27:03.070 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:03.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:03 smithi046 ceph-mon[26924]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:03.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:03 smithi106 ceph-mon[34679]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:04.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:04 smithi046 ceph-mon[26924]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:27:04.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:04 smithi106 ceph-mon[34679]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:27:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 -- 172.21.15.46:0/4176119231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 msgr2=0x7fec200fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 --2- 172.21.15.46:0/4176119231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec200fb970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec10004940 tx=0x7fec10009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 -- 172.21.15.46:0/4176119231 shutdown_connections 2024-05-09T06:27:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 --2- 172.21.15.46:0/4176119231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 0x7fec20101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 --2- 172.21.15.46:0/4176119231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec200fb970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 -- 172.21.15.46:0/4176119231 >> 172.21.15.46:0/4176119231 conn(0x7fec20073350 msgr2=0x7fec20073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 -- 172.21.15.46:0/4176119231 shutdown_connections 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 -- 172.21.15.46:0/4176119231 wait complete. 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 Processor -- start 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.788+0000 7fec27209700 1 -- start start 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec27209700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec20113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec27209700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 0x7fec20113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec27209700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20114510 con 0x7fec200fb5a0 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec27209700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2010db30 con 0x7fec200fbf40 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec20113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec20113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58984/0 (socket says 172.21.15.46:58984) 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 -- 172.21.15.46:0/1616992591 learned_addr learned my addr 172.21.15.46:0/1616992591 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec1ffff700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 0x7fec20113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 -- 172.21.15.46:0/1616992591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 msgr2=0x7fec20113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 0x7fec20113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 -- 172.21.15.46:0/1616992591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10005040 con 0x7fec200fb5a0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec1ffff700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 0x7fec20113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.789+0000 7fec24fa5700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec20113980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec1000b3b0 tx=0x7fec10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.790+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1000e040 con 0x7fec200fb5a0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.790+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec1000bbc0 con 0x7fec200fb5a0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.790+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2010ddb0 con 0x7fec200fb5a0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.790+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec1001c3f0 con 0x7fec200fb5a0 2024-05-09T06:27:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.790+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2010e2f0 con 0x7fec200fb5a0 2024-05-09T06:27:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.791+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec200fe670 con 0x7fec200fb5a0 2024-05-09T06:27:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.791+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fec1000bd30 con 0x7fec200fb5a0 2024-05-09T06:27:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.792+0000 7fec1d7fa700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fec080692a0 0x7fec0806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.792+0000 7fec1ffff700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fec080692a0 0x7fec0806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.792+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec100880f0 con 0x7fec200fb5a0 2024-05-09T06:27:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.792+0000 7fec1ffff700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fec080692a0 0x7fec0806b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec14007fd0 tx=0x7fec14009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.796+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fec100546e0 con 0x7fec200fb5a0 2024-05-09T06:27:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.988+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec2010efd0 con 0x7fec080692a0 2024-05-09T06:27:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.990+0000 7fec1d7fa700 1 -- 172.21.15.46:0/1616992591 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28149 (secure 0 0 0) 0x7fec2010efd0 con 0x7fec080692a0 2024-05-09T06:27:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:04.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.991+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fec080692a0 msgr2=0x7fec0806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:04.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.991+0000 7fec27209700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fec080692a0 0x7fec0806b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec14007fd0 tx=0x7fec14009040 comp rx=0 tx=0).stop 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.991+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 msgr2=0x7fec20113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.991+0000 7fec27209700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec20113980 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec1000b3b0 tx=0x7fec10009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 shutdown_connections 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fec080692a0 0x7fec0806b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec200fb5a0 0x7fec20113980 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 --2- 172.21.15.46:0/1616992591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec200fbf40 0x7fec20113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 >> 172.21.15.46:0/1616992591 conn(0x7fec20073350 msgr2=0x7fec20100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 shutdown_connections 2024-05-09T06:27:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:04.992+0000 7fec27209700 1 -- 172.21.15.46:0/1616992591 wait complete. 2024-05-09T06:27:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-09T06:27:05.261 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:05 smithi046 ceph-mon[26924]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:05.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:05 smithi106 ceph-mon[34679]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:05.604 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-05-09T06:27:03.951605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788028,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682884,"statfs":{"total":575970213888,"available":574139273216,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002151"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-09T06:26:12.677006+0000","last_change":"2024-05-09T06:25:47.015699+0000","last_active":"2024-05-09T06:26:12.677006+0000","last_peered":"2024-05-09T06:26:12.677006+0000","last_clean":"2024-05-09T06:26:12.677006+0000","last_became_active":"2024-05-09T06:25:47.015287+0000","last_became_peered":"2024-05-09T06:25:47.015287+0000","last_unstale":"2024-05-09T06:26:12.677006+0000","last_undegraded":"2024-05-09T06:26:12.677006+0000","last_fullsized":"2024-05-09T06:26:12.677006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T06:25:00.416458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T06:25:00.416458+0000","last_clean_scrub_stamp":"2024-05-09T06:25:00.416458+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:51.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447436,"statfs":{"total":95995035648,"available":95690174464,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.378}]},{"osd":1,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu May 9 06:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.315},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.625},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu May 9 06:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:25:59 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu May 9 06:25:59 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.437}]},{"osd":3,"last update":"Thu May 9 06:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu May 9 06:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 06:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.316},"min":{"1min":0.215,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.34899999999999998},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.50800000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu May 9 06:26:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.44},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu May 9 06:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu May 9 06:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 06:26:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.22,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.33000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu May 9 06:26:01 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.312},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu May 9 06:26:26 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu May 9 06:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T06:27:05.605 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T06:27:05.605 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T06:27:05.605 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-09T06:27:05.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-09T06:27:05.873 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:06.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:06 smithi046 ceph-mon[26924]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:27:06.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:06 smithi106 ceph-mon[34679]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T06:27:07.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:07 smithi106 ceph-mon[34679]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:07.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:07 smithi046 ceph-mon[26924]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 -- 172.21.15.46:0/3772289588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fd0a0 msgr2=0x7fbab4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:07.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3772289588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fd0a0 0x7fbab4109350 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4004940 tx=0x7fbaa4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 -- 172.21.15.46:0/3772289588 shutdown_connections 2024-05-09T06:27:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3772289588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fd0a0 0x7fbab4109350 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3772289588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fc790 0x7fbab40fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 -- 172.21.15.46:0/3772289588 >> 172.21.15.46:0/3772289588 conn(0x7fbab4071d00 msgr2=0x7fbab4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 -- 172.21.15.46:0/3772289588 shutdown_connections 2024-05-09T06:27:07.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.594+0000 7fbabbde7700 1 -- 172.21.15.46:0/3772289588 wait complete. 2024-05-09T06:27:07.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbabbde7700 1 Processor -- start 2024-05-09T06:27:07.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbabbde7700 1 -- start start 2024-05-09T06:27:07.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbabbde7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 0x7fbab4115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:07.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbabbde7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fd0a0 0x7fbab4116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:07.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbabbde7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4116a00 con 0x7fbab40fc790 2024-05-09T06:27:07.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbabbde7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab410fd40 con 0x7fbab40fd0a0 2024-05-09T06:27:07.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9b83700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 0x7fbab4115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:07.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9b83700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 0x7fbab4115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58998/0 (socket says 172.21.15.46:58998) 2024-05-09T06:27:07.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9b83700 1 -- 172.21.15.46:0/3143967598 learned_addr learned my addr 172.21.15.46:0/3143967598 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9382700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fd0a0 0x7fbab4116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9b83700 1 -- 172.21.15.46:0/3143967598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fd0a0 msgr2=0x7fbab4116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9b83700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fd0a0 0x7fbab4116320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9b83700 1 -- 172.21.15.46:0/3143967598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4005040 con 0x7fbab40fc790 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.595+0000 7fbab9382700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fd0a0 0x7fbab4116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.596+0000 7fbab9b83700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 0x7fbab4115de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbab000b790 tx=0x7fbab0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:07.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.596+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab000f770 con 0x7fbab40fc790 2024-05-09T06:27:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.596+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbab000fda0 con 0x7fbab40fc790 2024-05-09T06:27:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.596+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab410ffc0 con 0x7fbab40fc790 2024-05-09T06:27:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.596+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab000d310 con 0x7fbab40fc790 2024-05-09T06:27:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.596+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab4110500 con 0x7fbab40fc790 2024-05-09T06:27:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.597+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40fc330 con 0x7fbab40fc790 2024-05-09T06:27:07.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.597+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbab0010420 con 0x7fbab40fc790 2024-05-09T06:27:07.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.598+0000 7fbaaa7fc700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbaa00692a0 0x7fbaa006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:07.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.598+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbab0086e70 con 0x7fbab40fc790 2024-05-09T06:27:07.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.598+0000 7fbab9382700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbaa00692a0 0x7fbaa006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:07.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.598+0000 7fbab9382700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbaa00692a0 0x7fbaa006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4000c00 tx=0x7fbaa4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:07.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.602+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbab0056f70 con 0x7fbab40fc790 2024-05-09T06:27:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.841+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbab404bf00 con 0x7fbab40fc790 2024-05-09T06:27:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.841+0000 7fbaaa7fc700 1 -- 172.21.15.46:0/3143967598 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbab0056b00 con 0x7fbab40fc790 2024-05-09T06:27:07.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:07.826 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbaa00692a0 msgr2=0x7fbaa006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbaa00692a0 0x7fbaa006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4000c00 tx=0x7fbaa4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 msgr2=0x7fbab4115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 0x7fbab4115de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbab000b790 tx=0x7fbab0009250 comp rx=0 tx=0).stop 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 shutdown_connections 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbaa00692a0 0x7fbaa006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbab40fc790 0x7fbab4115de0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 --2- 172.21.15.46:0/3143967598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbab40fd0a0 0x7fbab4116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 >> 172.21.15.46:0/3143967598 conn(0x7fbab4071d00 msgr2=0x7fbab40f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 shutdown_connections 2024-05-09T06:27:07.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:07.843+0000 7fbabbde7700 1 -- 172.21.15.46:0/3143967598 wait complete. 2024-05-09T06:27:08.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:08 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3143967598' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T06:27:08.476 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-09T06:27:08.477 INFO:tasks.cephadm:Setup complete, yielding 2024-05-09T06:27:08.477 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:27:08.495 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-05-09T06:27:08.495 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:08.510 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:08.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-05-09T06:27:08.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:08 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3143967598' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T06:27:08.777 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:09.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:09 smithi046 ceph-mon[26924]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:09.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:09.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:09 smithi106 ceph-mon[34679]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:09.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:09 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:10.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 -- 172.21.15.46:0/436345275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 msgr2=0x7fe86c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 --2- 172.21.15.46:0/436345275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c0fc0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe868004940 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 -- 172.21.15.46:0/436345275 shutdown_connections 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 --2- 172.21.15.46:0/436345275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0fcf60 0x7fe86c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 --2- 172.21.15.46:0/436345275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c0fc0c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 -- 172.21.15.46:0/436345275 >> 172.21.15.46:0/436345275 conn(0x7fe86c0f7430 msgr2=0x7fe86c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 -- 172.21.15.46:0/436345275 shutdown_connections 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.380+0000 7fe873f92700 1 -- 172.21.15.46:0/436345275 wait complete. 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe873f92700 1 Processor -- start 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe873f92700 1 -- start start 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe873f92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c10da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe873f92700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0fcf60 0x7fe86c10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe873f92700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c10e5f0 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe873f92700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c10ed90 con 0x7fe86c0fcf60 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe871d2e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c10da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe871d2e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c10da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59016/0 (socket says 172.21.15.46:59016) 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe871d2e700 1 -- 172.21.15.46:0/2752614890 learned_addr learned my addr 172.21.15.46:0/2752614890 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe87152d700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0fcf60 0x7fe86c10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe871d2e700 1 -- 172.21.15.46:0/2752614890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0fcf60 msgr2=0x7fe86c10df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe871d2e700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0fcf60 0x7fe86c10df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.381+0000 7fe871d2e700 1 -- 172.21.15.46:0/2752614890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868005040 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.382+0000 7fe871d2e700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c10da20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe868009150 tx=0x7fe868009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.382+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86800e040 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.382+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe86800bbf0 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.382+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c10f010 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.382+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86801c630 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.382+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c10f5d0 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.383+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c101af0 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.383+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe86800bd60 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.384+0000 7fe8627fc700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe8580692b0 0x7fe85806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:10.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.384+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe868088240 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.384+0000 7fe87152d700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe8580692b0 0x7fe85806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:10.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.384+0000 7fe87152d700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe8580692b0 0x7fe85806b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe85c006fd0 tx=0x7fe85c008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:10.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.388+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe868058340 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.582+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fe86c104930 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.586+0000 7fe8627fc700 1 -- 172.21.15.46:0/2752614890 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe868057ed0 con 0x7fe86c0fbcb0 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe8580692b0 msgr2=0x7fe85806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe8580692b0 0x7fe85806b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe85c006fd0 tx=0x7fe85c008040 comp rx=0 tx=0).stop 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 msgr2=0x7fe86c10da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c10da20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe868009150 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 shutdown_connections 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe8580692b0 0x7fe85806b760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86c0fbcb0 0x7fe86c10da20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 --2- 172.21.15.46:0/2752614890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0fcf60 0x7fe86c10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:10.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 >> 172.21.15.46:0/2752614890 conn(0x7fe86c0f7430 msgr2=0x7fe86c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:10.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 shutdown_connections 2024-05-09T06:27:10.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:10.589+0000 7fe873f92700 1 -- 172.21.15.46:0/2752614890 wait complete. 2024-05-09T06:27:11.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:11 smithi046 ceph-mon[26924]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:11.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:11 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2752614890' entity='client.admin' 2024-05-09T06:27:11.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:11.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:11.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:11.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:11 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:11.180 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:27:11.190 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-05-09T06:27:11.190 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:11.204 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:11.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-09T06:27:11.472 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:11 smithi106 ceph-mon[34679]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:11 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2752614890' entity='client.admin' 2024-05-09T06:27:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:11 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:13.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 -- 172.21.15.46:0/33931757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fdfe0 msgr2=0x7f7c740fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/33931757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fdfe0 0x7f7c740fe450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c68004940 tx=0x7f7c68009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 -- 172.21.15.46:0/33931757 shutdown_connections 2024-05-09T06:27:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/33931757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fdfe0 0x7f7c740fe450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/33931757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c740fce70 0x7f7c740fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 -- 172.21.15.46:0/33931757 >> 172.21.15.46:0/33931757 conn(0x7f7c740f8550 msgr2=0x7f7c740fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:13.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 -- 172.21.15.46:0/33931757 shutdown_connections 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 -- 172.21.15.46:0/33931757 wait complete. 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.084+0000 7f7c79f2f700 1 Processor -- start 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c79f2f700 1 -- start start 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c79f2f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 0x7f7c74071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c79f2f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c740fdfe0 0x7f7c740702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c79f2f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74072200 con 0x7f7c740fce70 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c79f2f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c741115c0 con 0x7f7c740fdfe0 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 0x7f7c74071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 0x7f7c74071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51754/0 (socket says 172.21.15.46:51754) 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c737fe700 1 -- 172.21.15.46:0/864581145 learned_addr learned my addr 172.21.15.46:0/864581145 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c72ffd700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c740fdfe0 0x7f7c740702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c737fe700 1 -- 172.21.15.46:0/864581145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c740fdfe0 msgr2=0x7f7c740702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c737fe700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c740fdfe0 0x7f7c740702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.085+0000 7f7c737fe700 1 -- 172.21.15.46:0/864581145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68005040 con 0x7f7c740fce70 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.086+0000 7f7c737fe700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 0x7f7c74071c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c64002a50 tx=0x7f7c640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.086+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64007cc0 con 0x7f7c740fce70 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.086+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c740707f0 con 0x7f7c740fce70 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.086+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c6400f040 con 0x7f7c740fce70 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.086+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6400da30 con 0x7f7c740fce70 2024-05-09T06:27:13.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.086+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c74070db0 con 0x7f7c740fce70 2024-05-09T06:27:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.087+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c741060e0 con 0x7f7c740fce70 2024-05-09T06:27:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.088+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7c6400dbb0 con 0x7f7c740fce70 2024-05-09T06:27:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.088+0000 7f7c5bfff700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7c5c0692a0 0x7f7c5c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.088+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c64087280 con 0x7f7c740fce70 2024-05-09T06:27:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.088+0000 7f7c72ffd700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7c5c0692a0 0x7f7c5c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.089+0000 7f7c72ffd700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7c5c0692a0 0x7f7c5c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800b970 tx=0x7f7c68009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:13.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.092+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7c64057380 con 0x7f7c740fce70 2024-05-09T06:27:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.302+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c74102350 con 0x7f7c5c0692a0 2024-05-09T06:27:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.303+0000 7f7c5bfff700 1 -- 172.21.15.46:0/864581145 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f7c74102350 con 0x7f7c5c0692a0 2024-05-09T06:27:13.285 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2024-05-09T06:27:13.285 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2024-05-09T06:27:13.285 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2024-05-09T06:27:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7c5c0692a0 msgr2=0x7f7c5c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7c5c0692a0 0x7f7c5c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800b970 tx=0x7f7c68009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 msgr2=0x7f7c74071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 0x7f7c74071c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c64002a50 tx=0x7f7c640046b0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 shutdown_connections 2024-05-09T06:27:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7c5c0692a0 0x7f7c5c06b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c740fce70 0x7f7c74071c00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 --2- 172.21.15.46:0/864581145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c740fdfe0 0x7f7c740702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.305+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 >> 172.21.15.46:0/864581145 conn(0x7f7c740f8550 msgr2=0x7f7c740f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.306+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 shutdown_connections 2024-05-09T06:27:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:13.306+0000 7f7c79f2f700 1 -- 172.21.15.46:0/864581145 wait complete. 2024-05-09T06:27:13.323 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:13 smithi046 ceph-mon[26924]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:13.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:13 smithi106 ceph-mon[34679]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:14.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-09T06:27:14.360 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:15.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:15 smithi046 ceph-mon[26924]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:15.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:15 smithi046 ceph-mon[26924]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:15.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:15 smithi106 ceph-mon[34679]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:15.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:15 smithi106 ceph-mon[34679]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 -- 172.21.15.46:0/1652723885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 msgr2=0x7f3be00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 --2- 172.21.15.46:0/1652723885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fd3d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4004940 tx=0x7f3bd4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 -- 172.21.15.46:0/1652723885 shutdown_connections 2024-05-09T06:27:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 --2- 172.21.15.46:0/1652723885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fd3d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 --2- 172.21.15.46:0/1652723885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3be00fbcb0 0x7f3be00fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 -- 172.21.15.46:0/1652723885 >> 172.21.15.46:0/1652723885 conn(0x7f3be00f7430 msgr2=0x7f3be00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 -- 172.21.15.46:0/1652723885 shutdown_connections 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 -- 172.21.15.46:0/1652723885 wait complete. 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 Processor -- start 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 -- start start 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3be00fbcb0 0x7f3be00ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.897+0000 7f3be4ead700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3be4ead700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00fe850 con 0x7f3be00fcf60 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3be4ead700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00fe9c0 con 0x7f3be00fbcb0 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51764/0 (socket says 172.21.15.46:51764) 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 -- 172.21.15.46:0/2391526706 learned_addr learned my addr 172.21.15.46:0/2391526706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bde59c700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3be00fbcb0 0x7f3be00ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 -- 172.21.15.46:0/2391526706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3be00fbcb0 msgr2=0x7f3be00ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3be00fbcb0 0x7f3be00ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 -- 172.21.15.46:0/2391526706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4005040 con 0x7f3be00fcf60 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bddd9b700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fe2a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009150 tx=0x7f3bd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd400e040 con 0x7f3be00fcf60 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be00fec40 con 0x7f3be00fcf60 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bd400bcc0 con 0x7f3be00fcf60 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bd401c630 con 0x7f3be00fcf60 2024-05-09T06:27:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.898+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be01159f0 con 0x7f3be00fcf60 2024-05-09T06:27:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.899+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be0101af0 con 0x7f3be00fcf60 2024-05-09T06:27:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.900+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3bd4013420 con 0x7f3be00fcf60 2024-05-09T06:27:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.900+0000 7f3bceffd700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3bc80692a0 0x7f3bc806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.900+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3bd4087d00 con 0x7f3be00fcf60 2024-05-09T06:27:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.900+0000 7f3bde59c700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3bc80692a0 0x7f3bc806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:15.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.901+0000 7f3bde59c700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3bc80692a0 0x7f3bc806b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fd0 tx=0x7f3bd0009f60 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:15.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:15.905+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3bd40542d0 con 0x7f3be00fcf60 2024-05-09T06:27:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.108+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3be0104910 con 0x7f3bc80692a0 2024-05-09T06:27:16.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.117+0000 7f3bceffd700 1 -- 172.21.15.46:0/2391526706 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f3be0104910 con 0x7f3bc80692a0 2024-05-09T06:27:16.098 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 2m ago 5m 24.4M - 0.25.0 c8568f914cd2 b0b44c27fce3 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 2m ago 5m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (4m) 66s ago 4m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 2m ago 4m 76.3M - 9.4.7 954c08fa6188 9ac57528a8a2 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:9283 running (6m) 2m ago 6m 473M - 17.2.7-933-g4ba5a836 b96134859c76 8f6ac823d36e 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (4m) 66s ago 4m 433M - 17.2.7-933-g4ba5a836 b96134859c76 f21c8bcfc198 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (6m) 2m ago 6m 41.9M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (3m) 66s ago 3m 38.3M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 2m ago 5m 15.8M - 1.5.0 0da6a335fe13 8241269a3f80 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (4m) 66s ago 4m 17.0M - 1.5.0 0da6a335fe13 c00aff5800c6 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 2m ago 3m 39.7M 4289M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 2m ago 2m 40.3M 4289M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 2m ago 2m 39.7M 4289M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:27:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (2m) 66s ago 2m 38.2M 5312M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:27:16.100 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (95s) 66s ago 95s 39.2M 5312M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:27:16.100 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (70s) 66s ago 70s 13.3M 5312M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:27:16.100 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 2m ago 4m 35.6M - 2.43.0 a07b618ecd1d 85a9e537bba1 2024-05-09T06:27:16.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3bc80692a0 msgr2=0x7f3bc806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3bc80692a0 0x7f3bc806b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009fd0 tx=0x7f3bd0009f60 comp rx=0 tx=0).stop 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 msgr2=0x7f3be00fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fe2a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009150 tx=0x7f3bd4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 shutdown_connections 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3bc80692a0 0x7f3bc806b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3be00fbcb0 0x7f3be00ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 --2- 172.21.15.46:0/2391526706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3be00fcf60 0x7f3be00fe2a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 >> 172.21.15.46:0/2391526706 conn(0x7f3be00f7430 msgr2=0x7f3be00f89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 shutdown_connections 2024-05-09T06:27:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:16.119+0000 7f3be4ead700 1 -- 172.21.15.46:0/2391526706 wait complete. 2024-05-09T06:27:16.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-09T06:27:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:17.367 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:17 smithi046 ceph-mon[26924]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:17.367 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:17 smithi046 ceph-mon[26924]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:17.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:17 smithi106 ceph-mon[34679]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:17.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:17 smithi106 ceph-mon[34679]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:18.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 -- 172.21.15.46:0/2552487480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80ffee0 msgr2=0x7f51c8102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 --2- 172.21.15.46:0/2552487480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80ffee0 0x7f51c8102300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f51bc004940 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 -- 172.21.15.46:0/2552487480 shutdown_connections 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 --2- 172.21.15.46:0/2552487480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80ffee0 0x7f51c8102300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 --2- 172.21.15.46:0/2552487480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51c80662c0 0x7f51c80ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 -- 172.21.15.46:0/2552487480 >> 172.21.15.46:0/2552487480 conn(0x7f51c80f7430 msgr2=0x7f51c80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 -- 172.21.15.46:0/2552487480 shutdown_connections 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 -- 172.21.15.46:0/2552487480 wait complete. 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 Processor -- start 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 -- start start 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.635+0000 7f51d01cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 0x7f51c810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:18.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51d01cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51c80ffee0 0x7f51c8110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51d01cb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8110740 con 0x7f51c80662c0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51d01cb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8110f90 con 0x7f51c80ffee0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 0x7f51c810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 0x7f51c810fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51784/0 (socket says 172.21.15.46:51784) 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 -- 172.21.15.46:0/409216967 learned_addr learned my addr 172.21.15.46:0/409216967 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cd766700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51c80ffee0 0x7f51c8110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 -- 172.21.15.46:0/409216967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51c80ffee0 msgr2=0x7f51c8110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51c80ffee0 0x7f51c8110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 -- 172.21.15.46:0/409216967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc005040 con 0x7f51c80662c0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51cdf67700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 0x7f51c810fc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f51c4002a50 tx=0x7f51c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c4007cc0 con 0x7f51c80662c0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8111270 con 0x7f51c80662c0 2024-05-09T06:27:18.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51c400f040 con 0x7f51c80662c0 2024-05-09T06:27:18.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c400da40 con 0x7f51c80662c0 2024-05-09T06:27:18.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.636+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c81117b0 con 0x7f51c80662c0 2024-05-09T06:27:18.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.637+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c805f5c0 con 0x7f51c80662c0 2024-05-09T06:27:18.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.638+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f51c40097c0 con 0x7f51c80662c0 2024-05-09T06:27:18.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.638+0000 7f51ba7fc700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f51b40692a0 0x7f51b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:18.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.638+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f51c4086c70 con 0x7f51c80662c0 2024-05-09T06:27:18.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.638+0000 7f51cd766700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f51b40692a0 0x7f51b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:18.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.639+0000 7f51cd766700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f51b40692a0 0x7f51b406b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:18.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.643+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f51c4056a60 con 0x7f51c80662c0 2024-05-09T06:27:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.848+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f51c8111b40 con 0x7f51b40692a0 2024-05-09T06:27:18.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.853+0000 7f51ba7fc700 1 -- 172.21.15.46:0/409216967 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f51c8111b40 con 0x7f51b40692a0 2024-05-09T06:27:18.835 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-09T06:27:18.835 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-05-09T06:27:18.835 INFO:teuthology.orchestra.run.smithi046.stdout:crash 2/2 2m ago 6m * 2024-05-09T06:27:18.835 INFO:teuthology.orchestra.run.smithi046.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-05-09T06:27:18.835 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 2/2 2m ago 6m count:2 2024-05-09T06:27:18.836 INFO:teuthology.orchestra.run.smithi046.stdout:mon 2/2 2m ago 5m smithi046:172.21.15.46=smithi046;smithi106:172.21.15.106=smithi106;count:2 2024-05-09T06:27:18.836 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-05-09T06:27:18.836 INFO:teuthology.orchestra.run.smithi046.stdout:osd 6 2m ago - 2024-05-09T06:27:18.836 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-05-09T06:27:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f51b40692a0 msgr2=0x7f51b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f51b40692a0 0x7f51b406b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 msgr2=0x7f51c810fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 0x7f51c810fc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f51c4002a50 tx=0x7f51c4004600 comp rx=0 tx=0).stop 2024-05-09T06:27:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 shutdown_connections 2024-05-09T06:27:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f51b40692a0 0x7f51b406b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51c80662c0 0x7f51c810fc00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 --2- 172.21.15.46:0/409216967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51c80ffee0 0x7f51c8110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 >> 172.21.15.46:0/409216967 conn(0x7f51c80f7430 msgr2=0x7f51c80fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 shutdown_connections 2024-05-09T06:27:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:18.855+0000 7f51d01cb700 1 -- 172.21.15.46:0/409216967 wait complete. 2024-05-09T06:27:19.387 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:19 smithi046 ceph-mon[26924]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:19.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-09T06:27:19.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:19 smithi106 ceph-mon[34679]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:19.692 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:20.451 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:20 smithi046 ceph-mon[26924]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:20.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:20 smithi106 ceph-mon[34679]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 -- 172.21.15.46:0/13523300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fcf60 msgr2=0x7f73a00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 --2- 172.21.15.46:0/13523300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fcf60 0x7f73a00fd3d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7388004940 tx=0x7f7388009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 -- 172.21.15.46:0/13523300 shutdown_connections 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 --2- 172.21.15.46:0/13523300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fcf60 0x7f73a00fd3d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 --2- 172.21.15.46:0/13523300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a00fbcb0 0x7f73a00fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 -- 172.21.15.46:0/13523300 >> 172.21.15.46:0/13523300 conn(0x7f73a00f7430 msgr2=0x7f73a00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 -- 172.21.15.46:0/13523300 shutdown_connections 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.228+0000 7f73a4960700 1 -- 172.21.15.46:0/13523300 wait complete. 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f73a4960700 1 Processor -- start 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f73a4960700 1 -- start start 2024-05-09T06:27:21.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f73a4960700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 0x7f73a010da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f73a4960700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a00fcf60 0x7f73a010df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f73a4960700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a010e610 con 0x7f73a00fbcb0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f73a4960700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a010edb0 con 0x7f73a00fcf60 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f739e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 0x7f73a010da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f739e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 0x7f73a010da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38122/0 (socket says 172.21.15.46:38122) 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f739e59c700 1 -- 172.21.15.46:0/3550203211 learned_addr learned my addr 172.21.15.46:0/3550203211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.229+0000 7f739dd9b700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a00fcf60 0x7f73a010df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f739e59c700 1 -- 172.21.15.46:0/3550203211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a00fcf60 msgr2=0x7f73a010df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f739e59c700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a00fcf60 0x7f73a010df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f739e59c700 1 -- 172.21.15.46:0/3550203211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388005040 con 0x7f73a00fbcb0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f739e59c700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 0x7f73a010da40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f739000b790 tx=0x7f7390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f739000f6f0 con 0x7f73a00fbcb0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a010f090 con 0x7f73a00fbcb0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f739000fd20 con 0x7f73a00fbcb0 2024-05-09T06:27:21.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73900103a0 con 0x7f73a00fbcb0 2024-05-09T06:27:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.230+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a010f650 con 0x7f73a00fbcb0 2024-05-09T06:27:21.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.231+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0101af0 con 0x7f73a00fbcb0 2024-05-09T06:27:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.231+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7390011400 con 0x7f73a00fbcb0 2024-05-09T06:27:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.232+0000 7f7396ffd700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f738c0692a0 0x7f738c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.232+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7390086c40 con 0x7f73a00fbcb0 2024-05-09T06:27:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.232+0000 7f739dd9b700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f738c0692a0 0x7f738c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:21.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.232+0000 7f739dd9b700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f738c0692a0 0x7f738c06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f738800b970 tx=0x7f7388009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:21.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.236+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7390056d40 con 0x7f73a00fbcb0 2024-05-09T06:27:21.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:21 smithi046 ceph-mon[26924]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:21.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.440+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f73a0104990 con 0x7f738c0692a0 2024-05-09T06:27:21.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.442+0000 7f7396ffd700 1 -- 172.21.15.46:0/3550203211 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f73a0104990 con 0x7f738c0692a0 2024-05-09T06:27:21.423 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2024-05-09T06:27:21.424 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2024-05-09T06:27:21.424 INFO:teuthology.orchestra.run.smithi046.stdout:smithi106 172.21.15.106 2024-05-09T06:27:21.424 INFO:teuthology.orchestra.run.smithi046.stdout:2 hosts in cluster 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f738c0692a0 msgr2=0x7f738c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f738c0692a0 0x7f738c06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f738800b970 tx=0x7f7388009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 msgr2=0x7f73a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 0x7f73a010da40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f739000b790 tx=0x7f7390009250 comp rx=0 tx=0).stop 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 shutdown_connections 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f738c0692a0 0x7f738c06b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73a00fbcb0 0x7f73a010da40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 --2- 172.21.15.46:0/3550203211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a00fcf60 0x7f73a010df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:21.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 >> 172.21.15.46:0/3550203211 conn(0x7f73a00f7430 msgr2=0x7f73a0065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 shutdown_connections 2024-05-09T06:27:21.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:21.444+0000 7f73a4960700 1 -- 172.21.15.46:0/3550203211 wait complete. 2024-05-09T06:27:21.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:21 smithi106 ceph-mon[34679]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:22.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-09T06:27:22.344 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:23.490 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:23 smithi046 ceph-mon[26924]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:23.490 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:23 smithi046 ceph-mon[26924]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:23.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:23 smithi106 ceph-mon[34679]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:23.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:23 smithi106 ceph-mon[34679]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 -- 172.21.15.46:0/3693849584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 msgr2=0x7fbd6c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/3693849584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c0702f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbd60004940 tx=0x7fbd60009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:24.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 -- 172.21.15.46:0/3693849584 shutdown_connections 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/3693849584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd6c070830 0x7fbd6c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/3693849584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c0702f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 -- 172.21.15.46:0/3693849584 >> 172.21.15.46:0/3693849584 conn(0x7fbd6c0f8340 msgr2=0x7fbd6c0fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 -- 172.21.15.46:0/3693849584 shutdown_connections 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.143+0000 7fbd71d9f700 1 -- 172.21.15.46:0/3693849584 wait complete. 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd71d9f700 1 Processor -- start 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd71d9f700 1 -- start start 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd71d9f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd6c070830 0x7fbd6c10fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd71d9f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c10ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd71d9f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c1105a0 con 0x7fbd6c071de0 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd71d9f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c110df0 con 0x7fbd6c070830 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd6bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c10ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd6bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c10ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38134/0 (socket says 172.21.15.46:38134) 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd6bfff700 1 -- 172.21.15.46:0/1603420630 learned_addr learned my addr 172.21.15.46:0/1603420630 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:24.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd70d9d700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd6c070830 0x7fbd6c10fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd6bfff700 1 -- 172.21.15.46:0/1603420630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd6c070830 msgr2=0x7fbd6c10fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd6bfff700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd6c070830 0x7fbd6c10fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.144+0000 7fbd6bfff700 1 -- 172.21.15.46:0/1603420630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60005040 con 0x7fbd6c071de0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.145+0000 7fbd6bfff700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c10ffa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd58002a50 tx=0x7fbd580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.145+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd58007cc0 con 0x7fbd6c071de0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.145+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd5800f040 con 0x7fbd6c071de0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.145+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c1110d0 con 0x7fbd6c071de0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.145+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5800db70 con 0x7fbd6c071de0 2024-05-09T06:27:24.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.145+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c111610 con 0x7fbd6c071de0 2024-05-09T06:27:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.146+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c0fc000 con 0x7fbd6c071de0 2024-05-09T06:27:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.146+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbd5800dd10 con 0x7fbd6c071de0 2024-05-09T06:27:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.147+0000 7fbd697fa700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbd5c0692a0 0x7fbd5c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.147+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbd580864c0 con 0x7fbd6c071de0 2024-05-09T06:27:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.147+0000 7fbd70d9d700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbd5c0692a0 0x7fbd5c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:24.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.147+0000 7fbd70d9d700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbd5c0692a0 0x7fbd5c06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000b970 tx=0x7fbd60009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:24.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.151+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbd580565c0 con 0x7fbd6c071de0 2024-05-09T06:27:24.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:24.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.355+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd6c111930 con 0x7fbd5c0692a0 2024-05-09T06:27:24.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.357+0000 7fbd697fa700 1 -- 172.21.15.46:0/1603420630 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fbd6c111930 con 0x7fbd5c0692a0 2024-05-09T06:27:24.339 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-09T06:27:24.339 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-05-09T06:27:24.339 INFO:teuthology.orchestra.run.smithi046.stdout:smithi106 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013R400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbd5c0692a0 msgr2=0x7fbd5c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbd5c0692a0 0x7fbd5c06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000b970 tx=0x7fbd60009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 msgr2=0x7fbd6c10ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c10ffa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd58002a50 tx=0x7fbd580046b0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 shutdown_connections 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbd5c0692a0 0x7fbd5c06b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd6c070830 0x7fbd6c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 --2- 172.21.15.46:0/1603420630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd6c071de0 0x7fbd6c10ffa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:24.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 >> 172.21.15.46:0/1603420630 conn(0x7fbd6c0f8340 msgr2=0x7fbd6c0f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:24.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.359+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 shutdown_connections 2024-05-09T06:27:24.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:24.360+0000 7fbd71d9f700 1 -- 172.21.15.46:0/1603420630 wait complete. 2024-05-09T06:27:24.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:25.014 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:25.023 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:25.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-05-09T06:27:25.294 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:25.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:25 smithi046 ceph-mon[26924]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:25 smithi106 ceph-mon[34679]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:26.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:26 smithi106 ceph-mon[34679]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:26.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:26 smithi046 ceph-mon[26924]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.929+0000 7f35d195f700 1 -- 172.21.15.46:0/4170964405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 msgr2=0x7f35cc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.929+0000 7f35d195f700 1 --2- 172.21.15.46:0/4170964405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc0fe440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f35c0004940 tx=0x7f35c0009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 -- 172.21.15.46:0/4170964405 shutdown_connections 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 --2- 172.21.15.46:0/4170964405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc0fe440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 --2- 172.21.15.46:0/4170964405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35cc0fce60 0x7f35cc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 -- 172.21.15.46:0/4170964405 >> 172.21.15.46:0/4170964405 conn(0x7f35cc0f8540 msgr2=0x7f35cc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:26.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 -- 172.21.15.46:0/4170964405 shutdown_connections 2024-05-09T06:27:26.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 -- 172.21.15.46:0/4170964405 wait complete. 2024-05-09T06:27:26.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 Processor -- start 2024-05-09T06:27:26.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.930+0000 7f35d195f700 1 -- start start 2024-05-09T06:27:26.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35d195f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35cc0fce60 0x7f35cc10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:26.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35d195f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:26.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35d195f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc10e450 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35d195f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc10e5c0 con 0x7f35cc0fce60 2024-05-09T06:27:26.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38160/0 (socket says 172.21.15.46:38160) 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 -- 172.21.15.46:0/1701626358 learned_addr learned my addr 172.21.15.46:0/1701626358 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35caffd700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35cc0fce60 0x7f35cc10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 -- 172.21.15.46:0/1701626358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35cc0fce60 msgr2=0x7f35cc10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35cc0fce60 0x7f35cc10d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 -- 172.21.15.46:0/1701626358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0005040 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.931+0000 7f35ca7fc700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc10de50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009150 tx=0x7f35c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.932+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c000e040 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.932+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35c000bbf0 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.932+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc112fc0 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.932+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c001c630 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.932+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc113550 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.933+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc04c710 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.933+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f35c000bd60 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.934+0000 7f35b37fe700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f35b40692a0 0x7f35b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.934+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f35c00880b0 con 0x7f35cc0fdfd0 2024-05-09T06:27:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.934+0000 7f35caffd700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f35b40692a0 0x7f35b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.934+0000 7f35caffd700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f35b40692a0 0x7f35b406b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35bc004f40 tx=0x7f35bc00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:26.938+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f35c0058250 con 0x7f35cc0fdfd0 2024-05-09T06:27:27.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:27.167+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f35cc1023e0 con 0x7f35b40692a0 2024-05-09T06:27:27.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:27 smithi046 ceph-mon[26924]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:27.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:27 smithi106 ceph-mon[34679]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:28.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:28 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-09T06:27:28.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:28 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-05-09T06:27:29.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.161+0000 7f35b37fe700 1 -- 172.21.15.46:0/1701626358 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f35cc1023e0 con 0x7f35b40692a0 2024-05-09T06:27:29.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.165+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f35b40692a0 msgr2=0x7f35b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.165+0000 7f35d195f700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f35b40692a0 0x7f35b406b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35bc004f40 tx=0x7f35bc00b040 comp rx=0 tx=0).stop 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.165+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 msgr2=0x7f35cc10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.165+0000 7f35d195f700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc10de50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009150 tx=0x7f35c0009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 shutdown_connections 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f35b40692a0 0x7f35b406b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35cc0fce60 0x7f35cc10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 --2- 172.21.15.46:0/1701626358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35cc0fdfd0 0x7f35cc10de50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 >> 172.21.15.46:0/1701626358 conn(0x7f35cc0f8540 msgr2=0x7f35cc0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 shutdown_connections 2024-05-09T06:27:29.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:29.166+0000 7f35d195f700 1 -- 172.21.15.46:0/1701626358 wait complete. 2024-05-09T06:27:29.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:29 smithi046 ceph-mon[26924]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:29.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:29 smithi046 ceph-mon[26924]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:29.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:29 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-09T06:27:29.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:29 smithi046 ceph-mon[26924]: osdmap e41: 6 total, 6 up, 6 in 2024-05-09T06:27:29.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:29 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:29.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:29 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[26920]: 2024-05-09T06:27:29.142+0000 7f1017d1f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:27:29.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:29 smithi106 ceph-mon[34679]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:27:29.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:29 smithi106 ceph-mon[34679]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:29.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:29 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-05-09T06:27:29.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:29 smithi106 ceph-mon[34679]: osdmap e41: 6 total, 6 up, 6 in 2024-05-09T06:27:29.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:29 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:29.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T06:27:30.191 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: osdmap e42: 6 total, 6 up, 6 in 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: osdmap e43: 6 total, 6 up, 6 in 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: fsmap cephfs:0 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: Saving service mds.cephfs spec with placement count:4 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:30.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:30.438 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:30 smithi046 ceph-mon[26924]: pgmap v169: 65 pgs: 14 creating+peering, 50 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:30.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:30.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: osdmap e42: 6 total, 6 up, 6 in 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: osdmap e43: 6 total, 6 up, 6 in 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: fsmap cephfs:0 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: Saving service mds.cephfs spec with placement count:4 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:30.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:30 smithi106 ceph-mon[34679]: pgmap v169: 65 pgs: 14 creating+peering, 50 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: osdmap e44: 6 total, 6 up, 6 in 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:31.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:31.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:31 smithi046 ceph-mon[26924]: Deploying daemon mds.cephfs.smithi046.easboa on smithi046 2024-05-09T06:27:31.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: osdmap e44: 6 total, 6 up, 6 in 2024-05-09T06:27:31.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:31.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:31.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:31.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:31.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:31.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:31.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:31 smithi106 ceph-mon[34679]: Deploying daemon mds.cephfs.smithi046.easboa on smithi046 2024-05-09T06:27:32.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:32 smithi046 ceph-mon[26924]: osdmap e45: 6 total, 6 up, 6 in 2024-05-09T06:27:32.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:32 smithi046 ceph-mon[26924]: pgmap v172: 65 pgs: 18 creating+peering, 32 unknown, 15 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:32 smithi106 ceph-mon[34679]: osdmap e45: 6 total, 6 up, 6 in 2024-05-09T06:27:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:32 smithi106 ceph-mon[34679]: pgmap v172: 65 pgs: 18 creating+peering, 32 unknown, 15 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.802+0000 7f93afcfb700 1 -- 172.21.15.46:0/3125434836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 msgr2=0x7f93a80ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.802+0000 7f93afcfb700 1 --2- 172.21.15.46:0/3125434836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a80ffa00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f93a4004940 tx=0x7f93a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.802+0000 7f93afcfb700 1 -- 172.21.15.46:0/3125434836 shutdown_connections 2024-05-09T06:27:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.802+0000 7f93afcfb700 1 --2- 172.21.15.46:0/3125434836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a80fff40 0x7f93a8102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:32.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.802+0000 7f93afcfb700 1 --2- 172.21.15.46:0/3125434836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a80ffa00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 -- 172.21.15.46:0/3125434836 >> 172.21.15.46:0/3125434836 conn(0x7f93a80f7430 msgr2=0x7f93a80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 -- 172.21.15.46:0/3125434836 shutdown_connections 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 -- 172.21.15.46:0/3125434836 wait complete. 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 Processor -- start 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 -- start start 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a80fff40 0x7f93a810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a810e570 con 0x7f93a8066260 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93afcfb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a810edc0 con 0x7f93a80fff40 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93ada97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93ada97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35114/0 (socket says 172.21.15.46:35114) 2024-05-09T06:27:32.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.803+0000 7f93ada97700 1 -- 172.21.15.46:0/2074734597 learned_addr learned my addr 172.21.15.46:0/2074734597 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93ad296700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a80fff40 0x7f93a810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93ada97700 1 -- 172.21.15.46:0/2074734597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a80fff40 msgr2=0x7f93a810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93ada97700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a80fff40 0x7f93a810df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93ada97700 1 -- 172.21.15.46:0/2074734597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4005040 con 0x7f93a8066260 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93ada97700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a810da30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f93a400b3b0 tx=0x7f93a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a400e040 con 0x7f93a8066260 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93a400bcc0 con 0x7f93a8066260 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a810f040 con 0x7f93a8066260 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a401c630 con 0x7f93a8066260 2024-05-09T06:27:32.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.804+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a810f580 con 0x7f93a8066260 2024-05-09T06:27:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.805+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a805f5c0 con 0x7f93a8066260 2024-05-09T06:27:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.806+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f93a40139f0 con 0x7f93a8066260 2024-05-09T06:27:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.806+0000 7f939e7fc700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93940692a0 0x7f939406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.806+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f93a4087fa0 con 0x7f93a8066260 2024-05-09T06:27:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.806+0000 7f93ad296700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93940692a0 0x7f939406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.807+0000 7f93ad296700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93940692a0 0x7f939406b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9398004990 tx=0x7f9398009ee0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:32.811+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f93a4057d60 con 0x7f93a8066260 2024-05-09T06:27:33.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.064+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93a810f860 con 0x7f93a8066260 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.065+0000 7f939e7fc700 1 -- 172.21.15.46:0/2074734597 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f93a40578f0 con 0x7f93a8066260 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:e2 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:27:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 2 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:29.142406+0000 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:in 2024-05-09T06:27:33.049 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 0 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:33.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93940692a0 msgr2=0x7f939406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93940692a0 0x7f939406b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9398004990 tx=0x7f9398009ee0 comp rx=0 tx=0).stop 2024-05-09T06:27:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 msgr2=0x7f93a810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a810da30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f93a400b3b0 tx=0x7f93a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 shutdown_connections 2024-05-09T06:27:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f93940692a0 0x7f939406b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a8066260 0x7f93a810da30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 --2- 172.21.15.46:0/2074734597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a80fff40 0x7f93a810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 >> 172.21.15.46:0/2074734597 conn(0x7f93a80f7430 msgr2=0x7f93a80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 shutdown_connections 2024-05-09T06:27:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:33.068+0000 7f93afcfb700 1 -- 172.21.15.46:0/2074734597 wait complete. 2024-05-09T06:27:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-05-09T06:27:33.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:33 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2074734597' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:33.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:33 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2074734597' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:33.655 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:33.665 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:33.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-05-09T06:27:34.184 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:34.427 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:34 smithi046 ceph-mon[26924]: pgmap v173: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:34.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:34 smithi106 ceph-mon[34679]: pgmap v173: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6826/1263102272,v1:172.21.15.46:6827/1263102272] up:boot 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: daemon mds.cephfs.smithi046.easboa assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: Cluster is now healthy 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: fsmap cephfs:0 1 up:standby 2024-05-09T06:27:35.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:creating} 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: daemon mds.cephfs.smithi046.easboa is now active in filesystem cephfs as rank 0 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:35.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:35 smithi046 ceph-mon[26924]: Deploying daemon mds.cephfs.smithi106.fqgqkm on smithi106 2024-05-09T06:27:35.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6826/1263102272,v1:172.21.15.46:6827/1263102272] up:boot 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: daemon mds.cephfs.smithi046.easboa assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: Cluster is now healthy 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: fsmap cephfs:0 1 up:standby 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:creating} 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: daemon mds.cephfs.smithi046.easboa is now active in filesystem cephfs as rank 0 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:35.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:35.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:35 smithi106 ceph-mon[34679]: Deploying daemon mds.cephfs.smithi106.fqgqkm on smithi106 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 -- 172.21.15.46:0/1752229765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 msgr2=0x7fc7b80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/1752229765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b80fe440 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8004880 tx=0x7fc7a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 -- 172.21.15.46:0/1752229765 shutdown_connections 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/1752229765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b80fe440 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/1752229765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b80fce60 0x7fc7b80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 -- 172.21.15.46:0/1752229765 >> 172.21.15.46:0/1752229765 conn(0x7fc7b80f8560 msgr2=0x7fc7b80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 -- 172.21.15.46:0/1752229765 shutdown_connections 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.829+0000 7fc7bfb02700 1 -- 172.21.15.46:0/1752229765 wait complete. 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bfb02700 1 Processor -- start 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bfb02700 1 -- start start 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bfb02700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b80fce60 0x7fc7b810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:35.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bfb02700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b810dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bfb02700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b810e5a0 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bfb02700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b810eda0 con 0x7fc7b80fce60 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bd09d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b810dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bd09d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b810dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35144/0 (socket says 172.21.15.46:35144) 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bd09d700 1 -- 172.21.15.46:0/3406980949 learned_addr learned my addr 172.21.15.46:0/3406980949 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.830+0000 7fc7bd89e700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b80fce60 0x7fc7b810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7bd09d700 1 -- 172.21.15.46:0/3406980949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b80fce60 msgr2=0x7fc7b810da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7bd09d700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b80fce60 0x7fc7b810da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7bd09d700 1 -- 172.21.15.46:0/3406980949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4005040 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7bd09d700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b810dfa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8008fb0 tx=0x7fc7a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a800e030 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a8005040 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7a8013e60 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a80123c0 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.831+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b810f3d0 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.832+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b805f5c0 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.833+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc7a801c770 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.833+0000 7fc7ae7fc700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc7a40692a0 0x7fc7a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:35.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.833+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc7a8088b50 con 0x7fc7b80fdfd0 2024-05-09T06:27:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.833+0000 7fc7bd89e700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc7a40692a0 0x7fc7a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:35.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.833+0000 7fc7bd89e700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc7a40692a0 0x7fc7a406b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009fd0 tx=0x7fc7b400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:35.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:35.838+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc7a8058890 con 0x7fc7b80fdfd0 2024-05-09T06:27:36.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.080+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fc7b810f6b0 con 0x7fc7b80fdfd0 2024-05-09T06:27:36.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.173+0000 7fc7ae7fc700 1 -- 172.21.15.46:0/3406980949 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc7a801c400 con 0x7fc7b80fdfd0 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc7a40692a0 msgr2=0x7fc7a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc7a40692a0 0x7fc7a406b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009fd0 tx=0x7fc7b400b040 comp rx=0 tx=0).stop 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 msgr2=0x7fc7b810dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b810dfa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8008fb0 tx=0x7fc7a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 shutdown_connections 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc7a40692a0 0x7fc7a406b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7b80fce60 0x7fc7b810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 --2- 172.21.15.46:0/3406980949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7b80fdfd0 0x7fc7b810dfa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:36.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 >> 172.21.15.46:0/3406980949 conn(0x7fc7b80f8560 msgr2=0x7fc7b80f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:36.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 shutdown_connections 2024-05-09T06:27:36.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:36.175+0000 7fc7bfb02700 1 -- 172.21.15.46:0/3406980949 wait complete. 2024-05-09T06:27:36.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:36 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6826/1263102272,v1:172.21.15.46:6827/1263102272] up:active 2024-05-09T06:27:36.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:36 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2024-05-09T06:27:36.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:36 smithi106 ceph-mon[34679]: pgmap v174: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s wr, 3 op/s 2024-05-09T06:27:36.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:36 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3406980949' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-09T06:27:36.461 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:36 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6826/1263102272,v1:172.21.15.46:6827/1263102272] up:active 2024-05-09T06:27:36.461 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:36 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2024-05-09T06:27:36.461 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:36 smithi046 ceph-mon[26924]: pgmap v174: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s wr, 3 op/s 2024-05-09T06:27:36.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:36 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3406980949' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-05-09T06:27:36.732 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:36.742 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:36.742 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-05-09T06:27:37.022 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3406980949' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:37.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:37 smithi046 ceph-mon[26924]: Deploying daemon mds.cephfs.smithi046.pkuwsr on smithi046 2024-05-09T06:27:37.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3406980949' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-05-09T06:27:37.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:37.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:37 smithi106 ceph-mon[34679]: Deploying daemon mds.cephfs.smithi046.pkuwsr on smithi046 2024-05-09T06:27:38.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:38 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:boot 2024-05-09T06:27:38.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:38 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 1 up:standby 2024-05-09T06:27:38.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:38 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:27:38.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:38 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 1 up:standby 2024-05-09T06:27:38.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:38 smithi046 ceph-mon[26924]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-09T06:27:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:38 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:boot 2024-05-09T06:27:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:38 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 1 up:standby 2024-05-09T06:27:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:38 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:27:38.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:38 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 1 up:standby 2024-05-09T06:27:38.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:38 smithi106 ceph-mon[34679]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-09T06:27:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:39 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:39.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:39 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 -- 172.21.15.46:0/1401313610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c066ed0 msgr2=0x7fbe9c0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 --2- 172.21.15.46:0/1401313610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c0ff9a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009ce0 tx=0x7fbe98004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 -- 172.21.15.46:0/1401313610 shutdown_connections 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 --2- 172.21.15.46:0/1401313610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c0ffee0 0x7fbe9c102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 --2- 172.21.15.46:0/1401313610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c0ff9a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 -- 172.21.15.46:0/1401313610 >> 172.21.15.46:0/1401313610 conn(0x7fbe9c0f7430 msgr2=0x7fbe9c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 -- 172.21.15.46:0/1401313610 shutdown_connections 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.755+0000 7fbea4067700 1 -- 172.21.15.46:0/1401313610 wait complete. 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea4067700 1 Processor -- start 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea4067700 1 -- start start 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea4067700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c10d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea4067700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c0ffee0 0x7fbe9c10df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea4067700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c10e500 con 0x7fbe9c0ffee0 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea4067700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c10e670 con 0x7fbe9c066ed0 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea1e03700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c10d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea1602700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c0ffee0 0x7fbe9c10df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.756+0000 7fbea1e03700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c10d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:34024/0 (socket says 172.21.15.46:34024) 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea1e03700 1 -- 172.21.15.46:0/2629125392 learned_addr learned my addr 172.21.15.46:0/2629125392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea1e03700 1 -- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c0ffee0 msgr2=0x7fbe9c10df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea1e03700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c0ffee0 0x7fbe9c10df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea1e03700 1 -- 172.21.15.46:0/2629125392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009940 con 0x7fbe9c066ed0 2024-05-09T06:27:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea1e03700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c10d9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009380 tx=0x7fbe98004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9800e040 con 0x7fbe9c066ed0 2024-05-09T06:27:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9801cb20 con 0x7fbe9c066ed0 2024-05-09T06:27:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c113070 con 0x7fbe9c066ed0 2024-05-09T06:27:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe98012b10 con 0x7fbe9c066ed0 2024-05-09T06:27:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.757+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c113630 con 0x7fbe9c066ed0 2024-05-09T06:27:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.759+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c04c710 con 0x7fbe9c066ed0 2024-05-09T06:27:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.759+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbe98025400 con 0x7fbe9c066ed0 2024-05-09T06:27:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.759+0000 7fbe927fc700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbe880692a0 0x7fbe8806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.759+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbe980894b0 con 0x7fbe9c066ed0 2024-05-09T06:27:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.759+0000 7fbea1602700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbe880692a0 0x7fbe8806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.760+0000 7fbea1602700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbe880692a0 0x7fbe8806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009b80 tx=0x7fbe8c00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:39.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:39.764+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbe98059190 con 0x7fbe9c066ed0 2024-05-09T06:27:40.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.033+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbe9c1058a0 con 0x7fbe9c066ed0 2024-05-09T06:27:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.190+0000 7fbe927fc700 1 -- 172.21.15.46:0/2629125392 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe98058d20 con 0x7fbe9c066ed0 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbe880692a0 msgr2=0x7fbe8806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbe880692a0 0x7fbe8806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009b80 tx=0x7fbe8c00b040 comp rx=0 tx=0).stop 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 msgr2=0x7fbe9c10d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c10d9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009380 tx=0x7fbe98004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 shutdown_connections 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fbe880692a0 0x7fbe8806b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe9c066ed0 0x7fbe9c10d9c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 --2- 172.21.15.46:0/2629125392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c0ffee0 0x7fbe9c10df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 >> 172.21.15.46:0/2629125392 conn(0x7fbe9c0f7430 msgr2=0x7fbe9c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 shutdown_connections 2024-05-09T06:27:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:40.192+0000 7fbea4067700 1 -- 172.21.15.46:0/2629125392 wait complete. 2024-05-09T06:27:40.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:40 smithi106 ceph-mon[34679]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T06:27:40.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:40 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2629125392' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T06:27:40.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:40 smithi106 ceph-mon[34679]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T06:27:40.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:40 smithi046 ceph-mon[26924]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T06:27:40.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:40 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2629125392' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T06:27:40.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:40 smithi046 ceph-mon[26924]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-05-09T06:27:40.988 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:40.997 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:40.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-05-09T06:27:41.275 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 1 up:standby 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:41.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:41 smithi046 ceph-mon[26924]: Deploying daemon mds.cephfs.smithi106.ugnujp on smithi106 2024-05-09T06:27:41.435 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-05-09T06:27:41.435 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 1 up:standby 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:41.436 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:41 smithi106 ceph-mon[34679]: Deploying daemon mds.cephfs.smithi106.ugnujp on smithi106 2024-05-09T06:27:42.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:42 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:boot 2024-05-09T06:27:42.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:42 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2 up:standby 2024-05-09T06:27:42.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:42 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:27:42.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:42 smithi046 ceph-mon[26924]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-05-09T06:27:42.545 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:42 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:boot 2024-05-09T06:27:42.545 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:42 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2 up:standby 2024-05-09T06:27:42.545 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:42 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:27:42.545 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:42 smithi106 ceph-mon[34679]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 -- 172.21.15.46:0/3635153303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 msgr2=0x7f6ee80fc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 --2- 172.21.15.46:0/3635153303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee80fc000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6edc004940 tx=0x7f6edc009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 -- 172.21.15.46:0/3635153303 shutdown_connections 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 --2- 172.21.15.46:0/3635153303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee80fc000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 --2- 172.21.15.46:0/3635153303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ee80fd2a0 0x7f6ee80fd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 -- 172.21.15.46:0/3635153303 >> 172.21.15.46:0/3635153303 conn(0x7f6ee80f6b80 msgr2=0x7f6ee80f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 -- 172.21.15.46:0/3635153303 shutdown_connections 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.896+0000 7f6eed905700 1 -- 172.21.15.46:0/3635153303 wait complete. 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.897+0000 7f6eed905700 1 Processor -- start 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.897+0000 7f6eed905700 1 -- start start 2024-05-09T06:27:42.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.897+0000 7f6eed905700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ee80fd2a0 0x7f6ee8110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:42.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.897+0000 7f6eed905700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee8112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:42.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.897+0000 7f6eed905700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80fbcd0 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.897+0000 7f6eed905700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee80fbe10 con 0x7f6ee80fd2a0 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee8112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee8112cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38080/0 (socket says 172.21.15.46:38080) 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 -- 172.21.15.46:0/3692024664 learned_addr learned my addr 172.21.15.46:0/3692024664 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee6ffd700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ee80fd2a0 0x7f6ee8110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 -- 172.21.15.46:0/3692024664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ee80fd2a0 msgr2=0x7f6ee8110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ee80fd2a0 0x7f6ee8110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 -- 172.21.15.46:0/3692024664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc005040 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ee67fc700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee8112cb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00b3b0 tx=0x7f6edc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:42.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6edc00e040 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6edc00bbf0 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee81132b0 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.898+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6edc01c630 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.899+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee8113840 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.900+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee805f5c0 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.900+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6edc00bd60 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.901+0000 7f6ecf7fe700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f6ed00692a0 0x7f6ed006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.901+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6edc087e40 con 0x7f6ee80fdbf0 2024-05-09T06:27:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.901+0000 7f6ee6ffd700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f6ed00692a0 0x7f6ed006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:42.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.901+0000 7f6ee6ffd700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f6ed00692a0 0x7f6ed006b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80fb8c0 tx=0x7f6ed80091a0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:42.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:42.905+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6edc054170 con 0x7f6ee80fdbf0 2024-05-09T06:27:43.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.149+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ee804bed0 con 0x7f6ee80fdbf0 2024-05-09T06:27:43.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.200+0000 7f6ecf7fe700 1 -- 172.21.15.46:0/3692024664 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) v1 ==== 168+0+0 (secure 0 0 0) 0x7f6ee804bed0 con 0x7f6ee80fdbf0 2024-05-09T06:27:43.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.203+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f6ed00692a0 msgr2=0x7f6ed006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:43.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.203+0000 7f6eed905700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f6ed00692a0 0x7f6ed006b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80fb8c0 tx=0x7f6ed80091a0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.203+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 msgr2=0x7f6ee8112cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:43.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.203+0000 7f6eed905700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee8112cb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00b3b0 tx=0x7f6edc009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 shutdown_connections 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f6ed00692a0 0x7f6ed006b750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ee80fd2a0 0x7f6ee8110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 --2- 172.21.15.46:0/3692024664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ee80fdbf0 0x7f6ee8112cb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 >> 172.21.15.46:0/3692024664 conn(0x7f6ee80f6b80 msgr2=0x7f6ee80f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 shutdown_connections 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:43.204+0000 7f6eed905700 1 -- 172.21.15.46:0/3692024664 wait complete. 2024-05-09T06:27:43.187 INFO:teuthology.orchestra.run.smithi046.stderr:inline data enabled 2024-05-09T06:27:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3692024664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:27:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-05-09T06:27:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:boot 2024-05-09T06:27:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3692024664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:27:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:27:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:43 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:27:43.849 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:27:43.858 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:27:43.858 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3692024664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:boot 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3692024664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:27:44.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:27:44.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:43 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:27:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:45.233 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:45 smithi046 ceph-mon[26924]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T06:27:45.233 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:45 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:45 smithi106 ceph-mon[34679]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T06:27:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:45 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:46.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:standby 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:standby 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: Dropping low affinity active daemon mds.cephfs.smithi046.easboa in favor of higher affinity standby. 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: Replacing daemon mds.cephfs.smithi046.easboa as rank 0 with standby daemon mds.cephfs.smithi046.pkuwsr 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: osdmap e46: 6 total, 6 up, 6 in 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: fsmap cephfs:1/1 {0=cephfs.smithi046.pkuwsr=up:replay} 2 up:standby 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:46.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:46 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:46.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:standby 2024-05-09T06:27:46.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:standby 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: Dropping low affinity active daemon mds.cephfs.smithi046.easboa in favor of higher affinity standby. 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: Replacing daemon mds.cephfs.smithi046.easboa as rank 0 with standby daemon mds.cephfs.smithi046.pkuwsr 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: osdmap e46: 6 total, 6 up, 6 in 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: fsmap cephfs:1/1 {0=cephfs.smithi046.pkuwsr=up:replay} 2 up:standby 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:46.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:46 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:47.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:47 smithi046 ceph-mon[26924]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 614 B/s wr, 2 op/s 2024-05-09T06:27:47.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:47 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:reconnect 2024-05-09T06:27:47.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:47 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] up:boot 2024-05-09T06:27:47.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:47 smithi046 ceph-mon[26924]: fsmap cephfs:1/1 {0=cephfs.smithi046.pkuwsr=up:reconnect} 3 up:standby 2024-05-09T06:27:47.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:47 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:27:47.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:47 smithi106 ceph-mon[34679]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 614 B/s wr, 2 op/s 2024-05-09T06:27:47.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:47 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:reconnect 2024-05-09T06:27:47.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:47 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] up:boot 2024-05-09T06:27:47.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:47 smithi106 ceph-mon[34679]: fsmap cephfs:1/1 {0=cephfs.smithi046.pkuwsr=up:reconnect} 3 up:standby 2024-05-09T06:27:47.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:47 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/14712849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fce60 msgr2=0x7fa1f80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/14712849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fce60 0x7fa1f80fd270 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8004940 tx=0x7fa1e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/14712849 shutdown_connections 2024-05-09T06:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/14712849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/14712849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fce60 0x7fa1f80fd270 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/14712849 >> 172.21.15.46:0/14712849 conn(0x7fa1f80f8540 msgr2=0x7fa1f80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/14712849 shutdown_connections 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.984+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/14712849 wait complete. 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1fd7d8700 1 Processor -- start 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1fd7d8700 1 -- start start 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1fd7d8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f80fce60 0x7fa1f810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1fd7d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f810de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1fd7d8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f810e500 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1fd7d8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8112ea0 con 0x7fa1f80fce60 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1f67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f810de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1f67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f810de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38108/0 (socket says 172.21.15.46:38108) 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1f67fc700 1 -- 172.21.15.46:0/924657844 learned_addr learned my addr 172.21.15.46:0/924657844 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.985+0000 7fa1f6ffd700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f80fce60 0x7fa1f810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1f67fc700 1 -- 172.21.15.46:0/924657844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f80fce60 msgr2=0x7fa1f810d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1f67fc700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f80fce60 0x7fa1f810d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1f67fc700 1 -- 172.21.15.46:0/924657844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8005040 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1f67fc700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f810de70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b790 tx=0x7fa1ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1ec00f770 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f8113100 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1ec00fda0 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f8113670 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.986+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1ec00d310 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.987+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f804c710 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.988+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa1ec010420 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.988+0000 7fa1df7fe700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fa1e00692a0 0x7fa1e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.988+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa1ec087120 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.988+0000 7fa1f6ffd700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fa1e00692a0 0x7fa1e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.989+0000 7fa1f6ffd700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fa1e00692a0 0x7fa1e006b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800b3b0 tx=0x7fa1e8009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:47.993+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa1ec056f30 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.244+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1f8113b80 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.227 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:48 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:rejoin 2024-05-09T06:27:48.227 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:48 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:standby 2024-05-09T06:27:48.228 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:48 smithi046 ceph-mon[26924]: fsmap cephfs:1/1 {0=cephfs.smithi046.pkuwsr=up:rejoin} 3 up:standby 2024-05-09T06:27:48.228 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:48 smithi046 ceph-mon[26924]: daemon mds.cephfs.smithi046.pkuwsr is now active in filesystem cephfs as rank 0 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.245+0000 7fa1df7fe700 1 -- 172.21.15.46:0/924657844 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1811 (secure 0 0 0) 0x7fa1ec056ac0 con 0x7fa1f80fdfd0 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:48.228 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:27:48.229 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:27:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:48.231 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:48.231 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:48.231 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fa1e00692a0 msgr2=0x7fa1e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fa1e00692a0 0x7fa1e006b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800b3b0 tx=0x7fa1e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 msgr2=0x7fa1f810de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f810de70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b790 tx=0x7fa1ec009250 comp rx=0 tx=0).stop 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 shutdown_connections 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fa1e00692a0 0x7fa1e006b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f80fce60 0x7fa1f810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 --2- 172.21.15.46:0/924657844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80fdfd0 0x7fa1f810de70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 >> 172.21.15.46:0/924657844 conn(0x7fa1f80f8540 msgr2=0x7fa1f80f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 shutdown_connections 2024-05-09T06:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:48.248+0000 7fa1fd7d8700 1 -- 172.21.15.46:0/924657844 wait complete. 2024-05-09T06:27:48.233 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:27:48.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:48 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:rejoin 2024-05-09T06:27:48.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:48 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:standby 2024-05-09T06:27:48.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:48 smithi106 ceph-mon[34679]: fsmap cephfs:1/1 {0=cephfs.smithi046.pkuwsr=up:rejoin} 3 up:standby 2024-05-09T06:27:48.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:48 smithi106 ceph-mon[34679]: daemon mds.cephfs.smithi046.pkuwsr is now active in filesystem cephfs as rank 0 2024-05-09T06:27:49.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:49 smithi046 ceph-mon[26924]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 307 B/s wr, 2 op/s 2024-05-09T06:27:49.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:49 smithi046 ceph-mon[26924]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:27:49.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:49 smithi046 ceph-mon[26924]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:active 2024-05-09T06:27:49.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:49 smithi046 ceph-mon[26924]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:27:49.192 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:49 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/924657844' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:49.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-05-09T06:27:49.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:49 smithi106 ceph-mon[34679]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 307 B/s wr, 2 op/s 2024-05-09T06:27:49.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:49 smithi106 ceph-mon[34679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:27:49.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:49 smithi106 ceph-mon[34679]: mds.? [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] up:active 2024-05-09T06:27:49.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:49 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:27:49.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:49 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/924657844' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:27:49.926 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:51.257 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:51 smithi046 ceph-mon[26924]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-09T06:27:51.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:51 smithi106 ceph-mon[34679]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-09T06:27:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 -- 172.21.15.46:0/3167620216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 msgr2=0x7ff6bc0fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/3167620216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc0fe7f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8004940 tx=0x7ff6b8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 -- 172.21.15.46:0/3167620216 shutdown_connections 2024-05-09T06:27:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/3167620216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6bc0fed30 0x7ff6bc0fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/3167620216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc0fe7f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 -- 172.21.15.46:0/3167620216 >> 172.21.15.46:0/3167620216 conn(0x7ff6bc0f6b80 msgr2=0x7ff6bc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 -- 172.21.15.46:0/3167620216 shutdown_connections 2024-05-09T06:27:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.641+0000 7ff6c32ff700 1 -- 172.21.15.46:0/3167620216 wait complete. 2024-05-09T06:27:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c32ff700 1 Processor -- start 2024-05-09T06:27:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c32ff700 1 -- start start 2024-05-09T06:27:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c32ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c32ff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6bc0fed30 0x7ff6bc10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c32ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc10e4b0 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c32ff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc10ed00 con 0x7ff6bc0fed30 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c109b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c109b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc10d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41700/0 (socket says 172.21.15.46:41700) 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.642+0000 7ff6c109b700 1 -- 172.21.15.46:0/1364435482 learned_addr learned my addr 172.21.15.46:0/1364435482 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c089a700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6bc0fed30 0x7ff6bc10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c109b700 1 -- 172.21.15.46:0/1364435482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6bc0fed30 msgr2=0x7ff6bc10deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c109b700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6bc0fed30 0x7ff6bc10deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c109b700 1 -- 172.21.15.46:0/1364435482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8005040 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c109b700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc10d970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8013870 tx=0x7ff6b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b8021070 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6b8009430 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc10ef80 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b800e070 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.643+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc10f4c0 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.644+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc05f5c0 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.645+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff6b8026410 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.645+0000 7ff6b1ffb700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff6a8069230 0x7ff6a806b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.645+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff6b80884f0 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.645+0000 7ff6c089a700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff6a8069230 0x7ff6a806b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.646+0000 7ff6c089a700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff6a8069230 0x7ff6a806b6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009b80 tx=0x7ff6ac00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.650+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff6b8058260 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.895+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6bc04bed0 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.895+0000 7ff6b1ffb700 1 -- 172.21.15.46:0/1364435482 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4694 (secure 0 0 0) 0x7ff6b8057df0 con 0x7ff6bc0fe3e0 2024-05-09T06:27:51.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff6a8069230 msgr2=0x7ff6a806b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:51.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff6a8069230 0x7ff6a806b6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009b80 tx=0x7ff6ac00b040 comp rx=0 tx=0).stop 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 msgr2=0x7ff6bc10d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc10d970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8013870 tx=0x7ff6b8009e30 comp rx=0 tx=0).stop 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 shutdown_connections 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7ff6a8069230 0x7ff6a806b6e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6bc0fe3e0 0x7ff6bc10d970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 --2- 172.21.15.46:0/1364435482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6bc0fed30 0x7ff6bc10deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 >> 172.21.15.46:0/1364435482 conn(0x7ff6bc0f6b80 msgr2=0x7ff6bc0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 shutdown_connections 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:51.898+0000 7ff6c32ff700 1 -- 172.21.15.46:0/1364435482 wait complete. 2024-05-09T06:27:51.881 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:27:51.894 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1364435482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:27:52.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:52 smithi046 ceph-mon[26924]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:27:52.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-05-09T06:27:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:27:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:27:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:27:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1364435482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:27:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:52 smithi106 ceph-mon[34679]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:27:53.384 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:55.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:55.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:55.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:54 smithi106 ceph-mon[34679]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:27:55.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:55.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:55.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:55.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:55.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:54 smithi046 ceph-mon[26924]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:27:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:27:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 -- 172.21.15.46:0/72343028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fbcb0 msgr2=0x7fe2700fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 --2- 172.21.15.46:0/72343028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fbcb0 0x7fe2700fc0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009ce0 tx=0x7fe26c004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 -- 172.21.15.46:0/72343028 shutdown_connections 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 --2- 172.21.15.46:0/72343028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2700fcf60 0x7fe2700fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 --2- 172.21.15.46:0/72343028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fbcb0 0x7fe2700fc0c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 -- 172.21.15.46:0/72343028 >> 172.21.15.46:0/72343028 conn(0x7fe2700f7430 msgr2=0x7fe2700f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 -- 172.21.15.46:0/72343028 shutdown_connections 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.592+0000 7fe278648700 1 -- 172.21.15.46:0/72343028 wait complete. 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe278648700 1 Processor -- start 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe278648700 1 -- start start 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe278648700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2700fbcb0 0x7fe270104490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe278648700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 0x7fe270102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:55.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe278648700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270102f10 con 0x7fe2700fcf60 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe278648700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270103080 con 0x7fe2700fbcb0 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe275be3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 0x7fe270102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe275be3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 0x7fe270102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41718/0 (socket says 172.21.15.46:41718) 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe275be3700 1 -- 172.21.15.46:0/3964080507 learned_addr learned my addr 172.21.15.46:0/3964080507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.593+0000 7fe2763e4700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2700fbcb0 0x7fe270104490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe275be3700 1 -- 172.21.15.46:0/3964080507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2700fbcb0 msgr2=0x7fe270104490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe275be3700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2700fbcb0 0x7fe270104490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe275be3700 1 -- 172.21.15.46:0/3964080507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c009940 con 0x7fe2700fcf60 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe275be3700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 0x7fe270102960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe260002a50 tx=0x7fe2600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe260007cc0 con 0x7fe2700fcf60 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270103360 con 0x7fe2700fcf60 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe26000f040 con 0x7fe2700fcf60 2024-05-09T06:27:55.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26000da30 con 0x7fe2700fcf60 2024-05-09T06:27:55.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.594+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270115ba0 con 0x7fe2700fcf60 2024-05-09T06:27:55.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.595+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27005f5c0 con 0x7fe2700fcf60 2024-05-09T06:27:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.596+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe26000db90 con 0x7fe2700fcf60 2024-05-09T06:27:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.596+0000 7fe266ffd700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe25c0692a0 0x7fe25c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.596+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe260086fa0 con 0x7fe2700fcf60 2024-05-09T06:27:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.596+0000 7fe2763e4700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe25c0692a0 0x7fe25c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:55.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.597+0000 7fe2763e4700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe25c0692a0 0x7fe25c06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009470 tx=0x7fe26c004d10 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:55.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.601+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe260053200 con 0x7fe2700fcf60 2024-05-09T06:27:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.888+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fe270115dc0 con 0x7fe2700fcf60 2024-05-09T06:27:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.888+0000 7fe266ffd700 1 -- 172.21.15.46:0/3964080507 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+99 (secure 0 0 0) 0x7fe260056820 con 0x7fe2700fcf60 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe25c0692a0 msgr2=0x7fe25c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe25c0692a0 0x7fe25c06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009470 tx=0x7fe26c004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 msgr2=0x7fe270102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 0x7fe270102960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe260002a50 tx=0x7fe2600046b0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 shutdown_connections 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fe25c0692a0 0x7fe25c06b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2700fbcb0 0x7fe270104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 --2- 172.21.15.46:0/3964080507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2700fcf60 0x7fe270102960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.890+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 >> 172.21.15.46:0/3964080507 conn(0x7fe2700f7430 msgr2=0x7fe2700f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.891+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 shutdown_connections 2024-05-09T06:27:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:55.891+0000 7fe278648700 1 -- 172.21.15.46:0/3964080507 wait complete. 2024-05-09T06:27:55.883 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:27:56.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:55 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3964080507' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-09T06:27:56.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:55 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3964080507' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-05-09T06:27:56.764 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-05-09T06:27:56.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T06:27:57.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:57 smithi046 ceph-mon[26924]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:27:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:57 smithi106 ceph-mon[34679]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-05-09T06:27:57.494 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:27:59.198 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:27:59 smithi046 ceph-mon[26924]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-09T06:27:59.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:27:59 smithi106 ceph-mon[34679]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-09T06:27:59.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.729+0000 7f37a0c22700 1 -- 172.21.15.46:0/2632128352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 msgr2=0x7f379c103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:59.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.729+0000 7f37a0c22700 1 --2- 172.21.15.46:0/2632128352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c103220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f378c009ce0 tx=0x7f378c004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:59.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 -- 172.21.15.46:0/2632128352 shutdown_connections 2024-05-09T06:27:59.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 --2- 172.21.15.46:0/2632128352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f379c065640 0x7f379c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 --2- 172.21.15.46:0/2632128352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c103220 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 -- 172.21.15.46:0/2632128352 >> 172.21.15.46:0/2632128352 conn(0x7f379c071d00 msgr2=0x7f379c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:59.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 -- 172.21.15.46:0/2632128352 shutdown_connections 2024-05-09T06:27:59.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 -- 172.21.15.46:0/2632128352 wait complete. 2024-05-09T06:27:59.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 Processor -- start 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.730+0000 7f37a0c22700 1 -- start start 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f37a0c22700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f379c065640 0x7f379c113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f37a0c22700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c114290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f37a0c22700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c1148e0 con 0x7f379c102e50 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f37a0c22700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c10dcb0 con 0x7f379c065640 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c114290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c114290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41736/0 (socket says 172.21.15.46:41736) 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 -- 172.21.15.46:0/868395076 learned_addr learned my addr 172.21.15.46:0/868395076 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f379a59c700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f379c065640 0x7f379c113d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 -- 172.21.15.46:0/868395076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f379c065640 msgr2=0x7f379c113d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f379c065640 0x7f379c113d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 -- 172.21.15.46:0/868395076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c009940 con 0x7f379c102e50 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f3799d9b700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c114290 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f379000c8c0 tx=0x7f37900044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:59.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f379000a980 con 0x7f379c102e50 2024-05-09T06:27:59.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f379000ce60 con 0x7f379c102e50 2024-05-09T06:27:59.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c10df90 con 0x7f379c102e50 2024-05-09T06:27:59.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37900115e0 con 0x7f379c102e50 2024-05-09T06:27:59.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.731+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c10e550 con 0x7f379c102e50 2024-05-09T06:27:59.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.732+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c100100 con 0x7f379c102e50 2024-05-09T06:27:59.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.733+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3790012400 con 0x7f379c102e50 2024-05-09T06:27:59.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.733+0000 7f378affd700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f37840692b0 0x7f378406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:27:59.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.734+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f37900872f0 con 0x7f379c102e50 2024-05-09T06:27:59.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.734+0000 7f379a59c700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f37840692b0 0x7f378406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:27:59.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.734+0000 7f379a59c700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f37840692b0 0x7f378406b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f378c00b740 tx=0x7f378c004d10 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:27:59.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.738+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3790057060 con 0x7f379c102e50 2024-05-09T06:27:59.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.977+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f379c10f3a0 con 0x7f379c102e50 2024-05-09T06:27:59.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.978+0000 7f378affd700 1 -- 172.21.15.46:0/868395076 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4694 (secure 0 0 0) 0x7f37900126b0 con 0x7f379c102e50 2024-05-09T06:27:59.960 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:27:59.960 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14502,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1596433396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1596433396},{"type":"v1","addr":"172.21.15.46:6827","nonce":1596433396}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:27:48.012161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi046.pkuwsr","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6829/3210268761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3210268761},{"type":"v1","addr":"172.21.15.46:6829","nonce":3210268761}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-05-09T06:27:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f37840692b0 msgr2=0x7f378406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f37840692b0 0x7f378406b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f378c00b740 tx=0x7f378c004d10 comp rx=0 tx=0).stop 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 msgr2=0x7f379c114290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c114290 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f379000c8c0 tx=0x7f37900044c0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 shutdown_connections 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f37840692b0 0x7f378406b760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f379c065640 0x7f379c113d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 --2- 172.21.15.46:0/868395076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f379c102e50 0x7f379c114290 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 >> 172.21.15.46:0/868395076 conn(0x7f379c071d00 msgr2=0x7f379c0fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 shutdown_connections 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:27:59.980+0000 7f37a0c22700 1 -- 172.21.15.46:0/868395076 wait complete. 2024-05-09T06:27:59.963 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:28:00.601 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 18} 2024-05-09T06:28:00.601 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T06:28:00.625 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T06:28:00.625 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-05-09T06:28:00.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:00.625 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-05-09T06:28:00.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:00.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-05-09T06:28:00.717 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-05-09T06:28:00.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:28:00.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:00.719 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-09T06:28:00.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:00.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-05-09T06:28:00.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:00.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:00.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:28:00.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:28:00.807 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:00.807 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-09T06:28:00.807 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:00 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/868395076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:28:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-05-09T06:28:00.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:28:00.816 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-09T06:28:00.816 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T06:28:00.816 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:00.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T06:28:00.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:00.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:00.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:28:00.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:28:00.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:00.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-05-09T06:28:00.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:00 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/868395076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:28:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 -- 172.21.15.46:0/459089736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20380fb520 msgr2=0x7f20380fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 --2- 172.21.15.46:0/459089736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20380fb520 0x7f20380fb990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f202c004940 tx=0x7f202c009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 -- 172.21.15.46:0/459089736 shutdown_connections 2024-05-09T06:28:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 --2- 172.21.15.46:0/459089736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20380fb520 0x7f20380fb990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:02.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 --2- 172.21.15.46:0/459089736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2038102f60 0x7f2038103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 -- 172.21.15.46:0/459089736 >> 172.21.15.46:0/459089736 conn(0x7f20380714d0 msgr2=0x7f20380718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 -- 172.21.15.46:0/459089736 shutdown_connections 2024-05-09T06:28:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 -- 172.21.15.46:0/459089736 wait complete. 2024-05-09T06:28:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.720+0000 7f203efb2700 1 Processor -- start 2024-05-09T06:28:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f203efb2700 1 -- start start 2024-05-09T06:28:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f203efb2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380fb520 0x7f2038115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f203efb2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 0x7f2038116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f203efb2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2038116780 con 0x7f2038102f60 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f203efb2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203810fd60 con 0x7f20380fb520 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f2037fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 0x7f2038116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f2037fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 0x7f2038116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32952/0 (socket says 172.21.15.46:32952) 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f2037fff700 1 -- 172.21.15.46:0/758235279 learned_addr learned my addr 172.21.15.46:0/758235279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.721+0000 7f203cd4e700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380fb520 0x7f2038115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f2037fff700 1 -- 172.21.15.46:0/758235279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380fb520 msgr2=0x7f2038115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f2037fff700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380fb520 0x7f2038115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f2037fff700 1 -- 172.21.15.46:0/758235279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c005040 con 0x7f2038102f60 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f2037fff700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 0x7f2038116130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f202c00b8b0 tx=0x7f202c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202c00e040 con 0x7f2038102f60 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203810ffe0 con 0x7f2038102f60 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f202c004290 con 0x7f2038102f60 2024-05-09T06:28:02.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2038110520 con 0x7f2038102f60 2024-05-09T06:28:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.722+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f202c01c3f0 con 0x7f2038102f60 2024-05-09T06:28:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.723+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20240052b0 con 0x7f2038102f60 2024-05-09T06:28:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.724+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f202c00baf0 con 0x7f2038102f60 2024-05-09T06:28:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.724+0000 7f20357fa700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f20200692a0 0x7f202006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.724+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f202c088450 con 0x7f2038102f60 2024-05-09T06:28:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.724+0000 7f203cd4e700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f20200692a0 0x7f202006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.725+0000 7f203cd4e700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f20200692a0 0x7f202006b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2028009fd0 tx=0x7f2028009f20 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.729+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f202c0581c0 con 0x7f2038102f60 2024-05-09T06:28:02.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.971+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2024005d70 con 0x7f2038102f60 2024-05-09T06:28:02.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.972+0000 7f20357fa700 1 -- 172.21.15.46:0/758235279 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f202c057d50 con 0x7f2038102f60 2024-05-09T06:28:02.955 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f20200692a0 msgr2=0x7f202006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f20200692a0 0x7f202006b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2028009fd0 tx=0x7f2028009f20 comp rx=0 tx=0).stop 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 msgr2=0x7f2038116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 0x7f2038116130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f202c00b8b0 tx=0x7f202c009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 shutdown_connections 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f20200692a0 0x7f202006b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380fb520 0x7f2038115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 --2- 172.21.15.46:0/758235279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2038102f60 0x7f2038116130 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 >> 172.21.15.46:0/758235279 conn(0x7f20380714d0 msgr2=0x7f20380fa640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:02.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 shutdown_connections 2024-05-09T06:28:02.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:02.974+0000 7f203efb2700 1 -- 172.21.15.46:0/758235279 wait complete. 2024-05-09T06:28:03.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:03 smithi046 ceph-mon[26924]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-09T06:28:03.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:03 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/758235279' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:28:03.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:03 smithi106 ceph-mon[34679]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-05-09T06:28:03.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:03 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/758235279' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:28:03.567 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T06:28:03.567 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T06:28:03.568 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T06:28:03.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:03.568 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:28:03.625 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42253sec preferred_lft 42253sec 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:03.626 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-05-09T06:28:03.627 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T06:28:03.627 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T06:28:03.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:03.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:03.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:03.835 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T06:28:03.862 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-05-09T06:28:03.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:03.863 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-05-09T06:28:03.937 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-05-09T06:28:03.938 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T06:28:03.938 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-09T06:28:03.938 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-09T06:28:03.938 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T06:28:03.938 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:03.938 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T06:28:03.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-09T06:28:03.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-09T06:28:03.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-09T06:28:03.939 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T06:28:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:04.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:04.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:04.234 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-05-09T06:28:04.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:04.251 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-05-09T06:28:04.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:04.307 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T06:28:04.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T06:28:04.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T06:28:04.307 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T06:28:04.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:04.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:04.427 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T06:28:04.427 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:04.427 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T06:28:04.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T06:28:04.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T06:28:04.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T06:28:04.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T06:28:04.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T06:28:04.428 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T06:28:04.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:04.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:04.569 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:04.569 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-05-09T06:28:04.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-05-09T06:28:04.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T06:28:04.569 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-05-09T06:28:04.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:04.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:04.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:28:04.650 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:04.666 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T06:28:04.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:28:04.666 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:04.722 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T06:28:04.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:04.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:28:04.826 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:28:04.826 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T06:28:04.826 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2024-05-09T06:28:04.957 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:28:04.958 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T06:28:04.958 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2024-05-09T06:28:04.958 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.106:3300" 2024-05-09T06:28:04.958 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.106:3300" 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.106:6789" 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.106:6789:/ 2024-05-09T06:28:04.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=165d9e0a-0dcc-11ef-bc97-c7b262605968" will pass to kernel 2024-05-09T06:28:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T06:28:04.966 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-05-09T06:28:04.966 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T06:28:04.966 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T06:28:04.966 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T06:28:04.967 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T06:28:04.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:04.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:04.993 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:28:05.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:05 smithi046 ceph-mon[26924]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2024-05-09T06:28:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:28:05.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:05.098 INFO:teuthology.orchestra.run.smithi046.stdout:client14524 2024-05-09T06:28:05.098 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:28:05.098 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:28:05.116 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:28:05.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:28:05.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:05.220 INFO:teuthology.orchestra.run.smithi046.stdout:client14524 2024-05-09T06:28:05.220 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:28:05.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:28:05.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:05.280 INFO:teuthology.orchestra.run.smithi046.stdout:client14524 2024-05-09T06:28:05.280 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968.client14524/status') 2024-05-09T06:28:05.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:05 smithi106 ceph-mon[34679]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2024-05-09T06:28:05.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.14524 (3)192.168.0.1:0/176593620 2024-05-09T06:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2024-05-09T06:28:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2024-05-09T06:28:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2024-05-09T06:28:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:69 bytes copied, 2.4917e-05 s, 2.8 MB/s 2024-05-09T06:28:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:05.348 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-09T06:28:05.348 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T06:28:05.349 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:05.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T06:28:05.618 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 -- 172.21.15.46:0/3453659354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 msgr2=0x7f4f2c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/3453659354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c102160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f20004940 tx=0x7f4f20009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 -- 172.21.15.46:0/3453659354 shutdown_connections 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/3453659354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f2c0fbd40 0x7f4f2c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/3453659354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c102160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 -- 172.21.15.46:0/3453659354 >> 172.21.15.46:0/3453659354 conn(0x7f4f2c071d00 msgr2=0x7f4f2c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 -- 172.21.15.46:0/3453659354 shutdown_connections 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 -- 172.21.15.46:0/3453659354 wait complete. 2024-05-09T06:28:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.230+0000 7f4f32f7a700 1 Processor -- start 2024-05-09T06:28:07.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f32f7a700 1 -- start start 2024-05-09T06:28:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f32f7a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f2c0fbd40 0x7f4f2c112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f32f7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f32f7a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c113590 con 0x7f4f2c101d90 2024-05-09T06:28:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f32f7a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c10c980 con 0x7f4f2c0fbd40 2024-05-09T06:28:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f2bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f2bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c112f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32970/0 (socket says 172.21.15.46:32970) 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f2bfff700 1 -- 172.21.15.46:0/1282005831 learned_addr learned my addr 172.21.15.46:0/1282005831 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f30d16700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f2c0fbd40 0x7f4f2c112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f2bfff700 1 -- 172.21.15.46:0/1282005831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f2c0fbd40 msgr2=0x7f4f2c112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f2bfff700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f2c0fbd40 0x7f4f2c112a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.231+0000 7f4f2bfff700 1 -- 172.21.15.46:0/1282005831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20005040 con 0x7f4f2c101d90 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.232+0000 7f4f2bfff700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c112f40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800eb40 tx=0x7f4f1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.232+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f18007cc0 con 0x7f4f2c101d90 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.232+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f1800f040 con 0x7f4f2c101d90 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.232+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c10cc00 con 0x7f4f2c101d90 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.232+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f18009620 con 0x7f4f2c101d90 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.232+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c10d140 con 0x7f4f2c101d90 2024-05-09T06:28:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.233+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c0fd430 con 0x7f4f2c101d90 2024-05-09T06:28:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.233+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4f18009780 con 0x7f4f2c101d90 2024-05-09T06:28:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.234+0000 7f4f297fa700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4f1c0692a0 0x7f4f1c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.234+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4f18086df0 con 0x7f4f2c101d90 2024-05-09T06:28:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.234+0000 7f4f30d16700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4f1c0692a0 0x7f4f1c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.235+0000 7f4f30d16700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4f1c0692a0 0x7f4f1c06b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000b0d0 tx=0x7f4f20009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.238+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4f1804e250 con 0x7f4f2c101d90 2024-05-09T06:28:07.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:07 smithi106 ceph-mon[34679]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:07.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:07 smithi046 ceph-mon[26924]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:07.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.478+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f2c108df0 con 0x7f4f2c101d90 2024-05-09T06:28:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.478+0000 7f4f297fa700 1 -- 172.21.15.46:0/1282005831 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f4f18056c10 con 0x7f4f2c101d90 2024-05-09T06:28:07.461 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4f1c0692a0 msgr2=0x7f4f1c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4f1c0692a0 0x7f4f1c06b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000b0d0 tx=0x7f4f20009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 msgr2=0x7f4f2c112f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c112f40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800eb40 tx=0x7f4f1800b040 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 shutdown_connections 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f4f1c0692a0 0x7f4f1c06b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f2c0fbd40 0x7f4f2c112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 --2- 172.21.15.46:0/1282005831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f2c101d90 0x7f4f2c112f40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 >> 172.21.15.46:0/1282005831 conn(0x7f4f2c071d00 msgr2=0x7f4f2c0fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:07.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 shutdown_connections 2024-05-09T06:28:07.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:07.480+0000 7f4f32f7a700 1 -- 172.21.15.46:0/1282005831 wait complete. 2024-05-09T06:28:08.039 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:08 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1282005831' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T06:28:08.067 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-09T06:28:08.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:08.067 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:28:08.087 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42262sec preferred_lft 42262sec 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-05-09T06:28:08.088 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-05-09T06:28:08.088 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T06:28:08.088 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:08.088 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-09T06:28:08.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-05-09T06:28:08.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-05-09T06:28:08.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-05-09T06:28:08.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T06:28:08.089 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-09T06:28:08.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:08.258 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:08 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1282005831' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T06:28:08.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:08.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:08.301 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T06:28:08.327 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-05-09T06:28:08.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:08.330 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-05-09T06:28:08.398 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-05-09T06:28:08.398 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T06:28:08.398 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T06:28:08.398 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T06:28:08.399 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T06:28:08.399 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:08.399 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-09T06:28:08.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T06:28:08.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T06:28:08.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T06:28:08.399 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-09T06:28:08.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:08.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:08.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:08.699 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-09T06:28:08.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:08.715 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-05-09T06:28:08.770 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:08.770 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-09T06:28:08.770 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T06:28:08.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-09T06:28:08.771 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-09T06:28:08.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:08.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:08.890 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-09T06:28:08.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-09T06:28:08.891 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-09T06:28:08.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:09.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:09.022 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T06:28:09.022 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-05-09T06:28:09.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-05-09T06:28:09.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T06:28:09.022 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-05-09T06:28:09.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:09.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:09.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:28:09.099 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:09.114 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-09T06:28:09.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T06:28:09.114 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:09.170 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T06:28:09.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:09.170 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:28:09.231 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:09 smithi106 ceph-mon[34679]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:09.231 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:09 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:09.273 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:28:09.273 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T06:28:09.274 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2024-05-09T06:28:09.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:09 smithi046 ceph-mon[26924]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:09.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:09.390 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:28:09.390 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T06:28:09.390 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2024-05-09T06:28:09.390 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.106:3300" 2024-05-09T06:28:09.390 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:28:09.395 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T06:28:09.395 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T06:28:09.395 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2024-05-09T06:28:09.395 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.106:3300" 2024-05-09T06:28:09.395 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T06:28:09.395 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.106:6789" 2024-05-09T06:28:09.396 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.106:6789:/ 2024-05-09T06:28:09.396 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=165d9e0a-0dcc-11ef-bc97-c7b262605968" will pass to kernel 2024-05-09T06:28:09.399 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-09T06:28:09.399 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2024-05-09T06:28:09.399 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T06:28:09.399 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T06:28:09.400 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T06:28:09.401 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T06:28:09.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:28:09.401 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:09.468 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:28:09.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:28:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:09.565 INFO:teuthology.orchestra.run.smithi106.stdout:client14530 2024-05-09T06:28:09.565 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:28:09.565 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:28:09.581 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:28:09.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:28:09.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:09.677 INFO:teuthology.orchestra.run.smithi106.stdout:client14530 2024-05-09T06:28:09.678 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T06:28:09.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T06:28:09.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:09.734 INFO:teuthology.orchestra.run.smithi106.stdout:client14530 2024-05-09T06:28:09.734 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968.client14530/status') 2024-05-09T06:28:09.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T06:28:09.792 INFO:teuthology.orchestra.run.smithi106.stdout:instance: client.14530 (3)172.21.15.106:0/655094447 2024-05-09T06:28:09.792 INFO:teuthology.orchestra.run.smithi106.stdout:blocklisted: false 2024-05-09T06:28:09.793 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records in 2024-05-09T06:28:09.793 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records out 2024-05-09T06:28:09.793 INFO:teuthology.orchestra.run.smithi106.stderr:71 bytes copied, 2.3567e-05 s, 3.0 MB/s 2024-05-09T06:28:09.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-09T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T06:28:09.800 INFO:teuthology.run_tasks:Running task print... 2024-05-09T06:28:09.810 INFO:teuthology.task.print:**** done client 2024-05-09T06:28:09.810 INFO:teuthology.run_tasks:Running task parallel... 2024-05-09T06:28:09.819 INFO:teuthology.task.parallel:starting parallel... 2024-05-09T06:28:09.820 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-09T06:28:09.820 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:28:09.821 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:28:09.821 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-09T06:28:09.821 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-09T06:28:09.821 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-09T06:28:09.825 INFO:tasks.workunit:Pulling workunits from ref 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:09.825 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T06:28:09.825 INFO:tasks.workunit:timeout=3h 2024-05-09T06:28:09.825 INFO:tasks.workunit:cleanup=True 2024-05-09T06:28:09.825 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 85h/133d Inode: 1 Links: 2 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-09 06:27:34.171347960 +0000 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-09 06:28:05.009612890 +0000 2024-05-09T06:28:09.848 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-09 06:27:34.171347960 +0000 2024-05-09T06:28:09.848 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T06:28:09.849 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T06:28:09.920 DEBUG:teuthology.orchestra.run.smithi106:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6fh/111d Inode: 1 Links: 3 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-09 06:28:09.933559731 +0000 2024-05-09T06:28:09.937 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-09 06:28:09.933559731 +0000 2024-05-09T06:28:09.938 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-05-09 06:27:34.171347960 +0000 2024-05-09T06:28:09.938 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-09T06:28:09.938 DEBUG:teuthology.orchestra.run.smithi106:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-09T06:28:10.005 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:10.006 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:10.022 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T06:28:10.062 INFO:tasks.workunit.client.1.smithi106.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-09T06:28:10.118 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:11.188 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:11 smithi046 ceph-mon[26924]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:11.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:11 smithi106 ceph-mon[34679]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:11.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 -- 172.21.15.46:0/785255116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 msgr2=0x7f0b700fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:11.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 --2- 172.21.15.46:0/785255116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b700fd3e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b58004940 tx=0x7f0b58009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:11.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 -- 172.21.15.46:0/785255116 shutdown_connections 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 --2- 172.21.15.46:0/785255116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b700fd3e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 --2- 172.21.15.46:0/785255116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b700fbcc0 0x7f0b700fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 -- 172.21.15.46:0/785255116 >> 172.21.15.46:0/785255116 conn(0x7f0b700f7440 msgr2=0x7f0b700f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 -- 172.21.15.46:0/785255116 shutdown_connections 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.695+0000 7f0b7696d700 1 -- 172.21.15.46:0/785255116 wait complete. 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b7696d700 1 Processor -- start 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b7696d700 1 -- start start 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b7696d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b700fbcc0 0x7f0b7010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b7696d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b7010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b7696d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7010e520 con 0x7f0b700fcf70 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b7696d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7010e690 con 0x7f0b700fbcc0 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b7010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b7010df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57006/0 (socket says 172.21.15.46:57006) 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 -- 172.21.15.46:0/2474870926 learned_addr learned my addr 172.21.15.46:0/2474870926 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:11.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b6ffff700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b700fbcc0 0x7f0b7010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 -- 172.21.15.46:0/2474870926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b700fbcc0 msgr2=0x7f0b7010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b700fbcc0 0x7f0b7010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 -- 172.21.15.46:0/2474870926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58005040 con 0x7f0b700fcf70 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.696+0000 7f0b67fff700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b7010df20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009380 tx=0x7f0b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.697+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5800e040 con 0x7f0b700fcf70 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.697+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b5800bd90 con 0x7f0b700fcf70 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.697+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70112fa0 con 0x7f0b700fcf70 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.697+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5801c630 con 0x7f0b700fcf70 2024-05-09T06:28:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.697+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b70113530 con 0x7f0b700fcf70 2024-05-09T06:28:11.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.698+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b70101b00 con 0x7f0b700fcf70 2024-05-09T06:28:11.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.698+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0b580139f0 con 0x7f0b700fcf70 2024-05-09T06:28:11.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.699+0000 7f0b6d7fa700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0b5c0692a0 0x7f0b5c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:11.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.699+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0b580884e0 con 0x7f0b700fcf70 2024-05-09T06:28:11.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.699+0000 7f0b6ffff700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0b5c0692a0 0x7f0b5c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:11.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.700+0000 7f0b6ffff700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0b5c0692a0 0x7f0b5c06b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009fd0 tx=0x7f0b60009f60 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:11.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.703+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0b580582f0 con 0x7f0b700fcf70 2024-05-09T06:28:11.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.903+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0b7004c710 con 0x7f0b700fcf70 2024-05-09T06:28:11.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.904+0000 7f0b6d7fa700 1 -- 172.21.15.46:0/2474870926 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0b58057e80 con 0x7f0b700fcf70 2024-05-09T06:28:11.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0b5c0692a0 msgr2=0x7f0b5c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:11.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0b5c0692a0 0x7f0b5c06b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009fd0 tx=0x7f0b60009f60 comp rx=0 tx=0).stop 2024-05-09T06:28:11.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 msgr2=0x7f0b7010df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b7010df20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009380 tx=0x7f0b58009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 shutdown_connections 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f0b5c0692a0 0x7f0b5c06b750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b700fbcc0 0x7f0b7010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 --2- 172.21.15.46:0/2474870926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b700fcf70 0x7f0b7010df20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 >> 172.21.15.46:0/2474870926 conn(0x7f0b700f7440 msgr2=0x7f0b700667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 shutdown_connections 2024-05-09T06:28:11.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:11.906+0000 7f0b7696d700 1 -- 172.21.15.46:0/2474870926 wait complete. 2024-05-09T06:28:12.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-09T06:28:12.854 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:13.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:13 smithi046 ceph-mon[26924]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:13.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:13 smithi106 ceph-mon[34679]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 -- 172.21.15.46:0/4189763141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240662c0 msgr2=0x7fef240ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 --2- 172.21.15.46:0/4189763141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240662c0 0x7fef240ff910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fef14004940 tx=0x7fef14009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 -- 172.21.15.46:0/4189763141 shutdown_connections 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 --2- 172.21.15.46:0/4189763141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240ffe50 0x7fef24102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 --2- 172.21.15.46:0/4189763141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240662c0 0x7fef240ff910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 -- 172.21.15.46:0/4189763141 >> 172.21.15.46:0/4189763141 conn(0x7fef240f7360 msgr2=0x7fef240f97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 -- 172.21.15.46:0/4189763141 shutdown_connections 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.580+0000 7fef2a986700 1 -- 172.21.15.46:0/4189763141 wait complete. 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef2a986700 1 Processor -- start 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef2a986700 1 -- start start 2024-05-09T06:28:14.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef2a986700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 0x7fef240fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef2a986700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 0x7fef240fb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef2a986700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240fbda0 con 0x7fef240ffe50 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef2a986700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240fbee0 con 0x7fef240662c0 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 0x7fef240fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef23fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 0x7fef240fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef23fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 0x7fef240fd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:46718/0 (socket says 172.21.15.46:46718) 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef23fff700 1 -- 172.21.15.46:0/2166629673 learned_addr learned my addr 172.21.15.46:0/2166629673 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:14.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.581+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 0x7fef240fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57026/0 (socket says 172.21.15.46:57026) 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef23fff700 1 -- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 msgr2=0x7fef240fb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef23fff700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 0x7fef240fb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef23fff700 1 -- 172.21.15.46:0/2166629673 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14005040 con 0x7fef240662c0 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef1bfff700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 0x7fef240fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef23fff700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 0x7fef240fd2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef14000c00 tx=0x7fef14009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1400e030 con 0x7fef240662c0 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef14013de0 con 0x7fef240662c0 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240fc160 con 0x7fef240662c0 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef1401ce50 con 0x7fef240662c0 2024-05-09T06:28:14.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.582+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef241159d0 con 0x7fef240662c0 2024-05-09T06:28:14.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.583+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2405f5c0 con 0x7fef240662c0 2024-05-09T06:28:14.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.584+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fef1401c400 con 0x7fef240662c0 2024-05-09T06:28:14.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.584+0000 7fef217fa700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef10069230 0x7fef1006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:14.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.584+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fef14088d40 con 0x7fef240662c0 2024-05-09T06:28:14.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.584+0000 7fef1bfff700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef10069230 0x7fef1006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:14.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.585+0000 7fef1bfff700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef10069230 0x7fef1006b6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef240fd8d0 tx=0x7fef0c00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.588+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fef14054f40 con 0x7fef240662c0 2024-05-09T06:28:14.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.815+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fef2404bed0 con 0x7fef240662c0 2024-05-09T06:28:14.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.816+0000 7fef217fa700 1 -- 172.21.15.46:0/2166629673 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fef2404bed0 con 0x7fef240662c0 2024-05-09T06:28:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef10069230 msgr2=0x7fef1006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef10069230 0x7fef1006b6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef240fd8d0 tx=0x7fef0c00b040 comp rx=0 tx=0).stop 2024-05-09T06:28:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 msgr2=0x7fef240fd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 0x7fef240fd2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef14000c00 tx=0x7fef14009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 shutdown_connections 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fef10069230 0x7fef1006b6e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef240662c0 0x7fef240fd2f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 --2- 172.21.15.46:0/2166629673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef240ffe50 0x7fef240fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 >> 172.21.15.46:0/2166629673 conn(0x7fef240f7360 msgr2=0x7fef240f77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 shutdown_connections 2024-05-09T06:28:14.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:14.818+0000 7fef2a986700 1 -- 172.21.15.46:0/2166629673 wait complete. 2024-05-09T06:28:15.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:15 smithi046 ceph-mon[26924]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:15.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:15 smithi106 ceph-mon[34679]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:15.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-09T06:28:15.755 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:17.253 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:17 smithi046 ceph-mon[26924]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:17.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:17 smithi106 ceph-mon[34679]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:17.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 -- 172.21.15.46:0/3722283391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fdfd0 msgr2=0x7f019c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 --2- 172.21.15.46:0/3722283391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fdfd0 0x7f019c0fe440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0184004940 tx=0x7f0184009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 -- 172.21.15.46:0/3722283391 shutdown_connections 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 --2- 172.21.15.46:0/3722283391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fdfd0 0x7f019c0fe440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 --2- 172.21.15.46:0/3722283391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f019c0fce60 0x7f019c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 -- 172.21.15.46:0/3722283391 >> 172.21.15.46:0/3722283391 conn(0x7f019c0f8560 msgr2=0x7f019c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 -- 172.21.15.46:0/3722283391 shutdown_connections 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.523+0000 7f01a272f700 1 -- 172.21.15.46:0/3722283391 wait complete. 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f01a272f700 1 Processor -- start 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f01a272f700 1 -- start start 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f01a272f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 0x7f019c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f01a272f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f019c0fdfd0 0x7f019c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f01a272f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c070860 con 0x7f019c0fce60 2024-05-09T06:28:17.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f01a272f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0709d0 con 0x7f019c0fdfd0 2024-05-09T06:28:17.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f019bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 0x7f019c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:17.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f019bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 0x7f019c071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57046/0 (socket says 172.21.15.46:57046) 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.524+0000 7f019bfff700 1 -- 172.21.15.46:0/1387526351 learned_addr learned my addr 172.21.15.46:0/1387526351 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f0193fff700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f019c0fdfd0 0x7f019c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f019bfff700 1 -- 172.21.15.46:0/1387526351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f019c0fdfd0 msgr2=0x7f019c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f019bfff700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f019c0fdfd0 0x7f019c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f019bfff700 1 -- 172.21.15.46:0/1387526351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184005040 con 0x7f019c0fce60 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f019bfff700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 0x7f019c071de0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f018c002a50 tx=0x7f018c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f018c007cc0 con 0x7f019c0fce60 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f018c00f040 con 0x7f019c0fce60 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f018c00da30 con 0x7f019c0fce60 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c070cb0 con 0x7f019c0fce60 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.525+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c115a00 con 0x7f019c0fce60 2024-05-09T06:28:17.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.526+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c05f5c0 con 0x7f019c0fce60 2024-05-09T06:28:17.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.527+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f018c00dbb0 con 0x7f019c0fce60 2024-05-09T06:28:17.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.528+0000 7f01997fa700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f01880692a0 0x7f018806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:17.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.528+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f018c0874c0 con 0x7f019c0fce60 2024-05-09T06:28:17.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.528+0000 7f0193fff700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f01880692a0 0x7f018806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:17.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.528+0000 7f0193fff700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f01880692a0 0x7f018806b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f018400b3b0 tx=0x7f0184009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:17.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.535+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f018c053840 con 0x7f019c0fce60 2024-05-09T06:28:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.738+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f019c1058c0 con 0x7f019c0fce60 2024-05-09T06:28:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.739+0000 7f01997fa700 1 -- 172.21.15.46:0/1387526351 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f018c056e60 con 0x7f019c0fce60 2024-05-09T06:28:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f01880692a0 msgr2=0x7f018806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f01880692a0 0x7f018806b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f018400b3b0 tx=0x7f0184009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 msgr2=0x7f019c071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 0x7f019c071de0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f018c002a50 tx=0x7f018c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 shutdown_connections 2024-05-09T06:28:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f01880692a0 0x7f018806b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f019c0fce60 0x7f019c071de0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 --2- 172.21.15.46:0/1387526351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f019c0fdfd0 0x7f019c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 >> 172.21.15.46:0/1387526351 conn(0x7f019c0f8560 msgr2=0x7f019c0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 shutdown_connections 2024-05-09T06:28:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:17.741+0000 7f01a272f700 1 -- 172.21.15.46:0/1387526351 wait complete. 2024-05-09T06:28:18.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-05-09T06:28:18.672 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:19.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:19 smithi106 ceph-mon[34679]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:19 smithi046 ceph-mon[26924]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 -- 172.21.15.46:0/3292963854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 msgr2=0x7f2b6c0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 --2- 172.21.15.46:0/3292963854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c0fc0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c004940 tx=0x7f2b5c009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 -- 172.21.15.46:0/3292963854 shutdown_connections 2024-05-09T06:28:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 --2- 172.21.15.46:0/3292963854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b6c0fcf70 0x7f2b6c0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:20.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 --2- 172.21.15.46:0/3292963854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c0fc0d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 -- 172.21.15.46:0/3292963854 >> 172.21.15.46:0/3292963854 conn(0x7f2b6c0f7440 msgr2=0x7f2b6c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 -- 172.21.15.46:0/3292963854 shutdown_connections 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.373+0000 7f2b71a48700 1 -- 172.21.15.46:0/3292963854 wait complete. 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.374+0000 7f2b71a48700 1 Processor -- start 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.374+0000 7f2b71a48700 1 -- start start 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.374+0000 7f2b71a48700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.374+0000 7f2b71a48700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b6c0fcf70 0x7f2b6c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.374+0000 7f2b71a48700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c112c60 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.374+0000 7f2b71a48700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c112da0 con 0x7f2b6c0fcf70 2024-05-09T06:28:20.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57066/0 (socket says 172.21.15.46:57066) 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 -- 172.21.15.46:0/1079963 learned_addr learned my addr 172.21.15.46:0/1079963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6a7fc700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b6c0fcf70 0x7f2b6c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 -- 172.21.15.46:0/1079963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b6c0fcf70 msgr2=0x7f2b6c112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b6c0fcf70 0x7f2b6c112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 -- 172.21.15.46:0/1079963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c005040 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b6affd700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c066cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c013870 tx=0x7f2b5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5c021070 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c112fa0 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c113400 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b5c01c400 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.375+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5c00e070 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.376+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c04c710 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.377+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2b5c01ca70 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.377+0000 7f2b537fe700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2b540692a0 0x7f2b5406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.377+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2b5c088330 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.377+0000 7f2b6a7fc700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2b540692a0 0x7f2b5406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.378+0000 7f2b6a7fc700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2b540692a0 0x7f2b5406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009b80 tx=0x7f2b6000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:20.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.382+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2b5c058080 con 0x7f2b6c0fbcc0 2024-05-09T06:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:20.616+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6c101280 con 0x7f2b540692a0 2024-05-09T06:28:21.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:21 smithi106 ceph-mon[34679]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:21.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:21 smithi046 ceph-mon[26924]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:28:22.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:22 smithi106 ceph-mon[34679]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:22.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:22 smithi046 ceph-mon[26924]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:28:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:23 smithi106 ceph-mon[34679]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T06:28:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:23 smithi046 ceph-mon[26924]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T06:28:24.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:24.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:25.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:25 smithi106 ceph-mon[34679]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T06:28:25.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:25 smithi046 ceph-mon[26924]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-05-09T06:28:27.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:27 smithi106 ceph-mon[34679]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:27.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:27 smithi046 ceph-mon[26924]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:29 smithi106 ceph-mon[34679]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:29.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:29 smithi046 ceph-mon[26924]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:31.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:31 smithi106 ceph-mon[34679]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:31 smithi046 ceph-mon[26924]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:33.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:33 smithi106 ceph-mon[34679]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:33.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:33 smithi046 ceph-mon[26924]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:35.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:35 smithi106 ceph-mon[34679]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:35.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:35 smithi046 ceph-mon[26924]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:37.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:37 smithi106 ceph-mon[34679]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:37.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:37 smithi046 ceph-mon[26924]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:39 smithi106 ceph-mon[34679]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:39 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:39.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:39 smithi046 ceph-mon[26924]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:39.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:39 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:41.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:41 smithi106 ceph-mon[34679]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:41.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:41 smithi046 ceph-mon[26924]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:43.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:43 smithi106 ceph-mon[34679]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:43 smithi046 ceph-mon[26924]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:28:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:45 smithi106 ceph-mon[34679]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:45.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:45 smithi046 ceph-mon[26924]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:47.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:47 smithi106 ceph-mon[34679]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:47.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:47 smithi046 ceph-mon[26924]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:28:49.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:49 smithi106 ceph-mon[34679]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:28:49.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:49 smithi046 ceph-mon[26924]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:28:51.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:51 smithi106 ceph-mon[34679]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:51.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:51 smithi046 ceph-mon[26924]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:53 smithi106 ceph-mon[34679]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:53 smithi046 ceph-mon[26924]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-05-09T06:28:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:54 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:54.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:54 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:28:55.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:55 smithi106 ceph-mon[34679]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T06:28:55.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:55 smithi046 ceph-mon[26924]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-05-09T06:28:56.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.846+0000 7f2b537fe700 1 -- 172.21.15.46:0/1079963 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f2b6c101280 con 0x7f2b540692a0 2024-05-09T06:28:56.827 INFO:teuthology.orchestra.run.smithi046.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2b540692a0 msgr2=0x7f2b5406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2b540692a0 0x7f2b5406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009b80 tx=0x7f2b6000b040 comp rx=0 tx=0).stop 2024-05-09T06:28:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 msgr2=0x7f2b6c066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:56.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c066cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c013870 tx=0x7f2b5c009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 shutdown_connections 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f2b540692a0 0x7f2b5406b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b6c0fbcc0 0x7f2b6c066cd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 --2- 172.21.15.46:0/1079963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b6c0fcf70 0x7f2b6c112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 >> 172.21.15.46:0/1079963 conn(0x7f2b6c0f7440 msgr2=0x7f2b6c0f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 shutdown_connections 2024-05-09T06:28:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:56.848+0000 7f2b71a48700 1 -- 172.21.15.46:0/1079963 wait complete. 2024-05-09T06:28:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:57 smithi106 ceph-mon[34679]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:28:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:57 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:28:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:57 smithi046 ceph-mon[26924]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:28:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:57 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:28:57.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-05-09T06:28:57.826 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:28:58.225 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:58 smithi046 ceph-mon[26924]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:58.225 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:28:58.225 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:28:58.225 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:58 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:58.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:58 smithi106 ceph-mon[34679]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:58.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:58 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:28:58.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:58 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:28:58.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:58 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:28:59.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:59 smithi046 ceph-mon[26924]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:59.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:28:59 smithi046 ceph-mon[26924]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:28:59.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:59 smithi106 ceph-mon[34679]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:28:59.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:28:59 smithi106 ceph-mon[34679]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 -- 172.21.15.46:0/3687145670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0ffee0 msgr2=0x7fde2c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 --2- 172.21.15.46:0/3687145670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0ffee0 0x7fde2c102300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde14004940 tx=0x7fde14009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 -- 172.21.15.46:0/3687145670 shutdown_connections 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 --2- 172.21.15.46:0/3687145670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0ffee0 0x7fde2c102300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 --2- 172.21.15.46:0/3687145670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde2c0662c0 0x7fde2c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 -- 172.21.15.46:0/3687145670 >> 172.21.15.46:0/3687145670 conn(0x7fde2c0f7430 msgr2=0x7fde2c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 -- 172.21.15.46:0/3687145670 shutdown_connections 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.512+0000 7fde323aa700 1 -- 172.21.15.46:0/3687145670 wait complete. 2024-05-09T06:28:59.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.513+0000 7fde323aa700 1 Processor -- start 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.513+0000 7fde323aa700 1 -- start start 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.513+0000 7fde323aa700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 0x7fde2c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.513+0000 7fde323aa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde2c0ffee0 0x7fde2c10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde323aa700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c10e4f0 con 0x7fde2c0662c0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde323aa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c10ed40 con 0x7fde2c0ffee0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 0x7fde2c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 0x7fde2c10d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55142/0 (socket says 172.21.15.46:55142) 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 -- 172.21.15.46:0/1966083738 learned_addr learned my addr 172.21.15.46:0/1966083738 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde23fff700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde2c0ffee0 0x7fde2c10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 -- 172.21.15.46:0/1966083738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde2c0ffee0 msgr2=0x7fde2c10def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde2c0ffee0 0x7fde2c10def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 -- 172.21.15.46:0/1966083738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde14005040 con 0x7fde2c0662c0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde2bfff700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 0x7fde2c10d9b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00eb40 tx=0x7fde1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1c007cc0 con 0x7fde2c0662c0 2024-05-09T06:28:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c10efc0 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde1c00f040 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.514+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1c00c9d0 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.515+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c10f500 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.516+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c05f5c0 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.516+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fde1c00cc40 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.516+0000 7fde297fa700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fde180692a0 0x7fde1806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.517+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fde1c086c20 con 0x7fde2c0662c0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.517+0000 7fde23fff700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fde180692a0 0x7fde1806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.517+0000 7fde23fff700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fde180692a0 0x7fde1806b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde14009b30 tx=0x7fde14009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.522+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fde1c04e250 con 0x7fde2c0662c0 2024-05-09T06:28:59.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.758+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde2c10f7e0 con 0x7fde180692a0 2024-05-09T06:28:59.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.759+0000 7fde297fa700 1 -- 172.21.15.46:0/1966083738 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fde2c10f7e0 con 0x7fde180692a0 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fde180692a0 msgr2=0x7fde1806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fde180692a0 0x7fde1806b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde14009b30 tx=0x7fde14009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 msgr2=0x7fde2c10d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 0x7fde2c10d9b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00eb40 tx=0x7fde1c00b040 comp rx=0 tx=0).stop 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 shutdown_connections 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fde180692a0 0x7fde1806b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde2c0662c0 0x7fde2c10d9b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 --2- 172.21.15.46:0/1966083738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde2c0ffee0 0x7fde2c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.761+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 >> 172.21.15.46:0/1966083738 conn(0x7fde2c0f7430 msgr2=0x7fde2c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.762+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 shutdown_connections 2024-05-09T06:28:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.762+0000 7fde323aa700 1 -- 172.21.15.46:0/1966083738 wait complete. 2024-05-09T06:28:59.756 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:28:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 -- 172.21.15.46:0/2674286757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 msgr2=0x7f7ae40fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/2674286757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae40fd2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4004940 tx=0x7f7ad4009e30 comp rx=0 tx=0).stop 2024-05-09T06:28:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 -- 172.21.15.46:0/2674286757 shutdown_connections 2024-05-09T06:28:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/2674286757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae40fe090 0x7f7ae40fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/2674286757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae40fd2a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 -- 172.21.15.46:0/2674286757 >> 172.21.15.46:0/2674286757 conn(0x7f7ae40f85c0 msgr2=0x7f7ae40fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:28:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 -- 172.21.15.46:0/2674286757 shutdown_connections 2024-05-09T06:28:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.878+0000 7f7aea7e8700 1 -- 172.21.15.46:0/2674286757 wait complete. 2024-05-09T06:28:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7aea7e8700 1 Processor -- start 2024-05-09T06:28:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7aea7e8700 1 -- start start 2024-05-09T06:28:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7aea7e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae410fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7aea7e8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae40fe090 0x7f7ae4110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7aea7e8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4110740 con 0x7f7ae40fce90 2024-05-09T06:28:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7aea7e8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4110f90 con 0x7f7ae40fe090 2024-05-09T06:28:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7ae3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae410fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:59.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7ae3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae410fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55166/0 (socket says 172.21.15.46:55166) 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7ae3fff700 1 -- 172.21.15.46:0/330035794 learned_addr learned my addr 172.21.15.46:0/330035794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.879+0000 7f7adbfff700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae40fe090 0x7f7ae4110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae3fff700 1 -- 172.21.15.46:0/330035794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae40fe090 msgr2=0x7f7ae4110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae3fff700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae40fe090 0x7f7ae4110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae3fff700 1 -- 172.21.15.46:0/330035794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4005040 con 0x7f7ae40fce90 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae3fff700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae410fc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4000c00 tx=0x7f7ad4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad400e030 con 0x7f7ae40fce90 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ad4013de0 con 0x7f7ae40fce90 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad401ce50 con 0x7f7ae40fce90 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae4111210 con 0x7f7ae40fce90 2024-05-09T06:28:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.880+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae4111750 con 0x7f7ae40fce90 2024-05-09T06:28:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.881+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae4101a20 con 0x7f7ae40fce90 2024-05-09T06:28:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.882+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7ad401c400 con 0x7f7ae40fce90 2024-05-09T06:28:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.882+0000 7f7ae17fa700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7ad0069230 0x7f7ad006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:28:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.883+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7ad4088c80 con 0x7f7ae40fce90 2024-05-09T06:28:59.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.883+0000 7f7adbfff700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7ad0069230 0x7f7ad006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:28:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.883+0000 7f7adbfff700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7ad0069230 0x7f7ad006b6e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009b80 tx=0x7f7acc00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:28:59.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:28:59.887+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7ad4058970 con 0x7f7ae40fce90 2024-05-09T06:29:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.114+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae4105a70 con 0x7f7ad0069230 2024-05-09T06:29:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.115+0000 7f7ae17fa700 1 -- 172.21.15.46:0/330035794 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f7ae4105a70 con 0x7f7ad0069230 2024-05-09T06:29:00.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7ad0069230 msgr2=0x7f7ad006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7ad0069230 0x7f7ad006b6e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009b80 tx=0x7f7acc00b040 comp rx=0 tx=0).stop 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 msgr2=0x7f7ae410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae410fc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4000c00 tx=0x7f7ad4009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 shutdown_connections 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f7ad0069230 0x7f7ad006b6e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae40fce90 0x7f7ae410fc00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 --2- 172.21.15.46:0/330035794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae40fe090 0x7f7ae4110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 >> 172.21.15.46:0/330035794 conn(0x7f7ae40f85c0 msgr2=0x7f7ae40f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 shutdown_connections 2024-05-09T06:29:00.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.117+0000 7f7aea7e8700 1 -- 172.21.15.46:0/330035794 wait complete. 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.228+0000 7f98e2806700 1 -- 172.21.15.46:0/1447172167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fdfd0 msgr2=0x7f98dc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.228+0000 7f98e2806700 1 --2- 172.21.15.46:0/1447172167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fdfd0 0x7f98dc0fe440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98d0004940 tx=0x7f98d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 -- 172.21.15.46:0/1447172167 shutdown_connections 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 --2- 172.21.15.46:0/1447172167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fdfd0 0x7f98dc0fe440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 --2- 172.21.15.46:0/1447172167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc0fce60 0x7f98dc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 -- 172.21.15.46:0/1447172167 >> 172.21.15.46:0/1447172167 conn(0x7f98dc0f8540 msgr2=0x7f98dc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 -- 172.21.15.46:0/1447172167 shutdown_connections 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 -- 172.21.15.46:0/1447172167 wait complete. 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 Processor -- start 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.229+0000 7f98e2806700 1 -- start start 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98e2806700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 0x7f98dc10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98e2806700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc0fdfd0 0x7f98dc10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98e2806700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc10e540 con 0x7f98dc0fce60 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98e2806700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc10ed90 con 0x7f98dc0fdfd0 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 0x7f98dc10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 0x7f98dc10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55174/0 (socket says 172.21.15.46:55174) 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 -- 172.21.15.46:0/1595584098 learned_addr learned my addr 172.21.15.46:0/1595584098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98db7fe700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc0fdfd0 0x7f98dc10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 -- 172.21.15.46:0/1595584098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc0fdfd0 msgr2=0x7f98dc10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc0fdfd0 0x7f98dc10df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 -- 172.21.15.46:0/1595584098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0005040 con 0x7f98dc0fce60 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98dbfff700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 0x7f98dc10da00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f98cc002a50 tx=0x7f98cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc007cc0 con 0x7f98dc0fce60 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc10f070 con 0x7f98dc0fce60 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98cc00f040 con 0x7f98dc0fce60 2024-05-09T06:29:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc00da30 con 0x7f98dc0fce60 2024-05-09T06:29:00.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.230+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc10f5b0 con 0x7f98dc0fce60 2024-05-09T06:29:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.231+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc05f5c0 con 0x7f98dc0fce60 2024-05-09T06:29:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.232+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f98cc00db90 con 0x7f98dc0fce60 2024-05-09T06:29:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.232+0000 7f98d8ff9700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f98c40692a0 0x7f98c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.233+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f98cc086fa0 con 0x7f98dc0fce60 2024-05-09T06:29:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.233+0000 7f98db7fe700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f98c40692a0 0x7f98c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.233+0000 7f98db7fe700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f98c40692a0 0x7f98c406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98d000b970 tx=0x7f98d0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:00.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.237+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f98cc056c90 con 0x7f98dc0fce60 2024-05-09T06:29:00.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.456+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98dc10f950 con 0x7f98c40692a0 2024-05-09T06:29:00.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.466+0000 7f98d8ff9700 1 -- 172.21.15.46:0/1595584098 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f98dc10f950 con 0x7f98c40692a0 2024-05-09T06:29:00.447 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:29:00.447 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 60s ago 6m 25.6M - 0.25.0 c8568f914cd2 b0b44c27fce3 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 60s ago 7m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (5m) 66s ago 5m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 60s ago 6m 82.4M - 9.4.7 954c08fa6188 9ac57528a8a2 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (86s) 60s ago 86s 10.4M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (80s) 60s ago 80s 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (84s) 66s ago 83s 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (78s) 66s ago 77s 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:9283 running (8m) 60s ago 8m 480M - 17.2.7-933-g4ba5a836 b96134859c76 8f6ac823d36e 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (5m) 66s ago 5m 434M - 17.2.7-933-g4ba5a836 b96134859c76 f21c8bcfc198 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 60s ago 8m 45.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (5m) 66s ago 5m 33.0M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 60s ago 7m 16.4M - 1.5.0 0da6a335fe13 8241269a3f80 2024-05-09T06:29:00.448 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (5m) 66s ago 5m 16.8M - 1.5.0 0da6a335fe13 c00aff5800c6 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 60s ago 5m 45.4M 4289M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 60s ago 4m 48.0M 4289M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 60s ago 4m 45.6M 4289M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (3m) 66s ago 3m 43.7M 5312M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (3m) 66s ago 3m 43.8M 5312M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (2m) 66s ago 2m 44.0M 5312M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:29:00.449 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 60s ago 6m 51.6M - 2.43.0 a07b618ecd1d 85a9e537bba1 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f98c40692a0 msgr2=0x7f98c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f98c40692a0 0x7f98c406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98d000b970 tx=0x7f98d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 msgr2=0x7f98dc10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 0x7f98dc10da00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f98cc002a50 tx=0x7f98cc0046b0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 shutdown_connections 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f98c40692a0 0x7f98c406b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98dc0fce60 0x7f98dc10da00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 --2- 172.21.15.46:0/1595584098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc0fdfd0 0x7f98dc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 >> 172.21.15.46:0/1595584098 conn(0x7f98dc0f8540 msgr2=0x7f98dc0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 shutdown_connections 2024-05-09T06:29:00.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.468+0000 7f98e2806700 1 -- 172.21.15.46:0/1595584098 wait complete. 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 -- 172.21.15.46:0/4132186486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc610066b50 msgr2=0x7fc6100ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 --2- 172.21.15.46:0/4132186486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc610066b50 0x7fc6100ff9b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc600004940 tx=0x7fc600009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 -- 172.21.15.46:0/4132186486 shutdown_connections 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 --2- 172.21.15.46:0/4132186486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6100ffef0 0x7fc610102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 --2- 172.21.15.46:0/4132186486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc610066b50 0x7fc6100ff9b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 -- 172.21.15.46:0/4132186486 >> 172.21.15.46:0/4132186486 conn(0x7fc6100f7420 msgr2=0x7fc6100f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 -- 172.21.15.46:0/4132186486 shutdown_connections 2024-05-09T06:29:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.575+0000 7fc614bb5700 1 -- 172.21.15.46:0/4132186486 wait complete. 2024-05-09T06:29:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.576+0000 7fc614bb5700 1 Processor -- start 2024-05-09T06:29:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.576+0000 7fc614bb5700 1 -- start start 2024-05-09T06:29:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.576+0000 7fc614bb5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc610066b50 0x7fc61010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.576+0000 7fc614bb5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 0x7fc61010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.576+0000 7fc614bb5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61010e570 con 0x7fc6100ffef0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.576+0000 7fc614bb5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61010edc0 con 0x7fc610066b50 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 0x7fc61010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 0x7fc61010df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55180/0 (socket says 172.21.15.46:55180) 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60e59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc610066b50 0x7fc61010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 -- 172.21.15.46:0/1792622507 learned_addr learned my addr 172.21.15.46:0/1792622507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 -- 172.21.15.46:0/1792622507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc610066b50 msgr2=0x7fc61010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc610066b50 0x7fc61010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 -- 172.21.15.46:0/1792622507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600005040 con 0x7fc6100ffef0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc60dd9b700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 0x7fc61010df70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc604002a50 tx=0x7fc6040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc604007cc0 con 0x7fc6100ffef0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc60400f040 con 0x7fc6100ffef0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61010f0a0 con 0x7fc6100ffef0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60400da30 con 0x7fc6100ffef0 2024-05-09T06:29:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.577+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61010f5e0 con 0x7fc6100ffef0 2024-05-09T06:29:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.579+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61005f5c0 con 0x7fc6100ffef0 2024-05-09T06:29:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.580+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc60400dbb0 con 0x7fc6100ffef0 2024-05-09T06:29:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.581+0000 7fc5feffd700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc5f80692a0 0x7fc5f806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.581+0000 7fc60e59c700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc5f80692a0 0x7fc5f806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:00.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.581+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc604086ee0 con 0x7fc6100ffef0 2024-05-09T06:29:00.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.581+0000 7fc60e59c700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc5f80692a0 0x7fc5f806b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b970 tx=0x7fc600009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.585+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6040569c0 con 0x7fc6100ffef0 2024-05-09T06:29:00.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.952+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc61004bed0 con 0x7fc6100ffef0 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.953+0000 7fc5feffd700 1 -- 172.21.15.46:0/1792622507 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fc6040567e0 con 0x7fc6100ffef0 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:00.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 14 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:29:00.936 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc5f80692a0 msgr2=0x7fc5f806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc5f80692a0 0x7fc5f806b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b970 tx=0x7fc600009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 msgr2=0x7fc61010df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 0x7fc61010df70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc604002a50 tx=0x7fc6040046b0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 shutdown_connections 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fc5f80692a0 0x7fc5f806b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc610066b50 0x7fc61010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 --2- 172.21.15.46:0/1792622507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6100ffef0 0x7fc61010df70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 >> 172.21.15.46:0/1792622507 conn(0x7fc6100f7420 msgr2=0x7fc6100f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 shutdown_connections 2024-05-09T06:29:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:00.956+0000 7fc614bb5700 1 -- 172.21.15.46:0/1792622507 wait complete. 2024-05-09T06:29:01.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 -- 172.21.15.46:0/2121322567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 msgr2=0x7f3da00fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 --2- 172.21.15.46:0/2121322567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da00fd290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d90004940 tx=0x7f3d90009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 -- 172.21.15.46:0/2121322567 shutdown_connections 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 --2- 172.21.15.46:0/2121322567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3da00fe080 0x7f3da00fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 --2- 172.21.15.46:0/2121322567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da00fd290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 -- 172.21.15.46:0/2121322567 >> 172.21.15.46:0/2121322567 conn(0x7f3da00f8590 msgr2=0x7f3da00fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 -- 172.21.15.46:0/2121322567 shutdown_connections 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 -- 172.21.15.46:0/2121322567 wait complete. 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 Processor -- start 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.074+0000 7f3da4b41700 1 -- start start 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3da4b41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3da4b41700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3da00fe080 0x7f3da010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3da4b41700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da010e5a0 con 0x7f3da00fce80 2024-05-09T06:29:01.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3da4b41700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da010edf0 con 0x7f3da00fe080 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da010da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37740/0 (socket says 172.21.15.46:37740) 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 -- 172.21.15.46:0/3019300631 learned_addr learned my addr 172.21.15.46:0/3019300631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9dd9b700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3da00fe080 0x7f3da010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 -- 172.21.15.46:0/3019300631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3da00fe080 msgr2=0x7f3da010dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3da00fe080 0x7f3da010dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 -- 172.21.15.46:0/3019300631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90005040 con 0x7f3da00fce80 2024-05-09T06:29:01.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.075+0000 7f3d9e59c700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da010da60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3d90000c00 tx=0x7f3d90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:01.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.076+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9000e040 con 0x7f3da00fce80 2024-05-09T06:29:01.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.076+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d9000bbf0 con 0x7f3da00fce80 2024-05-09T06:29:01.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.076+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9001c630 con 0x7f3da00fce80 2024-05-09T06:29:01.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.076+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da010f070 con 0x7f3da00fce80 2024-05-09T06:29:01.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.076+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da010f4f0 con 0x7f3da00fce80 2024-05-09T06:29:01.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.077+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da005f5c0 con 0x7f3da00fce80 2024-05-09T06:29:01.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.077+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3d9000bd60 con 0x7f3da00fce80 2024-05-09T06:29:01.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.078+0000 7f3d8effd700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3d880692a0 0x7f3d8806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:01.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.078+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3d900884a0 con 0x7f3da00fce80 2024-05-09T06:29:01.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.078+0000 7f3d9dd9b700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3d880692a0 0x7f3d8806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:01.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.078+0000 7f3d9dd9b700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3d880692a0 0x7f3d8806b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d94004f60 tx=0x7f3d9400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:01.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.082+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3d90058210 con 0x7f3da00fce80 2024-05-09T06:29:01.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.326+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3da010f890 con 0x7f3d880692a0 2024-05-09T06:29:01.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:01 smithi046 ceph-mon[26924]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:01.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:01 smithi046 ceph-mon[26924]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:29:01.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:01 smithi046 ceph-mon[26924]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:01.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:01 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1792622507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.327+0000 7f3d8effd700 1 -- 172.21.15.46:0/3019300631 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f3da010f890 con 0x7f3d880692a0 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "", 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e image", 2024-05-09T06:29:01.309 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:29:01.310 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3d880692a0 msgr2=0x7f3d8806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3d880692a0 0x7f3d8806b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d94004f60 tx=0x7f3d9400b040 comp rx=0 tx=0).stop 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 msgr2=0x7f3da010da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da010da60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3d90000c00 tx=0x7f3d90009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 shutdown_connections 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f3d880692a0 0x7f3d8806b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3da00fce80 0x7f3da010da60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 --2- 172.21.15.46:0/3019300631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3da00fe080 0x7f3da010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:01.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.329+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 >> 172.21.15.46:0/3019300631 conn(0x7f3da00f8590 msgr2=0x7f3da00f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:01.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.330+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 shutdown_connections 2024-05-09T06:29:01.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:01.330+0000 7f3da4b41700 1 -- 172.21.15.46:0/3019300631 wait complete. 2024-05-09T06:29:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:01 smithi106 ceph-mon[34679]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:01 smithi106 ceph-mon[34679]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-05-09T06:29:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:01 smithi106 ceph-mon[34679]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:01 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1792622507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:02.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:02 smithi106 ceph-mon[34679]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:02 smithi046 ceph-mon[26924]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:03.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:03 smithi046 ceph-mon[26924]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:03.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:03 smithi046 ceph-mon[26924]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:29:03.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:03.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:03.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:03 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:03.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:03 smithi106 ceph-mon[34679]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:03.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:03 smithi106 ceph-mon[34679]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:29:03.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:03.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:03.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:03 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:04.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:04 smithi046 ceph-mon[26924]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (unknown) 2024-05-09T06:29:04.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:04 smithi046 ceph-mon[26924]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:29:04.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:04 smithi046 ceph-mon[26924]: Upgrade: Need to upgrade myself (mgr.smithi046.nvpcui) 2024-05-09T06:29:04.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:04 smithi106 ceph-mon[34679]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (unknown) 2024-05-09T06:29:04.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:04 smithi106 ceph-mon[34679]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:29:04.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:04 smithi106 ceph-mon[34679]: Upgrade: Need to upgrade myself (mgr.smithi046.nvpcui) 2024-05-09T06:29:05.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:05 smithi046 ceph-mon[26924]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc on smithi106 2024-05-09T06:29:05.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:05 smithi046 ceph-mon[26924]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:29:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:05 smithi106 ceph-mon[34679]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc on smithi106 2024-05-09T06:29:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:05 smithi106 ceph-mon[34679]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-05-09T06:29:07.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:07 smithi046 ceph-mon[26924]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:07.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:07 smithi106 ceph-mon[34679]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:09.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:09 smithi046 ceph-mon[26924]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:09.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:09 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:09.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:09 smithi106 ceph-mon[34679]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:09.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:09 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:11.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:11 smithi046 ceph-mon[26924]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:11 smithi106 ceph-mon[34679]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:13.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:13 smithi106 ceph-mon[34679]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:13.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:13 smithi046 ceph-mon[26924]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:15.376 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:15 smithi106 ceph-mon[34679]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:15 smithi046 ceph-mon[26924]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:17.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:17 smithi106 ceph-mon[34679]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:17.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:17 smithi046 ceph-mon[26924]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:19.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:19 smithi106 ceph-mon[34679]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:19.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:19 smithi046 ceph-mon[26924]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:21.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:21 smithi106 ceph-mon[34679]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:21.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:21 smithi046 ceph-mon[26924]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:23.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:23 smithi106 ceph-mon[34679]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:23.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:23 smithi046 ceph-mon[26924]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:24.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:24 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:24 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:25 smithi106 ceph-mon[34679]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:25.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:25 smithi046 ceph-mon[26924]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:27.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:27 smithi046 ceph-mon[26924]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:27.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:27 smithi106 ceph-mon[34679]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:29.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:29 smithi106 ceph-mon[34679]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:29.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:29 smithi046 ceph-mon[26924]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:31.475 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:31 smithi046 ceph-mon[26924]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.492+0000 7fd4109ce700 1 -- 172.21.15.46:0/3513528939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 msgr2=0x7fd40c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.492+0000 7fd4109ce700 1 --2- 172.21.15.46:0/3513528939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 0x7fd40c0fe440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd400004880 tx=0x7fd400009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.492+0000 7fd4109ce700 1 -- 172.21.15.46:0/3513528939 shutdown_connections 2024-05-09T06:29:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.492+0000 7fd4109ce700 1 --2- 172.21.15.46:0/3513528939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 0x7fd40c0fe440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.492+0000 7fd4109ce700 1 --2- 172.21.15.46:0/3513528939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.492+0000 7fd4109ce700 1 -- 172.21.15.46:0/3513528939 >> 172.21.15.46:0/3513528939 conn(0x7fd40c0f8560 msgr2=0x7fd40c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 -- 172.21.15.46:0/3513528939 shutdown_connections 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 -- 172.21.15.46:0/3513528939 wait complete. 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 Processor -- start 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 -- start start 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 0x7fd40c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c111650 con 0x7fd40c0fce60 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.493+0000 7fd4109ce700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c1117c0 con 0x7fd40c0fdfd0 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46816/0 (socket says 172.21.15.46:46816) 2024-05-09T06:29:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 -- 172.21.15.46:0/1155991342 learned_addr learned my addr 172.21.15.46:0/1155991342 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd409d9b700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 0x7fd40c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 -- 172.21.15.46:0/1155991342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 msgr2=0x7fd40c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 0x7fd40c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 -- 172.21.15.46:0/1155991342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400005040 con 0x7fd40c0fce60 2024-05-09T06:29:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd40a59c700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c071de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0041d0 tx=0x7fd3fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:31.479 INFO:tasks.workunit.client.1.smithi106.stderr:Updating files: 90% (11296/12535) Updating files: 91% (11407/12535) Updating files: 92% (11533/12535) Updating files: 93% (11658/12535) Updating files: 94% (11783/12535) Updating files: 95% (11909/12535) Updating files: 96% (12034/12535) Updating files: 97% (12159/12535) Updating files: 98% (12285/12535) Updating files: 99% (12410/12535) Updating files: 100% (12535/12535) Updating files: 100% (12535/12535), done. 2024-05-09T06:29:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3fc007cc0 con 0x7fd40c0fce60 2024-05-09T06:29:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.494+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c0708b0 con 0x7fd40c0fce60 2024-05-09T06:29:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.495+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c070e20 con 0x7fd40c0fce60 2024-05-09T06:29:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.495+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3fc00f040 con 0x7fd40c0fce60 2024-05-09T06:29:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.495+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3fc00ca50 con 0x7fd40c0fce60 2024-05-09T06:29:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.496+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c1060d0 con 0x7fd40c0fce60 2024-05-09T06:29:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.497+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd3fc00cbb0 con 0x7fd40c0fce60 2024-05-09T06:29:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.497+0000 7fd3faffd700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3f40692a0 0x7fd3f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.498+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd3fc086c00 con 0x7fd40c0fce60 2024-05-09T06:29:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.498+0000 7fd409d9b700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3f40692a0 0x7fd3f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.498+0000 7fd409d9b700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3f40692a0 0x7fd3f406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c00 tx=0x7fd400009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:31.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.502+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd3fc04e250 con 0x7fd40c0fce60 2024-05-09T06:29:31.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:31 smithi106 ceph-mon[34679]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.772+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd40c1022f0 con 0x7fd3f40692a0 2024-05-09T06:29:31.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.774+0000 7fd3faffd700 1 -- 172.21.15.46:0/1155991342 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd40c1022f0 con 0x7fd3f40692a0 2024-05-09T06:29:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.776+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3f40692a0 msgr2=0x7fd3f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.776+0000 7fd4109ce700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3f40692a0 0x7fd3f406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c00 tx=0x7fd400009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.776+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 msgr2=0x7fd40c071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.776+0000 7fd4109ce700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c071de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0041d0 tx=0x7fd3fc00b040 comp rx=0 tx=0).stop 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 shutdown_connections 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fd3f40692a0 0x7fd3f406b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c0fce60 0x7fd40c071de0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 --2- 172.21.15.46:0/1155991342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd40c0fdfd0 0x7fd40c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 >> 172.21.15.46:0/1155991342 conn(0x7fd40c0f8560 msgr2=0x7fd40c0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 shutdown_connections 2024-05-09T06:29:31.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.777+0000 7fd4109ce700 1 -- 172.21.15.46:0/1155991342 wait complete. 2024-05-09T06:29:31.770 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.919+0000 7fabb7816700 1 -- 172.21.15.46:0/4250184149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0102340 msgr2=0x7fabb0104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.919+0000 7fabb7816700 1 --2- 172.21.15.46:0/4250184149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0102340 0x7fabb0104720 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faba0004940 tx=0x7faba0009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.919+0000 7fabb7816700 1 -- 172.21.15.46:0/4250184149 shutdown_connections 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.919+0000 7fabb7816700 1 --2- 172.21.15.46:0/4250184149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0102340 0x7fabb0104720 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.919+0000 7fabb7816700 1 --2- 172.21.15.46:0/4250184149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0066260 0x7fabb0101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.919+0000 7fabb7816700 1 -- 172.21.15.46:0/4250184149 >> 172.21.15.46:0/4250184149 conn(0x7fabb00f7430 msgr2=0x7fabb00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.920+0000 7fabb7816700 1 -- 172.21.15.46:0/4250184149 shutdown_connections 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.920+0000 7fabb7816700 1 -- 172.21.15.46:0/4250184149 wait complete. 2024-05-09T06:29:31.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.920+0000 7fabb7816700 1 Processor -- start 2024-05-09T06:29:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.920+0000 7fabb7816700 1 -- start start 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb7816700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 0x7fabb010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb7816700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0102340 0x7fabb0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb7816700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0110700 con 0x7fabb0066260 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb7816700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0110f00 con 0x7fabb0102340 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb55b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 0x7fabb010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb55b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 0x7fabb010fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46840/0 (socket says 172.21.15.46:46840) 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb55b2700 1 -- 172.21.15.46:0/4207539543 learned_addr learned my addr 172.21.15.46:0/4207539543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb55b2700 1 -- 172.21.15.46:0/4207539543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0102340 msgr2=0x7fabb0110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb4db1700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0102340 0x7fabb0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:31.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb55b2700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0102340 0x7fabb0110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb55b2700 1 -- 172.21.15.46:0/4207539543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0005040 con 0x7fabb0066260 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.921+0000 7fabb4db1700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0102340 0x7fabb0110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.922+0000 7fabb55b2700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 0x7fabb010fbc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fabac00eb70 tx=0x7fabac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.922+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac007cc0 con 0x7fabb0066260 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.922+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb0111180 con 0x7fabb0066260 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.922+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabac00f040 con 0x7fabb0066260 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.922+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac00cbd0 con 0x7fabb0066260 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.922+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb01116c0 con 0x7fabb0066260 2024-05-09T06:29:31.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.923+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb005f5c0 con 0x7fabb0066260 2024-05-09T06:29:31.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.924+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fabac00cd30 con 0x7fabb0066260 2024-05-09T06:29:31.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.925+0000 7faba5ffb700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fab9c0692a0 0x7fab9c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:31.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.925+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fabac086cb0 con 0x7fabb0066260 2024-05-09T06:29:31.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.925+0000 7fabb4db1700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fab9c0692a0 0x7fab9c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:31.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.926+0000 7fabb4db1700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fab9c0692a0 0x7fab9c06b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faba00043d0 tx=0x7faba0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:31.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:31.930+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fabac04e250 con 0x7fabb0066260 2024-05-09T06:29:31.935 INFO:tasks.workunit.client.1.smithi106.stderr:Note: switching to '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'. 2024-05-09T06:29:31.935 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.935 INFO:tasks.workunit.client.1.smithi106.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T06:29:31.935 INFO:tasks.workunit.client.1.smithi106.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T06:29:31.935 INFO:tasks.workunit.client.1.smithi106.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T06:29:31.935 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: git switch -c 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr:Or undo this operation with: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: git switch - 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr: 2024-05-09T06:29:31.936 INFO:tasks.workunit.client.1.smithi106.stderr:HEAD is now at 720f8e954cd Merge pull request #55437 from tchaikov/ehh-upstart 2024-05-09T06:29:31.938 DEBUG:teuthology.orchestra.run.smithi106:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-09T06:29:32.000 INFO:tasks.workunit.client.1.smithi106.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T06:29:32.002 INFO:tasks.workunit.client.1.smithi106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T06:29:32.002 INFO:tasks.workunit.client.1.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T06:29:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.181+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabb0111ab0 con 0x7fab9c0692a0 2024-05-09T06:29:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.182+0000 7faba5ffb700 1 -- 172.21.15.46:0/4207539543 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fabb0111ab0 con 0x7fab9c0692a0 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.184+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fab9c0692a0 msgr2=0x7fab9c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.184+0000 7fabb7816700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fab9c0692a0 0x7fab9c06b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faba00043d0 tx=0x7faba0009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.184+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 msgr2=0x7fabb010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.184+0000 7fabb7816700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 0x7fabb010fbc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fabac00eb70 tx=0x7fabac00b040 comp rx=0 tx=0).stop 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.184+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 shutdown_connections 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.185+0000 7fabb7816700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7fab9c0692a0 0x7fab9c06b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.185+0000 7fabb7816700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabb0066260 0x7fabb010fbc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.185+0000 7fabb7816700 1 --2- 172.21.15.46:0/4207539543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabb0102340 0x7fabb0110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.185+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 >> 172.21.15.46:0/4207539543 conn(0x7fabb00f7430 msgr2=0x7fabb00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.185+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 shutdown_connections 2024-05-09T06:29:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.185+0000 7fabb7816700 1 -- 172.21.15.46:0/4207539543 wait complete. 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 -- 172.21.15.46:0/593013172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 msgr2=0x7f99e8102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 --2- 172.21.15.46:0/593013172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e8102300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99dc004940 tx=0x7f99dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 -- 172.21.15.46:0/593013172 shutdown_connections 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 --2- 172.21.15.46:0/593013172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e8102300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 --2- 172.21.15.46:0/593013172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 0x7f99e80ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 -- 172.21.15.46:0/593013172 >> 172.21.15.46:0/593013172 conn(0x7f99e80f7430 msgr2=0x7f99e80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 -- 172.21.15.46:0/593013172 shutdown_connections 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 -- 172.21.15.46:0/593013172 wait complete. 2024-05-09T06:29:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.320+0000 7f99ee169700 1 Processor -- start 2024-05-09T06:29:32.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99ee169700 1 -- start start 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99ee169700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 0x7f99e80fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99ee169700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e80fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99ee169700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80fbe30 con 0x7f99e80ffee0 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99ee169700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80fbf70 con 0x7f99e80662c0 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e80fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e80fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46860/0 (socket says 172.21.15.46:46860) 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e6ffd700 1 -- 172.21.15.46:0/2350443966 learned_addr learned my addr 172.21.15.46:0/2350443966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e77fe700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 0x7f99e80fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e6ffd700 1 -- 172.21.15.46:0/2350443966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 msgr2=0x7f99e80fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e6ffd700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 0x7f99e80fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e6ffd700 1 -- 172.21.15.46:0/2350443966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc005040 con 0x7f99e80ffee0 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.321+0000 7f99e77fe700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 0x7f99e80fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.322+0000 7f99e6ffd700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e80fb8a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f99dc013870 tx=0x7f99dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.322+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99dc021070 con 0x7f99e80ffee0 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.322+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e80fc1f0 con 0x7f99e80ffee0 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.322+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8115a00 con 0x7f99e80ffee0 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.322+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99dc009430 con 0x7f99e80ffee0 2024-05-09T06:29:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.322+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99dc00e070 con 0x7f99e80ffee0 2024-05-09T06:29:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.323+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e805f5c0 con 0x7f99e80ffee0 2024-05-09T06:29:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.324+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f99dc013af0 con 0x7f99e80ffee0 2024-05-09T06:29:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.324+0000 7f99cffff700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f99d00692a0 0x7f99d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.324+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f99dc089e00 con 0x7f99e80ffee0 2024-05-09T06:29:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.324+0000 7f99e77fe700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f99d00692a0 0x7f99d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.325+0000 7f99e77fe700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f99d00692a0 0x7f99d006b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99e80fd110 tx=0x7f99d800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.329+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f99dc08d060 con 0x7f99e80ffee0 2024-05-09T06:29:32.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.537+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e80f8f20 con 0x7f99d00692a0 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.555+0000 7f99cffff700 1 -- 172.21.15.46:0/2350443966 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f99e80f8f20 con 0x7f99d00692a0 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 92s ago 7m 25.6M - 0.25.0 c8568f914cd2 b0b44c27fce3 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 92s ago 7m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (6m) 98s ago 6m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 92s ago 7m 82.4M - 9.4.7 954c08fa6188 9ac57528a8a2 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (118s) 92s ago 118s 10.4M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:29:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (112s) 92s ago 112s 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (116s) 98s ago 115s 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (110s) 98s ago 109s 12.1M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:9283 running (8m) 92s ago 8m 480M - 17.2.7-933-g4ba5a836 b96134859c76 8f6ac823d36e 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (6m) 98s ago 6m 434M - 17.2.7-933-g4ba5a836 b96134859c76 f21c8bcfc198 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 92s ago 8m 45.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (6m) 98s ago 6m 33.0M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 92s ago 7m 16.4M - 1.5.0 0da6a335fe13 8241269a3f80 2024-05-09T06:29:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (6m) 98s ago 6m 16.8M - 1.5.0 0da6a335fe13 c00aff5800c6 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 92s ago 5m 45.4M 4289M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 92s ago 5m 48.0M 4289M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 92s ago 4m 45.6M 4289M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (4m) 98s ago 4m 43.7M 5312M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (3m) 98s ago 3m 43.8M 5312M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (3m) 98s ago 3m 44.0M 5312M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:29:32.540 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 92s ago 6m 51.6M - 2.43.0 a07b618ecd1d 85a9e537bba1 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f99d00692a0 msgr2=0x7f99d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f99d00692a0 0x7f99d006b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99e80fd110 tx=0x7f99d800b040 comp rx=0 tx=0).stop 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 msgr2=0x7f99e80fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e80fb8a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f99dc013870 tx=0x7f99dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 shutdown_connections 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f99d00692a0 0x7f99d006b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99e80662c0 0x7f99e80fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 --2- 172.21.15.46:0/2350443966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99e80ffee0 0x7f99e80fb8a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.558+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 >> 172.21.15.46:0/2350443966 conn(0x7f99e80f7430 msgr2=0x7f99e80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:32.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.559+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 shutdown_connections 2024-05-09T06:29:32.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.559+0000 7f99ee169700 1 -- 172.21.15.46:0/2350443966 wait complete. 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 -- 172.21.15.46:0/3449927047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 msgr2=0x7f92dc0ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 --2- 172.21.15.46:0/3449927047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc0ffab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92cc004940 tx=0x7f92cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 -- 172.21.15.46:0/3449927047 shutdown_connections 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 --2- 172.21.15.46:0/3449927047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 --2- 172.21.15.46:0/3449927047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc0ffab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 -- 172.21.15.46:0/3449927047 >> 172.21.15.46:0/3449927047 conn(0x7f92dc0f74c0 msgr2=0x7f92dc0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 -- 172.21.15.46:0/3449927047 shutdown_connections 2024-05-09T06:29:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.669+0000 7f92e2019700 1 -- 172.21.15.46:0/3449927047 wait complete. 2024-05-09T06:29:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.670+0000 7f92e2019700 1 Processor -- start 2024-05-09T06:29:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.670+0000 7f92e2019700 1 -- start start 2024-05-09T06:29:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.670+0000 7f92e2019700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc10da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:32.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92e2019700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc10df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92e2019700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc10e580 con 0x7f92dc066ad0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92e2019700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc10ed80 con 0x7f92dc0ffff0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc10df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc10df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:33810/0 (socket says 172.21.15.46:33810) 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 -- 172.21.15.46:0/2833218202 learned_addr learned my addr 172.21.15.46:0/2833218202 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92db7fe700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc10da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 -- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 msgr2=0x7f92dc10da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc10da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 -- 172.21.15.46:0/2833218202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc005040 con 0x7f92dc0ffff0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.671+0000 7f92daffd700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc10df80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f92d000eb40 tx=0x7f92d000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.672+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d0007cc0 con 0x7f92dc0ffff0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.672+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92d000f040 con 0x7f92dc0ffff0 2024-05-09T06:29:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.672+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d00095e0 con 0x7f92dc0ffff0 2024-05-09T06:29:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.672+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc10f000 con 0x7f92dc0ffff0 2024-05-09T06:29:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.672+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc10f4f0 con 0x7f92dc0ffff0 2024-05-09T06:29:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.672+0000 7f92db7fe700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:29:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.673+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc05f5c0 con 0x7f92dc0ffff0 2024-05-09T06:29:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.674+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f92d0009850 con 0x7f92dc0ffff0 2024-05-09T06:29:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.675+0000 7f92c3fff700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f92c40692a0 0x7f92c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.675+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f92d0087060 con 0x7f92dc0ffff0 2024-05-09T06:29:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.675+0000 7f92db7fe700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f92c40692a0 0x7f92c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.676+0000 7f92db7fe700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f92c40692a0 0x7f92c406b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92cc004890 tx=0x7f92cc009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:32.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.678+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f92d0056e80 con 0x7f92dc0ffff0 2024-05-09T06:29:32.684 INFO:tasks.workunit.client.1.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T06:29:32.738 INFO:tasks.workunit.client.1.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T06:29:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-09T06:29:32.784 INFO:tasks.workunit.client.1.smithi106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T06:29:32.784 INFO:tasks.workunit.client.1.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T06:29:32.826 INFO:tasks.workunit.client.1.smithi106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-09T06:29:32.830 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:29:32.830 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-09T06:29:32.888 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-05-09T06:29:32.890 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-09T06:29:32.891 DEBUG:teuthology.orchestra.run.smithi106:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-05-09T06:29:32.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.958+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92dc10f7d0 con 0x7f92dc0ffff0 2024-05-09T06:29:32.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.959+0000 7f92c3fff700 1 -- 172.21.15.46:0/2833218202 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f92d0056a10 con 0x7f92dc0ffff0 2024-05-09T06:29:32.941 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:29:32.941 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:29:32.942 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 14 2024-05-09T06:29:32.943 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:29:32.943 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.962+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f92c40692a0 msgr2=0x7f92c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.962+0000 7f92e2019700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f92c40692a0 0x7f92c406b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f92cc004890 tx=0x7f92cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.962+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 msgr2=0x7f92dc10df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.962+0000 7f92e2019700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc10df80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f92d000eb40 tx=0x7f92d000b040 comp rx=0 tx=0).stop 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.962+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 shutdown_connections 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.963+0000 7f92e2019700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f92c40692a0 0x7f92c406b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.963+0000 7f92e2019700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92dc066ad0 0x7f92dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.963+0000 7f92e2019700 1 --2- 172.21.15.46:0/2833218202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92dc0ffff0 0x7f92dc10df80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:32.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.963+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 >> 172.21.15.46:0/2833218202 conn(0x7f92dc0f74c0 msgr2=0x7f92dc0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:32.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.963+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 shutdown_connections 2024-05-09T06:29:32.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:32.963+0000 7f92e2019700 1 -- 172.21.15.46:0/2833218202 wait complete. 2024-05-09T06:29:32.950 INFO:tasks.workunit.client.1.smithi106.stderr:+ mkdir -p fsstress 2024-05-09T06:29:32.952 INFO:tasks.workunit.client.1.smithi106.stderr:+ pushd fsstress 2024-05-09T06:29:32.952 INFO:tasks.workunit.client.1.smithi106.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:29:32.952 INFO:tasks.workunit.client.1.smithi106.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-09T06:29:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 -- 172.21.15.46:0/2518279320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 msgr2=0x7f968c0ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 --2- 172.21.15.46:0/2518279320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0ffa20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f967c004940 tx=0x7f967c009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 -- 172.21.15.46:0/2518279320 shutdown_connections 2024-05-09T06:29:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 --2- 172.21.15.46:0/2518279320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c0fff60 0x7f968c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 --2- 172.21.15.46:0/2518279320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0ffa20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:33.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 -- 172.21.15.46:0/2518279320 >> 172.21.15.46:0/2518279320 conn(0x7f968c0f7430 msgr2=0x7f968c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:33.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 -- 172.21.15.46:0/2518279320 shutdown_connections 2024-05-09T06:29:33.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.105+0000 7f96917a4700 1 -- 172.21.15.46:0/2518279320 wait complete. 2024-05-09T06:29:33.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f96917a4700 1 Processor -- start 2024-05-09T06:29:33.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f96917a4700 1 -- start start 2024-05-09T06:29:33.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f96917a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:33.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f96917a4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c0fff60 0x7f968c0fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:33.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f96917a4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0fbed0 con 0x7f968c066240 2024-05-09T06:29:33.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f96917a4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0fc040 con 0x7f968c0fff60 2024-05-09T06:29:33.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f968a7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c0fff60 0x7f968c0fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f968affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.106+0000 7f968affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0fd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46890/0 (socket says 172.21.15.46:46890) 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f968affd700 1 -- 172.21.15.46:0/3648302461 learned_addr learned my addr 172.21.15.46:0/3648302461 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f968affd700 1 -- 172.21.15.46:0/3648302461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c0fff60 msgr2=0x7f968c0fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f968affd700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c0fff60 0x7f968c0fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f968affd700 1 -- 172.21.15.46:0/3648302461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c005040 con 0x7f968c066240 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f968affd700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0fd450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c00e070 con 0x7f968c066240 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f967c01c400 con 0x7f968c066240 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f96917a4700 1 -- 172.21.15.46:0/3648302461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0fc2c0 con 0x7f968c066240 2024-05-09T06:29:33.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.107+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c00e070 con 0x7f968c066240 2024-05-09T06:29:33.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.108+0000 7f96917a4700 1 -- 172.21.15.46:0/3648302461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c1159c0 con 0x7f968c066240 2024-05-09T06:29:33.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.110+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c0052b0 con 0x7f968c066240 2024-05-09T06:29:33.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.110+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f967c01c570 con 0x7f968c066240 2024-05-09T06:29:33.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.110+0000 7f96737fe700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f96740692a0 0x7f967406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:29:33.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.110+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f967c088370 con 0x7f968c066240 2024-05-09T06:29:33.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.111+0000 7f968a7fc700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f96740692a0 0x7f967406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:29:33.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.111+0000 7f968a7fc700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f96740692a0 0x7f967406b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9680004fd0 tx=0x7f968000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:29:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.115+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f967c054650 con 0x7f968c066240 2024-05-09T06:29:33.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:33 smithi046 ceph-mon[26924]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:33.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:33 smithi046 ceph-mon[26924]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:33.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:33 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2833218202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:33.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.442+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 --> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f966c000bc0 con 0x7f96740692a0 2024-05-09T06:29:33.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.443+0000 7f96737fe700 1 -- 172.21.15.46:0/3648302461 <== mgr.14218 v2:172.21.15.46:6800/394354124 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f966c000bc0 con 0x7f96740692a0 2024-05-09T06:29:33.425 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "0/2 daemons upgraded", 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc image on host smithi106", 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:29:33.426 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.445+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f96740692a0 msgr2=0x7f967406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.445+0000 7f96717fa700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f96740692a0 0x7f967406b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9680004fd0 tx=0x7f968000b040 comp rx=0 tx=0).stop 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.445+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 msgr2=0x7f968c0fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.445+0000 7f96717fa700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0fd450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c009e30 comp rx=0 tx=0).stop 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 shutdown_connections 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:6800/394354124,v1:172.21.15.46:6801/394354124] conn(0x7f96740692a0 0x7f967406b750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c066240 0x7f968c0fd450 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 --2- 172.21.15.46:0/3648302461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c0fff60 0x7f968c0fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:29:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 >> 172.21.15.46:0/3648302461 conn(0x7f968c0f7430 msgr2=0x7f968c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:29:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 shutdown_connections 2024-05-09T06:29:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:29:33.446+0000 7f96717fa700 1 -- 172.21.15.46:0/3648302461 wait complete. 2024-05-09T06:29:33.490 INFO:tasks.workunit.client.1.smithi106.stderr:+ tar xzf ltp-full.tgz 2024-05-09T06:29:33.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:33 smithi106 ceph-mon[34679]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:33.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:33 smithi106 ceph-mon[34679]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:29:33.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:33 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2833218202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:29:34.476 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:34 smithi106 ceph-mon[34679]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:34.476 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:34 smithi106 ceph-mon[34679]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:34.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:34 smithi046 ceph-mon[26924]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:34.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:34 smithi046 ceph-mon[26924]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:35.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:35 smithi106 ceph-mon[34679]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:35.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:35 smithi106 ceph-mon[34679]: pgmap v234: 65 pgs: 65 active+clean; 597 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:29:35.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:35 smithi046 ceph-mon[26924]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:29:35.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:35 smithi046 ceph-mon[26924]: pgmap v234: 65 pgs: 65 active+clean; 597 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: Upgrade: Updating mgr.smithi106.nlgnpx 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: Deploying daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:29:36.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:36 smithi106 ceph-mon[34679]: pgmap v235: 65 pgs: 65 active+clean; 597 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:29:36.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: Upgrade: Updating mgr.smithi106.nlgnpx 2024-05-09T06:29:36.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:36.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:29:36.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:29:36.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:36.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: Deploying daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:29:36.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:36 smithi046 ceph-mon[26924]: pgmap v235: 65 pgs: 65 active+clean; 597 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-05-09T06:29:36.979 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 94% (11833/12535) Updating files: 95% (11909/12535) Updating files: 96% (12034/12535) Updating files: 97% (12159/12535) Updating files: 98% (12285/12535) Updating files: 99% (12410/12535) Updating files: 100% (12535/12535) Updating files: 100% (12535/12535), done. 2024-05-09T06:29:37.039 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'. 2024-05-09T06:29:37.039 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.039 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T06:29:37.039 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T06:29:37.039 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-09T06:29:37.040 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 720f8e954cd Merge pull request #55437 from tchaikov/ehh-upstart 2024-05-09T06:29:37.041 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T06:29:37.084 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T06:29:37.086 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T06:29:37.086 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T06:29:37.763 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T06:29:37.820 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T06:29:37.863 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T06:29:37.864 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T06:29:37.865 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T06:29:37.905 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T06:29:37.909 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:29:37.909 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T06:29:37.966 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-05-09T06:29:37.967 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-05-09T06:29:37.968 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-05-09T06:29:38.030 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p fsstress 2024-05-09T06:29:38.032 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd fsstress 2024-05-09T06:29:38.032 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:29:38.032 INFO:tasks.workunit.client.0.smithi046.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-05-09T06:29:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:39 smithi106 ceph-mon[34679]: pgmap v236: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 349 KiB/s wr, 0 op/s 2024-05-09T06:29:39.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:39 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:39 smithi046 ceph-mon[26924]: pgmap v236: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 349 KiB/s wr, 0 op/s 2024-05-09T06:29:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:39 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:39.578 INFO:tasks.workunit.client.0.smithi046.stderr:+ tar xzf ltp-full.tgz 2024-05-09T06:29:41.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:41 smithi106 ceph-mon[34679]: pgmap v237: 65 pgs: 65 active+clean; 20 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 73 op/s 2024-05-09T06:29:41.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:41 smithi046 ceph-mon[26924]: pgmap v237: 65 pgs: 65 active+clean; 20 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 73 op/s 2024-05-09T06:29:43.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:43 smithi106 ceph-mon[34679]: pgmap v238: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 197 op/s 2024-05-09T06:29:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:43 smithi046 ceph-mon[26924]: pgmap v238: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 197 op/s 2024-05-09T06:29:44.867 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:44.867 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:44.868 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:44 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:44.868 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:44 smithi106 ceph-mon[34679]: pgmap v239: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s wr, 284 op/s 2024-05-09T06:29:45.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:45.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:45.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:44 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:45.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:44 smithi046 ceph-mon[26924]: pgmap v239: 65 pgs: 65 active+clean; 48 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.1 MiB/s wr, 284 op/s 2024-05-09T06:29:47.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:47 smithi106 ceph-mon[34679]: pgmap v240: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s wr, 314 op/s 2024-05-09T06:29:47.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:47 smithi046 ceph-mon[26924]: pgmap v240: 65 pgs: 65 active+clean; 57 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s wr, 314 op/s 2024-05-09T06:29:48.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:48.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:48.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:48 smithi106 ceph-mon[34679]: pgmap v241: 65 pgs: 65 active+clean; 58 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s wr, 336 op/s 2024-05-09T06:29:48.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:48.902 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:48 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:49.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:49.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:49.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:48 smithi046 ceph-mon[26924]: pgmap v241: 65 pgs: 65 active+clean; 58 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s wr, 336 op/s 2024-05-09T06:29:49.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:49.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:48 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:51.200 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:51 smithi106 ceph-mon[34679]: pgmap v242: 65 pgs: 65 active+clean; 73 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 362 op/s 2024-05-09T06:29:51.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:51 smithi046 ceph-mon[26924]: pgmap v242: 65 pgs: 65 active+clean; 73 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 362 op/s 2024-05-09T06:29:52.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx restarted 2024-05-09T06:29:52.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:29:52.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:29:52.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:29:52.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:29:52.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:29:52.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:52.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:52.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:52.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:29:52.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:52.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:52.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr fail", "who": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:29:52.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: Activating manager daemon smithi106.nlgnpx 2024-05-09T06:29:52.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: osdmap e47: 6 total, 6 up, 6 in 2024-05-09T06:29:52.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "mgr fail", "who": "smithi046.nvpcui"}]': finished 2024-05-09T06:29:52.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: mgrmap e20: smithi106.nlgnpx(active, starting, since 0.00799034s) 2024-05-09T06:29:52.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:29:52.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:29:52.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:29:52.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:29:52.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:29:52.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:29:52.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:29:52.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:29:52.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:29:52.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:29:52.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:29:52.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:29:52.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:29:52.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:29:52.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:29:52.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:29:52.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: Manager daemon smithi106.nlgnpx is now available 2024-05-09T06:29:52.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:52.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:52.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:52.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:52 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: Standby manager daemon smithi106.nlgnpx restarted 2024-05-09T06:29:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:29:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:29:52.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:29:52.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:29:52.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:29:52.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:52.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:52.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:29:52.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr fail", "who": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: Activating manager daemon smithi106.nlgnpx 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: osdmap e47: 6 total, 6 up, 6 in 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14218 172.21.15.46:0/611894694' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "mgr fail", "who": "smithi046.nvpcui"}]': finished 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: mgrmap e20: smithi106.nlgnpx(active, starting, since 0.00799034s) 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:29:52.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: Manager daemon smithi106.nlgnpx is now available 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:29:52.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:29:52.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:52.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:52 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: Deploying cephadm binary to smithi106 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: Deploying cephadm binary to smithi046 2024-05-09T06:29:53.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:53 smithi106 ceph-mon[34679]: mgrmap e21: smithi106.nlgnpx(active, since 1.00912s) 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi106.nlgnpx/trash_purge_schedule"}]: dispatch 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: Deploying cephadm binary to smithi106 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: Deploying cephadm binary to smithi046 2024-05-09T06:29:53.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:53 smithi046 ceph-mon[26924]: mgrmap e21: smithi106.nlgnpx(active, since 1.00912s) 2024-05-09T06:29:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:54 smithi106 ceph-mon[34679]: [09/May/2024:06:29:52] ENGINE Bus STARTING 2024-05-09T06:29:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:54 smithi106 ceph-mon[34679]: pgmap v3: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:29:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:54 smithi106 ceph-mon[34679]: [09/May/2024:06:29:53] ENGINE Serving on https://172.21.15.106:7150 2024-05-09T06:29:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:54 smithi106 ceph-mon[34679]: [09/May/2024:06:29:53] ENGINE Serving on http://172.21.15.106:8765 2024-05-09T06:29:54.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:54 smithi106 ceph-mon[34679]: [09/May/2024:06:29:53] ENGINE Bus STARTED 2024-05-09T06:29:54.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:54 smithi046 ceph-mon[26924]: [09/May/2024:06:29:52] ENGINE Bus STARTING 2024-05-09T06:29:54.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:54 smithi046 ceph-mon[26924]: pgmap v3: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:29:54.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:54 smithi046 ceph-mon[26924]: [09/May/2024:06:29:53] ENGINE Serving on https://172.21.15.106:7150 2024-05-09T06:29:54.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:54 smithi046 ceph-mon[26924]: [09/May/2024:06:29:53] ENGINE Serving on http://172.21.15.106:8765 2024-05-09T06:29:54.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:54 smithi046 ceph-mon[26924]: [09/May/2024:06:29:53] ENGINE Bus STARTED 2024-05-09T06:29:55.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:55 smithi106 ceph-mon[34679]: pgmap v4: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:29:55.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:55 smithi106 ceph-mon[34679]: mgrmap e22: smithi106.nlgnpx(active, since 2s) 2024-05-09T06:29:55.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:55 smithi046 ceph-mon[26924]: pgmap v4: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:29:55.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:55 smithi046 ceph-mon[26924]: mgrmap e22: smithi106.nlgnpx(active, since 2s) 2024-05-09T06:29:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:57 smithi106 ceph-mon[34679]: pgmap v5: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:29:57.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:57 smithi106 ceph-mon[34679]: mgrmap e23: smithi106.nlgnpx(active, since 4s) 2024-05-09T06:29:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:57 smithi046 ceph-mon[26924]: pgmap v5: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:29:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:57 smithi046 ceph-mon[26924]: mgrmap e23: smithi106.nlgnpx(active, since 4s) 2024-05-09T06:29:59.041 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:29:59 smithi106 ceph-mon[34679]: pgmap v6: 65 pgs: 65 active+clean; 95 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s wr, 222 op/s 2024-05-09T06:29:59.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:29:59 smithi046 ceph-mon[26924]: pgmap v6: 65 pgs: 65 active+clean; 95 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s wr, 222 op/s 2024-05-09T06:30:00.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:00 smithi046 ceph-mon[26924]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:00.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:00 smithi046 ceph-mon[26924]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:00.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:00 smithi046 ceph-mon[26924]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:30:00.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:00 smithi106 ceph-mon[34679]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:00.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:00 smithi106 ceph-mon[34679]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:30:00.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:00 smithi106 ceph-mon[34679]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: pgmap v7: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: Standby manager daemon smithi046.nvpcui started 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/crt"}]: dispatch 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/key"}]: dispatch 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:01.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:01 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: pgmap v7: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: Standby manager daemon smithi046.nvpcui started 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/crt"}]: dispatch 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/key"}]: dispatch 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/1642703267' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:01 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:02.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:02 smithi106 ceph-mon[34679]: mgrmap e24: smithi106.nlgnpx(active, since 9s), standbys: smithi046.nvpcui 2024-05-09T06:30:02.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:02 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:30:02.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:02 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:02.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:02 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:02 smithi046 ceph-mon[26924]: mgrmap e24: smithi106.nlgnpx(active, since 9s), standbys: smithi046.nvpcui 2024-05-09T06:30:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:02 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:30:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:02 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:02 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:03.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:03 smithi106 ceph-mon[34679]: pgmap v8: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 397 op/s 2024-05-09T06:30:03.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:03 smithi046 ceph-mon[26924]: pgmap v8: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 3.7 MiB/s wr, 397 op/s 2024-05-09T06:30:03.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.569+0000 7fcff3cd9700 1 -- 172.21.15.46:0/965450730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fdfd0 msgr2=0x7fcfec0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.569+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/965450730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec0fe440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc004940 tx=0x7fcfdc009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- 172.21.15.46:0/965450730 shutdown_connections 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/965450730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec0fe440 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/965450730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fce60 0x7fcfec0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- 172.21.15.46:0/965450730 >> 172.21.15.46:0/965450730 conn(0x7fcfec0f8540 msgr2=0x7fcfec0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- 172.21.15.46:0/965450730 shutdown_connections 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- 172.21.15.46:0/965450730 wait complete. 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 Processor -- start 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- start start 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 0x7fcfec10fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:03.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec110710 con 0x7fcfec0fce60 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff3cd9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1150b0 con 0x7fcfec0fdfd0 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.570+0000 7fcff1a75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 0x7fcfec10fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1a75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 0x7fcfec10fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42530/0 (socket says 172.21.15.46:42530) 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1a75700 1 -- 172.21.15.46:0/900273409 learned_addr learned my addr 172.21.15.46:0/900273409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1274700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1a75700 1 -- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fdfd0 msgr2=0x7fcfec110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1a75700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1a75700 1 -- 172.21.15.46:0/900273409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc005040 con 0x7fcfec0fce60 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1274700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff1a75700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 0x7fcfec10fb40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800b790 tx=0x7fcfe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe800f770 con 0x7fcfec0fce60 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec115310 con 0x7fcfec0fce60 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfe800fda0 con 0x7fcfec0fce60 2024-05-09T06:30:03.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe800d310 con 0x7fcfec0fce60 2024-05-09T06:30:03.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.571+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec115880 con 0x7fcfec0fce60 2024-05-09T06:30:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.572+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec101960 con 0x7fcfec0fce60 2024-05-09T06:30:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.573+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7fcfe8010420 con 0x7fcfec0fce60 2024-05-09T06:30:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.573+0000 7fcfe27fc700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fcfd8070bc0 0x7fcfd8073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:03.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.573+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcfe80909c0 con 0x7fcfec0fce60 2024-05-09T06:30:03.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.574+0000 7fcff1274700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fcfd8070bc0 0x7fcfd8073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:03.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.574+0000 7fcff1274700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fcfd8070bc0 0x7fcfd8073070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b020 tx=0x7fcfdc009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:03.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.578+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fcfe8058e80 con 0x7fcfec0fce60 2024-05-09T06:30:03.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.835+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfec02b3b0 con 0x7fcfd8070bc0 2024-05-09T06:30:03.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.837+0000 7fcfe27fc700 1 -- 172.21.15.46:0/900273409 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcfec02b3b0 con 0x7fcfd8070bc0 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fcfd8070bc0 msgr2=0x7fcfd8073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fcfd8070bc0 0x7fcfd8073070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b020 tx=0x7fcfdc009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 msgr2=0x7fcfec10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 0x7fcfec10fb40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800b790 tx=0x7fcfe8009250 comp rx=0 tx=0).stop 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 shutdown_connections 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fcfd8070bc0 0x7fcfd8073070 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfec0fce60 0x7fcfec10fb40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 --2- 172.21.15.46:0/900273409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfec0fdfd0 0x7fcfec110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 >> 172.21.15.46:0/900273409 conn(0x7fcfec0f8540 msgr2=0x7fcfec0f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 shutdown_connections 2024-05-09T06:30:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:03.840+0000 7fcff3cd9700 1 -- 172.21.15.46:0/900273409 wait complete. 2024-05-09T06:30:03.836 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:30:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2977893593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 msgr2=0x7f17b0102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2977893593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b0102320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f17a0004940 tx=0x7f17a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2977893593 shutdown_connections 2024-05-09T06:30:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2977893593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b0102320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2977893593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b0066260 0x7f17b00ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2977893593 >> 172.21.15.46:0/2977893593 conn(0x7f17b00f7430 msgr2=0x7f17b00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2977893593 shutdown_connections 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.007+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2977893593 wait complete. 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b7ab9700 1 Processor -- start 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b7ab9700 1 -- start start 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b7ab9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b0066260 0x7f17b010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b7ab9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b7ab9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b010e520 con 0x7f17b00fff40 2024-05-09T06:30:03.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b7ab9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b010ed70 con 0x7f17b0066260 2024-05-09T06:30:03.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b5054700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:03.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b5054700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b010df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42554/0 (socket says 172.21.15.46:42554) 2024-05-09T06:30:03.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b5054700 1 -- 172.21.15.46:0/2625976581 learned_addr learned my addr 172.21.15.46:0/2625976581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.008+0000 7f17b5855700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b0066260 0x7f17b010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17b5054700 1 -- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b0066260 msgr2=0x7f17b010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17b5054700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b0066260 0x7f17b010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17b5054700 1 -- 172.21.15.46:0/2625976581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0005040 con 0x7f17b00fff40 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17b5054700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b010df20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009150 tx=0x7f17a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a000e040 con 0x7f17b00fff40 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17a0004290 con 0x7f17b00fff40 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a001c630 con 0x7f17b00fff40 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b010eff0 con 0x7f17b00fff40 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.009+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b010f4e0 con 0x7f17b00fff40 2024-05-09T06:30:03.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.010+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b005f5c0 con 0x7f17b00fff40 2024-05-09T06:30:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.011+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f17a000bbf0 con 0x7f17b00fff40 2024-05-09T06:30:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.011+0000 7f17a67fc700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f179c070bb0 0x7f179c073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.012+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f17a0091610 con 0x7f17b00fff40 2024-05-09T06:30:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.012+0000 7f17b5855700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f179c070bb0 0x7f179c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.012+0000 7f17b5855700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f179c070bb0 0x7f179c073060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17b0065fa0 tx=0x7f17ac00b040 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.017+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f17a0059b60 con 0x7f17b00fff40 2024-05-09T06:30:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.294+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b010f8d0 con 0x7f179c070bb0 2024-05-09T06:30:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.296+0000 7f17a67fc700 1 -- 172.21.15.46:0/2625976581 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f17b010f8d0 con 0x7f179c070bb0 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f179c070bb0 msgr2=0x7f179c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f179c070bb0 0x7f179c073060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17b0065fa0 tx=0x7f17ac00b040 comp rx=0 tx=0).stop 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 msgr2=0x7f17b010df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b010df20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009150 tx=0x7f17a0009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 shutdown_connections 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f179c070bb0 0x7f179c073060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b0066260 0x7f17b010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 --2- 172.21.15.46:0/2625976581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17b00fff40 0x7f17b010df20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 >> 172.21.15.46:0/2625976581 conn(0x7f17b00f7430 msgr2=0x7f17b00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 shutdown_connections 2024-05-09T06:30:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.299+0000 7f17b7ab9700 1 -- 172.21.15.46:0/2625976581 wait complete. 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.409+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/785654347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fb470 msgr2=0x7fdbe00fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.409+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/785654347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fb470 0x7fdbe00fb880 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0004a50 tx=0x7fdbd000af40 comp rx=0 tx=0).stop 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.409+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/785654347 shutdown_connections 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.409+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/785654347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.409+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/785654347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fb470 0x7fdbe00fb880 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.409+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/785654347 >> 172.21.15.46:0/785654347 conn(0x7fdbe00f6bb0 msgr2=0x7fdbe00f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/785654347 shutdown_connections 2024-05-09T06:30:04.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/785654347 wait complete. 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 Processor -- start 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 -- start start 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe00fb470 0x7fdbe00ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00ff9b0 con 0x7fdbe00fc720 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.410+0000 7fdbe4b8c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00fdfa0 con 0x7fdbe00fb470 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42564/0 (socket says 172.21.15.46:42564) 2024-05-09T06:30:04.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 -- 172.21.15.46:0/1469693583 learned_addr learned my addr 172.21.15.46:0/1469693583 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbde59c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe00fb470 0x7fdbe00ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 -- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe00fb470 msgr2=0x7fdbe00ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe00fb470 0x7fdbe00ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 -- 172.21.15.46:0/1469693583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0005040 con 0x7fdbe00fc720 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbddd9b700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fda60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4002a50 tx=0x7fdbd40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd4007cc0 con 0x7fdbe00fc720 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbd400f040 con 0x7fdbe00fc720 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd4009670 con 0x7fdbe00fc720 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.411+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe00fe250 con 0x7fdbe00fc720 2024-05-09T06:30:04.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.412+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe00fe810 con 0x7fdbe00fc720 2024-05-09T06:30:04.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.413+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe004c710 con 0x7fdbe00fc720 2024-05-09T06:30:04.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.414+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7fdbd40097d0 con 0x7fdbe00fc720 2024-05-09T06:30:04.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.414+0000 7fdbceffd700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fdbc8070bc0 0x7fdbc8073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:04.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.414+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fdbd4090760 con 0x7fdbe00fc720 2024-05-09T06:30:04.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.414+0000 7fdbde59c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fdbc8070bc0 0x7fdbc8073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:04.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.415+0000 7fdbde59c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fdbc8070bc0 0x7fdbc8073070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000c3b0 tx=0x7fdbd000af40 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:04.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.419+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fdbd4058b90 con 0x7fdbe00fc720 2024-05-09T06:30:04.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.664+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbe0100c70 con 0x7fdbc8070bc0 2024-05-09T06:30:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.675+0000 7fdbceffd700 1 -- 172.21.15.46:0/1469693583 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fdbe0100c70 con 0x7fdbc8070bc0 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 2m ago 7m 25.6M - 0.25.0 c8568f914cd2 b0b44c27fce3 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 2m ago 8m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (7m) 3s ago 6m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 2m ago 7m 82.4M - 9.4.7 954c08fa6188 9ac57528a8a2 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (2m) 2m ago 2m 10.4M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (2m) 2m ago 2m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (2m) 3s ago 2m 15.4M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (2m) 3s ago 2m 13.0M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:9283 running (9m) 2m ago 9m 480M - 17.2.7-933-g4ba5a836 b96134859c76 8f6ac823d36e 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (21s) 3s ago 6m 504M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb1059f4aba5 2024-05-09T06:30:04.657 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 2m ago 9m 45.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (6m) 3s ago 6m 36.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 2m ago 8m 16.4M - 1.5.0 0da6a335fe13 8241269a3f80 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (6m) 3s ago 6m 16.9M - 1.5.0 0da6a335fe13 c00aff5800c6 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 2m ago 6m 45.4M 4289M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 2m ago 5m 48.0M 4289M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 2m ago 5m 45.6M 4289M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (4m) 3s ago 4m 95.5M 5312M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (4m) 3s ago 4m 85.7M 5312M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (3m) 3s ago 3m 88.7M 5312M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:30:04.658 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 2m ago 7m 51.6M - 2.43.0 a07b618ecd1d 85a9e537bba1 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.678+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fdbc8070bc0 msgr2=0x7fdbc8073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.678+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fdbc8070bc0 0x7fdbc8073070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000c3b0 tx=0x7fdbd000af40 comp rx=0 tx=0).stop 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.678+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 msgr2=0x7fdbe00fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.678+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fda60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4002a50 tx=0x7fdbd40046b0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 shutdown_connections 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fdbc8070bc0 0x7fdbc8073070 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe00fb470 0x7fdbe00ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 --2- 172.21.15.46:0/1469693583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe00fc720 0x7fdbe00fda60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 >> 172.21.15.46:0/1469693583 conn(0x7fdbe00f6bb0 msgr2=0x7fdbe00f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 shutdown_connections 2024-05-09T06:30:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.679+0000 7fdbe4b8c700 1 -- 172.21.15.46:0/1469693583 wait complete. 2024-05-09T06:30:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.789+0000 7f7dcc71f700 1 -- 172.21.15.46:0/1488288036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 msgr2=0x7f7dc4102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.789+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/1488288036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc4102320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7db4004940 tx=0x7f7db4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.789+0000 7f7dcc71f700 1 -- 172.21.15.46:0/1488288036 shutdown_connections 2024-05-09T06:30:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.789+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/1488288036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc4102320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.789+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/1488288036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc4066260 0x7f7dc40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.789+0000 7f7dcc71f700 1 -- 172.21.15.46:0/1488288036 >> 172.21.15.46:0/1488288036 conn(0x7f7dc40f7430 msgr2=0x7f7dc40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 -- 172.21.15.46:0/1488288036 shutdown_connections 2024-05-09T06:30:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 -- 172.21.15.46:0/1488288036 wait complete. 2024-05-09T06:30:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 Processor -- start 2024-05-09T06:30:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 -- start start 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc4066260 0x7f7dc40fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc40fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40fbeb0 con 0x7f7dc40fff40 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.790+0000 7f7dcc71f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40fc020 con 0x7f7dc4066260 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc40fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc40fb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42582/0 (socket says 172.21.15.46:42582) 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 -- 172.21.15.46:0/821023158 learned_addr learned my addr 172.21.15.46:0/821023158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:04.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dca4bb700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc4066260 0x7f7dc40fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 -- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc4066260 msgr2=0x7f7dc40fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc4066260 0x7f7dc40fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 -- 172.21.15.46:0/821023158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4005040 con 0x7f7dc40fff40 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dc9cba700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc40fb900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009150 tx=0x7f7db4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db400e040 con 0x7f7dc40fff40 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7db4004290 con 0x7f7dc40fff40 2024-05-09T06:30:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc40fc2a0 con 0x7f7dc40fff40 2024-05-09T06:30:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db401c630 con 0x7f7dc40fff40 2024-05-09T06:30:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.791+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc4115a10 con 0x7f7dc40fff40 2024-05-09T06:30:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.793+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc405f5c0 con 0x7f7dc40fff40 2024-05-09T06:30:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.794+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f7db400bbf0 con 0x7f7dc40fff40 2024-05-09T06:30:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.794+0000 7f7dbaffd700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f7db0070bb0 0x7f7db0073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.795+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7db4091670 con 0x7f7dc40fff40 2024-05-09T06:30:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.795+0000 7f7dca4bb700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f7db0070bb0 0x7f7db0073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:04.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.795+0000 7f7dca4bb700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f7db0070bb0 0x7f7db0073060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40fd1c0 tx=0x7f7dc000b040 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:04.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:04.803+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f7db4059b40 con 0x7f7dc40fff40 2024-05-09T06:30:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.121+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7dc404bed0 con 0x7f7dc40fff40 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.122+0000 7f7dbaffd700 1 -- 172.21.15.46:0/821023158 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f7db40594e0 con 0x7f7dc40fff40 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:30:05.103 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 13, 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:30:05.104 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:30:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f7db0070bb0 msgr2=0x7f7db0073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f7db0070bb0 0x7f7db0073060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40fd1c0 tx=0x7f7dc000b040 comp rx=0 tx=0).stop 2024-05-09T06:30:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 msgr2=0x7f7dc40fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc40fb900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009150 tx=0x7f7db4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 shutdown_connections 2024-05-09T06:30:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f7db0070bb0 0x7f7db0073060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7dc4066260 0x7f7dc40fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 --2- 172.21.15.46:0/821023158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dc40fff40 0x7f7dc40fb900 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 >> 172.21.15.46:0/821023158 conn(0x7f7dc40f7430 msgr2=0x7f7dc40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:05.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 shutdown_connections 2024-05-09T06:30:05.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.125+0000 7f7dcc71f700 1 -- 172.21.15.46:0/821023158 wait complete. 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 -- 172.21.15.46:0/62541223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a840fff60 msgr2=0x7f6a84102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/62541223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a840fff60 0x7f6a84102340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6a70004940 tx=0x7f6a70009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 -- 172.21.15.46:0/62541223 shutdown_connections 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/62541223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a840fff60 0x7f6a84102340 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/62541223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a84066240 0x7f6a840ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 -- 172.21.15.46:0/62541223 >> 172.21.15.46:0/62541223 conn(0x7f6a840f7430 msgr2=0x7f6a840f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:05.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 -- 172.21.15.46:0/62541223 shutdown_connections 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 -- 172.21.15.46:0/62541223 wait complete. 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 Processor -- start 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.240+0000 7f6a8af2f700 1 -- start start 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a8af2f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 0x7f6a840fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a8af2f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a840fff60 0x7f6a840fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a8af2f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840fbed0 con 0x7f6a84066240 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a8af2f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840fc040 con 0x7f6a840fff60 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 0x7f6a840fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 0x7f6a840fd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42604/0 (socket says 172.21.15.46:42604) 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 -- 172.21.15.46:0/2432062251 learned_addr learned my addr 172.21.15.46:0/2432062251 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a83fff700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a840fff60 0x7f6a840fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 -- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a840fff60 msgr2=0x7f6a840fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a840fff60 0x7f6a840fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 -- 172.21.15.46:0/2432062251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a70005040 con 0x7f6a84066240 2024-05-09T06:30:05.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.241+0000 7f6a88ccb700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 0x7f6a840fd450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800c8e0 tx=0x7f6a780044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:05.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.242+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7800a760 con 0x7f6a84066240 2024-05-09T06:30:05.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.242+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a840fc320 con 0x7f6a84066240 2024-05-09T06:30:05.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.242+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a7800ad90 con 0x7f6a84066240 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.242+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a780113a0 con 0x7f6a84066240 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.243+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a84115a50 con 0x7f6a84066240 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.244+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f6a78012400 con 0x7f6a84066240 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.244+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8405f5c0 con 0x7f6a84066240 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.244+0000 7f6a817fa700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6a74070bb0 0x7f6a74073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.244+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6a78090820 con 0x7f6a84066240 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.244+0000 7f6a83fff700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6a74070bb0 0x7f6a74073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:05.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.245+0000 7f6a83fff700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6a74070bb0 0x7f6a74073060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000b3b0 tx=0x7f6a70009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:05.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.249+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f6a78058e20 con 0x7f6a84066240 2024-05-09T06:30:05.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:05 smithi106 ceph-mon[34679]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:05.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:05 smithi106 ceph-mon[34679]: pgmap v9: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 914 op/s 2024-05-09T06:30:05.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:05 smithi106 ceph-mon[34679]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:05.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:05 smithi046 ceph-mon[26924]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:05.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:05 smithi046 ceph-mon[26924]: pgmap v9: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 914 op/s 2024-05-09T06:30:05.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:05 smithi046 ceph-mon[26924]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:05.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.577+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a840f8f20 con 0x7f6a74070bb0 2024-05-09T06:30:05.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.578+0000 7f6a817fa700 1 -- 172.21.15.46:0/2432062251 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6a840f8f20 con 0x7f6a74070bb0 2024-05-09T06:30:05.559 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:30:05.559 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "1/2 daemons upgraded", 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:30:05.560 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:30:05.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6a74070bb0 msgr2=0x7f6a74073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6a74070bb0 0x7f6a74073060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000b3b0 tx=0x7f6a70009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 msgr2=0x7f6a840fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 0x7f6a840fd450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800c8e0 tx=0x7f6a780044c0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 shutdown_connections 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6a74070bb0 0x7f6a74073060 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a84066240 0x7f6a840fd450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 --2- 172.21.15.46:0/2432062251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a840fff60 0x7f6a840fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 >> 172.21.15.46:0/2432062251 conn(0x7f6a840f7430 msgr2=0x7f6a840f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 shutdown_connections 2024-05-09T06:30:05.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:05.581+0000 7f6a8af2f700 1 -- 172.21.15.46:0/2432062251 wait complete. 2024-05-09T06:30:06.248 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:06 smithi106 ceph-mon[34679]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:06.248 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:06 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/821023158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:06.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:06 smithi046 ceph-mon[26924]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:06.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:06 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/821023158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:07.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:07 smithi046 ceph-mon[26924]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:07.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:07 smithi046 ceph-mon[26924]: pgmap v10: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 838 op/s 2024-05-09T06:30:07.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:07 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:07.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:07 smithi106 ceph-mon[34679]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:07.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:07 smithi106 ceph-mon[34679]: pgmap v10: 65 pgs: 65 active+clean; 163 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 838 op/s 2024-05-09T06:30:07.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:07 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:08.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:08 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:08.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:08 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:08.684 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:08 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:08.685 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:08 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: pgmap v11: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 838 op/s 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:09 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:09.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: pgmap v11: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 6.8 MiB/s wr, 838 op/s 2024-05-09T06:30:09.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:09.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:09.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:09 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:10.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:10 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi046 to 1559M 2024-05-09T06:30:10.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:10 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi046 to 1559M 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: pgmap v12: 65 pgs: 65 active+clean; 175 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 754 op/s 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:11.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:30:11.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:11 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:30:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: pgmap v12: 65 pgs: 65 active+clean; 175 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 754 op/s 2024-05-09T06:30:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:30:11.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:11.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:30:11.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:11 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:30:12.648 INFO:tasks.workunit.client.1.smithi106.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-09T06:30:12.661 INFO:tasks.workunit.client.1.smithi106.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:30:12.661 INFO:tasks.workunit.client.1.smithi106.stderr:+ make 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Adjusting osd_memory_target on smithi106 to 2581M 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:12 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Adjusting osd_memory_target on smithi106 to 2581M 2024-05-09T06:30:12.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:12.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:12 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:13.449 INFO:tasks.workunit.client.1.smithi106.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-09T06:30:13.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:13 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:13.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:13 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:13.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:13 smithi046 ceph-mon[26924]: pgmap v13: 65 pgs: 65 active+clean; 175 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 549 op/s 2024-05-09T06:30:13.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:13 smithi046 ceph-mon[26924]: Reconfiguring node-exporter.smithi046 (dependencies changed)... 2024-05-09T06:30:13.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:13 smithi046 ceph-mon[26924]: Reconfiguring daemon node-exporter.smithi046 on smithi046 2024-05-09T06:30:13.747 INFO:tasks.workunit.client.1.smithi106.stderr:++ readlink -f fsstress 2024-05-09T06:30:13.748 INFO:tasks.workunit.client.1.smithi106.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-09T06:30:13.748 INFO:tasks.workunit.client.1.smithi106.stderr:+ popd 2024-05-09T06:30:13.748 INFO:tasks.workunit.client.1.smithi106.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:30:13.748 INFO:tasks.workunit.client.1.smithi106.stderr:+ popd 2024-05-09T06:30:13.748 INFO:tasks.workunit.client.1.smithi106.stdout:~/cephtest/mnt.1/client.1/tmp 2024-05-09T06:30:13.749 INFO:tasks.workunit.client.1.smithi106.stderr:++ mktemp -d -p . 2024-05-09T06:30:13.751 INFO:tasks.workunit.client.1.smithi106.stderr:+ T=./tmp.gU2TWJPUCA 2024-05-09T06:30:13.751 INFO:tasks.workunit.client.1.smithi106.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gU2TWJPUCA -l 1 -n 1000 -p 10 -v 2024-05-09T06:30:13.753 INFO:tasks.workunit.client.1.smithi106.stdout:seed = 1714921488 2024-05-09T06:30:13.756 INFO:tasks.workunit.client.1.smithi106.stdout:0/0: truncate - no filename 2024-05-09T06:30:13.756 INFO:tasks.workunit.client.1.smithi106.stdout:0/1: unlink - no file 2024-05-09T06:30:13.757 INFO:tasks.workunit.client.1.smithi106.stdout:1/0: getdents . 0 2024-05-09T06:30:13.758 INFO:tasks.workunit.client.1.smithi106.stdout:0/2: creat f0 x:0 0 0 2024-05-09T06:30:13.759 INFO:tasks.workunit.client.1.smithi106.stdout:2/0: unlink - no file 2024-05-09T06:30:13.760 INFO:tasks.workunit.client.1.smithi106.stdout:1/1: mknod c0 0 2024-05-09T06:30:13.760 INFO:tasks.workunit.client.1.smithi106.stdout:1/2: chown c0 3 1 2024-05-09T06:30:13.762 INFO:tasks.workunit.client.1.smithi106.stdout:0/3: mkdir d1 0 2024-05-09T06:30:13.762 INFO:tasks.workunit.client.1.smithi106.stdout:3/0: link - no file 2024-05-09T06:30:13.762 INFO:tasks.workunit.client.1.smithi106.stdout:3/1: dwrite - no filename 2024-05-09T06:30:13.762 INFO:tasks.workunit.client.1.smithi106.stdout:3/2: write - no filename 2024-05-09T06:30:13.762 INFO:tasks.workunit.client.1.smithi106.stdout:3/3: dread - no filename 2024-05-09T06:30:13.764 INFO:tasks.workunit.client.1.smithi106.stdout:2/1: creat f0 x:0 0 0 2024-05-09T06:30:13.764 INFO:tasks.workunit.client.1.smithi106.stdout:2/2: creat f1 x:0 0 0 2024-05-09T06:30:13.764 INFO:tasks.workunit.client.1.smithi106.stdout:2/3: dread - f0 zero size 2024-05-09T06:30:13.764 INFO:tasks.workunit.client.1.smithi106.stdout:1/3: creat f1 x:0 0 0 2024-05-09T06:30:13.764 INFO:tasks.workunit.client.1.smithi106.stdout:1/4: write f1 [837977,82690] 0 2024-05-09T06:30:13.765 INFO:tasks.workunit.client.1.smithi106.stdout:0/4: symlink d1/l2 0 2024-05-09T06:30:13.765 INFO:tasks.workunit.client.1.smithi106.stdout:0/5: write f0 [986922,66480] 0 2024-05-09T06:30:13.766 INFO:tasks.workunit.client.1.smithi106.stdout:4/0: chown . 0 1 2024-05-09T06:30:13.767 INFO:tasks.workunit.client.1.smithi106.stdout:3/4: mknod c0 0 2024-05-09T06:30:13.768 INFO:tasks.workunit.client.1.smithi106.stdout:3/5: chown c0 4449 1 2024-05-09T06:30:13.769 INFO:tasks.workunit.client.1.smithi106.stdout:2/4: mkdir d2 0 2024-05-09T06:30:13.770 INFO:tasks.workunit.client.1.smithi106.stdout:1/5: rename f1 to f2 0 2024-05-09T06:30:13.774 INFO:tasks.workunit.client.1.smithi106.stdout:5/0: chown . 0 1 2024-05-09T06:30:13.774 INFO:tasks.workunit.client.1.smithi106.stdout:5/1: link - no file 2024-05-09T06:30:13.775 INFO:tasks.workunit.client.1.smithi106.stdout:4/1: creat f0 x:0 0 0 2024-05-09T06:30:13.775 INFO:tasks.workunit.client.1.smithi106.stdout:4/2: dread - f0 zero size 2024-05-09T06:30:13.775 INFO:tasks.workunit.client.1.smithi106.stdout:4/3: write f0 [5717,58758] 0 2024-05-09T06:30:13.775 INFO:tasks.workunit.client.1.smithi106.stdout:4/4: chown f0 0 1 2024-05-09T06:30:13.776 INFO:tasks.workunit.client.1.smithi106.stdout:3/6: creat f1 x:0 0 0 2024-05-09T06:30:13.777 INFO:tasks.workunit.client.1.smithi106.stdout:2/5: mkdir d2/d3 0 2024-05-09T06:30:13.779 INFO:tasks.workunit.client.1.smithi106.stdout:6/0: dwrite - no filename 2024-05-09T06:30:13.780 INFO:tasks.workunit.client.1.smithi106.stdout:4/5: dread f0 [0,4194304] 0 2024-05-09T06:30:13.781 INFO:tasks.workunit.client.1.smithi106.stdout:5/2: symlink l0 0 2024-05-09T06:30:13.781 INFO:tasks.workunit.client.1.smithi106.stdout:5/3: dread - no filename 2024-05-09T06:30:13.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/4: truncate - no filename 2024-05-09T06:30:13.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/5: read - no filename 2024-05-09T06:30:13.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/6: chown l0 274 1 2024-05-09T06:30:13.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/7: write - no filename 2024-05-09T06:30:13.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/8: dread - no filename 2024-05-09T06:30:13.783 INFO:tasks.workunit.client.1.smithi106.stdout:2/6: symlink d2/d3/l4 0 2024-05-09T06:30:13.784 INFO:tasks.workunit.client.1.smithi106.stdout:2/7: stat d2/d3 0 2024-05-09T06:30:13.784 INFO:tasks.workunit.client.1.smithi106.stdout:2/8: write f1 [1043292,78356] 0 2024-05-09T06:30:13.784 INFO:tasks.workunit.client.1.smithi106.stdout:2/9: dread - f0 zero size 2024-05-09T06:30:13.784 INFO:tasks.workunit.client.1.smithi106.stdout:2/10: write f1 [1459986,14208] 0 2024-05-09T06:30:13.785 INFO:tasks.workunit.client.1.smithi106.stdout:7/0: dwrite - no filename 2024-05-09T06:30:13.785 INFO:tasks.workunit.client.1.smithi106.stdout:7/1: rename - no filename 2024-05-09T06:30:13.785 INFO:tasks.workunit.client.1.smithi106.stdout:7/2: write - no filename 2024-05-09T06:30:13.786 INFO:tasks.workunit.client.1.smithi106.stdout:7/3: dwrite - no filename 2024-05-09T06:30:13.786 INFO:tasks.workunit.client.1.smithi106.stdout:7/4: dread - no filename 2024-05-09T06:30:13.787 INFO:tasks.workunit.client.1.smithi106.stdout:6/1: mkdir d0 0 2024-05-09T06:30:13.787 INFO:tasks.workunit.client.1.smithi106.stdout:6/2: dwrite - no filename 2024-05-09T06:30:13.787 INFO:tasks.workunit.client.1.smithi106.stdout:6/3: dwrite - no filename 2024-05-09T06:30:13.790 INFO:tasks.workunit.client.1.smithi106.stdout:4/6: mknod c1 0 2024-05-09T06:30:13.791 INFO:tasks.workunit.client.1.smithi106.stdout:4/7: truncate f0 1078501 0 2024-05-09T06:30:13.791 INFO:tasks.workunit.client.1.smithi106.stdout:4/8: fdatasync f0 0 2024-05-09T06:30:13.791 INFO:tasks.workunit.client.1.smithi106.stdout:4/9: fdatasync f0 0 2024-05-09T06:30:13.791 INFO:tasks.workunit.client.1.smithi106.stdout:4/10: write f0 [1445383,95642] 0 2024-05-09T06:30:13.792 INFO:tasks.workunit.client.1.smithi106.stdout:5/9: creat f1 x:0 0 0 2024-05-09T06:30:13.792 INFO:tasks.workunit.client.1.smithi106.stdout:5/10: fdatasync f1 0 2024-05-09T06:30:13.792 INFO:tasks.workunit.client.1.smithi106.stdout:5/11: write f1 [593334,17483] 0 2024-05-09T06:30:13.792 INFO:tasks.workunit.client.1.smithi106.stdout:5/12: write f1 [1004773,44781] 0 2024-05-09T06:30:13.796 INFO:tasks.workunit.client.1.smithi106.stdout:8/0: fsync - no filename 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:8/1: rename - no filename 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:8/2: read - no filename 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:8/3: chown . 6614421 1 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:8/4: dread - no filename 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:8/5: unlink - no file 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:8/6: link - no file 2024-05-09T06:30:13.797 INFO:tasks.workunit.client.1.smithi106.stdout:1/6: dwrite f2 [0,4194304] 0 2024-05-09T06:30:13.798 INFO:tasks.workunit.client.1.smithi106.stdout:3/7: dwrite f1 [0,4194304] 0 2024-05-09T06:30:13.798 INFO:tasks.workunit.client.1.smithi106.stdout:7/5: mkdir d0 0 2024-05-09T06:30:13.798 INFO:tasks.workunit.client.1.smithi106.stdout:7/6: getdents d0 0 2024-05-09T06:30:13.798 INFO:tasks.workunit.client.1.smithi106.stdout:7/7: dwrite - no filename 2024-05-09T06:30:13.798 INFO:tasks.workunit.client.1.smithi106.stdout:7/8: dread - no filename 2024-05-09T06:30:13.798 INFO:tasks.workunit.client.1.smithi106.stdout:7/9: dread - no filename 2024-05-09T06:30:13.800 INFO:tasks.workunit.client.1.smithi106.stdout:6/4: mkdir d0/d1 0 2024-05-09T06:30:13.800 INFO:tasks.workunit.client.1.smithi106.stdout:6/5: stat d0 0 2024-05-09T06:30:13.800 INFO:tasks.workunit.client.1.smithi106.stdout:6/6: fsync - no filename 2024-05-09T06:30:13.802 INFO:tasks.workunit.client.1.smithi106.stdout:5/13: link l0 l2 0 2024-05-09T06:30:13.802 INFO:tasks.workunit.client.1.smithi106.stdout:5/14: rmdir - no directory 2024-05-09T06:30:13.802 INFO:tasks.workunit.client.1.smithi106.stdout:4/11: fdatasync f0 0 2024-05-09T06:30:13.820 INFO:tasks.workunit.client.1.smithi106.stdout:8/7: creat f0 x:0 0 0 2024-05-09T06:30:13.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:13 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:13.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:13 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:30:13.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:13 smithi106 ceph-mon[34679]: pgmap v13: 65 pgs: 65 active+clean; 175 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 549 op/s 2024-05-09T06:30:13.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:13 smithi106 ceph-mon[34679]: Reconfiguring node-exporter.smithi046 (dependencies changed)... 2024-05-09T06:30:13.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:13 smithi106 ceph-mon[34679]: Reconfiguring daemon node-exporter.smithi046 on smithi046 2024-05-09T06:30:13.839 INFO:tasks.workunit.client.1.smithi106.stdout:6/7: rmdir d0/d1 0 2024-05-09T06:30:13.839 INFO:tasks.workunit.client.1.smithi106.stdout:6/8: fdatasync - no filename 2024-05-09T06:30:13.842 INFO:tasks.workunit.client.1.smithi106.stdout:5/15: symlink l3 0 2024-05-09T06:30:13.858 INFO:tasks.workunit.client.1.smithi106.stdout:8/8: rename f0 to f1 0 2024-05-09T06:30:13.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/9: mkdir d0/d2 0 2024-05-09T06:30:13.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/10: unlink - no file 2024-05-09T06:30:14.018 INFO:tasks.workunit.client.1.smithi106.stdout:6/11: creat d0/d2/f3 x:0 0 0 2024-05-09T06:30:14.038 INFO:tasks.workunit.client.1.smithi106.stdout:8/9: dwrite f1 [0,4194304] 0 2024-05-09T06:30:14.039 INFO:tasks.workunit.client.1.smithi106.stdout:8/10: stat f1 0 2024-05-09T06:30:14.047 INFO:tasks.workunit.client.1.smithi106.stdout:8/11: write f1 [3004252,37843] 0 2024-05-09T06:30:14.048 INFO:tasks.workunit.client.1.smithi106.stdout:8/12: creat f2 x:0 0 0 2024-05-09T06:30:14.061 INFO:tasks.workunit.client.1.smithi106.stdout:5/16: dwrite f1 [0,4194304] 0 2024-05-09T06:30:14.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/0: link - no file 2024-05-09T06:30:14.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/1: chown . 189 1 2024-05-09T06:30:14.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/2: link - no file 2024-05-09T06:30:14.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/3: read - no filename 2024-05-09T06:30:14.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/4: dread - no filename 2024-05-09T06:30:14.081 INFO:tasks.workunit.client.1.smithi106.stdout:4/12: dwrite f0 [0,4194304] 0 2024-05-09T06:30:14.081 INFO:tasks.workunit.client.1.smithi106.stdout:4/13: creat f2 x:0 0 0 2024-05-09T06:30:14.081 INFO:tasks.workunit.client.1.smithi106.stdout:4/14: creat f3 x:0 0 0 2024-05-09T06:30:14.279 INFO:tasks.workunit.client.1.smithi106.stdout:2/11: fsync f0 0 2024-05-09T06:30:14.282 INFO:tasks.workunit.client.1.smithi106.stdout:0/6: getdents d1 0 2024-05-09T06:30:14.291 INFO:tasks.workunit.client.1.smithi106.stdout:1/7: getdents . 0 2024-05-09T06:30:14.330 INFO:tasks.workunit.client.1.smithi106.stdout:3/8: truncate f1 4088350 0 2024-05-09T06:30:14.664 INFO:tasks.workunit.client.1.smithi106.stdout:3/9: dread f1 [0,4194304] 0 2024-05-09T06:30:14.664 INFO:tasks.workunit.client.1.smithi106.stdout:3/10: creat f2 x:0 0 0 2024-05-09T06:30:15.043 INFO:tasks.workunit.client.1.smithi106.stdout:6/12: symlink d0/d2/l4 0 2024-05-09T06:30:15.084 INFO:tasks.workunit.client.1.smithi106.stdout:8/13: mkdir d3 0 2024-05-09T06:30:15.110 INFO:tasks.workunit.client.1.smithi106.stdout:5/17: symlink l4 0 2024-05-09T06:30:15.110 INFO:tasks.workunit.client.1.smithi106.stdout:5/18: chown l3 1307727 1 2024-05-09T06:30:15.131 INFO:tasks.workunit.client.1.smithi106.stdout:4/15: symlink l4 0 2024-05-09T06:30:15.131 INFO:tasks.workunit.client.1.smithi106.stdout:4/16: fsync f0 0 2024-05-09T06:30:15.626 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:15 smithi106 ceph-mon[34679]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 803 op/s 2024-05-09T06:30:15.626 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:15 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:15.626 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:15 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:15.637 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:15 smithi046 ceph-mon[26924]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 803 op/s 2024-05-09T06:30:15.637 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:15 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:15.637 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:15 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:16.437 INFO:tasks.workunit.client.1.smithi106.stdout:2/12: mkdir d2/d5 0 2024-05-09T06:30:16.437 INFO:tasks.workunit.client.1.smithi106.stdout:0/7: creat d1/f3 x:0 0 0 2024-05-09T06:30:16.438 INFO:tasks.workunit.client.1.smithi106.stdout:1/8: link c0 c3 0 2024-05-09T06:30:16.439 INFO:tasks.workunit.client.1.smithi106.stdout:0/8: dread f0 [0,4194304] 0 2024-05-09T06:30:16.442 INFO:tasks.workunit.client.1.smithi106.stdout:3/11: symlink l3 0 2024-05-09T06:30:16.442 INFO:tasks.workunit.client.1.smithi106.stdout:3/12: fdatasync f2 0 2024-05-09T06:30:16.442 INFO:tasks.workunit.client.1.smithi106.stdout:3/13: chown c0 647 1 2024-05-09T06:30:16.446 INFO:tasks.workunit.client.1.smithi106.stdout:6/13: creat d0/f5 x:0 0 0 2024-05-09T06:30:16.446 INFO:tasks.workunit.client.1.smithi106.stdout:6/14: dread - d0/d2/f3 zero size 2024-05-09T06:30:16.446 INFO:tasks.workunit.client.1.smithi106.stdout:4/17: symlink l5 0 2024-05-09T06:30:16.446 INFO:tasks.workunit.client.1.smithi106.stdout:4/18: creat f6 x:0 0 0 2024-05-09T06:30:16.446 INFO:tasks.workunit.client.1.smithi106.stdout:4/19: readlink l5 0 2024-05-09T06:30:16.461 INFO:tasks.workunit.client.1.smithi106.stdout:3/14: dwrite f2 [0,4194304] 0 2024-05-09T06:30:16.465 INFO:tasks.workunit.client.1.smithi106.stdout:3/15: dread f1 [0,4194304] 0 2024-05-09T06:30:16.474 INFO:tasks.workunit.client.1.smithi106.stdout:4/20: dwrite f6 [0,4194304] 0 2024-05-09T06:30:16.474 INFO:tasks.workunit.client.1.smithi106.stdout:3/16: write f2 [699727,61338] 0 2024-05-09T06:30:16.484 INFO:tasks.workunit.client.1.smithi106.stdout:2/13: creat d2/d5/f6 x:0 0 0 2024-05-09T06:30:16.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/14: rename f2 to d3/f4 0 2024-05-09T06:30:16.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/15: write d3/f4 [528008,115962] 0 2024-05-09T06:30:16.489 INFO:tasks.workunit.client.1.smithi106.stdout:5/19: truncate f1 2450012 0 2024-05-09T06:30:16.489 INFO:tasks.workunit.client.1.smithi106.stdout:5/20: chown l3 0 1 2024-05-09T06:30:16.492 INFO:tasks.workunit.client.1.smithi106.stdout:3/17: dwrite f1 [4194304,4194304] 0 2024-05-09T06:30:16.493 INFO:tasks.workunit.client.1.smithi106.stdout:4/21: truncate f0 3950929 0 2024-05-09T06:30:16.493 INFO:tasks.workunit.client.1.smithi106.stdout:4/22: chown l5 185124897 1 2024-05-09T06:30:16.495 INFO:tasks.workunit.client.1.smithi106.stdout:2/14: rename d2/d3 to d2/d7 0 2024-05-09T06:30:16.495 INFO:tasks.workunit.client.1.smithi106.stdout:2/15: truncate f0 96453 0 2024-05-09T06:30:16.496 INFO:tasks.workunit.client.1.smithi106.stdout:1/9: mkdir d4 0 2024-05-09T06:30:16.501 INFO:tasks.workunit.client.1.smithi106.stdout:4/23: mkdir d7 0 2024-05-09T06:30:16.503 INFO:tasks.workunit.client.1.smithi106.stdout:2/16: mknod d2/c8 0 2024-05-09T06:30:16.504 INFO:tasks.workunit.client.1.smithi106.stdout:1/10: mkdir d4/d5 0 2024-05-09T06:30:16.506 INFO:tasks.workunit.client.1.smithi106.stdout:6/15: rename d0/d2 to d0/d6 0 2024-05-09T06:30:16.506 INFO:tasks.workunit.client.1.smithi106.stdout:6/16: stat d0/d6/f3 0 2024-05-09T06:30:16.506 INFO:tasks.workunit.client.1.smithi106.stdout:6/17: read - d0/d6/f3 zero size 2024-05-09T06:30:16.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/17: symlink d2/l9 0 2024-05-09T06:30:16.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/18: dread - d2/d5/f6 zero size 2024-05-09T06:30:16.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/19: write d2/d5/f6 [683822,75708] 0 2024-05-09T06:30:16.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/20: write f0 [829801,97590] 0 2024-05-09T06:30:16.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/21: write f0 [497065,102224] 0 2024-05-09T06:30:16.509 INFO:tasks.workunit.client.1.smithi106.stdout:6/18: mknod d0/d6/c7 0 2024-05-09T06:30:16.510 INFO:tasks.workunit.client.1.smithi106.stdout:2/22: link d2/c8 d2/ca 0 2024-05-09T06:30:16.511 INFO:tasks.workunit.client.1.smithi106.stdout:1/11: truncate f2 1647560 0 2024-05-09T06:30:16.512 INFO:tasks.workunit.client.1.smithi106.stdout:6/19: mkdir d0/d6/d8 0 2024-05-09T06:30:16.513 INFO:tasks.workunit.client.1.smithi106.stdout:3/18: dwrite f2 [0,4194304] 0 2024-05-09T06:30:16.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/12: write - open f2 failed 14 2024-05-09T06:30:16.516 INFO:tasks.workunit.client.1.smithi106.stdout:6/20: rename d0/d6/f3 to d0/d6/d8/f9 0 2024-05-09T06:30:16.522 INFO:tasks.workunit.client.1.smithi106.stdout:3/19: write f2 [1463004,7971] 0 2024-05-09T06:30:16.524 INFO:tasks.workunit.client.1.smithi106.stdout:3/20: symlink l4 0 2024-05-09T06:30:16.533 INFO:tasks.workunit.client.1.smithi106.stdout:2/23: dwrite d2/d5/f6 [0,4194304] 0 2024-05-09T06:30:16.540 INFO:tasks.workunit.client.1.smithi106.stdout:6/21: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:16.540 INFO:tasks.workunit.client.1.smithi106.stdout:6/22: dread - d0/d6/d8/f9 zero size 2024-05-09T06:30:16.547 INFO:tasks.workunit.client.1.smithi106.stdout:3/21: dwrite f1 [0,4194304] 0 2024-05-09T06:30:16.551 INFO:tasks.workunit.client.1.smithi106.stdout:6/23: dread d0/f5 [0,4194304] 0 2024-05-09T06:30:16.642 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:16 smithi046 ceph-mon[26924]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-05-09T06:30:16.642 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:16 smithi046 ceph-mon[26924]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-05-09T06:30:16.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:16 smithi106 ceph-mon[34679]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-05-09T06:30:16.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:16 smithi106 ceph-mon[34679]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-05-09T06:30:16.901 INFO:tasks.workunit.client.1.smithi106.stdout:0/9: fsync d1/f3 0 2024-05-09T06:30:16.901 INFO:tasks.workunit.client.1.smithi106.stdout:0/10: chown f0 519916466 1 2024-05-09T06:30:16.912 INFO:tasks.workunit.client.1.smithi106.stdout:0/11: dwrite f0 [0,4194304] 0 2024-05-09T06:30:16.919 INFO:tasks.workunit.client.1.smithi106.stdout:0/12: rename d1 to d1/d4 22 2024-05-09T06:30:16.922 INFO:tasks.workunit.client.1.smithi106.stdout:0/13: creat d1/f5 x:0 0 0 2024-05-09T06:30:16.933 INFO:tasks.workunit.client.1.smithi106.stdout:2/24: getdents d2/d5 0 2024-05-09T06:30:16.934 INFO:tasks.workunit.client.1.smithi106.stdout:8/16: getdents d3 0 2024-05-09T06:30:16.937 INFO:tasks.workunit.client.1.smithi106.stdout:2/25: mkdir d2/d5/db 0 2024-05-09T06:30:16.939 INFO:tasks.workunit.client.1.smithi106.stdout:2/26: fdatasync d2/d5/f6 0 2024-05-09T06:30:16.945 INFO:tasks.workunit.client.1.smithi106.stdout:5/21: dread f1 [0,4194304] 0 2024-05-09T06:30:16.946 INFO:tasks.workunit.client.1.smithi106.stdout:2/27: creat d2/fc x:0 0 0 2024-05-09T06:30:16.948 INFO:tasks.workunit.client.1.smithi106.stdout:5/22: read f1 [811558,63824] 0 2024-05-09T06:30:16.949 INFO:tasks.workunit.client.1.smithi106.stdout:4/24: write f0 [1070317,20076] 0 2024-05-09T06:30:16.950 INFO:tasks.workunit.client.1.smithi106.stdout:5/23: symlink l5 0 2024-05-09T06:30:16.952 INFO:tasks.workunit.client.1.smithi106.stdout:7/10: sync 2024-05-09T06:30:16.953 INFO:tasks.workunit.client.1.smithi106.stdout:9/5: sync 2024-05-09T06:30:16.953 INFO:tasks.workunit.client.1.smithi106.stdout:7/11: write - no filename 2024-05-09T06:30:16.953 INFO:tasks.workunit.client.1.smithi106.stdout:7/12: dwrite - no filename 2024-05-09T06:30:16.953 INFO:tasks.workunit.client.1.smithi106.stdout:7/13: fsync - no filename 2024-05-09T06:30:16.953 INFO:tasks.workunit.client.1.smithi106.stdout:7/14: stat d0 0 2024-05-09T06:30:16.953 INFO:tasks.workunit.client.1.smithi106.stdout:7/15: dread - no filename 2024-05-09T06:30:16.954 INFO:tasks.workunit.client.1.smithi106.stdout:8/17: dwrite d3/f4 [0,4194304] 0 2024-05-09T06:30:16.955 INFO:tasks.workunit.client.1.smithi106.stdout:4/25: symlink d7/l8 0 2024-05-09T06:30:16.957 INFO:tasks.workunit.client.1.smithi106.stdout:5/24: unlink l5 0 2024-05-09T06:30:16.958 INFO:tasks.workunit.client.1.smithi106.stdout:5/25: fsync f1 0 2024-05-09T06:30:16.960 INFO:tasks.workunit.client.1.smithi106.stdout:9/6: creat f0 x:0 0 0 2024-05-09T06:30:16.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/16: symlink d0/l1 0 2024-05-09T06:30:16.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/17: rename d0 to d0/d2 22 2024-05-09T06:30:16.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/18: write - no filename 2024-05-09T06:30:16.964 INFO:tasks.workunit.client.1.smithi106.stdout:6/24: write d0/f5 [4952216,88487] 0 2024-05-09T06:30:16.966 INFO:tasks.workunit.client.1.smithi106.stdout:4/26: dread f6 [0,4194304] 0 2024-05-09T06:30:16.969 INFO:tasks.workunit.client.1.smithi106.stdout:1/13: link f2 d4/d5/f6 0 2024-05-09T06:30:16.972 INFO:tasks.workunit.client.1.smithi106.stdout:8/18: dwrite f1 [0,4194304] 0 2024-05-09T06:30:16.972 INFO:tasks.workunit.client.1.smithi106.stdout:8/19: truncate f1 5190513 0 2024-05-09T06:30:16.973 INFO:tasks.workunit.client.1.smithi106.stdout:9/7: rename f0 to f1 0 2024-05-09T06:30:16.973 INFO:tasks.workunit.client.1.smithi106.stdout:9/8: write f1 [343277,11785] 0 2024-05-09T06:30:16.973 INFO:tasks.workunit.client.1.smithi106.stdout:9/9: chown f1 325588 1 2024-05-09T06:30:16.973 INFO:tasks.workunit.client.1.smithi106.stdout:9/10: creat f2 x:0 0 0 2024-05-09T06:30:16.973 INFO:tasks.workunit.client.1.smithi106.stdout:9/11: dread - f2 zero size 2024-05-09T06:30:16.973 INFO:tasks.workunit.client.1.smithi106.stdout:9/12: read - f2 zero size 2024-05-09T06:30:16.974 INFO:tasks.workunit.client.1.smithi106.stdout:7/19: rename d0/l1 to d0/l3 0 2024-05-09T06:30:16.977 INFO:tasks.workunit.client.1.smithi106.stdout:5/26: dwrite f1 [0,4194304] 0 2024-05-09T06:30:16.977 INFO:tasks.workunit.client.1.smithi106.stdout:6/25: rename d0/d6/c7 to d0/ca 0 2024-05-09T06:30:16.979 INFO:tasks.workunit.client.1.smithi106.stdout:4/27: creat d7/f9 x:0 0 0 2024-05-09T06:30:16.982 INFO:tasks.workunit.client.1.smithi106.stdout:1/14: creat d4/d5/f7 x:0 0 0 2024-05-09T06:30:16.983 INFO:tasks.workunit.client.1.smithi106.stdout:8/20: mkdir d3/d5 0 2024-05-09T06:30:16.985 INFO:tasks.workunit.client.1.smithi106.stdout:5/27: read f1 [4113167,16928] 0 2024-05-09T06:30:16.985 INFO:tasks.workunit.client.1.smithi106.stdout:5/28: write f1 [4296106,5230] 0 2024-05-09T06:30:16.985 INFO:tasks.workunit.client.1.smithi106.stdout:5/29: creat f6 x:0 0 0 2024-05-09T06:30:16.987 INFO:tasks.workunit.client.1.smithi106.stdout:9/13: mknod c3 0 2024-05-09T06:30:16.988 INFO:tasks.workunit.client.1.smithi106.stdout:9/14: dread f1 [0,4194304] 0 2024-05-09T06:30:16.989 INFO:tasks.workunit.client.1.smithi106.stdout:9/15: write f1 [111682,12743] 0 2024-05-09T06:30:16.992 INFO:tasks.workunit.client.1.smithi106.stdout:6/26: creat d0/d6/fb x:0 0 0 2024-05-09T06:30:16.993 INFO:tasks.workunit.client.1.smithi106.stdout:4/28: symlink d7/la 0 2024-05-09T06:30:16.994 INFO:tasks.workunit.client.1.smithi106.stdout:4/29: creat d7/fb x:0 0 0 2024-05-09T06:30:16.994 INFO:tasks.workunit.client.1.smithi106.stdout:2/28: truncate d2/d5/f6 3279489 0 2024-05-09T06:30:16.997 INFO:tasks.workunit.client.1.smithi106.stdout:8/21: rename d3/f4 to d3/f6 0 2024-05-09T06:30:17.005 INFO:tasks.workunit.client.1.smithi106.stdout:5/30: rename l3 to l7 0 2024-05-09T06:30:17.007 INFO:tasks.workunit.client.1.smithi106.stdout:9/16: mkdir d4 0 2024-05-09T06:30:17.009 INFO:tasks.workunit.client.1.smithi106.stdout:6/27: symlink d0/lc 0 2024-05-09T06:30:17.009 INFO:tasks.workunit.client.1.smithi106.stdout:6/28: read - d0/d6/fb zero size 2024-05-09T06:30:17.009 INFO:tasks.workunit.client.1.smithi106.stdout:6/29: dread - d0/d6/d8/f9 zero size 2024-05-09T06:30:17.009 INFO:tasks.workunit.client.1.smithi106.stdout:8/22: write d3/f6 [3910230,97586] 0 2024-05-09T06:30:17.011 INFO:tasks.workunit.client.1.smithi106.stdout:6/30: write d0/f5 [1340921,119356] 0 2024-05-09T06:30:17.011 INFO:tasks.workunit.client.1.smithi106.stdout:6/31: write d0/d6/d8/f9 [655823,10593] 0 2024-05-09T06:30:17.014 INFO:tasks.workunit.client.1.smithi106.stdout:5/31: stat l7 0 2024-05-09T06:30:17.014 INFO:tasks.workunit.client.1.smithi106.stdout:5/32: chown l4 1432593 1 2024-05-09T06:30:17.017 INFO:tasks.workunit.client.1.smithi106.stdout:8/23: mkdir d3/d5/d7 0 2024-05-09T06:30:17.020 INFO:tasks.workunit.client.1.smithi106.stdout:6/32: mkdir d0/d6/d8/dd 0 2024-05-09T06:30:17.020 INFO:tasks.workunit.client.1.smithi106.stdout:6/33: write d0/d6/d8/f9 [1088862,45919] 0 2024-05-09T06:30:17.020 INFO:tasks.workunit.client.1.smithi106.stdout:6/34: creat d0/d6/fe x:0 0 0 2024-05-09T06:30:17.021 INFO:tasks.workunit.client.1.smithi106.stdout:4/30: dwrite f6 [0,4194304] 0 2024-05-09T06:30:17.021 INFO:tasks.workunit.client.1.smithi106.stdout:4/31: truncate f3 884132 0 2024-05-09T06:30:17.027 INFO:tasks.workunit.client.1.smithi106.stdout:6/35: creat d0/d6/d8/ff x:0 0 0 2024-05-09T06:30:17.027 INFO:tasks.workunit.client.1.smithi106.stdout:6/36: stat d0/lc 0 2024-05-09T06:30:17.027 INFO:tasks.workunit.client.1.smithi106.stdout:6/37: write d0/d6/fe [87743,69638] 0 2024-05-09T06:30:17.034 INFO:tasks.workunit.client.1.smithi106.stdout:4/32: mkdir d7/dc 0 2024-05-09T06:30:17.034 INFO:tasks.workunit.client.1.smithi106.stdout:4/33: read - d7/f9 zero size 2024-05-09T06:30:17.035 INFO:tasks.workunit.client.1.smithi106.stdout:4/34: dread f3 [0,4194304] 0 2024-05-09T06:30:17.035 INFO:tasks.workunit.client.1.smithi106.stdout:4/35: chown d7/fb 280946658 1 2024-05-09T06:30:17.035 INFO:tasks.workunit.client.1.smithi106.stdout:4/36: chown l4 2826 1 2024-05-09T06:30:17.035 INFO:tasks.workunit.client.1.smithi106.stdout:4/37: chown l5 231676477 1 2024-05-09T06:30:17.035 INFO:tasks.workunit.client.1.smithi106.stdout:9/17: dwrite f1 [0,4194304] 0 2024-05-09T06:30:17.035 INFO:tasks.workunit.client.1.smithi106.stdout:9/18: readlink - no filename 2024-05-09T06:30:17.040 INFO:tasks.workunit.client.1.smithi106.stdout:6/38: creat d0/d6/d8/dd/f10 x:0 0 0 2024-05-09T06:30:17.040 INFO:tasks.workunit.client.1.smithi106.stdout:5/33: dwrite f6 [0,4194304] 0 2024-05-09T06:30:17.043 INFO:tasks.workunit.client.1.smithi106.stdout:4/38: rename f6 to d7/fd 0 2024-05-09T06:30:17.045 INFO:tasks.workunit.client.1.smithi106.stdout:9/19: mknod d4/c5 0 2024-05-09T06:30:17.046 INFO:tasks.workunit.client.1.smithi106.stdout:9/20: fdatasync f2 0 2024-05-09T06:30:17.047 INFO:tasks.workunit.client.1.smithi106.stdout:6/39: symlink d0/d6/d8/l11 0 2024-05-09T06:30:17.048 INFO:tasks.workunit.client.1.smithi106.stdout:6/40: creat d0/d6/d8/f12 x:0 0 0 2024-05-09T06:30:17.048 INFO:tasks.workunit.client.1.smithi106.stdout:6/41: truncate d0/d6/d8/f12 434849 0 2024-05-09T06:30:17.048 INFO:tasks.workunit.client.1.smithi106.stdout:6/42: read - d0/d6/d8/dd/f10 zero size 2024-05-09T06:30:17.049 INFO:tasks.workunit.client.1.smithi106.stdout:5/34: write f6 [63134,108670] 0 2024-05-09T06:30:17.058 INFO:tasks.workunit.client.1.smithi106.stdout:4/39: mkdir d7/dc/de 0 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/40: write d7/f9 [331731,14343] 0 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/41: truncate d7/fb 209369 0 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/42: read d7/fb [99998,8559] 0 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/43: write f3 [802814,116462] 0 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:9/21: rmdir d4 39 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:9/22: chown d4/c5 3 1 2024-05-09T06:30:17.059 INFO:tasks.workunit.client.1.smithi106.stdout:9/23: chown f1 3 1 2024-05-09T06:30:17.063 INFO:tasks.workunit.client.1.smithi106.stdout:6/43: mknod d0/d6/c13 0 2024-05-09T06:30:17.065 INFO:tasks.workunit.client.1.smithi106.stdout:5/35: mkdir d8 0 2024-05-09T06:30:17.065 INFO:tasks.workunit.client.1.smithi106.stdout:5/36: chown f6 127 1 2024-05-09T06:30:17.065 INFO:tasks.workunit.client.1.smithi106.stdout:5/37: chown l2 227233814 1 2024-05-09T06:30:17.070 INFO:tasks.workunit.client.1.smithi106.stdout:4/44: link c1 d7/dc/cf 0 2024-05-09T06:30:17.070 INFO:tasks.workunit.client.1.smithi106.stdout:4/45: dread - f2 zero size 2024-05-09T06:30:17.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/24: unlink d4/c5 0 2024-05-09T06:30:17.083 INFO:tasks.workunit.client.1.smithi106.stdout:4/46: dwrite d7/fd [4194304,4194304] 0 2024-05-09T06:30:17.084 INFO:tasks.workunit.client.1.smithi106.stdout:5/38: creat d8/f9 x:0 0 0 2024-05-09T06:30:17.084 INFO:tasks.workunit.client.1.smithi106.stdout:5/39: fdatasync f6 0 2024-05-09T06:30:17.084 INFO:tasks.workunit.client.1.smithi106.stdout:5/40: read - d8/f9 zero size 2024-05-09T06:30:17.084 INFO:tasks.workunit.client.1.smithi106.stdout:5/41: chown l2 141121 1 2024-05-09T06:30:17.415 INFO:tasks.workunit.client.1.smithi106.stdout:3/22: sync 2024-05-09T06:30:17.419 INFO:tasks.workunit.client.1.smithi106.stdout:3/23: mkdir d5 0 2024-05-09T06:30:17.422 INFO:tasks.workunit.client.1.smithi106.stdout:3/24: symlink d5/l6 0 2024-05-09T06:30:17.428 INFO:tasks.workunit.client.1.smithi106.stdout:3/25: dread f2 [0,4194304] 0 2024-05-09T06:30:17.428 INFO:tasks.workunit.client.1.smithi106.stdout:3/26: stat d5 0 2024-05-09T06:30:17.431 INFO:tasks.workunit.client.1.smithi106.stdout:3/27: creat d5/f7 x:0 0 0 2024-05-09T06:30:17.431 INFO:tasks.workunit.client.1.smithi106.stdout:3/28: creat d5/f8 x:0 0 0 2024-05-09T06:30:17.436 INFO:tasks.workunit.client.1.smithi106.stdout:3/29: unlink l4 0 2024-05-09T06:30:17.438 INFO:tasks.workunit.client.1.smithi106.stdout:3/30: truncate f2 809283 0 2024-05-09T06:30:17.440 INFO:tasks.workunit.client.1.smithi106.stdout:2/29: rmdir d2 39 2024-05-09T06:30:17.440 INFO:tasks.workunit.client.1.smithi106.stdout:2/30: stat d2/l9 0 2024-05-09T06:30:17.446 INFO:tasks.workunit.client.1.smithi106.stdout:3/31: write f1 [2824486,49911] 0 2024-05-09T06:30:17.446 INFO:tasks.workunit.client.1.smithi106.stdout:3/32: write d5/f7 [259557,45858] 0 2024-05-09T06:30:17.447 INFO:tasks.workunit.client.1.smithi106.stdout:2/31: symlink d2/d5/ld 0 2024-05-09T06:30:17.447 INFO:tasks.workunit.client.1.smithi106.stdout:2/32: fsync f0 0 2024-05-09T06:30:17.448 INFO:tasks.workunit.client.1.smithi106.stdout:3/33: mknod d5/c9 0 2024-05-09T06:30:17.451 INFO:tasks.workunit.client.1.smithi106.stdout:2/33: symlink d2/d5/db/le 0 2024-05-09T06:30:17.453 INFO:tasks.workunit.client.1.smithi106.stdout:6/44: getdents d0 0 2024-05-09T06:30:17.454 INFO:tasks.workunit.client.1.smithi106.stdout:6/45: truncate d0/d6/fe 917987 0 2024-05-09T06:30:17.455 INFO:tasks.workunit.client.1.smithi106.stdout:6/46: dread d0/d6/fe [0,4194304] 0 2024-05-09T06:30:17.456 INFO:tasks.workunit.client.1.smithi106.stdout:2/34: unlink d2/l9 0 2024-05-09T06:30:17.456 INFO:tasks.workunit.client.1.smithi106.stdout:4/47: fsync d7/fb 0 2024-05-09T06:30:17.458 INFO:tasks.workunit.client.1.smithi106.stdout:6/47: link d0/d6/d8/dd/f10 d0/d6/d8/f14 0 2024-05-09T06:30:17.458 INFO:tasks.workunit.client.1.smithi106.stdout:6/48: fdatasync d0/d6/d8/f12 0 2024-05-09T06:30:17.458 INFO:tasks.workunit.client.1.smithi106.stdout:6/49: write d0/d6/fb [758518,86873] 0 2024-05-09T06:30:17.458 INFO:tasks.workunit.client.1.smithi106.stdout:6/50: write d0/d6/d8/ff [911440,63868] 0 2024-05-09T06:30:17.463 INFO:tasks.workunit.client.1.smithi106.stdout:3/34: dwrite d5/f7 [0,4194304] 0 2024-05-09T06:30:17.463 INFO:tasks.workunit.client.1.smithi106.stdout:3/35: chown f2 24 1 2024-05-09T06:30:17.463 INFO:tasks.workunit.client.1.smithi106.stdout:3/36: write f1 [630127,35134] 0 2024-05-09T06:30:17.464 INFO:tasks.workunit.client.1.smithi106.stdout:2/35: rename d2/d5/db/le to d2/d5/lf 0 2024-05-09T06:30:17.470 INFO:tasks.workunit.client.1.smithi106.stdout:4/48: rename d7/dc/de to d7/d10 0 2024-05-09T06:30:17.470 INFO:tasks.workunit.client.1.smithi106.stdout:4/49: creat d7/f11 x:0 0 0 2024-05-09T06:30:17.470 INFO:tasks.workunit.client.1.smithi106.stdout:4/50: write f3 [1141697,36377] 0 2024-05-09T06:30:17.471 INFO:tasks.workunit.client.1.smithi106.stdout:2/36: creat d2/f10 x:0 0 0 2024-05-09T06:30:17.477 INFO:tasks.workunit.client.1.smithi106.stdout:6/51: dwrite d0/d6/d8/f12 [0,4194304] 0 2024-05-09T06:30:17.480 INFO:tasks.workunit.client.1.smithi106.stdout:4/51: dread d7/fd [4194304,4194304] 0 2024-05-09T06:30:17.481 INFO:tasks.workunit.client.1.smithi106.stdout:2/37: unlink d2/ca 0 2024-05-09T06:30:17.482 INFO:tasks.workunit.client.1.smithi106.stdout:2/38: chown d2/d7 127019 1 2024-05-09T06:30:17.487 INFO:tasks.workunit.client.1.smithi106.stdout:2/39: dread d2/d5/f6 [0,4194304] 0 2024-05-09T06:30:17.491 INFO:tasks.workunit.client.1.smithi106.stdout:2/40: creat d2/d7/f11 x:0 0 0 2024-05-09T06:30:17.495 INFO:tasks.workunit.client.1.smithi106.stdout:2/41: mknod d2/d5/c12 0 2024-05-09T06:30:17.495 INFO:tasks.workunit.client.1.smithi106.stdout:2/42: readlink d2/d7/l4 0 2024-05-09T06:30:17.495 INFO:tasks.workunit.client.1.smithi106.stdout:2/43: chown d2/d5/f6 2857 1 2024-05-09T06:30:17.496 INFO:tasks.workunit.client.1.smithi106.stdout:0/14: sync 2024-05-09T06:30:17.496 INFO:tasks.workunit.client.1.smithi106.stdout:0/15: read - d1/f5 zero size 2024-05-09T06:30:17.498 INFO:tasks.workunit.client.1.smithi106.stdout:6/52: dwrite d0/d6/d8/dd/f10 [0,4194304] 0 2024-05-09T06:30:17.500 INFO:tasks.workunit.client.1.smithi106.stdout:2/44: rename d2/d7/f11 to d2/d5/f13 0 2024-05-09T06:30:17.504 INFO:tasks.workunit.client.1.smithi106.stdout:6/53: truncate d0/d6/d8/f9 407259 0 2024-05-09T06:30:17.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/45: mknod d2/d5/c14 0 2024-05-09T06:30:17.509 INFO:tasks.workunit.client.1.smithi106.stdout:5/42: truncate f6 722782 0 2024-05-09T06:30:17.509 INFO:tasks.workunit.client.1.smithi106.stdout:5/43: write d8/f9 [890311,113413] 0 2024-05-09T06:30:17.511 INFO:tasks.workunit.client.1.smithi106.stdout:2/46: mkdir d2/d5/db/d15 0 2024-05-09T06:30:17.515 INFO:tasks.workunit.client.1.smithi106.stdout:4/52: dwrite d7/f11 [0,4194304] 0 2024-05-09T06:30:17.515 INFO:tasks.workunit.client.1.smithi106.stdout:0/16: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:30:17.518 INFO:tasks.workunit.client.1.smithi106.stdout:9/25: getdents d4 0 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:1/15: sync 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/20: sync 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/21: dwrite - no filename 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/22: read - no filename 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/23: rename d0 to d0/d4 22 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:1/16: fsync f2 0 2024-05-09T06:30:17.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/24: read - no filename 2024-05-09T06:30:17.520 INFO:tasks.workunit.client.1.smithi106.stdout:7/25: readlink d0/l3 0 2024-05-09T06:30:17.520 INFO:tasks.workunit.client.1.smithi106.stdout:4/53: mkdir d7/d10/d12 0 2024-05-09T06:30:17.523 INFO:tasks.workunit.client.1.smithi106.stdout:5/44: getdents d8 0 2024-05-09T06:30:17.524 INFO:tasks.workunit.client.1.smithi106.stdout:4/54: dread d7/fd [4194304,4194304] 0 2024-05-09T06:30:17.528 INFO:tasks.workunit.client.1.smithi106.stdout:1/17: mknod d4/c8 0 2024-05-09T06:30:17.530 INFO:tasks.workunit.client.1.smithi106.stdout:7/26: creat d0/f5 x:0 0 0 2024-05-09T06:30:17.530 INFO:tasks.workunit.client.1.smithi106.stdout:9/26: dwrite f2 [0,4194304] 0 2024-05-09T06:30:17.531 INFO:tasks.workunit.client.1.smithi106.stdout:5/45: stat l2 0 2024-05-09T06:30:17.531 INFO:tasks.workunit.client.1.smithi106.stdout:5/46: write d8/f9 [902173,13234] 0 2024-05-09T06:30:17.534 INFO:tasks.workunit.client.1.smithi106.stdout:0/17: link d1/f5 d1/f6 0 2024-05-09T06:30:17.536 INFO:tasks.workunit.client.1.smithi106.stdout:1/18: mkdir d4/d5/d9 0 2024-05-09T06:30:17.542 INFO:tasks.workunit.client.1.smithi106.stdout:9/27: mkdir d4/d6 0 2024-05-09T06:30:17.543 INFO:tasks.workunit.client.1.smithi106.stdout:7/27: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:17.543 INFO:tasks.workunit.client.1.smithi106.stdout:5/47: truncate f1 1882832 0 2024-05-09T06:30:17.546 INFO:tasks.workunit.client.1.smithi106.stdout:0/18: readlink d1/l2 0 2024-05-09T06:30:17.547 INFO:tasks.workunit.client.1.smithi106.stdout:1/19: creat d4/fa x:0 0 0 2024-05-09T06:30:17.547 INFO:tasks.workunit.client.1.smithi106.stdout:1/20: write d4/d5/f6 [2465427,4363] 0 2024-05-09T06:30:17.547 INFO:tasks.workunit.client.1.smithi106.stdout:1/21: creat d4/fb x:0 0 0 2024-05-09T06:30:17.549 INFO:tasks.workunit.client.1.smithi106.stdout:9/28: truncate f1 4051609 0 2024-05-09T06:30:17.552 INFO:tasks.workunit.client.1.smithi106.stdout:7/28: dread d0/f5 [0,4194304] 0 2024-05-09T06:30:17.552 INFO:tasks.workunit.client.1.smithi106.stdout:7/29: creat d0/f6 x:0 0 0 2024-05-09T06:30:17.555 INFO:tasks.workunit.client.1.smithi106.stdout:0/19: dread f0 [0,4194304] 0 2024-05-09T06:30:17.557 INFO:tasks.workunit.client.1.smithi106.stdout:1/22: dread d4/d5/f6 [0,4194304] 0 2024-05-09T06:30:17.557 INFO:tasks.workunit.client.1.smithi106.stdout:1/23: readlink - no filename 2024-05-09T06:30:17.562 INFO:tasks.workunit.client.1.smithi106.stdout:7/30: rename d0/l3 to d0/l7 0 2024-05-09T06:30:17.564 INFO:tasks.workunit.client.1.smithi106.stdout:1/24: creat d4/d5/d9/fc x:0 0 0 2024-05-09T06:30:17.567 INFO:tasks.workunit.client.1.smithi106.stdout:1/25: symlink d4/d5/ld 0 2024-05-09T06:30:17.568 INFO:tasks.workunit.client.1.smithi106.stdout:1/26: write d4/fa [799109,86508] 0 2024-05-09T06:30:17.568 INFO:tasks.workunit.client.1.smithi106.stdout:1/27: truncate d4/fb 589815 0 2024-05-09T06:30:17.568 INFO:tasks.workunit.client.1.smithi106.stdout:1/28: read - d4/d5/f7 zero size 2024-05-09T06:30:17.568 INFO:tasks.workunit.client.1.smithi106.stdout:1/29: creat d4/d5/d9/fe x:0 0 0 2024-05-09T06:30:17.568 INFO:tasks.workunit.client.1.smithi106.stdout:1/30: creat d4/d5/ff x:0 0 0 2024-05-09T06:30:17.569 INFO:tasks.workunit.client.1.smithi106.stdout:0/20: dwrite f0 [0,4194304] 0 2024-05-09T06:30:17.585 INFO:tasks.workunit.client.1.smithi106.stdout:0/21: dwrite d1/f6 [0,4194304] 0 2024-05-09T06:30:17.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:17 smithi046 ceph-mon[26924]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s wr, 262 op/s 2024-05-09T06:30:17.599 INFO:tasks.workunit.client.1.smithi106.stdout:0/22: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:30:17.609 INFO:tasks.workunit.client.1.smithi106.stdout:0/23: creat d1/f7 x:0 0 0 2024-05-09T06:30:17.609 INFO:tasks.workunit.client.1.smithi106.stdout:0/24: chown d1 20 1 2024-05-09T06:30:17.623 INFO:tasks.workunit.client.1.smithi106.stdout:0/25: dwrite d1/f6 [0,4194304] 0 2024-05-09T06:30:17.627 INFO:tasks.workunit.client.1.smithi106.stdout:0/26: mknod d1/c8 0 2024-05-09T06:30:17.627 INFO:tasks.workunit.client.1.smithi106.stdout:0/27: chown d1/f7 1787 1 2024-05-09T06:30:17.627 INFO:tasks.workunit.client.1.smithi106.stdout:0/28: write d1/f7 [113588,114599] 0 2024-05-09T06:30:17.631 INFO:tasks.workunit.client.1.smithi106.stdout:0/29: rename d1/c8 to d1/c9 0 2024-05-09T06:30:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:17 smithi106 ceph-mon[34679]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s wr, 262 op/s 2024-05-09T06:30:17.872 INFO:tasks.workunit.client.1.smithi106.stdout:4/55: getdents d7 0 2024-05-09T06:30:17.881 INFO:tasks.workunit.client.1.smithi106.stdout:4/56: truncate f0 465075 0 2024-05-09T06:30:17.905 INFO:tasks.workunit.client.1.smithi106.stdout:5/48: rename f6 to d8/fa 0 2024-05-09T06:30:17.907 INFO:tasks.workunit.client.1.smithi106.stdout:5/49: dread d8/fa [0,4194304] 0 2024-05-09T06:30:17.909 INFO:tasks.workunit.client.1.smithi106.stdout:5/50: mknod d8/cb 0 2024-05-09T06:30:17.913 INFO:tasks.workunit.client.1.smithi106.stdout:5/51: rename d8/f9 to d8/fc 0 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:7/31: fsync d0/f5 0 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:7/32: creat d0/f8 x:0 0 0 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:7/33: chown d0/f5 2064324 1 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:7/34: creat d0/f9 x:0 0 0 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:7/35: chown d0/f5 10029064 1 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:7/36: fdatasync d0/f9 0 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:5/52: dwrite d8/fc [0,4194304] 0 2024-05-09T06:30:17.926 INFO:tasks.workunit.client.1.smithi106.stdout:5/53: readlink l2 0 2024-05-09T06:30:17.932 INFO:tasks.workunit.client.1.smithi106.stdout:5/54: creat d8/fd x:0 0 0 2024-05-09T06:30:17.933 INFO:tasks.workunit.client.1.smithi106.stdout:7/37: rename d0/f8 to d0/fa 0 2024-05-09T06:30:17.933 INFO:tasks.workunit.client.1.smithi106.stdout:7/38: chown d0/f6 189803799 1 2024-05-09T06:30:17.936 INFO:tasks.workunit.client.1.smithi106.stdout:5/55: mknod d8/ce 0 2024-05-09T06:30:17.939 INFO:tasks.workunit.client.1.smithi106.stdout:7/39: mkdir d0/db 0 2024-05-09T06:30:17.941 INFO:tasks.workunit.client.1.smithi106.stdout:5/56: symlink d8/lf 0 2024-05-09T06:30:17.942 INFO:tasks.workunit.client.1.smithi106.stdout:5/57: readlink l0 0 2024-05-09T06:30:17.942 INFO:tasks.workunit.client.1.smithi106.stdout:5/58: creat d8/f10 x:0 0 0 2024-05-09T06:30:17.948 INFO:tasks.workunit.client.1.smithi106.stdout:5/59: rename l0 to d8/l11 0 2024-05-09T06:30:17.951 INFO:tasks.workunit.client.1.smithi106.stdout:8/24: sync 2024-05-09T06:30:17.951 INFO:tasks.workunit.client.1.smithi106.stdout:3/37: sync 2024-05-09T06:30:17.951 INFO:tasks.workunit.client.1.smithi106.stdout:8/25: chown d3 396191 1 2024-05-09T06:30:17.951 INFO:tasks.workunit.client.1.smithi106.stdout:3/38: write d5/f8 [775978,117553] 0 2024-05-09T06:30:17.951 INFO:tasks.workunit.client.1.smithi106.stdout:3/39: creat d5/fa x:0 0 0 2024-05-09T06:30:17.956 INFO:tasks.workunit.client.1.smithi106.stdout:5/60: rename f1 to d8/f12 0 2024-05-09T06:30:17.960 INFO:tasks.workunit.client.1.smithi106.stdout:8/26: unlink f1 0 2024-05-09T06:30:17.966 INFO:tasks.workunit.client.1.smithi106.stdout:3/40: link f2 d5/fb 0 2024-05-09T06:30:17.970 INFO:tasks.workunit.client.1.smithi106.stdout:3/41: mknod d5/cc 0 2024-05-09T06:30:17.970 INFO:tasks.workunit.client.1.smithi106.stdout:3/42: dread - d5/fa zero size 2024-05-09T06:30:17.972 INFO:tasks.workunit.client.1.smithi106.stdout:9/29: dwrite f1 [0,4194304] 0 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:3/43: symlink d5/ld 0 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:3/44: write f2 [1631387,90522] 0 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:3/45: chown d5/c9 378888 1 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:5/61: dwrite d8/fc [0,4194304] 0 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:5/62: chown d8/fd 1084997 1 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:5/63: write d8/f12 [2071099,67571] 0 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:5/64: write d8/f10 [215606,61970] 0 2024-05-09T06:30:17.975 INFO:tasks.workunit.client.1.smithi106.stdout:5/65: chown d8/ce 15915215 1 2024-05-09T06:30:17.976 INFO:tasks.workunit.client.1.smithi106.stdout:1/31: getdents d4/d5 0 2024-05-09T06:30:17.977 INFO:tasks.workunit.client.1.smithi106.stdout:9/30: rename f2 to d4/d6/f7 0 2024-05-09T06:30:17.978 INFO:tasks.workunit.client.1.smithi106.stdout:8/27: dwrite d3/f6 [0,4194304] 0 2024-05-09T06:30:17.979 INFO:tasks.workunit.client.1.smithi106.stdout:3/46: rename d5/fa to d5/fe 0 2024-05-09T06:30:17.982 INFO:tasks.workunit.client.1.smithi106.stdout:5/66: link l7 d8/l13 0 2024-05-09T06:30:17.982 INFO:tasks.workunit.client.1.smithi106.stdout:5/67: write d8/f10 [365198,68587] 0 2024-05-09T06:30:17.983 INFO:tasks.workunit.client.1.smithi106.stdout:5/68: chown d8/l11 145054 1 2024-05-09T06:30:17.985 INFO:tasks.workunit.client.1.smithi106.stdout:5/69: fdatasync d8/f10 0 2024-05-09T06:30:17.988 INFO:tasks.workunit.client.1.smithi106.stdout:3/47: dread d5/f8 [0,4194304] 0 2024-05-09T06:30:17.989 INFO:tasks.workunit.client.1.smithi106.stdout:8/28: creat d3/d5/f8 x:0 0 0 2024-05-09T06:30:17.990 INFO:tasks.workunit.client.1.smithi106.stdout:1/32: dwrite d4/d5/d9/fe [0,4194304] 0 2024-05-09T06:30:17.993 INFO:tasks.workunit.client.1.smithi106.stdout:3/48: link d5/fb d5/ff 0 2024-05-09T06:30:17.998 INFO:tasks.workunit.client.1.smithi106.stdout:8/29: write d3/f6 [1020902,6875] 0 2024-05-09T06:30:17.998 INFO:tasks.workunit.client.1.smithi106.stdout:8/30: chown d3/d5 5 1 2024-05-09T06:30:17.999 INFO:tasks.workunit.client.1.smithi106.stdout:8/31: stat d3/d5/f8 0 2024-05-09T06:30:18.001 INFO:tasks.workunit.client.1.smithi106.stdout:3/49: link d5/ld d5/l10 0 2024-05-09T06:30:18.001 INFO:tasks.workunit.client.1.smithi106.stdout:3/50: write d5/fe [457364,95968] 0 2024-05-09T06:30:18.001 INFO:tasks.workunit.client.1.smithi106.stdout:3/51: write d5/f7 [4905722,117934] 0 2024-05-09T06:30:18.003 INFO:tasks.workunit.client.1.smithi106.stdout:8/32: rmdir d3 39 2024-05-09T06:30:18.003 INFO:tasks.workunit.client.1.smithi106.stdout:5/70: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:30:18.003 INFO:tasks.workunit.client.1.smithi106.stdout:5/71: chown l4 1362796726 1 2024-05-09T06:30:18.003 INFO:tasks.workunit.client.1.smithi106.stdout:5/72: creat d8/f14 x:0 0 0 2024-05-09T06:30:18.007 INFO:tasks.workunit.client.1.smithi106.stdout:3/52: symlink d5/l11 0 2024-05-09T06:30:18.010 INFO:tasks.workunit.client.1.smithi106.stdout:1/33: truncate d4/fb 322205 0 2024-05-09T06:30:18.010 INFO:tasks.workunit.client.1.smithi106.stdout:8/33: mknod d3/d5/d7/c9 0 2024-05-09T06:30:18.010 INFO:tasks.workunit.client.1.smithi106.stdout:8/34: dread - d3/d5/f8 zero size 2024-05-09T06:30:18.020 INFO:tasks.workunit.client.1.smithi106.stdout:8/35: dread d3/f6 [0,4194304] 0 2024-05-09T06:30:18.020 INFO:tasks.workunit.client.1.smithi106.stdout:8/36: rename d3 to d3/d5/d7/da 22 2024-05-09T06:30:18.020 INFO:tasks.workunit.client.1.smithi106.stdout:8/37: read - d3/d5/f8 zero size 2024-05-09T06:30:18.021 INFO:tasks.workunit.client.1.smithi106.stdout:8/38: write d3/d5/f8 [479209,53893] 0 2024-05-09T06:30:18.021 INFO:tasks.workunit.client.1.smithi106.stdout:8/39: stat d3/d5/f8 0 2024-05-09T06:30:18.114 INFO:tasks.workunit.client.1.smithi106.stdout:5/73: mknod d8/c15 0 2024-05-09T06:30:18.115 INFO:tasks.workunit.client.1.smithi106.stdout:1/34: dwrite d4/d5/ff [0,4194304] 0 2024-05-09T06:30:18.116 INFO:tasks.workunit.client.1.smithi106.stdout:3/53: mkdir d5/d12 0 2024-05-09T06:30:18.118 INFO:tasks.workunit.client.1.smithi106.stdout:8/40: symlink d3/d5/d7/lb 0 2024-05-09T06:30:18.121 INFO:tasks.workunit.client.1.smithi106.stdout:5/74: symlink d8/l16 0 2024-05-09T06:30:18.145 INFO:tasks.workunit.client.1.smithi106.stdout:0/30: rmdir d1 39 2024-05-09T06:30:18.148 INFO:tasks.workunit.client.1.smithi106.stdout:1/35: mkdir d4/d5/d10 0 2024-05-09T06:30:18.148 INFO:tasks.workunit.client.1.smithi106.stdout:1/36: dread - d4/d5/f7 zero size 2024-05-09T06:30:18.148 INFO:tasks.workunit.client.1.smithi106.stdout:1/37: creat d4/d5/d9/f11 x:0 0 0 2024-05-09T06:30:18.148 INFO:tasks.workunit.client.1.smithi106.stdout:1/38: creat d4/f12 x:0 0 0 2024-05-09T06:30:18.148 INFO:tasks.workunit.client.1.smithi106.stdout:1/39: dread - d4/f12 zero size 2024-05-09T06:30:18.151 INFO:tasks.workunit.client.1.smithi106.stdout:3/54: rename d5/f8 to d5/d12/f13 0 2024-05-09T06:30:18.153 INFO:tasks.workunit.client.1.smithi106.stdout:0/31: read d1/f3 [1461892,98044] 0 2024-05-09T06:30:18.153 INFO:tasks.workunit.client.1.smithi106.stdout:8/41: mknod d3/d5/cc 0 2024-05-09T06:30:18.156 INFO:tasks.workunit.client.1.smithi106.stdout:1/40: write d4/d5/d9/fe [4030122,4050] 0 2024-05-09T06:30:18.156 INFO:tasks.workunit.client.1.smithi106.stdout:1/41: dread - d4/d5/f7 zero size 2024-05-09T06:30:18.156 INFO:tasks.workunit.client.1.smithi106.stdout:5/75: mkdir d8/d17 0 2024-05-09T06:30:18.156 INFO:tasks.workunit.client.1.smithi106.stdout:3/55: dread f2 [0,4194304] 0 2024-05-09T06:30:18.156 INFO:tasks.workunit.client.1.smithi106.stdout:3/56: chown d5/c9 1803171793 1 2024-05-09T06:30:18.156 INFO:tasks.workunit.client.1.smithi106.stdout:3/57: readlink d5/l11 0 2024-05-09T06:30:18.163 INFO:tasks.workunit.client.1.smithi106.stdout:0/32: write d1/f6 [3365394,89231] 0 2024-05-09T06:30:18.163 INFO:tasks.workunit.client.1.smithi106.stdout:0/33: fsync d1/f7 0 2024-05-09T06:30:18.164 INFO:tasks.workunit.client.1.smithi106.stdout:8/42: symlink d3/d5/d7/ld 0 2024-05-09T06:30:18.167 INFO:tasks.workunit.client.1.smithi106.stdout:1/42: rename d4/d5/d10 to d4/d5/d9/d13 0 2024-05-09T06:30:18.167 INFO:tasks.workunit.client.1.smithi106.stdout:1/43: fdatasync d4/f12 0 2024-05-09T06:30:18.167 INFO:tasks.workunit.client.1.smithi106.stdout:1/44: fdatasync d4/d5/f6 0 2024-05-09T06:30:18.167 INFO:tasks.workunit.client.1.smithi106.stdout:1/45: chown d4/c8 440 1 2024-05-09T06:30:18.168 INFO:tasks.workunit.client.1.smithi106.stdout:1/46: creat d4/f14 x:0 0 0 2024-05-09T06:30:18.168 INFO:tasks.workunit.client.1.smithi106.stdout:1/47: truncate d4/d5/f6 2814073 0 2024-05-09T06:30:18.168 INFO:tasks.workunit.client.1.smithi106.stdout:1/48: creat d4/f15 x:0 0 0 2024-05-09T06:30:18.168 INFO:tasks.workunit.client.1.smithi106.stdout:8/43: link d3/d5/d7/ld d3/d5/d7/le 0 2024-05-09T06:30:18.174 INFO:tasks.workunit.client.1.smithi106.stdout:3/58: rename d5/l10 to d5/d12/l14 0 2024-05-09T06:30:18.177 INFO:tasks.workunit.client.1.smithi106.stdout:1/49: read d4/d5/ff [2810238,77121] 0 2024-05-09T06:30:18.179 INFO:tasks.workunit.client.1.smithi106.stdout:5/76: dwrite d8/fc [0,4194304] 0 2024-05-09T06:30:18.179 INFO:tasks.workunit.client.1.smithi106.stdout:8/44: fdatasync d3/d5/f8 0 2024-05-09T06:30:18.179 INFO:tasks.workunit.client.1.smithi106.stdout:0/34: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:18.179 INFO:tasks.workunit.client.1.smithi106.stdout:0/35: write d1/f5 [522956,47266] 0 2024-05-09T06:30:18.179 INFO:tasks.workunit.client.1.smithi106.stdout:1/50: write d4/d5/f6 [1746915,110003] 0 2024-05-09T06:30:18.180 INFO:tasks.workunit.client.1.smithi106.stdout:1/51: creat d4/d5/d9/f16 x:0 0 0 2024-05-09T06:30:18.194 INFO:tasks.workunit.client.1.smithi106.stdout:1/52: mkdir d4/d5/d17 0 2024-05-09T06:30:18.195 INFO:tasks.workunit.client.1.smithi106.stdout:0/36: symlink d1/la 0 2024-05-09T06:30:18.196 INFO:tasks.workunit.client.1.smithi106.stdout:0/37: write d1/f6 [501403,28006] 0 2024-05-09T06:30:18.200 INFO:tasks.workunit.client.1.smithi106.stdout:0/38: creat d1/fb x:0 0 0 2024-05-09T06:30:18.202 INFO:tasks.workunit.client.1.smithi106.stdout:0/39: creat d1/fc x:0 0 0 2024-05-09T06:30:18.202 INFO:tasks.workunit.client.1.smithi106.stdout:0/40: truncate d1/fc 152733 0 2024-05-09T06:30:18.202 INFO:tasks.workunit.client.1.smithi106.stdout:0/41: read - d1/fb zero size 2024-05-09T06:30:18.204 INFO:tasks.workunit.client.1.smithi106.stdout:0/42: truncate d1/f3 2422438 0 2024-05-09T06:30:18.208 INFO:tasks.workunit.client.1.smithi106.stdout:0/43: mknod d1/cd 0 2024-05-09T06:30:18.430 INFO:tasks.workunit.client.1.smithi106.stdout:4/57: dwrite f0 [0,4194304] 0 2024-05-09T06:30:18.431 INFO:tasks.workunit.client.1.smithi106.stdout:4/58: dread d7/f9 [0,4194304] 0 2024-05-09T06:30:18.438 INFO:tasks.workunit.client.1.smithi106.stdout:6/54: sync 2024-05-09T06:30:18.438 INFO:tasks.workunit.client.1.smithi106.stdout:2/47: sync 2024-05-09T06:30:18.438 INFO:tasks.workunit.client.1.smithi106.stdout:2/48: chown d2/d5/db/d15 33 1 2024-05-09T06:30:18.439 INFO:tasks.workunit.client.1.smithi106.stdout:6/55: truncate d0/d6/d8/dd/f10 4001883 0 2024-05-09T06:30:18.440 INFO:tasks.workunit.client.1.smithi106.stdout:2/49: getdents d2/d5/db 0 2024-05-09T06:30:18.444 INFO:tasks.workunit.client.1.smithi106.stdout:2/50: getdents d2 0 2024-05-09T06:30:18.444 INFO:tasks.workunit.client.1.smithi106.stdout:4/59: dwrite d7/fd [4194304,4194304] 0 2024-05-09T06:30:18.450 INFO:tasks.workunit.client.1.smithi106.stdout:4/60: link l5 d7/dc/l13 0 2024-05-09T06:30:18.450 INFO:tasks.workunit.client.1.smithi106.stdout:4/61: rename d7/d10 to d7/d10/d12/d14 22 2024-05-09T06:30:18.450 INFO:tasks.workunit.client.1.smithi106.stdout:4/62: getdents d7 0 2024-05-09T06:30:18.452 INFO:tasks.workunit.client.1.smithi106.stdout:2/51: symlink d2/d5/db/l16 0 2024-05-09T06:30:18.459 INFO:tasks.workunit.client.1.smithi106.stdout:4/63: dread d7/f11 [0,4194304] 0 2024-05-09T06:30:18.459 INFO:tasks.workunit.client.1.smithi106.stdout:6/56: dwrite d0/d6/fe [0,4194304] 0 2024-05-09T06:30:18.459 INFO:tasks.workunit.client.1.smithi106.stdout:4/64: rename d7 to d7/d15 22 2024-05-09T06:30:18.459 INFO:tasks.workunit.client.1.smithi106.stdout:6/57: rename d0 to d0/d6/d15 22 2024-05-09T06:30:18.459 INFO:tasks.workunit.client.1.smithi106.stdout:4/65: chown d7/dc 174501251 1 2024-05-09T06:30:18.470 INFO:tasks.workunit.client.1.smithi106.stdout:4/66: creat d7/d10/f16 x:0 0 0 2024-05-09T06:30:18.473 INFO:tasks.workunit.client.1.smithi106.stdout:4/67: symlink d7/d10/d12/l17 0 2024-05-09T06:30:18.475 INFO:tasks.workunit.client.1.smithi106.stdout:4/68: creat d7/f18 x:0 0 0 2024-05-09T06:30:18.491 INFO:tasks.workunit.client.1.smithi106.stdout:4/69: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:18.494 INFO:tasks.workunit.client.1.smithi106.stdout:5/77: fsync d8/f12 0 2024-05-09T06:30:18.495 INFO:tasks.workunit.client.1.smithi106.stdout:5/78: fdatasync d8/fd 0 2024-05-09T06:30:18.503 INFO:tasks.workunit.client.1.smithi106.stdout:5/79: read d8/fc [1142686,70284] 0 2024-05-09T06:30:18.506 INFO:tasks.workunit.client.1.smithi106.stdout:9/31: getdents d4/d6 0 2024-05-09T06:30:18.513 INFO:tasks.workunit.client.1.smithi106.stdout:4/70: dwrite d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:18.523 INFO:tasks.workunit.client.1.smithi106.stdout:5/80: dwrite d8/f12 [0,4194304] 0 2024-05-09T06:30:18.523 INFO:tasks.workunit.client.1.smithi106.stdout:5/81: dread - d8/fd zero size 2024-05-09T06:30:18.527 INFO:tasks.workunit.client.1.smithi106.stdout:5/82: unlink d8/f14 0 2024-05-09T06:30:18.528 INFO:tasks.workunit.client.1.smithi106.stdout:5/83: stat d8/l13 0 2024-05-09T06:30:18.529 INFO:tasks.workunit.client.1.smithi106.stdout:9/32: dwrite f1 [0,4194304] 0 2024-05-09T06:30:18.532 INFO:tasks.workunit.client.1.smithi106.stdout:5/84: rmdir d8/d17 0 2024-05-09T06:30:18.532 INFO:tasks.workunit.client.1.smithi106.stdout:5/85: chown d8 5 1 2024-05-09T06:30:18.532 INFO:tasks.workunit.client.1.smithi106.stdout:5/86: write d8/fa [45657,12731] 0 2024-05-09T06:30:18.532 INFO:tasks.workunit.client.1.smithi106.stdout:5/87: read d8/fc [1896856,13706] 0 2024-05-09T06:30:18.551 INFO:tasks.workunit.client.1.smithi106.stdout:7/40: sync 2024-05-09T06:30:18.552 INFO:tasks.workunit.client.1.smithi106.stdout:7/41: readlink d0/l7 0 2024-05-09T06:30:18.648 INFO:tasks.workunit.client.1.smithi106.stdout:8/45: getdents d3/d5/d7 0 2024-05-09T06:30:18.648 INFO:tasks.workunit.client.1.smithi106.stdout:8/46: fsync d3/f6 0 2024-05-09T06:30:18.648 INFO:tasks.workunit.client.1.smithi106.stdout:8/47: chown d3/d5/d7/lb 55872 1 2024-05-09T06:30:18.648 INFO:tasks.workunit.client.1.smithi106.stdout:8/48: chown d3/d5/d7/lb 13429 1 2024-05-09T06:30:18.652 INFO:tasks.workunit.client.1.smithi106.stdout:8/49: truncate d3/f6 3316801 0 2024-05-09T06:30:18.652 INFO:tasks.workunit.client.1.smithi106.stdout:1/53: fsync d4/f14 0 2024-05-09T06:30:18.657 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-05-09T06:30:18.657 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:30:18.657 INFO:tasks.workunit.client.0.smithi046.stderr:+ make 2024-05-09T06:30:18.667 INFO:tasks.workunit.client.1.smithi106.stdout:1/54: dwrite d4/d5/d9/fc [0,4194304] 0 2024-05-09T06:30:18.667 INFO:tasks.workunit.client.1.smithi106.stdout:1/55: dread - d4/d5/d9/f16 zero size 2024-05-09T06:30:18.669 INFO:tasks.workunit.client.1.smithi106.stdout:0/44: truncate d1/f5 1135167 0 2024-05-09T06:30:18.673 INFO:tasks.workunit.client.1.smithi106.stdout:1/56: unlink d4/c8 0 2024-05-09T06:30:18.676 INFO:tasks.workunit.client.1.smithi106.stdout:1/57: mkdir d4/d5/d9/d18 0 2024-05-09T06:30:18.676 INFO:tasks.workunit.client.1.smithi106.stdout:1/58: getdents d4/d5/d9/d18 0 2024-05-09T06:30:18.676 INFO:tasks.workunit.client.1.smithi106.stdout:1/59: chown d4/d5/d9/d18 4096173 1 2024-05-09T06:30:18.676 INFO:tasks.workunit.client.1.smithi106.stdout:1/60: readlink d4/d5/ld 0 2024-05-09T06:30:18.677 INFO:tasks.workunit.client.1.smithi106.stdout:0/45: dread d1/f7 [0,4194304] 0 2024-05-09T06:30:18.678 INFO:tasks.workunit.client.1.smithi106.stdout:1/61: creat d4/d5/d9/d13/f19 x:0 0 0 2024-05-09T06:30:18.678 INFO:tasks.workunit.client.1.smithi106.stdout:1/62: write d4/d5/d9/fe [2141630,128205] 0 2024-05-09T06:30:18.682 INFO:tasks.workunit.client.1.smithi106.stdout:0/46: link d1/c9 d1/ce 0 2024-05-09T06:30:18.692 INFO:tasks.workunit.client.1.smithi106.stdout:1/63: dwrite d4/d5/d9/f16 [0,4194304] 0 2024-05-09T06:30:18.692 INFO:tasks.workunit.client.1.smithi106.stdout:1/64: write f2 [890742,31622] 0 2024-05-09T06:30:18.693 INFO:tasks.workunit.client.1.smithi106.stdout:1/65: creat d4/f1a x:0 0 0 2024-05-09T06:30:18.693 INFO:tasks.workunit.client.1.smithi106.stdout:1/66: readlink d4/d5/ld 0 2024-05-09T06:30:18.696 INFO:tasks.workunit.client.1.smithi106.stdout:1/67: creat d4/d5/d9/d13/f1b x:0 0 0 2024-05-09T06:30:18.696 INFO:tasks.workunit.client.1.smithi106.stdout:1/68: fdatasync d4/d5/d9/fc 0 2024-05-09T06:30:18.720 INFO:tasks.workunit.client.1.smithi106.stdout:1/69: dwrite f2 [0,4194304] 0 2024-05-09T06:30:18.720 INFO:tasks.workunit.client.1.smithi106.stdout:1/70: stat d4/d5/ld 0 2024-05-09T06:30:18.720 INFO:tasks.workunit.client.1.smithi106.stdout:1/71: write d4/f14 [842580,81530] 0 2024-05-09T06:30:18.721 INFO:tasks.workunit.client.1.smithi106.stdout:1/72: creat d4/d5/d9/d18/f1c x:0 0 0 2024-05-09T06:30:18.759 INFO:tasks.workunit.client.1.smithi106.stdout:6/58: rename d0/d6/d8/dd to d0/d6/d16 0 2024-05-09T06:30:18.761 INFO:tasks.workunit.client.1.smithi106.stdout:8/50: rename d3/d5/f8 to d3/ff 0 2024-05-09T06:30:18.763 INFO:tasks.workunit.client.1.smithi106.stdout:8/51: symlink d3/d5/l10 0 2024-05-09T06:30:18.780 INFO:tasks.workunit.client.1.smithi106.stdout:4/71: truncate d7/d10/f16 2555228 0 2024-05-09T06:30:18.786 INFO:tasks.workunit.client.1.smithi106.stdout:5/88: rmdir d8 39 2024-05-09T06:30:18.789 INFO:tasks.workunit.client.1.smithi106.stdout:5/89: creat d8/f18 x:0 0 0 2024-05-09T06:30:18.789 INFO:tasks.workunit.client.1.smithi106.stdout:5/90: write d8/fd [361112,20364] 0 2024-05-09T06:30:18.789 INFO:tasks.workunit.client.1.smithi106.stdout:5/91: write d8/fc [953761,31216] 0 2024-05-09T06:30:18.789 INFO:tasks.workunit.client.1.smithi106.stdout:5/92: creat d8/f19 x:0 0 0 2024-05-09T06:30:18.789 INFO:tasks.workunit.client.1.smithi106.stdout:5/93: creat d8/f1a x:0 0 0 2024-05-09T06:30:18.790 INFO:tasks.workunit.client.1.smithi106.stdout:9/33: truncate f1 1881699 0 2024-05-09T06:30:18.790 INFO:tasks.workunit.client.1.smithi106.stdout:4/72: write d7/fd [1780886,107711] 0 2024-05-09T06:30:18.825 INFO:tasks.workunit.client.1.smithi106.stdout:6/59: rename d0/d6/d16 to d0/d17 0 2024-05-09T06:30:18.825 INFO:tasks.workunit.client.1.smithi106.stdout:0/47: truncate d1/f3 1477818 0 2024-05-09T06:30:18.827 INFO:tasks.workunit.client.1.smithi106.stdout:1/73: rename d4/d5/d9/d18 to d4/d5/d9/d1d 0 2024-05-09T06:30:18.829 INFO:tasks.workunit.client.1.smithi106.stdout:1/74: rmdir d4/d5/d17 0 2024-05-09T06:30:18.829 INFO:tasks.workunit.client.1.smithi106.stdout:1/75: fdatasync d4/d5/d9/fc 0 2024-05-09T06:30:18.830 INFO:tasks.workunit.client.1.smithi106.stdout:4/73: rmdir d7/d10 39 2024-05-09T06:30:18.830 INFO:tasks.workunit.client.1.smithi106.stdout:4/74: stat d7/l8 0 2024-05-09T06:30:18.830 INFO:tasks.workunit.client.1.smithi106.stdout:4/75: fsync d7/f11 0 2024-05-09T06:30:18.830 INFO:tasks.workunit.client.1.smithi106.stdout:4/76: chown c1 983316 1 2024-05-09T06:30:18.830 INFO:tasks.workunit.client.1.smithi106.stdout:4/77: chown d7/d10/f16 1006 1 2024-05-09T06:30:18.831 INFO:tasks.workunit.client.1.smithi106.stdout:4/78: getdents d7/d10/d12 0 2024-05-09T06:30:18.833 INFO:tasks.workunit.client.1.smithi106.stdout:9/34: write f1 [2675298,124944] 0 2024-05-09T06:30:18.833 INFO:tasks.workunit.client.1.smithi106.stdout:9/35: chown d4 995518462 1 2024-05-09T06:30:18.833 INFO:tasks.workunit.client.1.smithi106.stdout:6/60: dread d0/d6/d8/f14 [0,4194304] 0 2024-05-09T06:30:18.833 INFO:tasks.workunit.client.1.smithi106.stdout:6/61: chown d0/d6/c13 398736 1 2024-05-09T06:30:18.833 INFO:tasks.workunit.client.1.smithi106.stdout:6/62: chown d0/d6/l4 5577979 1 2024-05-09T06:30:18.833 INFO:tasks.workunit.client.1.smithi106.stdout:6/63: rename d0 to d0/d17/d18 22 2024-05-09T06:30:18.834 INFO:tasks.workunit.client.1.smithi106.stdout:5/94: rmdir d8 39 2024-05-09T06:30:18.834 INFO:tasks.workunit.client.1.smithi106.stdout:5/95: write d8/f19 [937737,74018] 0 2024-05-09T06:30:18.835 INFO:tasks.workunit.client.1.smithi106.stdout:6/64: read d0/d6/d8/ff [331441,15879] 0 2024-05-09T06:30:18.836 INFO:tasks.workunit.client.1.smithi106.stdout:3/59: sync 2024-05-09T06:30:18.836 INFO:tasks.workunit.client.1.smithi106.stdout:7/42: sync 2024-05-09T06:30:18.836 INFO:tasks.workunit.client.1.smithi106.stdout:2/52: sync 2024-05-09T06:30:18.837 INFO:tasks.workunit.client.1.smithi106.stdout:2/53: dread - d2/f10 zero size 2024-05-09T06:30:18.837 INFO:tasks.workunit.client.1.smithi106.stdout:2/54: fsync d2/f10 0 2024-05-09T06:30:18.838 INFO:tasks.workunit.client.1.smithi106.stdout:3/60: creat d5/d12/f15 x:0 0 0 2024-05-09T06:30:18.840 INFO:tasks.workunit.client.0.smithi046.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-05-09T06:30:18.844 INFO:tasks.workunit.client.1.smithi106.stdout:2/55: rename d2/d5/c14 to d2/d5/db/d15/c17 0 2024-05-09T06:30:18.844 INFO:tasks.workunit.client.1.smithi106.stdout:0/48: read d1/f3 [498684,26445] 0 2024-05-09T06:30:18.846 INFO:tasks.workunit.client.1.smithi106.stdout:8/52: truncate d3/f6 1672350 0 2024-05-09T06:30:18.846 INFO:tasks.workunit.client.1.smithi106.stdout:8/53: rename d3/d5 to d3/d5/d11 22 2024-05-09T06:30:18.847 INFO:tasks.workunit.client.1.smithi106.stdout:8/54: chown d3/d5/l10 28 1 2024-05-09T06:30:18.847 INFO:tasks.workunit.client.1.smithi106.stdout:8/55: creat d3/d5/f12 x:0 0 0 2024-05-09T06:30:18.850 INFO:tasks.workunit.client.1.smithi106.stdout:2/56: creat d2/d5/db/d15/f18 x:0 0 0 2024-05-09T06:30:18.850 INFO:tasks.workunit.client.1.smithi106.stdout:2/57: dread - d2/fc zero size 2024-05-09T06:30:18.851 INFO:tasks.workunit.client.1.smithi106.stdout:2/58: truncate f1 1892217 0 2024-05-09T06:30:18.851 INFO:tasks.workunit.client.1.smithi106.stdout:2/59: write d2/fc [593814,47372] 0 2024-05-09T06:30:18.851 INFO:tasks.workunit.client.1.smithi106.stdout:2/60: write d2/d5/f13 [853556,130325] 0 2024-05-09T06:30:18.851 INFO:tasks.workunit.client.1.smithi106.stdout:0/49: creat d1/ff x:0 0 0 2024-05-09T06:30:18.851 INFO:tasks.workunit.client.1.smithi106.stdout:0/50: dread - d1/ff zero size 2024-05-09T06:30:18.854 INFO:tasks.workunit.client.1.smithi106.stdout:6/65: write d0/d6/fe [1545558,122860] 0 2024-05-09T06:30:18.854 INFO:tasks.workunit.client.1.smithi106.stdout:2/61: dread f0 [0,4194304] 0 2024-05-09T06:30:18.857 INFO:tasks.workunit.client.1.smithi106.stdout:8/56: unlink d3/d5/l10 0 2024-05-09T06:30:18.859 INFO:tasks.workunit.client.1.smithi106.stdout:5/96: write d8/f12 [2237999,23517] 0 2024-05-09T06:30:18.862 INFO:tasks.workunit.client.1.smithi106.stdout:1/76: dwrite d4/f14 [0,4194304] 0 2024-05-09T06:30:18.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/79: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:18.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/80: chown d7/d10/f16 0 1 2024-05-09T06:30:18.866 INFO:tasks.workunit.client.1.smithi106.stdout:6/66: write d0/d6/d8/f14 [866683,22956] 0 2024-05-09T06:30:18.866 INFO:tasks.workunit.client.1.smithi106.stdout:6/67: chown d0/d6/fb 1066217683 1 2024-05-09T06:30:18.869 INFO:tasks.workunit.client.1.smithi106.stdout:8/57: mkdir d3/d5/d13 0 2024-05-09T06:30:18.869 INFO:tasks.workunit.client.1.smithi106.stdout:8/58: write d3/d5/f12 [342721,706] 0 2024-05-09T06:30:18.869 INFO:tasks.workunit.client.1.smithi106.stdout:8/59: readlink d3/d5/d7/lb 0 2024-05-09T06:30:18.875 INFO:tasks.workunit.client.1.smithi106.stdout:3/61: dwrite f2 [0,4194304] 0 2024-05-09T06:30:18.876 INFO:tasks.workunit.client.1.smithi106.stdout:5/97: fsync d8/f12 0 2024-05-09T06:30:18.876 INFO:tasks.workunit.client.1.smithi106.stdout:7/43: dwrite d0/f9 [0,4194304] 0 2024-05-09T06:30:18.879 INFO:tasks.workunit.client.1.smithi106.stdout:1/77: symlink d4/d5/d9/d1d/l1e 0 2024-05-09T06:30:18.879 INFO:tasks.workunit.client.1.smithi106.stdout:1/78: creat d4/f1f x:0 0 0 2024-05-09T06:30:18.883 INFO:tasks.workunit.client.1.smithi106.stdout:2/62: getdents d2/d7 0 2024-05-09T06:30:18.884 INFO:tasks.workunit.client.1.smithi106.stdout:9/36: dwrite f1 [0,4194304] 0 2024-05-09T06:30:18.885 INFO:tasks.workunit.client.1.smithi106.stdout:3/62: read d5/ff [2461044,124067] 0 2024-05-09T06:30:18.885 INFO:tasks.workunit.client.1.smithi106.stdout:4/81: mknod d7/d10/d12/c19 0 2024-05-09T06:30:18.892 INFO:tasks.workunit.client.1.smithi106.stdout:6/68: creat d0/f19 x:0 0 0 2024-05-09T06:30:18.892 INFO:tasks.workunit.client.1.smithi106.stdout:6/69: chown d0 2885831 1 2024-05-09T06:30:18.893 INFO:tasks.workunit.client.1.smithi106.stdout:8/60: creat d3/d5/d13/f14 x:0 0 0 2024-05-09T06:30:18.894 INFO:tasks.workunit.client.1.smithi106.stdout:4/82: dread f0 [0,4194304] 0 2024-05-09T06:30:18.895 INFO:tasks.workunit.client.1.smithi106.stdout:5/98: getdents d8 0 2024-05-09T06:30:18.898 INFO:tasks.workunit.client.1.smithi106.stdout:1/79: dwrite d4/d5/ff [0,4194304] 0 2024-05-09T06:30:18.898 INFO:tasks.workunit.client.1.smithi106.stdout:1/80: stat d4/d5/ld 0 2024-05-09T06:30:18.898 INFO:tasks.workunit.client.1.smithi106.stdout:1/81: write d4/d5/f7 [1010226,7400] 0 2024-05-09T06:30:18.900 INFO:tasks.workunit.client.1.smithi106.stdout:7/44: mkdir d0/dc 0 2024-05-09T06:30:18.904 INFO:tasks.workunit.client.1.smithi106.stdout:9/37: getdents d4 0 2024-05-09T06:30:18.905 INFO:tasks.workunit.client.1.smithi106.stdout:3/63: mknod d5/c16 0 2024-05-09T06:30:18.905 INFO:tasks.workunit.client.1.smithi106.stdout:3/64: chown c0 412037 1 2024-05-09T06:30:18.905 INFO:tasks.workunit.client.1.smithi106.stdout:3/65: creat d5/f17 x:0 0 0 2024-05-09T06:30:18.906 INFO:tasks.workunit.client.1.smithi106.stdout:6/70: mknod d0/d6/d8/c1a 0 2024-05-09T06:30:18.906 INFO:tasks.workunit.client.1.smithi106.stdout:8/61: mkdir d3/d5/d7/d15 0 2024-05-09T06:30:18.907 INFO:tasks.workunit.client.1.smithi106.stdout:5/99: symlink d8/l1b 0 2024-05-09T06:30:18.908 INFO:tasks.workunit.client.1.smithi106.stdout:7/45: mkdir d0/db/dd 0 2024-05-09T06:30:18.909 INFO:tasks.workunit.client.1.smithi106.stdout:7/46: fsync d0/f9 0 2024-05-09T06:30:18.909 INFO:tasks.workunit.client.1.smithi106.stdout:7/47: readlink d0/l7 0 2024-05-09T06:30:18.911 INFO:tasks.workunit.client.1.smithi106.stdout:6/71: symlink d0/d6/d8/l1b 0 2024-05-09T06:30:18.912 INFO:tasks.workunit.client.1.smithi106.stdout:5/100: fdatasync d8/f1a 0 2024-05-09T06:30:18.914 INFO:tasks.workunit.client.1.smithi106.stdout:3/66: write f1 [7380503,1912] 0 2024-05-09T06:30:18.914 INFO:tasks.workunit.client.1.smithi106.stdout:3/67: fsync d5/f7 0 2024-05-09T06:30:18.914 INFO:tasks.workunit.client.1.smithi106.stdout:6/72: read d0/d6/fb [79623,2213] 0 2024-05-09T06:30:18.915 INFO:tasks.workunit.client.1.smithi106.stdout:9/38: write f1 [3873118,54694] 0 2024-05-09T06:30:18.915 INFO:tasks.workunit.client.1.smithi106.stdout:7/48: truncate d0/f9 396676 0 2024-05-09T06:30:18.918 INFO:tasks.workunit.client.1.smithi106.stdout:9/39: creat d4/f8 x:0 0 0 2024-05-09T06:30:18.920 INFO:tasks.workunit.client.1.smithi106.stdout:9/40: unlink f1 0 2024-05-09T06:30:18.920 INFO:tasks.workunit.client.1.smithi106.stdout:9/41: fdatasync d4/f8 0 2024-05-09T06:30:18.921 INFO:tasks.workunit.client.1.smithi106.stdout:9/42: truncate d4/d6/f7 3347517 0 2024-05-09T06:30:18.921 INFO:tasks.workunit.client.1.smithi106.stdout:9/43: chown d4/d6/f7 24 1 2024-05-09T06:30:18.922 INFO:tasks.workunit.client.1.smithi106.stdout:9/44: readlink - no filename 2024-05-09T06:30:18.922 INFO:tasks.workunit.client.1.smithi106.stdout:9/45: write d4/f8 [291541,113969] 0 2024-05-09T06:30:18.922 INFO:tasks.workunit.client.1.smithi106.stdout:9/46: readlink - no filename 2024-05-09T06:30:18.925 INFO:tasks.workunit.client.1.smithi106.stdout:5/101: dread d8/f12 [0,4194304] 0 2024-05-09T06:30:18.925 INFO:tasks.workunit.client.1.smithi106.stdout:3/68: dread f2 [0,4194304] 0 2024-05-09T06:30:18.925 INFO:tasks.workunit.client.1.smithi106.stdout:3/69: fdatasync d5/d12/f15 0 2024-05-09T06:30:18.926 INFO:tasks.workunit.client.1.smithi106.stdout:3/70: unlink d5/ff 0 2024-05-09T06:30:18.927 INFO:tasks.workunit.client.1.smithi106.stdout:5/102: mkdir d8/d1c 0 2024-05-09T06:30:18.927 INFO:tasks.workunit.client.1.smithi106.stdout:5/103: truncate d8/f1a 874191 0 2024-05-09T06:30:18.928 INFO:tasks.workunit.client.1.smithi106.stdout:3/71: symlink d5/l18 0 2024-05-09T06:30:18.929 INFO:tasks.workunit.client.1.smithi106.stdout:3/72: creat d5/d12/f19 x:0 0 0 2024-05-09T06:30:18.929 INFO:tasks.workunit.client.1.smithi106.stdout:5/104: write d8/fc [856100,129653] 0 2024-05-09T06:30:18.929 INFO:tasks.workunit.client.1.smithi106.stdout:6/73: dread d0/d17/f10 [0,4194304] 0 2024-05-09T06:30:18.929 INFO:tasks.workunit.client.1.smithi106.stdout:6/74: read d0/d6/d8/ff [280666,37711] 0 2024-05-09T06:30:18.930 INFO:tasks.workunit.client.1.smithi106.stdout:5/105: write d8/f18 [591046,101181] 0 2024-05-09T06:30:18.930 INFO:tasks.workunit.client.1.smithi106.stdout:5/106: write d8/f1a [133850,49136] 0 2024-05-09T06:30:18.932 INFO:tasks.workunit.client.1.smithi106.stdout:2/63: dwrite f1 [0,4194304] 0 2024-05-09T06:30:18.933 INFO:tasks.workunit.client.1.smithi106.stdout:2/64: write d2/fc [1423940,21438] 0 2024-05-09T06:30:18.933 INFO:tasks.workunit.client.1.smithi106.stdout:4/83: dwrite d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:18.933 INFO:tasks.workunit.client.1.smithi106.stdout:4/84: dread - f2 zero size 2024-05-09T06:30:18.933 INFO:tasks.workunit.client.1.smithi106.stdout:6/75: dread d0/d6/d8/ff [0,4194304] 0 2024-05-09T06:30:18.933 INFO:tasks.workunit.client.1.smithi106.stdout:6/76: creat d0/f1c x:0 0 0 2024-05-09T06:30:18.933 INFO:tasks.workunit.client.1.smithi106.stdout:6/77: creat d0/d6/d8/f1d x:0 0 0 2024-05-09T06:30:18.941 INFO:tasks.workunit.client.1.smithi106.stdout:6/78: creat d0/d17/f1e x:0 0 0 2024-05-09T06:30:18.943 INFO:tasks.workunit.client.1.smithi106.stdout:2/65: mknod d2/d5/c19 0 2024-05-09T06:30:18.943 INFO:tasks.workunit.client.1.smithi106.stdout:6/79: dread d0/d6/d8/f9 [0,4194304] 0 2024-05-09T06:30:18.943 INFO:tasks.workunit.client.1.smithi106.stdout:6/80: chown d0/d6 14 1 2024-05-09T06:30:18.944 INFO:tasks.workunit.client.1.smithi106.stdout:2/66: dread f0 [0,4194304] 0 2024-05-09T06:30:18.945 INFO:tasks.workunit.client.1.smithi106.stdout:7/49: write d0/f9 [588563,36918] 0 2024-05-09T06:30:18.945 INFO:tasks.workunit.client.1.smithi106.stdout:7/50: stat d0/db 0 2024-05-09T06:30:18.945 INFO:tasks.workunit.client.1.smithi106.stdout:7/51: creat d0/fe x:0 0 0 2024-05-09T06:30:18.945 INFO:tasks.workunit.client.1.smithi106.stdout:7/52: fsync d0/f5 0 2024-05-09T06:30:18.954 INFO:tasks.workunit.client.1.smithi106.stdout:3/73: dwrite d5/d12/f13 [0,4194304] 0 2024-05-09T06:30:18.954 INFO:tasks.workunit.client.1.smithi106.stdout:3/74: stat d5/c9 0 2024-05-09T06:30:18.955 INFO:tasks.workunit.client.1.smithi106.stdout:3/75: truncate d5/fe 142337 0 2024-05-09T06:30:18.955 INFO:tasks.workunit.client.1.smithi106.stdout:3/76: chown d5/d12/f19 29224885 1 2024-05-09T06:30:18.956 INFO:tasks.workunit.client.1.smithi106.stdout:3/77: truncate f1 9340851 0 2024-05-09T06:30:18.956 INFO:tasks.workunit.client.1.smithi106.stdout:3/78: readlink d5/ld 0 2024-05-09T06:30:18.956 INFO:tasks.workunit.client.1.smithi106.stdout:3/79: mknod d5/d12/c1a 0 2024-05-09T06:30:18.956 INFO:tasks.workunit.client.1.smithi106.stdout:3/80: stat d5/f17 0 2024-05-09T06:30:18.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/81: dread - d5/d12/f15 zero size 2024-05-09T06:30:18.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/82: mkdir d5/d12/d1b 0 2024-05-09T06:30:18.958 INFO:tasks.workunit.client.1.smithi106.stdout:4/85: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:18.958 INFO:tasks.workunit.client.1.smithi106.stdout:4/86: chown d7/la 9901 1 2024-05-09T06:30:18.964 INFO:tasks.workunit.client.1.smithi106.stdout:7/53: fsync d0/f9 0 2024-05-09T06:30:18.965 INFO:tasks.workunit.client.1.smithi106.stdout:2/67: dwrite f1 [0,4194304] 0 2024-05-09T06:30:18.965 INFO:tasks.workunit.client.1.smithi106.stdout:2/68: readlink d2/d7/l4 0 2024-05-09T06:30:18.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/54: symlink d0/dc/lf 0 2024-05-09T06:30:18.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/55: truncate d0/fe 793252 0 2024-05-09T06:30:18.966 INFO:tasks.workunit.client.1.smithi106.stdout:5/107: dwrite d8/fc [0,4194304] 0 2024-05-09T06:30:18.968 INFO:tasks.workunit.client.1.smithi106.stdout:2/69: mknod d2/d7/c1a 0 2024-05-09T06:30:18.968 INFO:tasks.workunit.client.1.smithi106.stdout:2/70: chown f1 1164 1 2024-05-09T06:30:18.968 INFO:tasks.workunit.client.1.smithi106.stdout:2/71: chown d2 5 1 2024-05-09T06:30:18.970 INFO:tasks.workunit.client.1.smithi106.stdout:7/56: stat d0/l7 0 2024-05-09T06:30:18.970 INFO:tasks.workunit.client.1.smithi106.stdout:7/57: fsync d0/f9 0 2024-05-09T06:30:18.971 INFO:tasks.workunit.client.1.smithi106.stdout:9/47: write d4/d6/f7 [2156505,80128] 0 2024-05-09T06:30:18.975 INFO:tasks.workunit.client.1.smithi106.stdout:6/81: getdents d0/d17 0 2024-05-09T06:30:18.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/48: unlink d4/f8 0 2024-05-09T06:30:18.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/49: readlink - no filename 2024-05-09T06:30:18.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/50: stat c3 0 2024-05-09T06:30:18.984 INFO:tasks.workunit.client.1.smithi106.stdout:9/51: symlink d4/d6/l9 0 2024-05-09T06:30:18.984 INFO:tasks.workunit.client.1.smithi106.stdout:9/52: read d4/d6/f7 [2737287,79262] 0 2024-05-09T06:30:18.984 INFO:tasks.workunit.client.1.smithi106.stdout:9/53: readlink d4/d6/l9 0 2024-05-09T06:30:18.985 INFO:tasks.workunit.client.1.smithi106.stdout:9/54: link d4/d6/f7 d4/d6/fa 0 2024-05-09T06:30:18.986 INFO:tasks.workunit.client.1.smithi106.stdout:5/108: write d8/f10 [3757698,119607] 0 2024-05-09T06:30:18.989 INFO:tasks.workunit.client.1.smithi106.stdout:6/82: dread d0/f5 [0,4194304] 0 2024-05-09T06:30:18.990 INFO:tasks.workunit.client.1.smithi106.stdout:4/87: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:18.992 INFO:tasks.workunit.client.1.smithi106.stdout:4/88: unlink d7/la 0 2024-05-09T06:30:18.992 INFO:tasks.workunit.client.1.smithi106.stdout:4/89: fsync d7/f11 0 2024-05-09T06:30:19.005 INFO:tasks.workunit.client.1.smithi106.stdout:6/83: dread d0/d6/d8/f12 [0,4194304] 0 2024-05-09T06:30:19.005 INFO:tasks.workunit.client.1.smithi106.stdout:6/84: stat d0/d17/f1e 0 2024-05-09T06:30:19.006 INFO:tasks.workunit.client.1.smithi106.stdout:6/85: symlink d0/d17/l1f 0 2024-05-09T06:30:19.030 INFO:tasks.workunit.client.1.smithi106.stdout:0/51: sync 2024-05-09T06:30:19.030 INFO:tasks.workunit.client.1.smithi106.stdout:7/58: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:19.031 INFO:tasks.workunit.client.1.smithi106.stdout:3/83: dwrite d5/fe [0,4194304] 0 2024-05-09T06:30:19.031 INFO:tasks.workunit.client.1.smithi106.stdout:3/84: truncate d5/d12/f15 296008 0 2024-05-09T06:30:19.032 INFO:tasks.workunit.client.1.smithi106.stdout:7/59: creat d0/dc/f10 x:0 0 0 2024-05-09T06:30:19.033 INFO:tasks.workunit.client.1.smithi106.stdout:6/86: dwrite d0/d6/d8/ff [0,4194304] 0 2024-05-09T06:30:19.033 INFO:tasks.workunit.client.1.smithi106.stdout:5/109: dwrite d8/f18 [0,4194304] 0 2024-05-09T06:30:19.033 INFO:tasks.workunit.client.1.smithi106.stdout:5/110: read d8/f12 [2884285,23210] 0 2024-05-09T06:30:19.060 INFO:tasks.workunit.client.1.smithi106.stdout:2/72: dwrite d2/f10 [0,4194304] 0 2024-05-09T06:30:19.062 INFO:tasks.workunit.client.1.smithi106.stdout:0/52: symlink d1/l10 0 2024-05-09T06:30:19.062 INFO:tasks.workunit.client.1.smithi106.stdout:0/53: chown d1/la 0 1 2024-05-09T06:30:19.062 INFO:tasks.workunit.client.1.smithi106.stdout:0/54: write d1/fc [184101,95480] 0 2024-05-09T06:30:19.063 INFO:tasks.workunit.client.1.smithi106.stdout:4/90: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:19.063 INFO:tasks.workunit.client.1.smithi106.stdout:9/55: fsync d4/d6/fa 0 2024-05-09T06:30:19.065 INFO:tasks.workunit.client.1.smithi106.stdout:7/60: symlink d0/db/l11 0 2024-05-09T06:30:19.065 INFO:tasks.workunit.client.1.smithi106.stdout:7/61: chown d0/fa 16972798 1 2024-05-09T06:30:19.066 INFO:tasks.workunit.client.1.smithi106.stdout:0/55: write d1/f7 [270768,59696] 0 2024-05-09T06:30:19.066 INFO:tasks.workunit.client.1.smithi106.stdout:3/85: dwrite d5/f7 [0,4194304] 0 2024-05-09T06:30:19.070 INFO:tasks.workunit.client.1.smithi106.stdout:6/87: link d0/d17/l1f d0/l20 0 2024-05-09T06:30:19.073 INFO:tasks.workunit.client.1.smithi106.stdout:4/91: dread d7/fd [0,4194304] 0 2024-05-09T06:30:19.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/56: mkdir d4/d6/db 0 2024-05-09T06:30:19.080 INFO:tasks.workunit.client.1.smithi106.stdout:3/86: mkdir d5/d1c 0 2024-05-09T06:30:19.082 INFO:tasks.workunit.client.1.smithi106.stdout:4/92: mkdir d7/d10/d1a 0 2024-05-09T06:30:19.082 INFO:tasks.workunit.client.1.smithi106.stdout:9/57: mkdir d4/d6/dc 0 2024-05-09T06:30:19.084 INFO:tasks.workunit.client.1.smithi106.stdout:0/56: mkdir d1/d11 0 2024-05-09T06:30:19.085 INFO:tasks.workunit.client.1.smithi106.stdout:3/87: mkdir d5/d1d 0 2024-05-09T06:30:19.085 INFO:tasks.workunit.client.1.smithi106.stdout:2/73: dwrite f1 [0,4194304] 0 2024-05-09T06:30:19.086 INFO:tasks.workunit.client.1.smithi106.stdout:3/88: creat d5/d1c/f1e x:0 0 0 2024-05-09T06:30:19.087 INFO:tasks.workunit.client.1.smithi106.stdout:0/57: mkdir d1/d12 0 2024-05-09T06:30:19.087 INFO:tasks.workunit.client.1.smithi106.stdout:0/58: fdatasync d1/f5 0 2024-05-09T06:30:19.088 INFO:tasks.workunit.client.1.smithi106.stdout:9/58: dread d4/d6/f7 [0,4194304] 0 2024-05-09T06:30:19.088 INFO:tasks.workunit.client.1.smithi106.stdout:9/59: chown c3 456358841 1 2024-05-09T06:30:19.088 INFO:tasks.workunit.client.1.smithi106.stdout:9/60: readlink d4/d6/l9 0 2024-05-09T06:30:19.089 INFO:tasks.workunit.client.1.smithi106.stdout:2/74: creat d2/d5/db/f1b x:0 0 0 2024-05-09T06:30:19.090 INFO:tasks.workunit.client.1.smithi106.stdout:0/59: mkdir d1/d12/d13 0 2024-05-09T06:30:19.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/61: creat d4/d6/dc/fd x:0 0 0 2024-05-09T06:30:19.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/62: read d4/d6/f7 [2447139,21812] 0 2024-05-09T06:30:19.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/63: creat d4/d6/dc/fe x:0 0 0 2024-05-09T06:30:19.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/64: fdatasync d4/d6/dc/fd 0 2024-05-09T06:30:19.092 INFO:tasks.workunit.client.1.smithi106.stdout:4/93: dread d7/f11 [0,4194304] 0 2024-05-09T06:30:19.092 INFO:tasks.workunit.client.1.smithi106.stdout:4/94: write f3 [642604,33850] 0 2024-05-09T06:30:19.092 INFO:tasks.workunit.client.1.smithi106.stdout:4/95: fdatasync f2 0 2024-05-09T06:30:19.093 INFO:tasks.workunit.client.1.smithi106.stdout:0/60: creat d1/d12/d13/f14 x:0 0 0 2024-05-09T06:30:19.093 INFO:tasks.workunit.client.1.smithi106.stdout:0/61: creat d1/d12/d13/f15 x:0 0 0 2024-05-09T06:30:19.093 INFO:tasks.workunit.client.1.smithi106.stdout:2/75: dread d2/d5/f13 [0,4194304] 0 2024-05-09T06:30:19.094 INFO:tasks.workunit.client.1.smithi106.stdout:9/65: creat d4/d6/ff x:0 0 0 2024-05-09T06:30:19.094 INFO:tasks.workunit.client.1.smithi106.stdout:9/66: creat d4/d6/dc/f10 x:0 0 0 2024-05-09T06:30:19.096 INFO:tasks.workunit.client.1.smithi106.stdout:4/96: mknod d7/d10/d1a/c1b 0 2024-05-09T06:30:19.101 INFO:tasks.workunit.client.1.smithi106.stdout:2/76: creat d2/d7/f1c x:0 0 0 2024-05-09T06:30:19.102 INFO:tasks.workunit.client.1.smithi106.stdout:2/77: fsync d2/d5/f6 0 2024-05-09T06:30:19.102 INFO:tasks.workunit.client.1.smithi106.stdout:4/97: truncate d7/f11 1384347 0 2024-05-09T06:30:19.103 INFO:tasks.workunit.client.1.smithi106.stdout:2/78: mkdir d2/d5/db/d1d 0 2024-05-09T06:30:19.117 INFO:tasks.workunit.client.1.smithi106.stdout:1/82: sync 2024-05-09T06:30:19.117 INFO:tasks.workunit.client.1.smithi106.stdout:8/62: sync 2024-05-09T06:30:19.117 INFO:tasks.workunit.client.1.smithi106.stdout:6/88: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:19.117 INFO:tasks.workunit.client.1.smithi106.stdout:6/89: write d0/d6/d8/f14 [1829722,59932] 0 2024-05-09T06:30:19.117 INFO:tasks.workunit.client.1.smithi106.stdout:6/90: write d0/f1c [14743,90192] 0 2024-05-09T06:30:19.118 INFO:tasks.workunit.client.1.smithi106.stdout:5/111: dwrite d8/fd [0,4194304] 0 2024-05-09T06:30:19.118 INFO:tasks.workunit.client.1.smithi106.stdout:1/83: creat d4/d5/d9/d13/f20 x:0 0 0 2024-05-09T06:30:19.118 INFO:tasks.workunit.client.1.smithi106.stdout:9/67: dwrite d4/d6/dc/fd [0,4194304] 0 2024-05-09T06:30:19.118 INFO:tasks.workunit.client.1.smithi106.stdout:9/68: creat d4/d6/f11 x:0 0 0 2024-05-09T06:30:19.119 INFO:tasks.workunit.client.1.smithi106.stdout:3/89: dwrite d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:19.119 INFO:tasks.workunit.client.1.smithi106.stdout:3/90: write d5/d12/f19 [357674,9574] 0 2024-05-09T06:30:19.123 INFO:tasks.workunit.client.1.smithi106.stdout:7/62: dwrite d0/fe [0,4194304] 0 2024-05-09T06:30:19.124 INFO:tasks.workunit.client.1.smithi106.stdout:1/84: rename d4/d5/d9/d1d/f1c to d4/d5/f21 0 2024-05-09T06:30:19.125 INFO:tasks.workunit.client.1.smithi106.stdout:1/85: creat d4/d5/d9/f22 x:0 0 0 2024-05-09T06:30:19.134 INFO:tasks.workunit.client.1.smithi106.stdout:1/86: creat d4/d5/f23 x:0 0 0 2024-05-09T06:30:19.134 INFO:tasks.workunit.client.1.smithi106.stdout:1/87: write d4/f1f [551329,41618] 0 2024-05-09T06:30:19.134 INFO:tasks.workunit.client.1.smithi106.stdout:1/88: chown d4/d5/ff 10170644 1 2024-05-09T06:30:19.135 INFO:tasks.workunit.client.1.smithi106.stdout:9/69: rename d4/d6/db to d4/d6/dc/d12 0 2024-05-09T06:30:19.136 INFO:tasks.workunit.client.1.smithi106.stdout:7/63: write d0/f5 [2000766,21821] 0 2024-05-09T06:30:19.136 INFO:tasks.workunit.client.1.smithi106.stdout:7/64: chown d0/l7 4064 1 2024-05-09T06:30:19.138 INFO:tasks.workunit.client.1.smithi106.stdout:9/70: rename d4/d6/dc/f10 to d4/d6/f13 0 2024-05-09T06:30:19.140 INFO:tasks.workunit.client.1.smithi106.stdout:0/62: rmdir d1/d12/d13 39 2024-05-09T06:30:19.141 INFO:tasks.workunit.client.1.smithi106.stdout:7/65: rmdir d0/dc 39 2024-05-09T06:30:19.142 INFO:tasks.workunit.client.1.smithi106.stdout:0/63: symlink d1/d11/l16 0 2024-05-09T06:30:19.143 INFO:tasks.workunit.client.1.smithi106.stdout:0/64: symlink d1/d12/d13/l17 0 2024-05-09T06:30:19.143 INFO:tasks.workunit.client.1.smithi106.stdout:0/65: chown d1/cd 153 1 2024-05-09T06:30:19.143 INFO:tasks.workunit.client.1.smithi106.stdout:3/91: dread d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:19.144 INFO:tasks.workunit.client.1.smithi106.stdout:0/66: symlink d1/l18 0 2024-05-09T06:30:19.145 INFO:tasks.workunit.client.1.smithi106.stdout:0/67: rmdir d1/d12/d13 39 2024-05-09T06:30:19.146 INFO:tasks.workunit.client.1.smithi106.stdout:0/68: mknod d1/d11/c19 0 2024-05-09T06:30:19.153 INFO:tasks.workunit.client.1.smithi106.stdout:0/69: dread d1/f3 [0,4194304] 0 2024-05-09T06:30:19.157 INFO:tasks.workunit.client.1.smithi106.stdout:2/79: dwrite d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:19.157 INFO:tasks.workunit.client.1.smithi106.stdout:2/80: creat d2/d5/db/d15/f1e x:0 0 0 2024-05-09T06:30:19.160 INFO:tasks.workunit.client.1.smithi106.stdout:2/81: mknod d2/d7/c1f 0 2024-05-09T06:30:19.161 INFO:tasks.workunit.client.1.smithi106.stdout:8/63: dwrite d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.162 INFO:tasks.workunit.client.1.smithi106.stdout:9/71: dwrite d4/d6/f11 [0,4194304] 0 2024-05-09T06:30:19.162 INFO:tasks.workunit.client.1.smithi106.stdout:0/70: fdatasync d1/fc 0 2024-05-09T06:30:19.162 INFO:tasks.workunit.client.1.smithi106.stdout:2/82: link d2/c8 d2/d7/c20 0 2024-05-09T06:30:19.163 INFO:tasks.workunit.client.1.smithi106.stdout:2/83: chown d2/d5 97609 1 2024-05-09T06:30:19.163 INFO:tasks.workunit.client.1.smithi106.stdout:0/71: fdatasync d1/f6 0 2024-05-09T06:30:19.163 INFO:tasks.workunit.client.1.smithi106.stdout:6/91: dwrite d0/d6/d8/f14 [0,4194304] 0 2024-05-09T06:30:19.163 INFO:tasks.workunit.client.1.smithi106.stdout:5/112: dwrite d8/f19 [0,4194304] 0 2024-05-09T06:30:19.164 INFO:tasks.workunit.client.1.smithi106.stdout:3/92: dwrite f2 [0,4194304] 0 2024-05-09T06:30:19.169 INFO:tasks.workunit.client.1.smithi106.stdout:9/72: symlink d4/d6/dc/d12/l14 0 2024-05-09T06:30:19.170 INFO:tasks.workunit.client.1.smithi106.stdout:0/72: rename d1/f6 to d1/d12/f1a 0 2024-05-09T06:30:19.178 INFO:tasks.workunit.client.1.smithi106.stdout:3/93: unlink d5/d12/l14 0 2024-05-09T06:30:19.180 INFO:tasks.workunit.client.1.smithi106.stdout:6/92: getdents d0/d6 0 2024-05-09T06:30:19.182 INFO:tasks.workunit.client.1.smithi106.stdout:8/64: dwrite d3/d5/f12 [0,4194304] 0 2024-05-09T06:30:19.183 INFO:tasks.workunit.client.1.smithi106.stdout:5/113: mkdir d8/d1d 0 2024-05-09T06:30:19.183 INFO:tasks.workunit.client.1.smithi106.stdout:5/114: fsync d8/f18 0 2024-05-09T06:30:19.185 INFO:tasks.workunit.client.1.smithi106.stdout:3/94: link d5/d12/f13 d5/d12/d1b/f1f 0 2024-05-09T06:30:19.186 INFO:tasks.workunit.client.1.smithi106.stdout:1/89: getdents d4/d5/d9 0 2024-05-09T06:30:19.191 INFO:tasks.workunit.client.1.smithi106.stdout:5/115: creat d8/d1c/f1e x:0 0 0 2024-05-09T06:30:19.191 INFO:tasks.workunit.client.1.smithi106.stdout:5/116: creat d8/d1c/f1f x:0 0 0 2024-05-09T06:30:19.192 INFO:tasks.workunit.client.1.smithi106.stdout:6/93: dread d0/d6/d8/f14 [0,4194304] 0 2024-05-09T06:30:19.192 INFO:tasks.workunit.client.1.smithi106.stdout:5/117: getdents d8/d1d 0 2024-05-09T06:30:19.193 INFO:tasks.workunit.client.1.smithi106.stdout:1/90: creat d4/d5/d9/d1d/f24 x:0 0 0 2024-05-09T06:30:19.193 INFO:tasks.workunit.client.1.smithi106.stdout:1/91: write d4/d5/d9/f11 [596539,129541] 0 2024-05-09T06:30:19.195 INFO:tasks.workunit.client.1.smithi106.stdout:6/94: mkdir d0/d17/d21 0 2024-05-09T06:30:19.195 INFO:tasks.workunit.client.1.smithi106.stdout:6/95: chown d0/d6/l4 1 1 2024-05-09T06:30:19.195 INFO:tasks.workunit.client.1.smithi106.stdout:6/96: chown d0/d6/d8/f12 644 1 2024-05-09T06:30:19.196 INFO:tasks.workunit.client.1.smithi106.stdout:1/92: creat d4/d5/d9/d13/f25 x:0 0 0 2024-05-09T06:30:19.196 INFO:tasks.workunit.client.1.smithi106.stdout:1/93: fsync d4/fa 0 2024-05-09T06:30:19.197 INFO:tasks.workunit.client.1.smithi106.stdout:6/97: truncate d0/d6/d8/f12 589997 0 2024-05-09T06:30:19.199 INFO:tasks.workunit.client.1.smithi106.stdout:6/98: stat d0/l20 0 2024-05-09T06:30:19.201 INFO:tasks.workunit.client.1.smithi106.stdout:6/99: creat d0/d17/f22 x:0 0 0 2024-05-09T06:30:19.208 INFO:tasks.workunit.client.1.smithi106.stdout:8/65: write d3/d5/d13/f14 [2725376,125170] 0 2024-05-09T06:30:19.209 INFO:tasks.workunit.client.1.smithi106.stdout:3/95: write d5/d1c/f1e [53621,54213] 0 2024-05-09T06:30:19.210 INFO:tasks.workunit.client.1.smithi106.stdout:3/96: symlink d5/d12/d1b/l20 0 2024-05-09T06:30:19.210 INFO:tasks.workunit.client.1.smithi106.stdout:3/97: write d5/d12/f15 [1154456,99144] 0 2024-05-09T06:30:19.210 INFO:tasks.workunit.client.1.smithi106.stdout:3/98: chown d5/f17 1807591596 1 2024-05-09T06:30:19.212 INFO:tasks.workunit.client.1.smithi106.stdout:3/99: unlink d5/cc 0 2024-05-09T06:30:19.219 INFO:tasks.workunit.client.1.smithi106.stdout:0/73: dwrite d1/fc [0,4194304] 0 2024-05-09T06:30:19.219 INFO:tasks.workunit.client.1.smithi106.stdout:7/66: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:19.219 INFO:tasks.workunit.client.1.smithi106.stdout:0/74: stat d1/f7 0 2024-05-09T06:30:19.219 INFO:tasks.workunit.client.1.smithi106.stdout:0/75: stat d1/f7 0 2024-05-09T06:30:19.219 INFO:tasks.workunit.client.1.smithi106.stdout:0/76: write d1/d12/f1a [117035,65396] 0 2024-05-09T06:30:19.224 INFO:tasks.workunit.client.1.smithi106.stdout:0/77: rename d1/l2 to d1/d12/d13/l1b 0 2024-05-09T06:30:19.224 INFO:tasks.workunit.client.1.smithi106.stdout:0/78: write d1/ff [658600,124901] 0 2024-05-09T06:30:19.225 INFO:tasks.workunit.client.1.smithi106.stdout:9/73: dwrite d4/d6/fa [0,4194304] 0 2024-05-09T06:30:19.225 INFO:tasks.workunit.client.1.smithi106.stdout:9/74: chown d4/d6/f11 608558 1 2024-05-09T06:30:19.225 INFO:tasks.workunit.client.1.smithi106.stdout:9/75: creat d4/d6/f15 x:0 0 0 2024-05-09T06:30:19.225 INFO:tasks.workunit.client.1.smithi106.stdout:5/118: dwrite d8/d1c/f1e [0,4194304] 0 2024-05-09T06:30:19.225 INFO:tasks.workunit.client.1.smithi106.stdout:2/84: dwrite d2/d5/db/f1b [0,4194304] 0 2024-05-09T06:30:19.226 INFO:tasks.workunit.client.1.smithi106.stdout:6/100: dwrite d0/d6/d8/f9 [0,4194304] 0 2024-05-09T06:30:19.228 INFO:tasks.workunit.client.1.smithi106.stdout:4/98: dwrite d7/f11 [0,4194304] 0 2024-05-09T06:30:19.229 INFO:tasks.workunit.client.1.smithi106.stdout:4/99: fsync d7/f18 0 2024-05-09T06:30:19.231 INFO:tasks.workunit.client.1.smithi106.stdout:0/79: dread d1/f5 [0,4194304] 0 2024-05-09T06:30:19.240 INFO:tasks.workunit.client.1.smithi106.stdout:6/101: dread d0/d17/f10 [0,4194304] 0 2024-05-09T06:30:19.254 INFO:tasks.workunit.client.1.smithi106.stdout:8/66: dwrite d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.264 INFO:tasks.workunit.client.1.smithi106.stdout:8/67: dread d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.290 INFO:tasks.workunit.client.1.smithi106.stdout:2/85: write d2/d7/f1c [3571713,81837] 0 2024-05-09T06:30:19.290 INFO:tasks.workunit.client.1.smithi106.stdout:7/67: dwrite d0/fe [0,4194304] 0 2024-05-09T06:30:19.292 INFO:tasks.workunit.client.1.smithi106.stdout:9/76: dwrite d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:19.294 INFO:tasks.workunit.client.1.smithi106.stdout:1/94: getdents d4/d5/d9/d13 0 2024-05-09T06:30:19.298 INFO:tasks.workunit.client.1.smithi106.stdout:2/86: dread f1 [0,4194304] 0 2024-05-09T06:30:19.298 INFO:tasks.workunit.client.1.smithi106.stdout:8/68: dwrite d3/d5/f12 [0,4194304] 0 2024-05-09T06:30:19.301 INFO:tasks.workunit.client.1.smithi106.stdout:4/100: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:19.301 INFO:tasks.workunit.client.1.smithi106.stdout:4/101: chown d7/d10/d12 58727 1 2024-05-09T06:30:19.311 INFO:tasks.workunit.client.1.smithi106.stdout:0/80: symlink d1/d11/l1c 0 2024-05-09T06:30:19.311 INFO:tasks.workunit.client.1.smithi106.stdout:0/81: stat d1/l10 0 2024-05-09T06:30:19.311 INFO:tasks.workunit.client.1.smithi106.stdout:2/87: dread d2/d5/db/f1b [0,4194304] 0 2024-05-09T06:30:19.311 INFO:tasks.workunit.client.1.smithi106.stdout:5/119: unlink d8/l13 0 2024-05-09T06:30:19.311 INFO:tasks.workunit.client.1.smithi106.stdout:5/120: fdatasync d8/f18 0 2024-05-09T06:30:19.312 INFO:tasks.workunit.client.1.smithi106.stdout:6/102: mknod d0/d6/c23 0 2024-05-09T06:30:19.312 INFO:tasks.workunit.client.1.smithi106.stdout:6/103: fdatasync d0/d17/f10 0 2024-05-09T06:30:19.313 INFO:tasks.workunit.client.1.smithi106.stdout:6/104: stat d0/d6/l4 0 2024-05-09T06:30:19.313 INFO:tasks.workunit.client.1.smithi106.stdout:6/105: read - d0/d17/f1e zero size 2024-05-09T06:30:19.313 INFO:tasks.workunit.client.1.smithi106.stdout:6/106: write d0/d17/f22 [133236,6765] 0 2024-05-09T06:30:19.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/77: mkdir d4/d6/dc/d16 0 2024-05-09T06:30:19.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/78: chown d4/d6/f13 36787085 1 2024-05-09T06:30:19.315 INFO:tasks.workunit.client.1.smithi106.stdout:2/88: dread f1 [0,4194304] 0 2024-05-09T06:30:19.315 INFO:tasks.workunit.client.1.smithi106.stdout:2/89: fdatasync d2/f10 0 2024-05-09T06:30:19.316 INFO:tasks.workunit.client.1.smithi106.stdout:1/95: symlink d4/d5/d9/d13/l26 0 2024-05-09T06:30:19.319 INFO:tasks.workunit.client.1.smithi106.stdout:5/121: write d8/fc [3634130,103921] 0 2024-05-09T06:30:19.320 INFO:tasks.workunit.client.1.smithi106.stdout:5/122: write d8/fd [4752942,127292] 0 2024-05-09T06:30:19.322 INFO:tasks.workunit.client.1.smithi106.stdout:4/102: rename d7/dc to d7/d10/d12/d1c 0 2024-05-09T06:30:19.322 INFO:tasks.workunit.client.1.smithi106.stdout:6/107: dread d0/d6/d8/f9 [0,4194304] 0 2024-05-09T06:30:19.322 INFO:tasks.workunit.client.1.smithi106.stdout:6/108: truncate d0/d6/fb 1857040 0 2024-05-09T06:30:19.322 INFO:tasks.workunit.client.1.smithi106.stdout:6/109: truncate d0/d17/f22 927379 0 2024-05-09T06:30:19.322 INFO:tasks.workunit.client.1.smithi106.stdout:8/69: dwrite d3/d5/d13/f14 [4194304,4194304] 0 2024-05-09T06:30:19.322 INFO:tasks.workunit.client.1.smithi106.stdout:0/82: truncate f0 3044311 0 2024-05-09T06:30:19.323 INFO:tasks.workunit.client.1.smithi106.stdout:8/70: dread d3/ff [0,4194304] 0 2024-05-09T06:30:19.324 INFO:tasks.workunit.client.1.smithi106.stdout:9/79: link d4/d6/l9 d4/d6/dc/d12/l17 0 2024-05-09T06:30:19.324 INFO:tasks.workunit.client.1.smithi106.stdout:4/103: dread f3 [0,4194304] 0 2024-05-09T06:30:19.324 INFO:tasks.workunit.client.1.smithi106.stdout:2/90: mknod d2/d5/db/c21 0 2024-05-09T06:30:19.325 INFO:tasks.workunit.client.1.smithi106.stdout:5/123: symlink d8/d1c/l20 0 2024-05-09T06:30:19.326 INFO:tasks.workunit.client.1.smithi106.stdout:6/110: truncate d0/d6/d8/f9 1023839 0 2024-05-09T06:30:19.327 INFO:tasks.workunit.client.1.smithi106.stdout:0/83: creat d1/f1d x:0 0 0 2024-05-09T06:30:19.328 INFO:tasks.workunit.client.1.smithi106.stdout:4/104: creat d7/d10/f1d x:0 0 0 2024-05-09T06:30:19.329 INFO:tasks.workunit.client.1.smithi106.stdout:1/96: truncate d4/d5/d9/f11 74694 0 2024-05-09T06:30:19.330 INFO:tasks.workunit.client.1.smithi106.stdout:0/84: dread d1/f3 [0,4194304] 0 2024-05-09T06:30:19.332 INFO:tasks.workunit.client.1.smithi106.stdout:6/111: creat d0/d6/f24 x:0 0 0 2024-05-09T06:30:19.333 INFO:tasks.workunit.client.1.smithi106.stdout:4/105: creat d7/d10/d1a/f1e x:0 0 0 2024-05-09T06:30:19.334 INFO:tasks.workunit.client.1.smithi106.stdout:8/71: write d3/d5/f12 [1003391,35271] 0 2024-05-09T06:30:19.336 INFO:tasks.workunit.client.1.smithi106.stdout:1/97: creat d4/d5/d9/f27 x:0 0 0 2024-05-09T06:30:19.336 INFO:tasks.workunit.client.1.smithi106.stdout:8/72: dread d3/ff [0,4194304] 0 2024-05-09T06:30:19.336 INFO:tasks.workunit.client.1.smithi106.stdout:8/73: chown d3/f6 287450 1 2024-05-09T06:30:19.337 INFO:tasks.workunit.client.1.smithi106.stdout:0/85: symlink d1/d11/l1e 0 2024-05-09T06:30:19.337 INFO:tasks.workunit.client.1.smithi106.stdout:0/86: readlink d1/d12/d13/l17 0 2024-05-09T06:30:19.339 INFO:tasks.workunit.client.1.smithi106.stdout:4/106: unlink d7/d10/d12/l17 0 2024-05-09T06:30:19.343 INFO:tasks.workunit.client.1.smithi106.stdout:1/98: truncate f2 2585932 0 2024-05-09T06:30:19.343 INFO:tasks.workunit.client.1.smithi106.stdout:1/99: fsync d4/d5/d9/fc 0 2024-05-09T06:30:19.344 INFO:tasks.workunit.client.1.smithi106.stdout:8/74: mkdir d3/d5/d7/d15/d16 0 2024-05-09T06:30:19.344 INFO:tasks.workunit.client.1.smithi106.stdout:8/75: write d3/d5/f12 [830080,47221] 0 2024-05-09T06:30:19.344 INFO:tasks.workunit.client.1.smithi106.stdout:8/76: truncate d3/f6 2218264 0 2024-05-09T06:30:19.347 INFO:tasks.workunit.client.1.smithi106.stdout:5/124: rmdir d8/d1d 0 2024-05-09T06:30:19.349 INFO:tasks.workunit.client.1.smithi106.stdout:0/87: rename d1/ff to d1/d12/f1f 0 2024-05-09T06:30:19.351 INFO:tasks.workunit.client.1.smithi106.stdout:1/100: getdents d4/d5/d9/d13 0 2024-05-09T06:30:19.351 INFO:tasks.workunit.client.1.smithi106.stdout:1/101: stat d4/d5/d9/d1d/f24 0 2024-05-09T06:30:19.351 INFO:tasks.workunit.client.1.smithi106.stdout:3/100: sync 2024-05-09T06:30:19.354 INFO:tasks.workunit.client.1.smithi106.stdout:4/107: rename c1 to d7/d10/d12/c1f 0 2024-05-09T06:30:19.354 INFO:tasks.workunit.client.1.smithi106.stdout:4/108: chown d7/d10 12090171 1 2024-05-09T06:30:19.354 INFO:tasks.workunit.client.1.smithi106.stdout:4/109: write f2 [375807,9894] 0 2024-05-09T06:30:19.356 INFO:tasks.workunit.client.1.smithi106.stdout:4/110: rename d7/l8 to d7/d10/l20 0 2024-05-09T06:30:19.357 INFO:tasks.workunit.client.1.smithi106.stdout:4/111: link d7/d10/d12/d1c/l13 d7/d10/d12/l21 0 2024-05-09T06:30:19.359 INFO:tasks.workunit.client.1.smithi106.stdout:5/125: write d8/f19 [614116,128095] 0 2024-05-09T06:30:19.364 INFO:tasks.workunit.client.1.smithi106.stdout:5/126: fsync d8/fc 0 2024-05-09T06:30:19.364 INFO:tasks.workunit.client.1.smithi106.stdout:5/127: write d8/d1c/f1f [977809,122302] 0 2024-05-09T06:30:19.365 INFO:tasks.workunit.client.1.smithi106.stdout:1/102: dread d4/d5/d9/f16 [0,4194304] 0 2024-05-09T06:30:19.365 INFO:tasks.workunit.client.1.smithi106.stdout:9/80: dwrite d4/d6/f7 [0,4194304] 0 2024-05-09T06:30:19.365 INFO:tasks.workunit.client.1.smithi106.stdout:8/77: dwrite d3/ff [0,4194304] 0 2024-05-09T06:30:19.366 INFO:tasks.workunit.client.1.smithi106.stdout:5/128: write d8/fa [786665,93283] 0 2024-05-09T06:30:19.366 INFO:tasks.workunit.client.1.smithi106.stdout:5/129: write d8/d1c/f1f [1061848,75133] 0 2024-05-09T06:30:19.366 INFO:tasks.workunit.client.1.smithi106.stdout:5/130: write d8/f19 [1145874,77471] 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:0/88: dwrite d1/fb [0,4194304] 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/101: dread d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/102: chown d5/d12/c1a 6021 1 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/103: stat d5/d12/f15 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/104: stat d5/d12/f15 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/105: chown d5/d1c 1043859 1 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:2/91: dwrite f0 [0,4194304] 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/106: write d5/f17 [989403,3383] 0 2024-05-09T06:30:19.369 INFO:tasks.workunit.client.1.smithi106.stdout:3/107: fdatasync d5/d12/f15 0 2024-05-09T06:30:19.370 INFO:tasks.workunit.client.1.smithi106.stdout:2/92: chown d2/d5/ld 394 1 2024-05-09T06:30:19.370 INFO:tasks.workunit.client.1.smithi106.stdout:3/108: readlink d5/l6 0 2024-05-09T06:30:19.370 INFO:tasks.workunit.client.1.smithi106.stdout:3/109: stat d5/d12/d1b/l20 0 2024-05-09T06:30:19.370 INFO:tasks.workunit.client.1.smithi106.stdout:1/103: read d4/f1f [159,120349] 0 2024-05-09T06:30:19.370 INFO:tasks.workunit.client.1.smithi106.stdout:9/81: creat d4/d6/dc/d16/f18 x:0 0 0 2024-05-09T06:30:19.370 INFO:tasks.workunit.client.1.smithi106.stdout:1/104: write d4/d5/d9/d1d/f24 [460479,100499] 0 2024-05-09T06:30:19.371 INFO:tasks.workunit.client.1.smithi106.stdout:4/112: dread d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:19.373 INFO:tasks.workunit.client.1.smithi106.stdout:8/78: mknod d3/d5/d7/d15/c17 0 2024-05-09T06:30:19.382 INFO:tasks.workunit.client.1.smithi106.stdout:9/82: write d4/d6/f15 [3676130,76021] 0 2024-05-09T06:30:19.385 INFO:tasks.workunit.client.1.smithi106.stdout:1/105: mknod d4/d5/d9/c28 0 2024-05-09T06:30:19.388 INFO:tasks.workunit.client.1.smithi106.stdout:4/113: truncate f0 4080077 0 2024-05-09T06:30:19.397 INFO:tasks.workunit.client.1.smithi106.stdout:8/79: link d3/d5/cc d3/d5/d7/d15/d16/c18 0 2024-05-09T06:30:19.397 INFO:tasks.workunit.client.1.smithi106.stdout:8/80: chown d3/d5/cc 0 1 2024-05-09T06:30:19.398 INFO:tasks.workunit.client.1.smithi106.stdout:5/131: symlink d8/l21 0 2024-05-09T06:30:19.400 INFO:tasks.workunit.client.1.smithi106.stdout:9/83: mkdir d4/d19 0 2024-05-09T06:30:19.402 INFO:tasks.workunit.client.1.smithi106.stdout:3/110: getdents d5 0 2024-05-09T06:30:19.404 INFO:tasks.workunit.client.1.smithi106.stdout:0/89: dwrite d1/f5 [0,4194304] 0 2024-05-09T06:30:19.405 INFO:tasks.workunit.client.1.smithi106.stdout:4/114: mkdir d7/d22 0 2024-05-09T06:30:19.406 INFO:tasks.workunit.client.1.smithi106.stdout:2/93: dwrite d2/d5/db/f1b [0,4194304] 0 2024-05-09T06:30:19.406 INFO:tasks.workunit.client.1.smithi106.stdout:1/106: dwrite d4/d5/d9/d13/f19 [0,4194304] 0 2024-05-09T06:30:19.407 INFO:tasks.workunit.client.1.smithi106.stdout:3/111: mkdir d5/d1c/d21 0 2024-05-09T06:30:19.409 INFO:tasks.workunit.client.1.smithi106.stdout:0/90: unlink d1/fc 0 2024-05-09T06:30:19.411 INFO:tasks.workunit.client.1.smithi106.stdout:1/107: read d4/d5/f6 [194370,79784] 0 2024-05-09T06:30:19.411 INFO:tasks.workunit.client.1.smithi106.stdout:1/108: write d4/f12 [474646,108805] 0 2024-05-09T06:30:19.413 INFO:tasks.workunit.client.1.smithi106.stdout:9/84: dread d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:19.413 INFO:tasks.workunit.client.1.smithi106.stdout:4/115: unlink d7/d10/l20 0 2024-05-09T06:30:19.416 INFO:tasks.workunit.client.1.smithi106.stdout:2/94: creat d2/d5/f22 x:0 0 0 2024-05-09T06:30:19.418 INFO:tasks.workunit.client.1.smithi106.stdout:3/112: rename d5/f7 to d5/d12/d1b/f22 0 2024-05-09T06:30:19.419 INFO:tasks.workunit.client.1.smithi106.stdout:1/109: mknod d4/d5/d9/d13/c29 0 2024-05-09T06:30:19.419 INFO:tasks.workunit.client.1.smithi106.stdout:1/110: chown d4/fb 12092491 1 2024-05-09T06:30:19.421 INFO:tasks.workunit.client.1.smithi106.stdout:9/85: unlink d4/d6/dc/fe 0 2024-05-09T06:30:19.421 INFO:tasks.workunit.client.1.smithi106.stdout:9/86: chown d4/d6/dc/d12 57695 1 2024-05-09T06:30:19.421 INFO:tasks.workunit.client.1.smithi106.stdout:9/87: getdents d4/d19 0 2024-05-09T06:30:19.422 INFO:tasks.workunit.client.1.smithi106.stdout:2/95: mkdir d2/d5/db/d1d/d23 0 2024-05-09T06:30:19.422 INFO:tasks.workunit.client.1.smithi106.stdout:2/96: chown d2/d7/l4 0 1 2024-05-09T06:30:19.424 INFO:tasks.workunit.client.1.smithi106.stdout:2/97: symlink d2/d5/db/d15/l24 0 2024-05-09T06:30:19.424 INFO:tasks.workunit.client.1.smithi106.stdout:2/98: creat d2/d7/f25 x:0 0 0 2024-05-09T06:30:19.424 INFO:tasks.workunit.client.1.smithi106.stdout:1/111: read d4/d5/f7 [35253,38041] 0 2024-05-09T06:30:19.425 INFO:tasks.workunit.client.1.smithi106.stdout:2/99: fdatasync d2/d7/f1c 0 2024-05-09T06:30:19.425 INFO:tasks.workunit.client.1.smithi106.stdout:9/88: getdents d4/d6 0 2024-05-09T06:30:19.428 INFO:tasks.workunit.client.1.smithi106.stdout:2/100: truncate f0 2945925 0 2024-05-09T06:30:19.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/112: mknod d4/d5/d9/d1d/c2a 0 2024-05-09T06:30:19.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/113: write d4/f12 [1558117,13968] 0 2024-05-09T06:30:19.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/114: readlink d4/d5/ld 0 2024-05-09T06:30:19.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/115: chown d4/d5/d9/d1d/c2a 394169323 1 2024-05-09T06:30:19.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/116: write d4/d5/f21 [122049,97193] 0 2024-05-09T06:30:19.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/117: fdatasync d4/d5/d9/fc 0 2024-05-09T06:30:19.431 INFO:tasks.workunit.client.1.smithi106.stdout:1/118: dread d4/d5/d9/f11 [0,4194304] 0 2024-05-09T06:30:19.431 INFO:tasks.workunit.client.1.smithi106.stdout:3/113: dread d5/d12/f13 [0,4194304] 0 2024-05-09T06:30:19.432 INFO:tasks.workunit.client.1.smithi106.stdout:1/119: link d4/d5/d9/fc d4/d5/d9/d13/f2b 0 2024-05-09T06:30:19.432 INFO:tasks.workunit.client.1.smithi106.stdout:1/120: chown d4/d5/d9/c28 26474790 1 2024-05-09T06:30:19.434 INFO:tasks.workunit.client.1.smithi106.stdout:3/114: rename d5/d12/d1b/f1f to d5/d12/f23 0 2024-05-09T06:30:19.434 INFO:tasks.workunit.client.1.smithi106.stdout:3/115: fdatasync d5/fb 0 2024-05-09T06:30:19.458 INFO:tasks.workunit.client.1.smithi106.stdout:8/81: dwrite d3/d5/d13/f14 [8388608,4194304] 0 2024-05-09T06:30:19.458 INFO:tasks.workunit.client.1.smithi106.stdout:3/116: dread d5/d12/f19 [0,4194304] 0 2024-05-09T06:30:19.459 INFO:tasks.workunit.client.1.smithi106.stdout:5/132: dwrite d8/fa [0,4194304] 0 2024-05-09T06:30:19.459 INFO:tasks.workunit.client.1.smithi106.stdout:5/133: fdatasync d8/fa 0 2024-05-09T06:30:19.464 INFO:tasks.workunit.client.1.smithi106.stdout:8/82: mknod d3/d5/d7/c19 0 2024-05-09T06:30:19.464 INFO:tasks.workunit.client.1.smithi106.stdout:2/101: write d2/d5/db/f1b [3080051,54821] 0 2024-05-09T06:30:19.466 INFO:tasks.workunit.client.1.smithi106.stdout:3/117: rename d5/d1d to d5/d1c/d24 0 2024-05-09T06:30:19.466 INFO:tasks.workunit.client.1.smithi106.stdout:3/118: chown d5/d12/c1a 274830 1 2024-05-09T06:30:19.466 INFO:tasks.workunit.client.1.smithi106.stdout:0/91: dwrite d1/d12/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.466 INFO:tasks.workunit.client.1.smithi106.stdout:4/116: dwrite d7/d10/d1a/f1e [0,4194304] 0 2024-05-09T06:30:19.468 INFO:tasks.workunit.client.1.smithi106.stdout:9/89: getdents d4/d6/dc 0 2024-05-09T06:30:19.468 INFO:tasks.workunit.client.1.smithi106.stdout:9/90: write d4/d6/dc/d16/f18 [906488,65259] 0 2024-05-09T06:30:19.470 INFO:tasks.workunit.client.1.smithi106.stdout:1/121: dwrite d4/f1f [0,4194304] 0 2024-05-09T06:30:19.471 INFO:tasks.workunit.client.1.smithi106.stdout:0/92: read f0 [690915,112429] 0 2024-05-09T06:30:19.479 INFO:tasks.workunit.client.1.smithi106.stdout:3/119: dread d5/d12/f15 [0,4194304] 0 2024-05-09T06:30:19.480 INFO:tasks.workunit.client.1.smithi106.stdout:3/120: fdatasync d5/d12/f13 0 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:1/122: mknod d4/d5/d9/c2c 0 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:9/91: dread d4/d6/fa [0,4194304] 0 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:1/123: write d4/f1a [732000,116257] 0 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:1/124: creat d4/f2d x:0 0 0 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:1/125: chown d4/d5/d9/d13/f25 16673435 1 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:1/126: write d4/d5/d9/d1d/f24 [553623,38234] 0 2024-05-09T06:30:19.482 INFO:tasks.workunit.client.1.smithi106.stdout:5/134: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:30:19.483 INFO:tasks.workunit.client.1.smithi106.stdout:4/117: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:19.483 INFO:tasks.workunit.client.1.smithi106.stdout:7/68: sync 2024-05-09T06:30:19.484 INFO:tasks.workunit.client.1.smithi106.stdout:6/112: sync 2024-05-09T06:30:19.484 INFO:tasks.workunit.client.1.smithi106.stdout:3/121: write d5/d12/f13 [2915620,43197] 0 2024-05-09T06:30:19.486 INFO:tasks.workunit.client.1.smithi106.stdout:1/127: truncate d4/fb 125607 0 2024-05-09T06:30:19.488 INFO:tasks.workunit.client.1.smithi106.stdout:9/92: dread d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:19.488 INFO:tasks.workunit.client.1.smithi106.stdout:9/93: stat d4/d6/dc/fd 0 2024-05-09T06:30:19.488 INFO:tasks.workunit.client.1.smithi106.stdout:4/118: truncate d7/f9 1064863 0 2024-05-09T06:30:19.490 INFO:tasks.workunit.client.1.smithi106.stdout:3/122: truncate d5/d12/d1b/f22 4343254 0 2024-05-09T06:30:19.491 INFO:tasks.workunit.client.1.smithi106.stdout:1/128: mknod d4/d5/d9/c2e 0 2024-05-09T06:30:19.492 INFO:tasks.workunit.client.1.smithi106.stdout:6/113: read d0/d6/d8/f14 [2575485,33192] 0 2024-05-09T06:30:19.492 INFO:tasks.workunit.client.1.smithi106.stdout:3/123: symlink d5/d1c/d21/l25 0 2024-05-09T06:30:19.494 INFO:tasks.workunit.client.1.smithi106.stdout:1/129: mkdir d4/d5/d9/d13/d2f 0 2024-05-09T06:30:19.494 INFO:tasks.workunit.client.1.smithi106.stdout:1/130: rename d4/d5/d9 to d4/d5/d9/d1d/d30 22 2024-05-09T06:30:19.494 INFO:tasks.workunit.client.1.smithi106.stdout:8/83: truncate d3/d5/d13/f14 10451708 0 2024-05-09T06:30:19.496 INFO:tasks.workunit.client.1.smithi106.stdout:3/124: rmdir d5/d12/d1b 39 2024-05-09T06:30:19.496 INFO:tasks.workunit.client.1.smithi106.stdout:3/125: fsync d5/d12/f15 0 2024-05-09T06:30:19.496 INFO:tasks.workunit.client.1.smithi106.stdout:5/135: fdatasync d8/f19 0 2024-05-09T06:30:19.496 INFO:tasks.workunit.client.1.smithi106.stdout:5/136: write d8/fc [883802,71182] 0 2024-05-09T06:30:19.496 INFO:tasks.workunit.client.1.smithi106.stdout:5/137: write d8/d1c/f1e [5228833,124775] 0 2024-05-09T06:30:19.497 INFO:tasks.workunit.client.1.smithi106.stdout:0/93: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:19.498 INFO:tasks.workunit.client.1.smithi106.stdout:8/84: rename d3/d5/d7/le to d3/d5/d7/l1a 0 2024-05-09T06:30:19.498 INFO:tasks.workunit.client.1.smithi106.stdout:2/102: dwrite d2/f10 [0,4194304] 0 2024-05-09T06:30:19.499 INFO:tasks.workunit.client.1.smithi106.stdout:2/103: chown d2/d7/l4 33079770 1 2024-05-09T06:30:19.499 INFO:tasks.workunit.client.1.smithi106.stdout:6/114: dread d0/d6/d8/f14 [0,4194304] 0 2024-05-09T06:30:19.499 INFO:tasks.workunit.client.1.smithi106.stdout:5/138: symlink d8/d1c/l22 0 2024-05-09T06:30:19.500 INFO:tasks.workunit.client.1.smithi106.stdout:3/126: dread d5/f17 [0,4194304] 0 2024-05-09T06:30:19.506 INFO:tasks.workunit.client.1.smithi106.stdout:0/94: getdents d1/d11 0 2024-05-09T06:30:19.507 INFO:tasks.workunit.client.1.smithi106.stdout:6/115: dread d0/d6/fe [0,4194304] 0 2024-05-09T06:30:19.513 INFO:tasks.workunit.client.1.smithi106.stdout:5/139: dread d8/d1c/f1e [0,4194304] 0 2024-05-09T06:30:19.519 INFO:tasks.workunit.client.1.smithi106.stdout:2/104: truncate d2/fc 1275128 0 2024-05-09T06:30:19.519 INFO:tasks.workunit.client.1.smithi106.stdout:3/127: truncate f2 2847576 0 2024-05-09T06:30:19.522 INFO:tasks.workunit.client.1.smithi106.stdout:5/140: symlink d8/d1c/l23 0 2024-05-09T06:30:19.524 INFO:tasks.workunit.client.1.smithi106.stdout:0/95: link d1/d11/c19 d1/c20 0 2024-05-09T06:30:19.525 INFO:tasks.workunit.client.1.smithi106.stdout:2/105: rmdir d2/d5/db 39 2024-05-09T06:30:19.526 INFO:tasks.workunit.client.1.smithi106.stdout:3/128: dread d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:19.526 INFO:tasks.workunit.client.1.smithi106.stdout:2/106: creat d2/f26 x:0 0 0 2024-05-09T06:30:19.528 INFO:tasks.workunit.client.1.smithi106.stdout:3/129: rename d5/d12/d1b to d5/d12/d26 0 2024-05-09T06:30:19.528 INFO:tasks.workunit.client.1.smithi106.stdout:3/130: chown d5/d1c/d24 1396437 1 2024-05-09T06:30:19.529 INFO:tasks.workunit.client.1.smithi106.stdout:3/131: rename d5/l11 to d5/d12/d26/l27 0 2024-05-09T06:30:19.530 INFO:tasks.workunit.client.1.smithi106.stdout:3/132: creat d5/d1c/d24/f28 x:0 0 0 2024-05-09T06:30:19.531 INFO:tasks.workunit.client.1.smithi106.stdout:1/131: dwrite d4/f1a [0,4194304] 0 2024-05-09T06:30:19.531 INFO:tasks.workunit.client.1.smithi106.stdout:1/132: write d4/d5/d9/d13/f20 [1014918,61557] 0 2024-05-09T06:30:19.531 INFO:tasks.workunit.client.1.smithi106.stdout:1/133: write d4/d5/d9/d1d/f24 [1027304,29446] 0 2024-05-09T06:30:19.532 INFO:tasks.workunit.client.1.smithi106.stdout:1/134: mknod d4/d5/d9/d1d/c31 0 2024-05-09T06:30:19.532 INFO:tasks.workunit.client.1.smithi106.stdout:1/135: creat d4/f32 x:0 0 0 2024-05-09T06:30:19.533 INFO:tasks.workunit.client.1.smithi106.stdout:4/119: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:19.533 INFO:tasks.workunit.client.1.smithi106.stdout:1/136: mknod d4/d5/d9/d1d/c33 0 2024-05-09T06:30:19.535 INFO:tasks.workunit.client.1.smithi106.stdout:6/116: dwrite d0/f1c [0,4194304] 0 2024-05-09T06:30:19.536 INFO:tasks.workunit.client.1.smithi106.stdout:0/96: read d1/f7 [3461821,33099] 0 2024-05-09T06:30:19.536 INFO:tasks.workunit.client.1.smithi106.stdout:0/97: chown d1/cd 49380887 1 2024-05-09T06:30:19.539 INFO:tasks.workunit.client.1.smithi106.stdout:2/107: write f0 [2157401,21199] 0 2024-05-09T06:30:19.540 INFO:tasks.workunit.client.1.smithi106.stdout:2/108: chown d2/d5/c12 3213122 1 2024-05-09T06:30:19.540 INFO:tasks.workunit.client.1.smithi106.stdout:2/109: write d2/d7/f1c [194194,125442] 0 2024-05-09T06:30:19.541 INFO:tasks.workunit.client.1.smithi106.stdout:6/117: truncate d0/d17/f22 540703 0 2024-05-09T06:30:19.543 INFO:tasks.workunit.client.1.smithi106.stdout:0/98: symlink d1/d12/l21 0 2024-05-09T06:30:19.543 INFO:tasks.workunit.client.1.smithi106.stdout:0/99: chown d1/f7 6539 1 2024-05-09T06:30:19.545 INFO:tasks.workunit.client.1.smithi106.stdout:6/118: getdents d0/d6 0 2024-05-09T06:30:19.548 INFO:tasks.workunit.client.1.smithi106.stdout:6/119: rename d0/d6/d8/f12 to d0/d17/f25 0 2024-05-09T06:30:19.549 INFO:tasks.workunit.client.1.smithi106.stdout:5/141: truncate d8/f10 4122285 0 2024-05-09T06:30:19.549 INFO:tasks.workunit.client.1.smithi106.stdout:5/142: chown d8/c15 11 1 2024-05-09T06:30:19.554 INFO:tasks.workunit.client.1.smithi106.stdout:2/110: fsync d2/f26 0 2024-05-09T06:30:19.554 INFO:tasks.workunit.client.1.smithi106.stdout:2/111: creat d2/d7/f27 x:0 0 0 2024-05-09T06:30:19.554 INFO:tasks.workunit.client.1.smithi106.stdout:1/137: dwrite d4/d5/f23 [0,4194304] 0 2024-05-09T06:30:19.561 INFO:tasks.workunit.client.1.smithi106.stdout:3/133: dwrite d5/f17 [0,4194304] 0 2024-05-09T06:30:19.565 INFO:tasks.workunit.client.1.smithi106.stdout:5/143: fsync d8/fc 0 2024-05-09T06:30:19.567 INFO:tasks.workunit.client.1.smithi106.stdout:0/100: dwrite f0 [0,4194304] 0 2024-05-09T06:30:19.567 INFO:tasks.workunit.client.1.smithi106.stdout:4/120: dwrite f2 [0,4194304] 0 2024-05-09T06:30:19.568 INFO:tasks.workunit.client.1.smithi106.stdout:6/120: dread d0/d17/f22 [0,4194304] 0 2024-05-09T06:30:19.568 INFO:tasks.workunit.client.1.smithi106.stdout:6/121: dread - d0/d17/f1e zero size 2024-05-09T06:30:19.574 INFO:tasks.workunit.client.1.smithi106.stdout:0/101: mkdir d1/d12/d22 0 2024-05-09T06:30:19.574 INFO:tasks.workunit.client.1.smithi106.stdout:2/112: dwrite d2/f26 [0,4194304] 0 2024-05-09T06:30:19.575 INFO:tasks.workunit.client.1.smithi106.stdout:2/113: read - d2/d7/f27 zero size 2024-05-09T06:30:19.579 INFO:tasks.workunit.client.1.smithi106.stdout:8/85: truncate d3/d5/d13/f14 5786142 0 2024-05-09T06:30:19.579 INFO:tasks.workunit.client.1.smithi106.stdout:1/138: dwrite d4/d5/f6 [0,4194304] 0 2024-05-09T06:30:19.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/122: dread d0/d17/f10 [0,4194304] 0 2024-05-09T06:30:19.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/123: readlink d0/d6/l4 0 2024-05-09T06:30:19.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/124: write d0/d6/d8/f9 [1953030,123685] 0 2024-05-09T06:30:19.584 INFO:tasks.workunit.client.1.smithi106.stdout:4/121: dread f0 [0,4194304] 0 2024-05-09T06:30:19.584 INFO:tasks.workunit.client.1.smithi106.stdout:4/122: readlink l4 0 2024-05-09T06:30:19.586 INFO:tasks.workunit.client.1.smithi106.stdout:2/114: mknod d2/d5/db/d1d/c28 0 2024-05-09T06:30:19.588 INFO:tasks.workunit.client.1.smithi106.stdout:8/86: rename d3/ff to d3/d5/d13/f1b 0 2024-05-09T06:30:19.588 INFO:tasks.workunit.client.1.smithi106.stdout:1/139: dread d4/d5/ff [0,4194304] 0 2024-05-09T06:30:19.589 INFO:tasks.workunit.client.1.smithi106.stdout:4/123: symlink d7/l23 0 2024-05-09T06:30:19.590 INFO:tasks.workunit.client.1.smithi106.stdout:2/115: link d2/d7/c1f d2/d5/db/c29 0 2024-05-09T06:30:19.590 INFO:tasks.workunit.client.1.smithi106.stdout:2/116: fdatasync d2/d5/db/f1b 0 2024-05-09T06:30:19.592 INFO:tasks.workunit.client.1.smithi106.stdout:5/144: dwrite d8/f12 [0,4194304] 0 2024-05-09T06:30:19.592 INFO:tasks.workunit.client.1.smithi106.stdout:5/145: fdatasync d8/fd 0 2024-05-09T06:30:19.592 INFO:tasks.workunit.client.1.smithi106.stdout:0/102: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:30:19.592 INFO:tasks.workunit.client.1.smithi106.stdout:6/125: rename d0/d17/f10 to d0/d17/d21/f26 0 2024-05-09T06:30:19.592 INFO:tasks.workunit.client.1.smithi106.stdout:1/140: symlink d4/d5/d9/d1d/l34 0 2024-05-09T06:30:19.594 INFO:tasks.workunit.client.1.smithi106.stdout:4/124: unlink d7/d10/d12/d1c/cf 0 2024-05-09T06:30:19.597 INFO:tasks.workunit.client.1.smithi106.stdout:2/117: unlink d2/d5/db/d15/c17 0 2024-05-09T06:30:19.597 INFO:tasks.workunit.client.1.smithi106.stdout:2/118: read - d2/d7/f25 zero size 2024-05-09T06:30:19.599 INFO:tasks.workunit.client.1.smithi106.stdout:0/103: getdents d1/d12 0 2024-05-09T06:30:19.601 INFO:tasks.workunit.client.1.smithi106.stdout:6/126: mkdir d0/d6/d8/d27 0 2024-05-09T06:30:19.602 INFO:tasks.workunit.client.1.smithi106.stdout:4/125: symlink d7/d10/d1a/l24 0 2024-05-09T06:30:19.602 INFO:tasks.workunit.client.1.smithi106.stdout:8/87: write d3/d5/d13/f14 [5272191,124526] 0 2024-05-09T06:30:19.606 INFO:tasks.workunit.client.1.smithi106.stdout:6/127: creat d0/d6/f28 x:0 0 0 2024-05-09T06:30:19.608 INFO:tasks.workunit.client.1.smithi106.stdout:8/88: symlink d3/d5/d7/l1c 0 2024-05-09T06:30:19.610 INFO:tasks.workunit.client.1.smithi106.stdout:6/128: rename d0/d6/d8/f9 to d0/d17/f29 0 2024-05-09T06:30:19.611 INFO:tasks.workunit.client.1.smithi106.stdout:8/89: rmdir d3 39 2024-05-09T06:30:19.611 INFO:tasks.workunit.client.1.smithi106.stdout:8/90: read d3/f6 [541541,14219] 0 2024-05-09T06:30:19.612 INFO:tasks.workunit.client.1.smithi106.stdout:6/129: dread d0/d17/f22 [0,4194304] 0 2024-05-09T06:30:19.613 INFO:tasks.workunit.client.1.smithi106.stdout:8/91: symlink d3/d5/d7/d15/d16/l1d 0 2024-05-09T06:30:19.613 INFO:tasks.workunit.client.1.smithi106.stdout:8/92: chown d3/d5/d13 7470 1 2024-05-09T06:30:19.614 INFO:tasks.workunit.client.1.smithi106.stdout:6/130: unlink d0/d6/d8/l11 0 2024-05-09T06:30:19.614 INFO:tasks.workunit.client.1.smithi106.stdout:6/131: dread - d0/d6/f28 zero size 2024-05-09T06:30:19.616 INFO:tasks.workunit.client.1.smithi106.stdout:8/93: mknod d3/c1e 0 2024-05-09T06:30:19.616 INFO:tasks.workunit.client.1.smithi106.stdout:6/132: mknod d0/d6/d8/d27/c2a 0 2024-05-09T06:30:19.616 INFO:tasks.workunit.client.1.smithi106.stdout:6/133: chown d0/d6/d8/d27/c2a 1 1 2024-05-09T06:30:19.619 INFO:tasks.workunit.client.1.smithi106.stdout:6/134: link d0/d6/d8/f14 d0/d17/d21/f2b 0 2024-05-09T06:30:19.619 INFO:tasks.workunit.client.1.smithi106.stdout:6/135: write d0/f1c [5134136,60462] 0 2024-05-09T06:30:19.624 INFO:tasks.workunit.client.1.smithi106.stdout:4/126: dread d7/f11 [0,4194304] 0 2024-05-09T06:30:19.624 INFO:tasks.workunit.client.1.smithi106.stdout:4/127: chown d7/d10/d1a/l24 376909 1 2024-05-09T06:30:19.624 INFO:tasks.workunit.client.1.smithi106.stdout:4/128: chown f0 6685 1 2024-05-09T06:30:19.625 INFO:tasks.workunit.client.1.smithi106.stdout:4/129: chown l5 12610 1 2024-05-09T06:30:19.625 INFO:tasks.workunit.client.1.smithi106.stdout:4/130: mknod d7/d10/d12/d1c/c25 0 2024-05-09T06:30:19.630 INFO:tasks.workunit.client.1.smithi106.stdout:0/104: dwrite d1/d12/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.631 INFO:tasks.workunit.client.1.smithi106.stdout:0/105: write d1/d12/f1f [135627,61261] 0 2024-05-09T06:30:19.635 INFO:tasks.workunit.client.1.smithi106.stdout:1/141: dwrite d4/d5/d9/f11 [0,4194304] 0 2024-05-09T06:30:19.635 INFO:tasks.workunit.client.1.smithi106.stdout:1/142: read - d4/f15 zero size 2024-05-09T06:30:19.635 INFO:tasks.workunit.client.1.smithi106.stdout:5/146: dwrite d8/fa [0,4194304] 0 2024-05-09T06:30:19.635 INFO:tasks.workunit.client.1.smithi106.stdout:2/119: dwrite d2/fc [0,4194304] 0 2024-05-09T06:30:19.638 INFO:tasks.workunit.client.1.smithi106.stdout:1/143: symlink d4/d5/d9/d1d/l35 0 2024-05-09T06:30:19.645 INFO:tasks.workunit.client.1.smithi106.stdout:5/147: dread d8/f18 [0,4194304] 0 2024-05-09T06:30:19.649 INFO:tasks.workunit.client.1.smithi106.stdout:5/148: unlink d8/d1c/l20 0 2024-05-09T06:30:19.650 INFO:tasks.workunit.client.1.smithi106.stdout:5/149: creat d8/d1c/f24 x:0 0 0 2024-05-09T06:30:19.651 INFO:tasks.workunit.client.1.smithi106.stdout:8/94: dread d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.652 INFO:tasks.workunit.client.1.smithi106.stdout:8/95: getdents d3/d5/d7 0 2024-05-09T06:30:19.655 INFO:tasks.workunit.client.1.smithi106.stdout:5/150: symlink d8/l25 0 2024-05-09T06:30:19.656 INFO:tasks.workunit.client.1.smithi106.stdout:8/96: link d3/c1e d3/c1f 0 2024-05-09T06:30:19.661 INFO:tasks.workunit.client.1.smithi106.stdout:7/69: sync 2024-05-09T06:30:19.661 INFO:tasks.workunit.client.1.smithi106.stdout:9/94: sync 2024-05-09T06:30:19.661 INFO:tasks.workunit.client.1.smithi106.stdout:3/134: sync 2024-05-09T06:30:19.661 INFO:tasks.workunit.client.1.smithi106.stdout:9/95: truncate d4/d6/f11 4700336 0 2024-05-09T06:30:19.661 INFO:tasks.workunit.client.1.smithi106.stdout:9/96: readlink d4/d6/dc/d12/l17 0 2024-05-09T06:30:19.661 INFO:tasks.workunit.client.1.smithi106.stdout:9/97: fdatasync d4/d6/fa 0 2024-05-09T06:30:19.662 INFO:tasks.workunit.client.1.smithi106.stdout:7/70: symlink d0/l12 0 2024-05-09T06:30:19.663 INFO:tasks.workunit.client.1.smithi106.stdout:1/144: dwrite d4/d5/ff [0,4194304] 0 2024-05-09T06:30:19.664 INFO:tasks.workunit.client.1.smithi106.stdout:9/98: mknod d4/d6/c1a 0 2024-05-09T06:30:19.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:19 smithi046 ceph-mon[26924]: pgmap v16: 65 pgs: 65 active+clean; 230 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 303 op/s 2024-05-09T06:30:19.665 INFO:tasks.workunit.client.1.smithi106.stdout:5/151: write d8/f18 [1322426,108079] 0 2024-05-09T06:30:19.666 INFO:tasks.workunit.client.1.smithi106.stdout:7/71: link d0/f5 d0/f13 0 2024-05-09T06:30:19.666 INFO:tasks.workunit.client.1.smithi106.stdout:0/106: dwrite d1/d12/f1f [0,4194304] 0 2024-05-09T06:30:19.666 INFO:tasks.workunit.client.1.smithi106.stdout:0/107: fdatasync d1/d12/d13/f14 0 2024-05-09T06:30:19.667 INFO:tasks.workunit.client.1.smithi106.stdout:3/135: getdents d5/d12 0 2024-05-09T06:30:19.669 INFO:tasks.workunit.client.1.smithi106.stdout:8/97: read d3/d5/d13/f1b [2040037,44731] 0 2024-05-09T06:30:19.670 INFO:tasks.workunit.client.1.smithi106.stdout:1/145: mknod d4/d5/d9/d13/c36 0 2024-05-09T06:30:19.673 INFO:tasks.workunit.client.1.smithi106.stdout:9/99: rename d4/d19 to d4/d6/d1b 0 2024-05-09T06:30:19.673 INFO:tasks.workunit.client.1.smithi106.stdout:2/120: dwrite d2/f10 [0,4194304] 0 2024-05-09T06:30:19.677 INFO:tasks.workunit.client.1.smithi106.stdout:0/108: truncate d1/f3 3782346 0 2024-05-09T06:30:19.679 INFO:tasks.workunit.client.1.smithi106.stdout:1/146: mkdir d4/d37 0 2024-05-09T06:30:19.681 INFO:tasks.workunit.client.1.smithi106.stdout:1/147: truncate d4/d5/d9/d13/f2b 188918 0 2024-05-09T06:30:19.681 INFO:tasks.workunit.client.1.smithi106.stdout:1/148: fsync d4/d5/f7 0 2024-05-09T06:30:19.682 INFO:tasks.workunit.client.1.smithi106.stdout:5/152: dread d8/f18 [0,4194304] 0 2024-05-09T06:30:19.684 INFO:tasks.workunit.client.1.smithi106.stdout:5/153: mknod d8/c26 0 2024-05-09T06:30:19.685 INFO:tasks.workunit.client.1.smithi106.stdout:5/154: mknod d8/c27 0 2024-05-09T06:30:19.687 INFO:tasks.workunit.client.1.smithi106.stdout:0/109: dread f0 [0,4194304] 0 2024-05-09T06:30:19.689 INFO:tasks.workunit.client.1.smithi106.stdout:3/136: dwrite d5/d12/d26/f22 [0,4194304] 0 2024-05-09T06:30:19.690 INFO:tasks.workunit.client.1.smithi106.stdout:0/110: rename d1/d12 to d1/d11/d23 0 2024-05-09T06:30:19.690 INFO:tasks.workunit.client.1.smithi106.stdout:1/149: dread d4/d5/f6 [0,4194304] 0 2024-05-09T06:30:19.691 INFO:tasks.workunit.client.1.smithi106.stdout:1/150: stat d4/d5/d9/c28 0 2024-05-09T06:30:19.691 INFO:tasks.workunit.client.1.smithi106.stdout:3/137: mknod d5/c29 0 2024-05-09T06:30:19.691 INFO:tasks.workunit.client.1.smithi106.stdout:3/138: readlink d5/d12/d26/l27 0 2024-05-09T06:30:19.692 INFO:tasks.workunit.client.1.smithi106.stdout:7/72: getdents d0 0 2024-05-09T06:30:19.693 INFO:tasks.workunit.client.1.smithi106.stdout:0/111: creat d1/d11/d23/f24 x:0 0 0 2024-05-09T06:30:19.693 INFO:tasks.workunit.client.1.smithi106.stdout:8/98: dwrite d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:19.693 INFO:tasks.workunit.client.1.smithi106.stdout:2/121: dread d2/d5/db/f1b [0,4194304] 0 2024-05-09T06:30:19.693 INFO:tasks.workunit.client.1.smithi106.stdout:2/122: chown d2/d5/db/d1d 0 1 2024-05-09T06:30:19.694 INFO:tasks.workunit.client.1.smithi106.stdout:3/139: mknod d5/d1c/c2a 0 2024-05-09T06:30:19.696 INFO:tasks.workunit.client.1.smithi106.stdout:7/73: creat d0/dc/f14 x:0 0 0 2024-05-09T06:30:19.696 INFO:tasks.workunit.client.1.smithi106.stdout:7/74: stat d0/dc/lf 0 2024-05-09T06:30:19.696 INFO:tasks.workunit.client.1.smithi106.stdout:0/112: mknod d1/d11/d23/c25 0 2024-05-09T06:30:19.697 INFO:tasks.workunit.client.1.smithi106.stdout:8/99: creat d3/d5/d7/f20 x:0 0 0 2024-05-09T06:30:19.699 INFO:tasks.workunit.client.1.smithi106.stdout:2/123: mknod d2/d5/db/d15/c2a 0 2024-05-09T06:30:19.700 INFO:tasks.workunit.client.1.smithi106.stdout:3/140: link d5/d1c/d24/f28 d5/d1c/f2b 0 2024-05-09T06:30:19.701 INFO:tasks.workunit.client.1.smithi106.stdout:7/75: symlink d0/db/l15 0 2024-05-09T06:30:19.703 INFO:tasks.workunit.client.1.smithi106.stdout:0/113: mknod d1/d11/d23/d13/c26 0 2024-05-09T06:30:19.703 INFO:tasks.workunit.client.1.smithi106.stdout:0/114: chown d1/l10 51 1 2024-05-09T06:30:19.704 INFO:tasks.workunit.client.1.smithi106.stdout:3/141: mknod d5/d1c/d24/c2c 0 2024-05-09T06:30:19.705 INFO:tasks.workunit.client.1.smithi106.stdout:1/151: dread d4/d5/d9/fc [0,4194304] 0 2024-05-09T06:30:19.706 INFO:tasks.workunit.client.1.smithi106.stdout:7/76: creat d0/db/dd/f16 x:0 0 0 2024-05-09T06:30:19.708 INFO:tasks.workunit.client.1.smithi106.stdout:0/115: link d1/d11/d23/f1a d1/d11/d23/f27 0 2024-05-09T06:30:19.710 INFO:tasks.workunit.client.1.smithi106.stdout:3/142: mknod d5/c2d 0 2024-05-09T06:30:19.712 INFO:tasks.workunit.client.1.smithi106.stdout:1/152: link d4/d5/f7 d4/d5/d9/d1d/f38 0 2024-05-09T06:30:19.713 INFO:tasks.workunit.client.1.smithi106.stdout:5/155: getdents d8 0 2024-05-09T06:30:19.717 INFO:tasks.workunit.client.1.smithi106.stdout:5/156: mkdir d8/d1c/d28 0 2024-05-09T06:30:19.717 INFO:tasks.workunit.client.1.smithi106.stdout:5/157: fsync d8/fa 0 2024-05-09T06:30:19.717 INFO:tasks.workunit.client.1.smithi106.stdout:2/124: dwrite d2/d5/db/d15/f18 [0,4194304] 0 2024-05-09T06:30:19.717 INFO:tasks.workunit.client.1.smithi106.stdout:2/125: creat d2/f2b x:0 0 0 2024-05-09T06:30:19.717 INFO:tasks.workunit.client.1.smithi106.stdout:2/126: fsync d2/d5/db/d15/f1e 0 2024-05-09T06:30:19.717 INFO:tasks.workunit.client.1.smithi106.stdout:2/127: truncate d2/d5/db/d15/f1e 476496 0 2024-05-09T06:30:19.719 INFO:tasks.workunit.client.1.smithi106.stdout:5/158: rename d8/fd to d8/d1c/f29 0 2024-05-09T06:30:19.720 INFO:tasks.workunit.client.1.smithi106.stdout:2/128: dread d2/d5/f13 [0,4194304] 0 2024-05-09T06:30:19.720 INFO:tasks.workunit.client.1.smithi106.stdout:2/129: write d2/f2b [819028,79962] 0 2024-05-09T06:30:19.725 INFO:tasks.workunit.client.1.smithi106.stdout:2/130: mkdir d2/d7/d2c 0 2024-05-09T06:30:19.728 INFO:tasks.workunit.client.1.smithi106.stdout:7/77: dwrite d0/f6 [0,4194304] 0 2024-05-09T06:30:19.729 INFO:tasks.workunit.client.1.smithi106.stdout:2/131: rename d2/d5/c19 to d2/d7/d2c/c2d 0 2024-05-09T06:30:19.751 INFO:tasks.workunit.client.1.smithi106.stdout:0/116: dwrite d1/d11/d23/f27 [0,4194304] 0 2024-05-09T06:30:19.755 INFO:tasks.workunit.client.1.smithi106.stdout:3/143: dwrite d5/d12/f15 [0,4194304] 0 2024-05-09T06:30:19.755 INFO:tasks.workunit.client.1.smithi106.stdout:3/144: write d5/d12/f13 [64722,125548] 0 2024-05-09T06:30:19.756 INFO:tasks.workunit.client.1.smithi106.stdout:5/159: dwrite d8/d1c/f1e [4194304,4194304] 0 2024-05-09T06:30:19.756 INFO:tasks.workunit.client.1.smithi106.stdout:7/78: dwrite d0/db/dd/f16 [0,4194304] 0 2024-05-09T06:30:19.756 INFO:tasks.workunit.client.1.smithi106.stdout:2/132: dwrite d2/d7/f25 [0,4194304] 0 2024-05-09T06:30:19.759 INFO:tasks.workunit.client.1.smithi106.stdout:0/117: dread d1/d11/d23/f1f [0,4194304] 0 2024-05-09T06:30:19.759 INFO:tasks.workunit.client.1.smithi106.stdout:3/145: symlink d5/d1c/l2e 0 2024-05-09T06:30:19.759 INFO:tasks.workunit.client.1.smithi106.stdout:3/146: chown d5/l18 1649 1 2024-05-09T06:30:19.760 INFO:tasks.workunit.client.1.smithi106.stdout:5/160: truncate d8/f18 2014446 0 2024-05-09T06:30:19.763 INFO:tasks.workunit.client.1.smithi106.stdout:7/79: mknod d0/dc/c17 0 2024-05-09T06:30:19.766 INFO:tasks.workunit.client.1.smithi106.stdout:2/133: creat d2/d5/db/d1d/d23/f2e x:0 0 0 2024-05-09T06:30:19.767 INFO:tasks.workunit.client.1.smithi106.stdout:0/118: creat d1/f28 x:0 0 0 2024-05-09T06:30:19.768 INFO:tasks.workunit.client.1.smithi106.stdout:3/147: mknod d5/c2f 0 2024-05-09T06:30:19.770 INFO:tasks.workunit.client.1.smithi106.stdout:5/161: mknod d8/c2a 0 2024-05-09T06:30:19.770 INFO:tasks.workunit.client.1.smithi106.stdout:6/136: sync 2024-05-09T06:30:19.770 INFO:tasks.workunit.client.1.smithi106.stdout:4/131: sync 2024-05-09T06:30:19.772 INFO:tasks.workunit.client.1.smithi106.stdout:3/148: mkdir d5/d12/d30 0 2024-05-09T06:30:19.774 INFO:tasks.workunit.client.1.smithi106.stdout:5/162: mknod d8/d1c/c2b 0 2024-05-09T06:30:19.774 INFO:tasks.workunit.client.1.smithi106.stdout:5/163: write d8/fc [3150919,25848] 0 2024-05-09T06:30:19.776 INFO:tasks.workunit.client.1.smithi106.stdout:6/137: rename d0/f1c to d0/d6/d8/d27/f2c 0 2024-05-09T06:30:19.777 INFO:tasks.workunit.client.1.smithi106.stdout:6/138: chown d0/d6/d8/d27/c2a 0 1 2024-05-09T06:30:19.777 INFO:tasks.workunit.client.1.smithi106.stdout:0/119: truncate d1/f5 1355015 0 2024-05-09T06:30:19.778 INFO:tasks.workunit.client.1.smithi106.stdout:5/164: link d8/f12 d8/d1c/f2c 0 2024-05-09T06:30:19.779 INFO:tasks.workunit.client.1.smithi106.stdout:6/139: getdents d0/d17/d21 0 2024-05-09T06:30:19.779 INFO:tasks.workunit.client.1.smithi106.stdout:4/132: dread d7/f9 [0,4194304] 0 2024-05-09T06:30:19.780 INFO:tasks.workunit.client.1.smithi106.stdout:0/120: symlink d1/d11/d23/d22/l29 0 2024-05-09T06:30:19.780 INFO:tasks.workunit.client.1.smithi106.stdout:0/121: truncate d1/f7 4337490 0 2024-05-09T06:30:19.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/165: symlink d8/d1c/l2d 0 2024-05-09T06:30:19.782 INFO:tasks.workunit.client.1.smithi106.stdout:3/149: dread d5/f17 [0,4194304] 0 2024-05-09T06:30:19.782 INFO:tasks.workunit.client.1.smithi106.stdout:3/150: read - d5/d1c/d24/f28 zero size 2024-05-09T06:30:19.782 INFO:tasks.workunit.client.1.smithi106.stdout:3/151: write d5/d12/f13 [787798,4640] 0 2024-05-09T06:30:19.783 INFO:tasks.workunit.client.1.smithi106.stdout:6/140: mkdir d0/d6/d8/d27/d2d 0 2024-05-09T06:30:19.783 INFO:tasks.workunit.client.1.smithi106.stdout:6/141: chown d0/d6/fe 132359950 1 2024-05-09T06:30:19.783 INFO:tasks.workunit.client.1.smithi106.stdout:6/142: fdatasync d0/d17/d21/f2b 0 2024-05-09T06:30:19.784 INFO:tasks.workunit.client.1.smithi106.stdout:0/122: creat d1/d11/d23/f2a x:0 0 0 2024-05-09T06:30:19.784 INFO:tasks.workunit.client.1.smithi106.stdout:0/123: readlink d1/d11/l1c 0 2024-05-09T06:30:19.785 INFO:tasks.workunit.client.1.smithi106.stdout:3/152: rmdir d5/d12/d30 0 2024-05-09T06:30:19.785 INFO:tasks.workunit.client.1.smithi106.stdout:3/153: read - d5/d1c/f2b zero size 2024-05-09T06:30:19.785 INFO:tasks.workunit.client.1.smithi106.stdout:3/154: stat d5/d12/f15 0 2024-05-09T06:30:19.790 INFO:tasks.workunit.client.1.smithi106.stdout:6/143: symlink d0/d17/d21/l2e 0 2024-05-09T06:30:19.790 INFO:tasks.workunit.client.1.smithi106.stdout:6/144: fsync d0/d6/d8/ff 0 2024-05-09T06:30:19.793 INFO:tasks.workunit.client.1.smithi106.stdout:3/155: rename d5/c2d to d5/d1c/d24/c31 0 2024-05-09T06:30:19.793 INFO:tasks.workunit.client.1.smithi106.stdout:5/166: dread d8/d1c/f1e [4194304,4194304] 0 2024-05-09T06:30:19.795 INFO:tasks.workunit.client.1.smithi106.stdout:6/145: link d0/d6/l4 d0/d6/d8/l2f 0 2024-05-09T06:30:19.796 INFO:tasks.workunit.client.1.smithi106.stdout:5/167: dread d8/d1c/f1f [0,4194304] 0 2024-05-09T06:30:19.798 INFO:tasks.workunit.client.1.smithi106.stdout:3/156: unlink d5/c29 0 2024-05-09T06:30:19.798 INFO:tasks.workunit.client.1.smithi106.stdout:3/157: fsync f1 0 2024-05-09T06:30:19.799 INFO:tasks.workunit.client.1.smithi106.stdout:6/146: link d0/d17/f1e d0/f30 0 2024-05-09T06:30:19.800 INFO:tasks.workunit.client.1.smithi106.stdout:5/168: creat d8/d1c/d28/f2e x:0 0 0 2024-05-09T06:30:19.800 INFO:tasks.workunit.client.1.smithi106.stdout:5/169: write d8/f1a [1672031,123139] 0 2024-05-09T06:30:19.800 INFO:tasks.workunit.client.1.smithi106.stdout:4/133: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:19.800 INFO:tasks.workunit.client.1.smithi106.stdout:7/80: dwrite d0/fe [0,4194304] 0 2024-05-09T06:30:19.801 INFO:tasks.workunit.client.1.smithi106.stdout:3/158: mkdir d5/d1c/d21/d32 0 2024-05-09T06:30:19.801 INFO:tasks.workunit.client.1.smithi106.stdout:3/159: readlink d5/l18 0 2024-05-09T06:30:19.802 INFO:tasks.workunit.client.1.smithi106.stdout:3/160: truncate d5/d12/f19 1031036 0 2024-05-09T06:30:19.802 INFO:tasks.workunit.client.1.smithi106.stdout:3/161: creat d5/d1c/f33 x:0 0 0 2024-05-09T06:30:19.802 INFO:tasks.workunit.client.1.smithi106.stdout:6/147: rename d0/d17/l1f to d0/d17/d21/l31 0 2024-05-09T06:30:19.802 INFO:tasks.workunit.client.1.smithi106.stdout:7/81: rename d0 to d0/db/dd/d18 22 2024-05-09T06:30:19.802 INFO:tasks.workunit.client.1.smithi106.stdout:7/82: creat d0/dc/f19 x:0 0 0 2024-05-09T06:30:19.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/83: chown d0/f9 6 1 2024-05-09T06:30:19.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/84: stat d0/dc/f14 0 2024-05-09T06:30:19.803 INFO:tasks.workunit.client.1.smithi106.stdout:0/124: dwrite d1/d11/d23/d13/f14 [0,4194304] 0 2024-05-09T06:30:19.814 INFO:tasks.workunit.client.1.smithi106.stdout:7/85: unlink d0/f6 0 2024-05-09T06:30:19.814 INFO:tasks.workunit.client.1.smithi106.stdout:7/86: chown d0/f9 3922 1 2024-05-09T06:30:19.820 INFO:tasks.workunit.client.1.smithi106.stdout:0/125: getdents d1 0 2024-05-09T06:30:19.820 INFO:tasks.workunit.client.1.smithi106.stdout:0/126: read - d1/d11/d23/f24 zero size 2024-05-09T06:30:19.820 INFO:tasks.workunit.client.1.smithi106.stdout:0/127: stat f0 0 2024-05-09T06:30:19.820 INFO:tasks.workunit.client.1.smithi106.stdout:0/128: readlink d1/d11/d23/d13/l1b 0 2024-05-09T06:30:19.820 INFO:tasks.workunit.client.1.smithi106.stdout:5/170: dread d8/f12 [0,4194304] 0 2024-05-09T06:30:19.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:19 smithi106 ceph-mon[34679]: pgmap v16: 65 pgs: 65 active+clean; 230 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 303 op/s 2024-05-09T06:30:19.827 INFO:tasks.workunit.client.1.smithi106.stdout:5/171: write d8/f12 [3682103,78235] 0 2024-05-09T06:30:19.827 INFO:tasks.workunit.client.1.smithi106.stdout:3/162: rmdir d5 39 2024-05-09T06:30:19.828 INFO:tasks.workunit.client.1.smithi106.stdout:9/100: sync 2024-05-09T06:30:19.828 INFO:tasks.workunit.client.1.smithi106.stdout:9/101: truncate d4/d6/dc/d16/f18 1780311 0 2024-05-09T06:30:19.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/172: write d8/d1c/f1e [39062,110326] 0 2024-05-09T06:30:19.829 INFO:tasks.workunit.client.1.smithi106.stdout:9/102: rmdir d4/d6/dc/d12 39 2024-05-09T06:30:19.830 INFO:tasks.workunit.client.1.smithi106.stdout:7/87: rmdir d0 39 2024-05-09T06:30:19.831 INFO:tasks.workunit.client.1.smithi106.stdout:5/173: symlink d8/d1c/d28/l2f 0 2024-05-09T06:30:19.833 INFO:tasks.workunit.client.1.smithi106.stdout:5/174: creat d8/f30 x:0 0 0 2024-05-09T06:30:19.833 INFO:tasks.workunit.client.1.smithi106.stdout:5/175: readlink d8/l16 0 2024-05-09T06:30:19.862 INFO:tasks.workunit.client.1.smithi106.stdout:4/134: dwrite d7/fd [0,4194304] 0 2024-05-09T06:30:19.862 INFO:tasks.workunit.client.1.smithi106.stdout:4/135: mknod d7/c26 0 2024-05-09T06:30:19.870 INFO:tasks.workunit.client.1.smithi106.stdout:6/148: dwrite d0/d17/d21/f2b [0,4194304] 0 2024-05-09T06:30:19.870 INFO:tasks.workunit.client.1.smithi106.stdout:0/129: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:19.871 INFO:tasks.workunit.client.1.smithi106.stdout:4/136: write d7/fd [3319261,37400] 0 2024-05-09T06:30:19.871 INFO:tasks.workunit.client.1.smithi106.stdout:7/88: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:19.871 INFO:tasks.workunit.client.1.smithi106.stdout:9/103: dwrite d4/d6/f11 [4194304,4194304] 0 2024-05-09T06:30:19.871 INFO:tasks.workunit.client.1.smithi106.stdout:3/163: dwrite d5/d1c/f2b [0,4194304] 0 2024-05-09T06:30:19.871 INFO:tasks.workunit.client.1.smithi106.stdout:9/104: dread - d4/d6/ff zero size 2024-05-09T06:30:19.874 INFO:tasks.workunit.client.1.smithi106.stdout:0/130: symlink d1/d11/d23/l2b 0 2024-05-09T06:30:19.876 INFO:tasks.workunit.client.1.smithi106.stdout:7/89: rename d0/db/dd to d0/dc/d1a 0 2024-05-09T06:30:19.876 INFO:tasks.workunit.client.1.smithi106.stdout:7/90: read - d0/dc/f14 zero size 2024-05-09T06:30:19.879 INFO:tasks.workunit.client.1.smithi106.stdout:4/137: write d7/d10/f16 [3379713,48375] 0 2024-05-09T06:30:19.879 INFO:tasks.workunit.client.1.smithi106.stdout:9/105: link d4/d6/f11 d4/d6/dc/d12/f1c 0 2024-05-09T06:30:19.880 INFO:tasks.workunit.client.1.smithi106.stdout:9/106: chown d4/d6/ff 3367601 1 2024-05-09T06:30:19.880 INFO:tasks.workunit.client.1.smithi106.stdout:7/91: symlink d0/db/l1b 0 2024-05-09T06:30:19.881 INFO:tasks.workunit.client.1.smithi106.stdout:4/138: creat d7/d22/f27 x:0 0 0 2024-05-09T06:30:19.882 INFO:tasks.workunit.client.1.smithi106.stdout:9/107: symlink d4/l1d 0 2024-05-09T06:30:19.883 INFO:tasks.workunit.client.1.smithi106.stdout:7/92: getdents d0 0 2024-05-09T06:30:19.883 INFO:tasks.workunit.client.1.smithi106.stdout:7/93: write d0/fe [4648436,110532] 0 2024-05-09T06:30:19.886 INFO:tasks.workunit.client.1.smithi106.stdout:0/131: write d1/d11/d23/d13/f14 [3457270,118418] 0 2024-05-09T06:30:19.887 INFO:tasks.workunit.client.1.smithi106.stdout:0/132: rmdir d1/d11/d23/d22 39 2024-05-09T06:30:19.894 INFO:tasks.workunit.client.1.smithi106.stdout:8/100: sync 2024-05-09T06:30:19.894 INFO:tasks.workunit.client.1.smithi106.stdout:1/153: sync 2024-05-09T06:30:19.895 INFO:tasks.workunit.client.1.smithi106.stdout:2/134: sync 2024-05-09T06:30:19.895 INFO:tasks.workunit.client.1.smithi106.stdout:2/135: read - d2/d5/f22 zero size 2024-05-09T06:30:19.895 INFO:tasks.workunit.client.1.smithi106.stdout:7/94: read d0/dc/d1a/f16 [1863223,9645] 0 2024-05-09T06:30:19.895 INFO:tasks.workunit.client.1.smithi106.stdout:6/149: dwrite d0/f19 [0,4194304] 0 2024-05-09T06:30:19.895 INFO:tasks.workunit.client.1.smithi106.stdout:6/150: getdents d0/d6/d8/d27/d2d 0 2024-05-09T06:30:19.901 INFO:tasks.workunit.client.1.smithi106.stdout:7/95: creat d0/dc/d1a/f1c x:0 0 0 2024-05-09T06:30:19.903 INFO:tasks.workunit.client.1.smithi106.stdout:2/136: getdents d2/d5/db/d15 0 2024-05-09T06:30:19.903 INFO:tasks.workunit.client.1.smithi106.stdout:2/137: write f0 [379194,80349] 0 2024-05-09T06:30:19.903 INFO:tasks.workunit.client.1.smithi106.stdout:2/138: stat d2/fc 0 2024-05-09T06:30:19.904 INFO:tasks.workunit.client.1.smithi106.stdout:7/96: symlink d0/dc/d1a/l1d 0 2024-05-09T06:30:19.906 INFO:tasks.workunit.client.1.smithi106.stdout:9/108: rmdir d4 39 2024-05-09T06:30:19.908 INFO:tasks.workunit.client.1.smithi106.stdout:4/139: rename d7/d22 to d7/d28 0 2024-05-09T06:30:19.910 INFO:tasks.workunit.client.1.smithi106.stdout:6/151: read d0/d6/d8/ff [3751444,85945] 0 2024-05-09T06:30:19.910 INFO:tasks.workunit.client.1.smithi106.stdout:6/152: readlink d0/l20 0 2024-05-09T06:30:19.910 INFO:tasks.workunit.client.1.smithi106.stdout:9/109: creat d4/d6/dc/d12/f1e x:0 0 0 2024-05-09T06:30:19.910 INFO:tasks.workunit.client.1.smithi106.stdout:9/110: chown d4/d6/dc/d12 45 1 2024-05-09T06:30:19.910 INFO:tasks.workunit.client.1.smithi106.stdout:9/111: fsync d4/d6/f13 0 2024-05-09T06:30:19.910 INFO:tasks.workunit.client.1.smithi106.stdout:9/112: rename d4 to d4/d6/d1b/d1f 22 2024-05-09T06:30:19.911 INFO:tasks.workunit.client.1.smithi106.stdout:4/140: getdents d7/d28 0 2024-05-09T06:30:19.912 INFO:tasks.workunit.client.1.smithi106.stdout:6/153: mknod d0/c32 0 2024-05-09T06:30:19.914 INFO:tasks.workunit.client.1.smithi106.stdout:6/154: mknod d0/d6/d8/c33 0 2024-05-09T06:30:19.922 INFO:tasks.workunit.client.1.smithi106.stdout:4/141: write d7/f11 [92147,20943] 0 2024-05-09T06:30:19.924 INFO:tasks.workunit.client.1.smithi106.stdout:4/142: rename f3 to d7/f29 0 2024-05-09T06:30:19.927 INFO:tasks.workunit.client.1.smithi106.stdout:1/154: dwrite d4/d5/ff [0,4194304] 0 2024-05-09T06:30:19.927 INFO:tasks.workunit.client.1.smithi106.stdout:0/133: dwrite d1/d11/d23/f2a [0,4194304] 0 2024-05-09T06:30:19.927 INFO:tasks.workunit.client.1.smithi106.stdout:1/155: chown f2 2616978 1 2024-05-09T06:30:19.930 INFO:tasks.workunit.client.1.smithi106.stdout:0/134: mkdir d1/d11/d23/d13/d2c 0 2024-05-09T06:30:19.932 INFO:tasks.workunit.client.1.smithi106.stdout:1/156: rename d4/d5/f6 to d4/d5/d9/d13/f39 0 2024-05-09T06:30:19.932 INFO:tasks.workunit.client.1.smithi106.stdout:1/157: creat d4/d5/f3a x:0 0 0 2024-05-09T06:30:19.933 INFO:tasks.workunit.client.1.smithi106.stdout:0/135: rename f0 to d1/d11/d23/d13/d2c/f2d 0 2024-05-09T06:30:19.933 INFO:tasks.workunit.client.1.smithi106.stdout:0/136: dread - d1/f1d zero size 2024-05-09T06:30:19.933 INFO:tasks.workunit.client.1.smithi106.stdout:0/137: fsync d1/d11/d23/f24 0 2024-05-09T06:30:19.934 INFO:tasks.workunit.client.1.smithi106.stdout:8/101: dwrite d3/d5/f12 [4194304,4194304] 0 2024-05-09T06:30:19.934 INFO:tasks.workunit.client.1.smithi106.stdout:9/113: dwrite d4/d6/dc/fd [0,4194304] 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:7/97: fdatasync d0/fe 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:9/114: write d4/d6/dc/d12/f1e [51829,47589] 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:2/139: dwrite d2/d7/f25 [0,4194304] 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:3/164: dwrite d5/d1c/f2b [4194304,4194304] 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:3/165: read d5/d12/f23 [442929,72421] 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:1/158: mknod d4/d5/d9/d13/d2f/c3b 0 2024-05-09T06:30:19.935 INFO:tasks.workunit.client.1.smithi106.stdout:1/159: creat d4/d5/d9/d1d/f3c x:0 0 0 2024-05-09T06:30:19.936 INFO:tasks.workunit.client.1.smithi106.stdout:0/138: link d1/d11/l16 d1/d11/d23/l2e 0 2024-05-09T06:30:19.938 INFO:tasks.workunit.client.1.smithi106.stdout:8/102: rename d3/d5/d7/l1a to d3/d5/d13/l21 0 2024-05-09T06:30:19.941 INFO:tasks.workunit.client.1.smithi106.stdout:5/176: sync 2024-05-09T06:30:19.944 INFO:tasks.workunit.client.1.smithi106.stdout:9/115: unlink d4/d6/dc/d12/l14 0 2024-05-09T06:30:19.944 INFO:tasks.workunit.client.1.smithi106.stdout:9/116: write d4/d6/f13 [959708,112227] 0 2024-05-09T06:30:19.945 INFO:tasks.workunit.client.1.smithi106.stdout:7/98: mkdir d0/db/d1e 0 2024-05-09T06:30:19.945 INFO:tasks.workunit.client.1.smithi106.stdout:7/99: write d0/dc/d1a/f1c [896985,128588] 0 2024-05-09T06:30:19.945 INFO:tasks.workunit.client.1.smithi106.stdout:3/166: dread d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:19.946 INFO:tasks.workunit.client.1.smithi106.stdout:2/140: unlink d2/d7/l4 0 2024-05-09T06:30:19.946 INFO:tasks.workunit.client.1.smithi106.stdout:2/141: chown d2/d5/f6 639354 1 2024-05-09T06:30:19.950 INFO:tasks.workunit.client.1.smithi106.stdout:0/139: read d1/d11/d23/f1f [3073030,35497] 0 2024-05-09T06:30:19.950 INFO:tasks.workunit.client.1.smithi106.stdout:0/140: truncate d1/d11/d23/f1f 5129234 0 2024-05-09T06:30:19.952 INFO:tasks.workunit.client.1.smithi106.stdout:8/103: mknod d3/d5/c22 0 2024-05-09T06:30:19.953 INFO:tasks.workunit.client.1.smithi106.stdout:9/117: write d4/d6/dc/d12/f1c [6286807,47530] 0 2024-05-09T06:30:19.954 INFO:tasks.workunit.client.1.smithi106.stdout:5/177: rename d8/l1b to d8/d1c/d28/l31 0 2024-05-09T06:30:19.954 INFO:tasks.workunit.client.1.smithi106.stdout:9/118: write d4/d6/ff [600054,118975] 0 2024-05-09T06:30:19.954 INFO:tasks.workunit.client.1.smithi106.stdout:9/119: write d4/d6/ff [601470,74972] 0 2024-05-09T06:30:19.954 INFO:tasks.workunit.client.1.smithi106.stdout:7/100: symlink d0/db/l1f 0 2024-05-09T06:30:19.954 INFO:tasks.workunit.client.1.smithi106.stdout:7/101: truncate d0/dc/f19 56648 0 2024-05-09T06:30:19.954 INFO:tasks.workunit.client.1.smithi106.stdout:7/102: stat d0/f13 0 2024-05-09T06:30:19.955 INFO:tasks.workunit.client.1.smithi106.stdout:7/103: readlink d0/db/l1f 0 2024-05-09T06:30:19.956 INFO:tasks.workunit.client.1.smithi106.stdout:0/141: creat d1/d11/d23/d13/d2c/f2f x:0 0 0 2024-05-09T06:30:19.956 INFO:tasks.workunit.client.1.smithi106.stdout:0/142: write d1/f3 [4376477,59508] 0 2024-05-09T06:30:19.957 INFO:tasks.workunit.client.1.smithi106.stdout:8/104: symlink d3/l23 0 2024-05-09T06:30:19.958 INFO:tasks.workunit.client.1.smithi106.stdout:4/143: dwrite d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:19.958 INFO:tasks.workunit.client.1.smithi106.stdout:4/144: chown d7/f29 0 1 2024-05-09T06:30:19.959 INFO:tasks.workunit.client.1.smithi106.stdout:4/145: readlink d7/l23 0 2024-05-09T06:30:19.959 INFO:tasks.workunit.client.1.smithi106.stdout:5/178: mkdir d8/d1c/d28/d32 0 2024-05-09T06:30:19.960 INFO:tasks.workunit.client.1.smithi106.stdout:7/104: unlink d0/db/l15 0 2024-05-09T06:30:19.961 INFO:tasks.workunit.client.1.smithi106.stdout:7/105: write d0/dc/f14 [229454,8911] 0 2024-05-09T06:30:19.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/106: read d0/dc/f14 [126570,80154] 0 2024-05-09T06:30:19.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/107: stat d0/db/l1b 0 2024-05-09T06:30:19.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/108: stat d0/dc/c17 0 2024-05-09T06:30:19.963 INFO:tasks.workunit.client.1.smithi106.stdout:2/142: mknod d2/d5/c2f 0 2024-05-09T06:30:19.963 INFO:tasks.workunit.client.1.smithi106.stdout:2/143: write d2/d5/f22 [631195,79513] 0 2024-05-09T06:30:19.964 INFO:tasks.workunit.client.1.smithi106.stdout:0/143: mknod d1/d11/d23/d13/d2c/c30 0 2024-05-09T06:30:19.964 INFO:tasks.workunit.client.1.smithi106.stdout:0/144: chown d1/d11/d23/d13/d2c/c30 6516853 1 2024-05-09T06:30:19.965 INFO:tasks.workunit.client.1.smithi106.stdout:5/179: dread d8/fc [0,4194304] 0 2024-05-09T06:30:19.965 INFO:tasks.workunit.client.1.smithi106.stdout:5/180: getdents d8/d1c/d28/d32 0 2024-05-09T06:30:19.965 INFO:tasks.workunit.client.1.smithi106.stdout:5/181: write d8/f19 [5003050,113899] 0 2024-05-09T06:30:19.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/109: symlink d0/db/d1e/l20 0 2024-05-09T06:30:19.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/110: stat d0/dc/lf 0 2024-05-09T06:30:19.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/111: chown d0/dc 31787255 1 2024-05-09T06:30:19.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/112: chown d0/l7 59191997 1 2024-05-09T06:30:19.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/113: fdatasync d0/dc/d1a/f16 0 2024-05-09T06:30:19.966 INFO:tasks.workunit.client.1.smithi106.stdout:2/144: creat d2/d5/db/d1d/f30 x:0 0 0 2024-05-09T06:30:19.968 INFO:tasks.workunit.client.1.smithi106.stdout:0/145: creat d1/d11/d23/d22/f31 x:0 0 0 2024-05-09T06:30:19.969 INFO:tasks.workunit.client.1.smithi106.stdout:5/182: mkdir d8/d33 0 2024-05-09T06:30:19.971 INFO:tasks.workunit.client.1.smithi106.stdout:7/114: creat d0/db/d1e/f21 x:0 0 0 2024-05-09T06:30:19.972 INFO:tasks.workunit.client.1.smithi106.stdout:5/183: dread d8/fc [0,4194304] 0 2024-05-09T06:30:19.974 INFO:tasks.workunit.client.1.smithi106.stdout:3/167: dwrite d5/d1c/f2b [4194304,4194304] 0 2024-05-09T06:30:19.975 INFO:tasks.workunit.client.1.smithi106.stdout:0/146: rename d1/c9 to d1/d11/d23/c32 0 2024-05-09T06:30:19.977 INFO:tasks.workunit.client.1.smithi106.stdout:7/115: symlink d0/db/l22 0 2024-05-09T06:30:19.977 INFO:tasks.workunit.client.1.smithi106.stdout:7/116: read d0/dc/d1a/f16 [3928434,97629] 0 2024-05-09T06:30:19.977 INFO:tasks.workunit.client.1.smithi106.stdout:7/117: dread - d0/fa zero size 2024-05-09T06:30:19.977 INFO:tasks.workunit.client.1.smithi106.stdout:7/118: read - d0/fa zero size 2024-05-09T06:30:19.977 INFO:tasks.workunit.client.1.smithi106.stdout:7/119: truncate d0/fa 131908 0 2024-05-09T06:30:19.977 INFO:tasks.workunit.client.1.smithi106.stdout:7/120: stat d0/l12 0 2024-05-09T06:30:19.978 INFO:tasks.workunit.client.1.smithi106.stdout:5/184: truncate d8/fc 524400 0 2024-05-09T06:30:19.978 INFO:tasks.workunit.client.1.smithi106.stdout:5/185: fdatasync d8/fa 0 2024-05-09T06:30:19.978 INFO:tasks.workunit.client.1.smithi106.stdout:5/186: write d8/d1c/f2c [4628960,98666] 0 2024-05-09T06:30:19.979 INFO:tasks.workunit.client.1.smithi106.stdout:5/187: readlink d8/d1c/l2d 0 2024-05-09T06:30:19.979 INFO:tasks.workunit.client.1.smithi106.stdout:5/188: write d8/f18 [685968,126561] 0 2024-05-09T06:30:19.980 INFO:tasks.workunit.client.1.smithi106.stdout:0/147: truncate d1/fb 974756 0 2024-05-09T06:30:19.980 INFO:tasks.workunit.client.1.smithi106.stdout:0/148: chown d1/d11/d23/d22/l29 1 1 2024-05-09T06:30:19.980 INFO:tasks.workunit.client.1.smithi106.stdout:2/145: write f1 [1485123,57634] 0 2024-05-09T06:30:19.980 INFO:tasks.workunit.client.1.smithi106.stdout:0/149: dread - d1/d11/d23/f24 zero size 2024-05-09T06:30:19.982 INFO:tasks.workunit.client.1.smithi106.stdout:7/121: symlink d0/l23 0 2024-05-09T06:30:19.982 INFO:tasks.workunit.client.1.smithi106.stdout:7/122: write d0/fa [974715,66888] 0 2024-05-09T06:30:19.982 INFO:tasks.workunit.client.1.smithi106.stdout:7/123: dread - d0/dc/f10 zero size 2024-05-09T06:30:19.984 INFO:tasks.workunit.client.1.smithi106.stdout:2/146: symlink d2/d7/d2c/l31 0 2024-05-09T06:30:19.985 INFO:tasks.workunit.client.1.smithi106.stdout:9/120: dwrite d4/d6/f13 [0,4194304] 0 2024-05-09T06:30:19.985 INFO:tasks.workunit.client.1.smithi106.stdout:9/121: write d4/d6/dc/fd [4860000,53145] 0 2024-05-09T06:30:19.987 INFO:tasks.workunit.client.1.smithi106.stdout:7/124: mkdir d0/dc/d24 0 2024-05-09T06:30:19.990 INFO:tasks.workunit.client.1.smithi106.stdout:2/147: creat d2/d5/db/f32 x:0 0 0 2024-05-09T06:30:19.991 INFO:tasks.workunit.client.1.smithi106.stdout:2/148: write d2/f2b [659800,20985] 0 2024-05-09T06:30:19.994 INFO:tasks.workunit.client.1.smithi106.stdout:9/122: unlink d4/d6/dc/d16/f18 0 2024-05-09T06:30:19.994 INFO:tasks.workunit.client.1.smithi106.stdout:1/160: rmdir d4/d5/d9/d1d 39 2024-05-09T06:30:19.995 INFO:tasks.workunit.client.1.smithi106.stdout:9/123: write d4/d6/ff [759632,90791] 0 2024-05-09T06:30:19.995 INFO:tasks.workunit.client.1.smithi106.stdout:9/124: creat d4/d6/dc/d12/f20 x:0 0 0 2024-05-09T06:30:19.997 INFO:tasks.workunit.client.1.smithi106.stdout:7/125: creat d0/dc/f25 x:0 0 0 2024-05-09T06:30:19.997 INFO:tasks.workunit.client.1.smithi106.stdout:7/126: chown d0/dc/f14 15991 1 2024-05-09T06:30:19.997 INFO:tasks.workunit.client.1.smithi106.stdout:7/127: fsync d0/f9 0 2024-05-09T06:30:19.998 INFO:tasks.workunit.client.1.smithi106.stdout:4/146: write f0 [1266200,90515] 0 2024-05-09T06:30:19.998 INFO:tasks.workunit.client.1.smithi106.stdout:8/105: dwrite d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:19.999 INFO:tasks.workunit.client.1.smithi106.stdout:8/106: dread - d3/d5/d7/f20 zero size 2024-05-09T06:30:19.999 INFO:tasks.workunit.client.1.smithi106.stdout:8/107: chown d3/d5/d13 0 1 2024-05-09T06:30:19.999 INFO:tasks.workunit.client.1.smithi106.stdout:3/168: dwrite d5/fe [0,4194304] 0 2024-05-09T06:30:19.999 INFO:tasks.workunit.client.1.smithi106.stdout:3/169: fdatasync d5/d1c/f33 0 2024-05-09T06:30:19.999 INFO:tasks.workunit.client.1.smithi106.stdout:1/161: write d4/d5/d9/f16 [2607755,8594] 0 2024-05-09T06:30:20.000 INFO:tasks.workunit.client.1.smithi106.stdout:2/149: rename d2/d5/db/d1d/d23/f2e to d2/d5/db/f33 0 2024-05-09T06:30:20.007 INFO:tasks.workunit.client.1.smithi106.stdout:8/108: write d3/d5/d13/f1b [2127175,82677] 0 2024-05-09T06:30:20.008 INFO:tasks.workunit.client.1.smithi106.stdout:0/150: dwrite d1/f1d [0,4194304] 0 2024-05-09T06:30:20.011 INFO:tasks.workunit.client.1.smithi106.stdout:7/128: creat d0/dc/d24/f26 x:0 0 0 2024-05-09T06:30:20.011 INFO:tasks.workunit.client.1.smithi106.stdout:7/129: truncate d0/fe 5724835 0 2024-05-09T06:30:20.018 INFO:tasks.workunit.client.1.smithi106.stdout:4/147: mkdir d7/d28/d2a 0 2024-05-09T06:30:20.021 INFO:tasks.workunit.client.1.smithi106.stdout:8/109: rename d3/d5/d7/d15/d16/c18 to d3/d5/d7/d15/c24 0 2024-05-09T06:30:20.021 INFO:tasks.workunit.client.1.smithi106.stdout:8/110: write d3/d5/d13/f1b [4290038,70108] 0 2024-05-09T06:30:20.022 INFO:tasks.workunit.client.1.smithi106.stdout:3/170: dwrite d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:20.022 INFO:tasks.workunit.client.1.smithi106.stdout:3/171: readlink d5/ld 0 2024-05-09T06:30:20.022 INFO:tasks.workunit.client.1.smithi106.stdout:3/172: read d5/d12/f13 [2824492,75022] 0 2024-05-09T06:30:20.023 INFO:tasks.workunit.client.1.smithi106.stdout:0/151: unlink d1/d11/d23/d13/c26 0 2024-05-09T06:30:20.025 INFO:tasks.workunit.client.1.smithi106.stdout:7/130: creat d0/f27 x:0 0 0 2024-05-09T06:30:20.025 INFO:tasks.workunit.client.1.smithi106.stdout:7/131: chown d0/dc/d1a/f1c 10009 1 2024-05-09T06:30:20.026 INFO:tasks.workunit.client.1.smithi106.stdout:0/152: dread d1/f3 [4194304,4194304] 0 2024-05-09T06:30:20.030 INFO:tasks.workunit.client.1.smithi106.stdout:4/148: rename f0 to d7/d28/d2a/f2b 0 2024-05-09T06:30:20.031 INFO:tasks.workunit.client.1.smithi106.stdout:3/173: truncate d5/fb 959221 0 2024-05-09T06:30:20.032 INFO:tasks.workunit.client.1.smithi106.stdout:9/125: getdents d4/d6/dc/d16 0 2024-05-09T06:30:20.034 INFO:tasks.workunit.client.1.smithi106.stdout:3/174: rename d5/d12/d26/f22 to d5/d12/f34 0 2024-05-09T06:30:20.034 INFO:tasks.workunit.client.1.smithi106.stdout:3/175: write d5/d1c/f33 [468521,24889] 0 2024-05-09T06:30:20.034 INFO:tasks.workunit.client.1.smithi106.stdout:3/176: chown d5/d1c/f1e 1797 1 2024-05-09T06:30:20.035 INFO:tasks.workunit.client.1.smithi106.stdout:3/177: creat d5/d1c/d24/f35 x:0 0 0 2024-05-09T06:30:20.035 INFO:tasks.workunit.client.1.smithi106.stdout:3/178: symlink d5/d1c/d24/l36 0 2024-05-09T06:30:20.037 INFO:tasks.workunit.client.1.smithi106.stdout:3/179: symlink d5/d1c/l37 0 2024-05-09T06:30:20.037 INFO:tasks.workunit.client.1.smithi106.stdout:3/180: fdatasync d5/fb 0 2024-05-09T06:30:20.037 INFO:tasks.workunit.client.1.smithi106.stdout:2/150: rmdir d2/d5 39 2024-05-09T06:30:20.039 INFO:tasks.workunit.client.1.smithi106.stdout:2/151: creat d2/d7/d2c/f34 x:0 0 0 2024-05-09T06:30:20.039 INFO:tasks.workunit.client.1.smithi106.stdout:2/152: dread - d2/d7/d2c/f34 zero size 2024-05-09T06:30:20.039 INFO:tasks.workunit.client.1.smithi106.stdout:2/153: chown d2/d5/db/c21 0 1 2024-05-09T06:30:20.039 INFO:tasks.workunit.client.1.smithi106.stdout:2/154: mknod d2/d5/db/d1d/d23/c35 0 2024-05-09T06:30:20.040 INFO:tasks.workunit.client.1.smithi106.stdout:2/155: creat d2/d5/db/d1d/f36 x:0 0 0 2024-05-09T06:30:20.044 INFO:tasks.workunit.client.1.smithi106.stdout:6/155: sync 2024-05-09T06:30:20.044 INFO:tasks.workunit.client.1.smithi106.stdout:6/156: dread - d0/d6/f28 zero size 2024-05-09T06:30:20.048 INFO:tasks.workunit.client.1.smithi106.stdout:2/156: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:20.058 INFO:tasks.workunit.client.1.smithi106.stdout:1/162: dwrite d4/d5/d9/d13/f20 [0,4194304] 0 2024-05-09T06:30:20.058 INFO:tasks.workunit.client.1.smithi106.stdout:8/111: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:20.058 INFO:tasks.workunit.client.1.smithi106.stdout:8/112: write d3/d5/f12 [2519584,103359] 0 2024-05-09T06:30:20.058 INFO:tasks.workunit.client.1.smithi106.stdout:0/153: write d1/f5 [629161,92241] 0 2024-05-09T06:30:20.058 INFO:tasks.workunit.client.1.smithi106.stdout:0/154: chown d1/d11/d23/d13/d2c/c30 92 1 2024-05-09T06:30:20.058 INFO:tasks.workunit.client.1.smithi106.stdout:0/155: read d1/f5 [991479,17646] 0 2024-05-09T06:30:20.059 INFO:tasks.workunit.client.1.smithi106.stdout:7/132: dwrite d0/db/d1e/f21 [0,4194304] 0 2024-05-09T06:30:20.061 INFO:tasks.workunit.client.1.smithi106.stdout:7/133: write d0/f9 [286094,69269] 0 2024-05-09T06:30:20.062 INFO:tasks.workunit.client.1.smithi106.stdout:6/157: dwrite d0/d17/f1e [0,4194304] 0 2024-05-09T06:30:20.063 INFO:tasks.workunit.client.1.smithi106.stdout:2/157: getdents d2/d5/db/d1d/d23 0 2024-05-09T06:30:20.067 INFO:tasks.workunit.client.1.smithi106.stdout:8/113: mknod d3/d5/d7/d15/d16/c25 0 2024-05-09T06:30:20.068 INFO:tasks.workunit.client.1.smithi106.stdout:8/114: creat d3/d5/d13/f26 x:0 0 0 2024-05-09T06:30:20.069 INFO:tasks.workunit.client.1.smithi106.stdout:0/156: symlink d1/d11/l33 0 2024-05-09T06:30:20.075 INFO:tasks.workunit.client.1.smithi106.stdout:7/134: symlink d0/db/l28 0 2024-05-09T06:30:20.075 INFO:tasks.workunit.client.1.smithi106.stdout:7/135: truncate d0/f27 888290 0 2024-05-09T06:30:20.075 INFO:tasks.workunit.client.1.smithi106.stdout:7/136: creat d0/f29 x:0 0 0 2024-05-09T06:30:20.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/126: dwrite d4/d6/dc/fd [0,4194304] 0 2024-05-09T06:30:20.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/127: write d4/d6/f15 [3817974,28205] 0 2024-05-09T06:30:20.080 INFO:tasks.workunit.client.1.smithi106.stdout:6/158: mkdir d0/d17/d34 0 2024-05-09T06:30:20.083 INFO:tasks.workunit.client.1.smithi106.stdout:8/115: symlink d3/l27 0 2024-05-09T06:30:20.085 INFO:tasks.workunit.client.1.smithi106.stdout:0/157: rename d1/ce to d1/d11/d23/d22/c34 0 2024-05-09T06:30:20.088 INFO:tasks.workunit.client.1.smithi106.stdout:8/116: mknod d3/d5/d7/c28 0 2024-05-09T06:30:20.088 INFO:tasks.workunit.client.1.smithi106.stdout:8/117: creat d3/d5/d13/f29 x:0 0 0 2024-05-09T06:30:20.089 INFO:tasks.workunit.client.1.smithi106.stdout:6/159: dread d0/f30 [0,4194304] 0 2024-05-09T06:30:20.091 INFO:tasks.workunit.client.1.smithi106.stdout:0/158: dread d1/fb [0,4194304] 0 2024-05-09T06:30:20.091 INFO:tasks.workunit.client.1.smithi106.stdout:7/137: rename d0/db/l28 to d0/l2a 0 2024-05-09T06:30:20.091 INFO:tasks.workunit.client.1.smithi106.stdout:0/159: rename d1/d11/d23/d22 to d1/d11/d23/d22/d35 22 2024-05-09T06:30:20.091 INFO:tasks.workunit.client.1.smithi106.stdout:7/138: creat d0/dc/f2b x:0 0 0 2024-05-09T06:30:20.092 INFO:tasks.workunit.client.1.smithi106.stdout:2/158: dwrite d2/d5/db/d15/f18 [0,4194304] 0 2024-05-09T06:30:20.098 INFO:tasks.workunit.client.1.smithi106.stdout:6/160: dread d0/d17/d21/f26 [0,4194304] 0 2024-05-09T06:30:20.098 INFO:tasks.workunit.client.1.smithi106.stdout:2/159: unlink d2/d5/db/d15/c2a 0 2024-05-09T06:30:20.098 INFO:tasks.workunit.client.1.smithi106.stdout:2/160: creat d2/d7/d2c/f37 x:0 0 0 2024-05-09T06:30:20.102 INFO:tasks.workunit.client.1.smithi106.stdout:6/161: rename d0/d6/d8/c33 to d0/d6/c35 0 2024-05-09T06:30:20.103 INFO:tasks.workunit.client.1.smithi106.stdout:2/161: getdents d2/d5 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:0/160: dread d1/d11/d23/d13/f14 [0,4194304] 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:0/161: chown d1/d11/d23/l21 97206570 1 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:1/163: dwrite d4/d5/d9/d13/f39 [0,4194304] 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:9/128: dwrite d4/d6/dc/fd [0,4194304] 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:6/162: link d0/d6/d8/ff d0/d17/f36 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:6/163: chown d0/d6/c23 69815449 1 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:6/164: readlink d0/d6/l4 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:9/129: read d4/d6/f15 [1444813,128886] 0 2024-05-09T06:30:20.105 INFO:tasks.workunit.client.1.smithi106.stdout:9/130: write d4/d6/dc/d12/f20 [41848,1975] 0 2024-05-09T06:30:20.106 INFO:tasks.workunit.client.1.smithi106.stdout:8/118: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:20.106 INFO:tasks.workunit.client.1.smithi106.stdout:8/119: rename d3/d5/d7 to d3/d5/d7/d15/d2a 22 2024-05-09T06:30:20.110 INFO:tasks.workunit.client.1.smithi106.stdout:0/162: symlink d1/d11/d23/d13/l36 0 2024-05-09T06:30:20.110 INFO:tasks.workunit.client.1.smithi106.stdout:0/163: fdatasync d1/d11/d23/f1a 0 2024-05-09T06:30:20.110 INFO:tasks.workunit.client.1.smithi106.stdout:0/164: write d1/f28 [663740,125020] 0 2024-05-09T06:30:20.111 INFO:tasks.workunit.client.1.smithi106.stdout:0/165: chown d1/d11/d23/f2a 36 1 2024-05-09T06:30:20.111 INFO:tasks.workunit.client.1.smithi106.stdout:0/166: write d1/d11/d23/f24 [804092,64368] 0 2024-05-09T06:30:20.111 INFO:tasks.workunit.client.1.smithi106.stdout:6/165: write d0/d17/d21/f26 [3673995,34008] 0 2024-05-09T06:30:20.112 INFO:tasks.workunit.client.1.smithi106.stdout:8/120: link d3/l27 d3/l2b 0 2024-05-09T06:30:20.112 INFO:tasks.workunit.client.1.smithi106.stdout:2/162: rmdir d2/d5/db/d1d 39 2024-05-09T06:30:20.115 INFO:tasks.workunit.client.1.smithi106.stdout:1/164: getdents d4/d5 0 2024-05-09T06:30:20.115 INFO:tasks.workunit.client.1.smithi106.stdout:6/166: fdatasync d0/d17/d21/f26 0 2024-05-09T06:30:20.116 INFO:tasks.workunit.client.1.smithi106.stdout:8/121: truncate d3/d5/d13/f1b 775479 0 2024-05-09T06:30:20.116 INFO:tasks.workunit.client.1.smithi106.stdout:9/131: dread d4/d6/dc/d12/f1c [0,4194304] 0 2024-05-09T06:30:20.116 INFO:tasks.workunit.client.1.smithi106.stdout:9/132: stat d4/d6/dc/d12/f1e 0 2024-05-09T06:30:20.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/163: rename d2/d5/db/d1d/d23/c35 to d2/d5/db/d15/c38 0 2024-05-09T06:30:20.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/164: stat d2/d5/db/d15/f18 0 2024-05-09T06:30:20.117 INFO:tasks.workunit.client.1.smithi106.stdout:0/167: dread d1/d11/d23/f1f [0,4194304] 0 2024-05-09T06:30:20.118 INFO:tasks.workunit.client.1.smithi106.stdout:7/139: rename d0/db to d0/d2c 0 2024-05-09T06:30:20.121 INFO:tasks.workunit.client.1.smithi106.stdout:8/122: symlink d3/l2c 0 2024-05-09T06:30:20.121 INFO:tasks.workunit.client.1.smithi106.stdout:8/123: rename d3/d5/d7 to d3/d5/d7/d2d 22 2024-05-09T06:30:20.121 INFO:tasks.workunit.client.1.smithi106.stdout:8/124: fdatasync d3/d5/d13/f14 0 2024-05-09T06:30:20.122 INFO:tasks.workunit.client.1.smithi106.stdout:8/125: chown d3/c1e 626572027 1 2024-05-09T06:30:20.122 INFO:tasks.workunit.client.1.smithi106.stdout:8/126: creat d3/d5/d13/f2e x:0 0 0 2024-05-09T06:30:20.122 INFO:tasks.workunit.client.1.smithi106.stdout:8/127: readlink d3/d5/d7/lb 0 2024-05-09T06:30:20.122 INFO:tasks.workunit.client.1.smithi106.stdout:8/128: write d3/d5/d13/f2e [901605,54863] 0 2024-05-09T06:30:20.122 INFO:tasks.workunit.client.1.smithi106.stdout:9/133: getdents d4/d6 0 2024-05-09T06:30:20.126 INFO:tasks.workunit.client.1.smithi106.stdout:2/165: mknod d2/d5/db/d1d/c39 0 2024-05-09T06:30:20.127 INFO:tasks.workunit.client.1.smithi106.stdout:0/168: symlink d1/d11/d23/d13/l37 0 2024-05-09T06:30:20.128 INFO:tasks.workunit.client.1.smithi106.stdout:1/165: dwrite d4/fb [0,4194304] 0 2024-05-09T06:30:20.128 INFO:tasks.workunit.client.1.smithi106.stdout:8/129: rename d3/l2b to d3/d5/d7/l2f 0 2024-05-09T06:30:20.129 INFO:tasks.workunit.client.1.smithi106.stdout:8/130: truncate d3/d5/d13/f26 366114 0 2024-05-09T06:30:20.129 INFO:tasks.workunit.client.1.smithi106.stdout:8/131: dread - d3/d5/d13/f29 zero size 2024-05-09T06:30:20.129 INFO:tasks.workunit.client.1.smithi106.stdout:8/132: chown d3/l23 2 1 2024-05-09T06:30:20.129 INFO:tasks.workunit.client.1.smithi106.stdout:9/134: creat d4/d6/dc/f21 x:0 0 0 2024-05-09T06:30:20.129 INFO:tasks.workunit.client.1.smithi106.stdout:9/135: getdents d4/d6/dc/d16 0 2024-05-09T06:30:20.130 INFO:tasks.workunit.client.1.smithi106.stdout:9/136: stat d4/d6/f13 0 2024-05-09T06:30:20.130 INFO:tasks.workunit.client.1.smithi106.stdout:2/166: symlink d2/d5/db/l3a 0 2024-05-09T06:30:20.131 INFO:tasks.workunit.client.1.smithi106.stdout:0/169: symlink d1/d11/l38 0 2024-05-09T06:30:20.132 INFO:tasks.workunit.client.1.smithi106.stdout:7/140: getdents d0/dc/d1a 0 2024-05-09T06:30:20.132 INFO:tasks.workunit.client.1.smithi106.stdout:7/141: chown d0/fe 836 1 2024-05-09T06:30:20.134 INFO:tasks.workunit.client.1.smithi106.stdout:6/167: rmdir d0/d6/d8/d27/d2d 0 2024-05-09T06:30:20.134 INFO:tasks.workunit.client.1.smithi106.stdout:6/168: readlink d0/d6/d8/l1b 0 2024-05-09T06:30:20.134 INFO:tasks.workunit.client.1.smithi106.stdout:6/169: write d0/d6/d8/f14 [2049176,6105] 0 2024-05-09T06:30:20.134 INFO:tasks.workunit.client.1.smithi106.stdout:6/170: creat d0/d6/f37 x:0 0 0 2024-05-09T06:30:20.136 INFO:tasks.workunit.client.1.smithi106.stdout:1/166: write f2 [117735,13737] 0 2024-05-09T06:30:20.136 INFO:tasks.workunit.client.1.smithi106.stdout:1/167: write d4/d5/d9/f16 [3797235,19138] 0 2024-05-09T06:30:20.136 INFO:tasks.workunit.client.1.smithi106.stdout:1/168: write d4/d5/d9/d13/f25 [301048,54002] 0 2024-05-09T06:30:20.136 INFO:tasks.workunit.client.1.smithi106.stdout:1/169: readlink d4/d5/ld 0 2024-05-09T06:30:20.137 INFO:tasks.workunit.client.1.smithi106.stdout:1/170: dread d4/d5/d9/d1d/f38 [0,4194304] 0 2024-05-09T06:30:20.139 INFO:tasks.workunit.client.1.smithi106.stdout:5/189: sync 2024-05-09T06:30:20.139 INFO:tasks.workunit.client.1.smithi106.stdout:5/190: read d8/d1c/f1f [646091,55710] 0 2024-05-09T06:30:20.141 INFO:tasks.workunit.client.1.smithi106.stdout:9/137: stat d4/d6/l9 0 2024-05-09T06:30:20.143 INFO:tasks.workunit.client.1.smithi106.stdout:2/167: symlink d2/d7/l3b 0 2024-05-09T06:30:20.143 INFO:tasks.workunit.client.1.smithi106.stdout:8/133: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:20.145 INFO:tasks.workunit.client.1.smithi106.stdout:0/170: mknod d1/d11/d23/c39 0 2024-05-09T06:30:20.148 INFO:tasks.workunit.client.1.smithi106.stdout:6/171: truncate d0/d6/d8/ff 3833766 0 2024-05-09T06:30:20.149 INFO:tasks.workunit.client.1.smithi106.stdout:1/171: mkdir d4/d37/d3d 0 2024-05-09T06:30:20.150 INFO:tasks.workunit.client.1.smithi106.stdout:5/191: rename d8/c26 to d8/d33/c34 0 2024-05-09T06:30:20.152 INFO:tasks.workunit.client.1.smithi106.stdout:6/172: write d0/d17/f1e [3817612,77263] 0 2024-05-09T06:30:20.152 INFO:tasks.workunit.client.1.smithi106.stdout:2/168: truncate d2/d5/f6 1923327 0 2024-05-09T06:30:20.152 INFO:tasks.workunit.client.1.smithi106.stdout:2/169: write d2/f2b [1415962,73238] 0 2024-05-09T06:30:20.154 INFO:tasks.workunit.client.1.smithi106.stdout:8/134: creat d3/d5/d7/d15/d16/f30 x:0 0 0 2024-05-09T06:30:20.156 INFO:tasks.workunit.client.1.smithi106.stdout:7/142: rmdir d0/dc/d24 39 2024-05-09T06:30:20.159 INFO:tasks.workunit.client.1.smithi106.stdout:5/192: mkdir d8/d1c/d28/d35 0 2024-05-09T06:30:20.161 INFO:tasks.workunit.client.1.smithi106.stdout:9/138: dwrite d4/d6/f11 [0,4194304] 0 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:6/173: link d0/d17/d21/l2e d0/l38 0 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:6/174: readlink d0/d17/d21/l2e 0 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:4/149: sync 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:3/181: sync 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:4/150: stat d7/f29 0 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:3/182: readlink d5/l18 0 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:4/151: readlink d7/d10/d1a/l24 0 2024-05-09T06:30:20.162 INFO:tasks.workunit.client.1.smithi106.stdout:3/183: fsync f1 0 2024-05-09T06:30:20.166 INFO:tasks.workunit.client.1.smithi106.stdout:7/143: unlink d0/dc/d1a/f1c 0 2024-05-09T06:30:20.166 INFO:tasks.workunit.client.1.smithi106.stdout:7/144: creat d0/dc/f2d x:0 0 0 2024-05-09T06:30:20.167 INFO:tasks.workunit.client.1.smithi106.stdout:5/193: creat d8/d1c/d28/d35/f36 x:0 0 0 2024-05-09T06:30:20.167 INFO:tasks.workunit.client.1.smithi106.stdout:5/194: creat d8/f37 x:0 0 0 2024-05-09T06:30:20.168 INFO:tasks.workunit.client.1.smithi106.stdout:9/139: truncate d4/d6/f7 3220769 0 2024-05-09T06:30:20.168 INFO:tasks.workunit.client.1.smithi106.stdout:9/140: stat d4 0 2024-05-09T06:30:20.168 INFO:tasks.workunit.client.1.smithi106.stdout:5/195: dread d8/fc [0,4194304] 0 2024-05-09T06:30:20.169 INFO:tasks.workunit.client.1.smithi106.stdout:6/175: mknod d0/d17/d34/c39 0 2024-05-09T06:30:20.169 INFO:tasks.workunit.client.1.smithi106.stdout:6/176: chown d0/d6/c13 231 1 2024-05-09T06:30:20.170 INFO:tasks.workunit.client.1.smithi106.stdout:4/152: creat d7/d10/d12/d1c/f2c x:0 0 0 2024-05-09T06:30:20.171 INFO:tasks.workunit.client.1.smithi106.stdout:3/184: mknod d5/d1c/d21/d32/c38 0 2024-05-09T06:30:20.172 INFO:tasks.workunit.client.1.smithi106.stdout:0/171: dwrite d1/d11/d23/f1a [0,4194304] 0 2024-05-09T06:30:20.172 INFO:tasks.workunit.client.1.smithi106.stdout:2/170: rmdir d2/d5/db/d15 39 2024-05-09T06:30:20.172 INFO:tasks.workunit.client.1.smithi106.stdout:2/171: chown d2/d5/db/f1b 25444 1 2024-05-09T06:30:20.174 INFO:tasks.workunit.client.1.smithi106.stdout:1/172: dwrite d4/d5/d9/f16 [0,4194304] 0 2024-05-09T06:30:20.175 INFO:tasks.workunit.client.1.smithi106.stdout:7/145: symlink d0/dc/l2e 0 2024-05-09T06:30:20.177 INFO:tasks.workunit.client.1.smithi106.stdout:8/135: rmdir d3/d5/d7/d15/d16 39 2024-05-09T06:30:20.178 INFO:tasks.workunit.client.1.smithi106.stdout:4/153: write d7/fb [2029766,41923] 0 2024-05-09T06:30:20.179 INFO:tasks.workunit.client.1.smithi106.stdout:9/141: symlink d4/d6/dc/l22 0 2024-05-09T06:30:20.180 INFO:tasks.workunit.client.1.smithi106.stdout:5/196: unlink d8/d1c/d28/d35/f36 0 2024-05-09T06:30:20.183 INFO:tasks.workunit.client.1.smithi106.stdout:3/185: mknod d5/d1c/d21/d32/c39 0 2024-05-09T06:30:20.184 INFO:tasks.workunit.client.1.smithi106.stdout:0/172: write d1/d11/d23/f1a [1653935,125407] 0 2024-05-09T06:30:20.184 INFO:tasks.workunit.client.1.smithi106.stdout:1/173: creat d4/d5/d9/d13/f3e x:0 0 0 2024-05-09T06:30:20.184 INFO:tasks.workunit.client.1.smithi106.stdout:1/174: read - d4/f2d zero size 2024-05-09T06:30:20.185 INFO:tasks.workunit.client.1.smithi106.stdout:2/172: dread d2/d5/db/d15/f18 [0,4194304] 0 2024-05-09T06:30:20.185 INFO:tasks.workunit.client.1.smithi106.stdout:7/146: creat d0/dc/d1a/f2f x:0 0 0 2024-05-09T06:30:20.185 INFO:tasks.workunit.client.1.smithi106.stdout:2/173: dread - d2/d5/db/f32 zero size 2024-05-09T06:30:20.189 INFO:tasks.workunit.client.1.smithi106.stdout:8/136: write d3/d5/d7/f20 [572263,123100] 0 2024-05-09T06:30:20.189 INFO:tasks.workunit.client.1.smithi106.stdout:8/137: chown d3/d5 8896 1 2024-05-09T06:30:20.191 INFO:tasks.workunit.client.1.smithi106.stdout:5/197: read d8/fa [2901183,171] 0 2024-05-09T06:30:20.191 INFO:tasks.workunit.client.1.smithi106.stdout:4/154: symlink d7/d28/d2a/l2d 0 2024-05-09T06:30:20.191 INFO:tasks.workunit.client.1.smithi106.stdout:4/155: readlink l4 0 2024-05-09T06:30:20.191 INFO:tasks.workunit.client.1.smithi106.stdout:4/156: chown d7/d10 1819484 1 2024-05-09T06:30:20.191 INFO:tasks.workunit.client.1.smithi106.stdout:6/177: getdents d0/d17 0 2024-05-09T06:30:20.191 INFO:tasks.workunit.client.1.smithi106.stdout:4/157: creat d7/f2e x:0 0 0 2024-05-09T06:30:20.192 INFO:tasks.workunit.client.1.smithi106.stdout:7/147: rename d0/dc/d24 to d0/d2c/d30 0 2024-05-09T06:30:20.193 INFO:tasks.workunit.client.1.smithi106.stdout:2/174: getdents d2/d5/db/d1d/d23 0 2024-05-09T06:30:20.194 INFO:tasks.workunit.client.1.smithi106.stdout:8/138: mknod d3/d5/d7/c31 0 2024-05-09T06:30:20.196 INFO:tasks.workunit.client.1.smithi106.stdout:1/175: dread d4/d5/d9/f11 [0,4194304] 0 2024-05-09T06:30:20.196 INFO:tasks.workunit.client.1.smithi106.stdout:1/176: write d4/d5/d9/d13/f20 [4940308,23228] 0 2024-05-09T06:30:20.198 INFO:tasks.workunit.client.1.smithi106.stdout:5/198: dread d8/fa [0,4194304] 0 2024-05-09T06:30:20.198 INFO:tasks.workunit.client.1.smithi106.stdout:5/199: readlink l2 0 2024-05-09T06:30:20.198 INFO:tasks.workunit.client.1.smithi106.stdout:5/200: fsync d8/f19 0 2024-05-09T06:30:20.200 INFO:tasks.workunit.client.1.smithi106.stdout:4/158: mkdir d7/d10/d12/d2f 0 2024-05-09T06:30:20.203 INFO:tasks.workunit.client.1.smithi106.stdout:6/178: creat d0/d6/d8/d27/f3a x:0 0 0 2024-05-09T06:30:20.206 INFO:tasks.workunit.client.1.smithi106.stdout:2/175: truncate d2/d5/f6 712586 0 2024-05-09T06:30:20.208 INFO:tasks.workunit.client.1.smithi106.stdout:8/139: mkdir d3/d5/d7/d15/d16/d32 0 2024-05-09T06:30:20.209 INFO:tasks.workunit.client.1.smithi106.stdout:1/177: symlink d4/d5/d9/d13/d2f/l3f 0 2024-05-09T06:30:20.211 INFO:tasks.workunit.client.1.smithi106.stdout:9/142: rename d4/d6/dc to d4/d6/d23 0 2024-05-09T06:30:20.211 INFO:tasks.workunit.client.1.smithi106.stdout:9/143: write d4/d6/f15 [4757755,6827] 0 2024-05-09T06:30:20.211 INFO:tasks.workunit.client.1.smithi106.stdout:5/201: truncate d8/f19 3437839 0 2024-05-09T06:30:20.213 INFO:tasks.workunit.client.1.smithi106.stdout:6/179: truncate d0/d17/f1e 1662693 0 2024-05-09T06:30:20.214 INFO:tasks.workunit.client.1.smithi106.stdout:2/176: rmdir d2/d5/db/d15 39 2024-05-09T06:30:20.215 INFO:tasks.workunit.client.1.smithi106.stdout:2/177: chown d2/d5/db/c21 38 1 2024-05-09T06:30:20.216 INFO:tasks.workunit.client.1.smithi106.stdout:8/140: mknod d3/d5/d7/d15/d16/d32/c33 0 2024-05-09T06:30:20.217 INFO:tasks.workunit.client.1.smithi106.stdout:1/178: creat d4/d37/d3d/f40 x:0 0 0 2024-05-09T06:30:20.218 INFO:tasks.workunit.client.1.smithi106.stdout:9/144: creat d4/d6/d23/d16/f24 x:0 0 0 2024-05-09T06:30:20.218 INFO:tasks.workunit.client.1.smithi106.stdout:9/145: fdatasync d4/d6/d23/fd 0 2024-05-09T06:30:20.219 INFO:tasks.workunit.client.1.smithi106.stdout:9/146: fdatasync d4/d6/f11 0 2024-05-09T06:30:20.220 INFO:tasks.workunit.client.1.smithi106.stdout:8/141: mknod d3/d5/d7/c34 0 2024-05-09T06:30:20.220 INFO:tasks.workunit.client.1.smithi106.stdout:8/142: fsync d3/d5/d13/f26 0 2024-05-09T06:30:20.222 INFO:tasks.workunit.client.1.smithi106.stdout:1/179: rename d4/d5/f23 to d4/d5/d9/d1d/f41 0 2024-05-09T06:30:20.224 INFO:tasks.workunit.client.1.smithi106.stdout:9/147: unlink d4/d6/d23/d12/f1c 0 2024-05-09T06:30:20.225 INFO:tasks.workunit.client.1.smithi106.stdout:9/148: readlink d4/d6/l9 0 2024-05-09T06:30:20.226 INFO:tasks.workunit.client.1.smithi106.stdout:6/180: getdents d0/d6/d8 0 2024-05-09T06:30:20.226 INFO:tasks.workunit.client.1.smithi106.stdout:6/181: write d0/d17/d21/f26 [1696017,752] 0 2024-05-09T06:30:20.228 INFO:tasks.workunit.client.1.smithi106.stdout:8/143: mkdir d3/d5/d35 0 2024-05-09T06:30:20.228 INFO:tasks.workunit.client.1.smithi106.stdout:8/144: creat d3/d5/d13/f36 x:0 0 0 2024-05-09T06:30:20.229 INFO:tasks.workunit.client.1.smithi106.stdout:8/145: readlink d3/d5/d7/l2f 0 2024-05-09T06:30:20.229 INFO:tasks.workunit.client.1.smithi106.stdout:8/146: creat d3/d5/d7/f37 x:0 0 0 2024-05-09T06:30:20.229 INFO:tasks.workunit.client.1.smithi106.stdout:8/147: chown d3/d5/f12 409825754 1 2024-05-09T06:30:20.230 INFO:tasks.workunit.client.1.smithi106.stdout:1/180: link d4/d5/d9/f11 d4/d5/d9/d13/d2f/f42 0 2024-05-09T06:30:20.233 INFO:tasks.workunit.client.1.smithi106.stdout:8/148: symlink d3/d5/l38 0 2024-05-09T06:30:20.234 INFO:tasks.workunit.client.1.smithi106.stdout:8/149: write d3/d5/d13/f14 [4804204,130294] 0 2024-05-09T06:30:20.234 INFO:tasks.workunit.client.1.smithi106.stdout:8/150: readlink d3/d5/l38 0 2024-05-09T06:30:20.236 INFO:tasks.workunit.client.1.smithi106.stdout:1/181: creat d4/d37/f43 x:0 0 0 2024-05-09T06:30:20.236 INFO:tasks.workunit.client.1.smithi106.stdout:1/182: creat d4/d37/d3d/f44 x:0 0 0 2024-05-09T06:30:20.236 INFO:tasks.workunit.client.1.smithi106.stdout:1/183: creat d4/f45 x:0 0 0 2024-05-09T06:30:20.236 INFO:tasks.workunit.client.1.smithi106.stdout:9/149: dread d4/d6/f13 [0,4194304] 0 2024-05-09T06:30:20.255 INFO:tasks.workunit.client.1.smithi106.stdout:1/184: mknod d4/d5/d9/d13/c46 0 2024-05-09T06:30:20.255 INFO:tasks.workunit.client.1.smithi106.stdout:1/185: chown d4 44975821 1 2024-05-09T06:30:20.261 INFO:tasks.workunit.client.1.smithi106.stdout:7/148: getdents d0/dc 0 2024-05-09T06:30:20.264 INFO:tasks.workunit.client.1.smithi106.stdout:4/159: write d7/f18 [2495247,58046] 0 2024-05-09T06:30:20.264 INFO:tasks.workunit.client.1.smithi106.stdout:4/160: dread - d7/f2e zero size 2024-05-09T06:30:20.268 INFO:tasks.workunit.client.1.smithi106.stdout:9/150: rename d4/d6/f7 to d4/f25 0 2024-05-09T06:30:20.270 INFO:tasks.workunit.client.1.smithi106.stdout:0/173: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:20.275 INFO:tasks.workunit.client.1.smithi106.stdout:6/182: dread d0/d6/fe [0,4194304] 0 2024-05-09T06:30:20.277 INFO:tasks.workunit.client.1.smithi106.stdout:8/151: dwrite d3/f6 [0,4194304] 0 2024-05-09T06:30:20.277 INFO:tasks.workunit.client.1.smithi106.stdout:2/178: dwrite d2/d5/db/d1d/f36 [0,4194304] 0 2024-05-09T06:30:20.279 INFO:tasks.workunit.client.1.smithi106.stdout:3/186: dwrite d5/d1c/d24/f35 [0,4194304] 0 2024-05-09T06:30:20.281 INFO:tasks.workunit.client.1.smithi106.stdout:5/202: dwrite d8/d1c/f2c [0,4194304] 0 2024-05-09T06:30:20.295 INFO:tasks.workunit.client.1.smithi106.stdout:7/149: dwrite d0/f9 [0,4194304] 0 2024-05-09T06:30:20.295 INFO:tasks.workunit.client.1.smithi106.stdout:7/150: stat d0/dc/c17 0 2024-05-09T06:30:20.296 INFO:tasks.workunit.client.1.smithi106.stdout:6/183: dwrite d0/d6/d8/f14 [4194304,4194304] 0 2024-05-09T06:30:20.311 INFO:tasks.workunit.client.1.smithi106.stdout:1/186: creat d4/d5/d9/d1d/f47 x:0 0 0 2024-05-09T06:30:20.317 INFO:tasks.workunit.client.1.smithi106.stdout:9/151: creat d4/d6/d23/d12/f26 x:0 0 0 2024-05-09T06:30:20.317 INFO:tasks.workunit.client.1.smithi106.stdout:9/152: truncate d4/d6/d23/d12/f1e 1070017 0 2024-05-09T06:30:20.317 INFO:tasks.workunit.client.1.smithi106.stdout:9/153: dread - d4/d6/d23/d12/f26 zero size 2024-05-09T06:30:20.319 INFO:tasks.workunit.client.1.smithi106.stdout:8/152: symlink d3/d5/d7/d15/d16/l39 0 2024-05-09T06:30:20.320 INFO:tasks.workunit.client.1.smithi106.stdout:8/153: chown d3/c1f 135213338 1 2024-05-09T06:30:20.326 INFO:tasks.workunit.client.1.smithi106.stdout:2/179: mknod d2/d5/db/c3c 0 2024-05-09T06:30:20.334 INFO:tasks.workunit.client.1.smithi106.stdout:3/187: link d5/fb d5/d12/f3a 0 2024-05-09T06:30:20.342 INFO:tasks.workunit.client.1.smithi106.stdout:7/151: creat d0/dc/f31 x:0 0 0 2024-05-09T06:30:20.349 INFO:tasks.workunit.client.1.smithi106.stdout:3/188: dwrite f2 [0,4194304] 0 2024-05-09T06:30:20.352 INFO:tasks.workunit.client.1.smithi106.stdout:6/184: mkdir d0/d6/d8/d27/d3b 0 2024-05-09T06:30:20.353 INFO:tasks.workunit.client.1.smithi106.stdout:1/187: mknod d4/d5/d9/c48 0 2024-05-09T06:30:20.355 INFO:tasks.workunit.client.1.smithi106.stdout:9/154: creat d4/d6/d23/d16/f27 x:0 0 0 2024-05-09T06:30:20.356 INFO:tasks.workunit.client.1.smithi106.stdout:8/154: unlink d3/d5/c22 0 2024-05-09T06:30:20.356 INFO:tasks.workunit.client.1.smithi106.stdout:8/155: chown d3/c1e 2017 1 2024-05-09T06:30:20.357 INFO:tasks.workunit.client.1.smithi106.stdout:2/180: creat d2/d5/db/d1d/f3d x:0 0 0 2024-05-09T06:30:20.358 INFO:tasks.workunit.client.1.smithi106.stdout:5/203: getdents d8/d1c 0 2024-05-09T06:30:20.358 INFO:tasks.workunit.client.1.smithi106.stdout:6/185: dread d0/d6/fe [0,4194304] 0 2024-05-09T06:30:20.360 INFO:tasks.workunit.client.1.smithi106.stdout:7/152: creat d0/d2c/d30/f32 x:0 0 0 2024-05-09T06:30:20.360 INFO:tasks.workunit.client.1.smithi106.stdout:7/153: truncate d0/dc/f19 946818 0 2024-05-09T06:30:20.362 INFO:tasks.workunit.client.1.smithi106.stdout:3/189: rename d5/f17 to d5/f3b 0 2024-05-09T06:30:20.366 INFO:tasks.workunit.client.1.smithi106.stdout:1/188: symlink d4/d37/l49 0 2024-05-09T06:30:20.366 INFO:tasks.workunit.client.1.smithi106.stdout:1/189: truncate d4/d5/f21 1101520 0 2024-05-09T06:30:20.366 INFO:tasks.workunit.client.1.smithi106.stdout:5/204: write d8/d1c/f2c [270915,112586] 0 2024-05-09T06:30:20.367 INFO:tasks.workunit.client.1.smithi106.stdout:1/190: dread d4/d5/d9/d13/f2b [0,4194304] 0 2024-05-09T06:30:20.367 INFO:tasks.workunit.client.1.smithi106.stdout:9/155: creat d4/f28 x:0 0 0 2024-05-09T06:30:20.368 INFO:tasks.workunit.client.1.smithi106.stdout:9/156: chown d4/d6/ff 169302264 1 2024-05-09T06:30:20.369 INFO:tasks.workunit.client.1.smithi106.stdout:8/156: mkdir d3/d5/d13/d3a 0 2024-05-09T06:30:20.371 INFO:tasks.workunit.client.1.smithi106.stdout:2/181: link d2/d5/c12 d2/d5/db/d1d/c3e 0 2024-05-09T06:30:20.371 INFO:tasks.workunit.client.1.smithi106.stdout:2/182: stat d2/d5 0 2024-05-09T06:30:20.372 INFO:tasks.workunit.client.1.smithi106.stdout:6/186: link d0/d6/d8/d27/f3a d0/d6/d8/f3c 0 2024-05-09T06:30:20.372 INFO:tasks.workunit.client.1.smithi106.stdout:6/187: chown d0/d6/d8/c1a 5853243 1 2024-05-09T06:30:20.375 INFO:tasks.workunit.client.1.smithi106.stdout:7/154: symlink d0/l33 0 2024-05-09T06:30:20.375 INFO:tasks.workunit.client.1.smithi106.stdout:7/155: truncate d0/dc/f14 832877 0 2024-05-09T06:30:20.376 INFO:tasks.workunit.client.1.smithi106.stdout:2/183: dread f0 [0,4194304] 0 2024-05-09T06:30:20.378 INFO:tasks.workunit.client.1.smithi106.stdout:1/191: truncate d4/f1a 3926654 0 2024-05-09T06:30:20.379 INFO:tasks.workunit.client.1.smithi106.stdout:9/157: mknod d4/c29 0 2024-05-09T06:30:20.383 INFO:tasks.workunit.client.1.smithi106.stdout:6/188: mkdir d0/d17/d3d 0 2024-05-09T06:30:20.386 INFO:tasks.workunit.client.1.smithi106.stdout:7/156: mkdir d0/d34 0 2024-05-09T06:30:20.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/161: truncate d7/f18 3668384 0 2024-05-09T06:30:20.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/162: stat d7/d10/f1d 0 2024-05-09T06:30:20.391 INFO:tasks.workunit.client.1.smithi106.stdout:1/192: mkdir d4/d37/d4a 0 2024-05-09T06:30:20.396 INFO:tasks.workunit.client.1.smithi106.stdout:6/189: mkdir d0/d6/d8/d27/d3e 0 2024-05-09T06:30:20.401 INFO:tasks.workunit.client.1.smithi106.stdout:1/193: link d4/d5/f21 d4/d5/d9/f4b 0 2024-05-09T06:30:20.403 INFO:tasks.workunit.client.1.smithi106.stdout:5/205: rmdir d8/d1c/d28/d35 0 2024-05-09T06:30:20.404 INFO:tasks.workunit.client.1.smithi106.stdout:4/163: dwrite d7/fd [4194304,4194304] 0 2024-05-09T06:30:20.405 INFO:tasks.workunit.client.1.smithi106.stdout:9/158: dwrite d4/d6/d23/f21 [0,4194304] 0 2024-05-09T06:30:20.405 INFO:tasks.workunit.client.1.smithi106.stdout:1/194: symlink d4/d5/d9/l4c 0 2024-05-09T06:30:20.405 INFO:tasks.workunit.client.1.smithi106.stdout:1/195: write d4/d5/f21 [1125456,8073] 0 2024-05-09T06:30:20.407 INFO:tasks.workunit.client.1.smithi106.stdout:6/190: write d0/f19 [3550611,5970] 0 2024-05-09T06:30:20.421 INFO:tasks.workunit.client.1.smithi106.stdout:5/206: dwrite d8/f18 [0,4194304] 0 2024-05-09T06:30:20.460 INFO:tasks.workunit.client.1.smithi106.stdout:4/164: unlink d7/fd 0 2024-05-09T06:30:20.465 INFO:tasks.workunit.client.1.smithi106.stdout:1/196: symlink d4/d5/d9/l4d 0 2024-05-09T06:30:20.465 INFO:tasks.workunit.client.1.smithi106.stdout:1/197: creat d4/d5/d9/d1d/f4e x:0 0 0 2024-05-09T06:30:20.467 INFO:tasks.workunit.client.1.smithi106.stdout:5/207: mknod d8/d1c/c38 0 2024-05-09T06:30:20.470 INFO:tasks.workunit.client.1.smithi106.stdout:9/159: rename d4/d6/d23/d12 to d4/d6/d1b/d2a 0 2024-05-09T06:30:20.471 INFO:tasks.workunit.client.1.smithi106.stdout:9/160: fsync d4/d6/d1b/d2a/f26 0 2024-05-09T06:30:20.472 INFO:tasks.workunit.client.1.smithi106.stdout:6/191: rename d0/d6/l4 to d0/d6/d8/d27/d3e/l3f 0 2024-05-09T06:30:20.472 INFO:tasks.workunit.client.1.smithi106.stdout:6/192: write d0/d6/fe [2201859,112737] 0 2024-05-09T06:30:20.472 INFO:tasks.workunit.client.1.smithi106.stdout:6/193: chown d0/d6/d8/d27/d3e/l3f 22198726 1 2024-05-09T06:30:20.472 INFO:tasks.workunit.client.1.smithi106.stdout:6/194: chown d0/d6/d8/c1a 680831637 1 2024-05-09T06:30:20.473 INFO:tasks.workunit.client.1.smithi106.stdout:6/195: fdatasync d0/d17/f25 0 2024-05-09T06:30:20.473 INFO:tasks.workunit.client.1.smithi106.stdout:6/196: chown d0/d6/f28 11 1 2024-05-09T06:30:20.474 INFO:tasks.workunit.client.1.smithi106.stdout:9/161: rename d4/d6/d23/fd to d4/d6/f2b 0 2024-05-09T06:30:20.475 INFO:tasks.workunit.client.1.smithi106.stdout:6/197: getdents d0/d17/d21 0 2024-05-09T06:30:20.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/198: dread - d0/d6/d8/f1d zero size 2024-05-09T06:30:20.477 INFO:tasks.workunit.client.1.smithi106.stdout:9/162: symlink d4/d6/d23/d16/l2c 0 2024-05-09T06:30:20.477 INFO:tasks.workunit.client.1.smithi106.stdout:9/163: fdatasync d4/d6/d23/d16/f24 0 2024-05-09T06:30:20.479 INFO:tasks.workunit.client.1.smithi106.stdout:6/199: unlink d0/d6/d8/ff 0 2024-05-09T06:30:20.481 INFO:tasks.workunit.client.1.smithi106.stdout:9/164: creat d4/d6/d23/f2d x:0 0 0 2024-05-09T06:30:20.482 INFO:tasks.workunit.client.1.smithi106.stdout:6/200: mkdir d0/d6/d40 0 2024-05-09T06:30:20.483 INFO:tasks.workunit.client.1.smithi106.stdout:6/201: fdatasync d0/d17/f36 0 2024-05-09T06:30:20.484 INFO:tasks.workunit.client.1.smithi106.stdout:9/165: creat d4/d6/f2e x:0 0 0 2024-05-09T06:30:20.484 INFO:tasks.workunit.client.1.smithi106.stdout:9/166: chown d4/d6/d23/d16/f27 13059 1 2024-05-09T06:30:20.484 INFO:tasks.workunit.client.1.smithi106.stdout:9/167: dread - d4/d6/d23/d16/f27 zero size 2024-05-09T06:30:20.484 INFO:tasks.workunit.client.1.smithi106.stdout:7/157: rmdir d0/dc 39 2024-05-09T06:30:20.490 INFO:tasks.workunit.client.1.smithi106.stdout:9/168: dread d4/d6/d1b/d2a/f1e [0,4194304] 0 2024-05-09T06:30:20.498 INFO:tasks.workunit.client.1.smithi106.stdout:3/190: fsync d5/f3b 0 2024-05-09T06:30:20.499 INFO:tasks.workunit.client.1.smithi106.stdout:3/191: mknod d5/d1c/d21/d32/c3c 0 2024-05-09T06:30:20.500 INFO:tasks.workunit.client.1.smithi106.stdout:3/192: creat d5/f3d x:0 0 0 2024-05-09T06:30:20.501 INFO:tasks.workunit.client.1.smithi106.stdout:3/193: mknod d5/d12/c3e 0 2024-05-09T06:30:20.501 INFO:tasks.workunit.client.1.smithi106.stdout:3/194: write d5/d12/f13 [4956996,126641] 0 2024-05-09T06:30:20.502 INFO:tasks.workunit.client.1.smithi106.stdout:6/202: dwrite d0/d6/d8/d27/f3a [0,4194304] 0 2024-05-09T06:30:20.502 INFO:tasks.workunit.client.1.smithi106.stdout:3/195: mkdir d5/d3f 0 2024-05-09T06:30:20.506 INFO:tasks.workunit.client.1.smithi106.stdout:6/203: creat d0/d6/d40/f41 x:0 0 0 2024-05-09T06:30:20.506 INFO:tasks.workunit.client.1.smithi106.stdout:7/158: dwrite d0/f9 [0,4194304] 0 2024-05-09T06:30:20.510 INFO:tasks.workunit.client.1.smithi106.stdout:6/204: mknod d0/d6/d8/c42 0 2024-05-09T06:30:20.510 INFO:tasks.workunit.client.1.smithi106.stdout:6/205: stat d0/d6/d8/f14 0 2024-05-09T06:30:20.510 INFO:tasks.workunit.client.1.smithi106.stdout:6/206: read - d0/d6/f37 zero size 2024-05-09T06:30:20.514 INFO:tasks.workunit.client.1.smithi106.stdout:2/184: mkdir d2/d3f 0 2024-05-09T06:30:20.515 INFO:tasks.workunit.client.1.smithi106.stdout:3/196: dwrite d5/d1c/f2b [0,4194304] 0 2024-05-09T06:30:20.517 INFO:tasks.workunit.client.1.smithi106.stdout:7/159: rmdir d0 39 2024-05-09T06:30:20.517 INFO:tasks.workunit.client.1.smithi106.stdout:4/165: read d7/f18 [2238731,122834] 0 2024-05-09T06:30:20.519 INFO:tasks.workunit.client.1.smithi106.stdout:4/166: mknod d7/d10/d1a/c30 0 2024-05-09T06:30:20.523 INFO:tasks.workunit.client.1.smithi106.stdout:2/185: dread d2/f10 [0,4194304] 0 2024-05-09T06:30:20.523 INFO:tasks.workunit.client.1.smithi106.stdout:2/186: write d2/d5/f13 [928228,14867] 0 2024-05-09T06:30:20.524 INFO:tasks.workunit.client.1.smithi106.stdout:3/197: write d5/d12/f34 [4050640,126338] 0 2024-05-09T06:30:20.525 INFO:tasks.workunit.client.1.smithi106.stdout:3/198: truncate d5/d12/f19 1211273 0 2024-05-09T06:30:20.525 INFO:tasks.workunit.client.1.smithi106.stdout:2/187: creat d2/d5/f40 x:0 0 0 2024-05-09T06:30:20.527 INFO:tasks.workunit.client.1.smithi106.stdout:7/160: write d0/f5 [2339975,98142] 0 2024-05-09T06:30:20.527 INFO:tasks.workunit.client.1.smithi106.stdout:7/161: dread - d0/d2c/d30/f32 zero size 2024-05-09T06:30:20.527 INFO:tasks.workunit.client.1.smithi106.stdout:2/188: mkdir d2/d5/db/d15/d41 0 2024-05-09T06:30:20.527 INFO:tasks.workunit.client.1.smithi106.stdout:2/189: truncate d2/d5/db/d1d/f30 128419 0 2024-05-09T06:30:20.527 INFO:tasks.workunit.client.1.smithi106.stdout:2/190: creat d2/d7/d2c/f42 x:0 0 0 2024-05-09T06:30:20.529 INFO:tasks.workunit.client.1.smithi106.stdout:4/167: dread d7/d10/d1a/f1e [0,4194304] 0 2024-05-09T06:30:20.529 INFO:tasks.workunit.client.1.smithi106.stdout:2/191: symlink d2/d5/l43 0 2024-05-09T06:30:20.529 INFO:tasks.workunit.client.1.smithi106.stdout:4/168: chown d7 672527 1 2024-05-09T06:30:20.529 INFO:tasks.workunit.client.1.smithi106.stdout:2/192: readlink d2/d5/db/l16 0 2024-05-09T06:30:20.535 INFO:tasks.workunit.client.1.smithi106.stdout:2/193: rename d2/d5/db/l16 to d2/d5/l44 0 2024-05-09T06:30:20.535 INFO:tasks.workunit.client.1.smithi106.stdout:2/194: chown d2/d5/c12 13624846 1 2024-05-09T06:30:20.535 INFO:tasks.workunit.client.1.smithi106.stdout:3/199: write d5/d1c/f2b [390993,100006] 0 2024-05-09T06:30:20.536 INFO:tasks.workunit.client.1.smithi106.stdout:7/162: write d0/fe [302794,85927] 0 2024-05-09T06:30:20.537 INFO:tasks.workunit.client.1.smithi106.stdout:7/163: dread d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:20.537 INFO:tasks.workunit.client.1.smithi106.stdout:3/200: link d5/ld d5/d1c/d21/l40 0 2024-05-09T06:30:20.537 INFO:tasks.workunit.client.1.smithi106.stdout:3/201: stat d5/d12/d26/l20 0 2024-05-09T06:30:20.538 INFO:tasks.workunit.client.1.smithi106.stdout:7/164: symlink d0/d2c/d30/l35 0 2024-05-09T06:30:20.538 INFO:tasks.workunit.client.1.smithi106.stdout:7/165: chown d0/dc/f31 4242749 1 2024-05-09T06:30:20.538 INFO:tasks.workunit.client.1.smithi106.stdout:0/174: sync 2024-05-09T06:30:20.538 INFO:tasks.workunit.client.1.smithi106.stdout:0/175: chown d1/d11/d23/f1a 3 1 2024-05-09T06:30:20.538 INFO:tasks.workunit.client.1.smithi106.stdout:7/166: rmdir d0/dc/d1a 39 2024-05-09T06:30:20.546 INFO:tasks.workunit.client.1.smithi106.stdout:9/169: rmdir d4/d6 39 2024-05-09T06:30:20.546 INFO:tasks.workunit.client.1.smithi106.stdout:9/170: chown d4/d6/fa 64012 1 2024-05-09T06:30:20.549 INFO:tasks.workunit.client.1.smithi106.stdout:3/202: dread d5/f3b [0,4194304] 0 2024-05-09T06:30:20.549 INFO:tasks.workunit.client.1.smithi106.stdout:3/203: chown f2 14317801 1 2024-05-09T06:30:20.549 INFO:tasks.workunit.client.1.smithi106.stdout:3/204: chown d5/d12/f13 7528562 1 2024-05-09T06:30:20.552 INFO:tasks.workunit.client.1.smithi106.stdout:9/171: mkdir d4/d6/d23/d2f 0 2024-05-09T06:30:20.552 INFO:tasks.workunit.client.1.smithi106.stdout:9/172: fdatasync d4/d6/d1b/d2a/f20 0 2024-05-09T06:30:20.555 INFO:tasks.workunit.client.1.smithi106.stdout:8/157: sync 2024-05-09T06:30:20.557 INFO:tasks.workunit.client.1.smithi106.stdout:3/205: dread f1 [4194304,4194304] 0 2024-05-09T06:30:20.557 INFO:tasks.workunit.client.1.smithi106.stdout:3/206: fsync d5/d12/f19 0 2024-05-09T06:30:20.557 INFO:tasks.workunit.client.1.smithi106.stdout:8/158: truncate d3/f6 634185 0 2024-05-09T06:30:20.557 INFO:tasks.workunit.client.1.smithi106.stdout:8/159: write d3/d5/d13/f36 [797245,106183] 0 2024-05-09T06:30:20.557 INFO:tasks.workunit.client.1.smithi106.stdout:8/160: truncate d3/d5/d13/f36 1558129 0 2024-05-09T06:30:20.558 INFO:tasks.workunit.client.1.smithi106.stdout:0/176: dwrite d1/f5 [0,4194304] 0 2024-05-09T06:30:20.558 INFO:tasks.workunit.client.1.smithi106.stdout:0/177: fdatasync d1/f28 0 2024-05-09T06:30:20.558 INFO:tasks.workunit.client.1.smithi106.stdout:3/207: rmdir d5/d1c/d24 39 2024-05-09T06:30:20.560 INFO:tasks.workunit.client.1.smithi106.stdout:8/161: creat d3/d5/d7/d15/d16/f3b x:0 0 0 2024-05-09T06:30:20.560 INFO:tasks.workunit.client.1.smithi106.stdout:8/162: creat d3/d5/f3c x:0 0 0 2024-05-09T06:30:20.560 INFO:tasks.workunit.client.1.smithi106.stdout:8/163: write d3/d5/d7/f20 [3865577,126524] 0 2024-05-09T06:30:20.561 INFO:tasks.workunit.client.1.smithi106.stdout:8/164: chown d3/d5/f3c 377542 1 2024-05-09T06:30:20.562 INFO:tasks.workunit.client.1.smithi106.stdout:3/208: creat d5/d1c/d21/d32/f41 x:0 0 0 2024-05-09T06:30:20.569 INFO:tasks.workunit.client.1.smithi106.stdout:7/167: rename d0/d2c to d0/dc/d1a/d36 0 2024-05-09T06:30:20.570 INFO:tasks.workunit.client.1.smithi106.stdout:7/168: chown d0/dc/l2e 25046 1 2024-05-09T06:30:20.570 INFO:tasks.workunit.client.1.smithi106.stdout:0/178: dwrite d1/f28 [0,4194304] 0 2024-05-09T06:30:20.573 INFO:tasks.workunit.client.1.smithi106.stdout:9/173: getdents d4/d6/d23 0 2024-05-09T06:30:20.574 INFO:tasks.workunit.client.1.smithi106.stdout:0/179: symlink d1/d11/d23/l3a 0 2024-05-09T06:30:20.578 INFO:tasks.workunit.client.1.smithi106.stdout:7/169: read d0/f9 [2993044,129190] 0 2024-05-09T06:30:20.578 INFO:tasks.workunit.client.1.smithi106.stdout:7/170: chown d0/dc/d1a/d36/l1b 10335260 1 2024-05-09T06:30:20.593 INFO:tasks.workunit.client.1.smithi106.stdout:9/174: creat d4/d6/d23/d2f/f30 x:0 0 0 2024-05-09T06:30:20.595 INFO:tasks.workunit.client.1.smithi106.stdout:0/180: rename d1/l10 to d1/d11/d23/d13/d2c/l3b 0 2024-05-09T06:30:20.596 INFO:tasks.workunit.client.1.smithi106.stdout:0/181: write d1/f7 [4384795,73129] 0 2024-05-09T06:30:20.597 INFO:tasks.workunit.client.1.smithi106.stdout:7/171: symlink d0/dc/d1a/d36/l37 0 2024-05-09T06:30:20.597 INFO:tasks.workunit.client.1.smithi106.stdout:8/165: dwrite d3/d5/d13/f36 [0,4194304] 0 2024-05-09T06:30:20.601 INFO:tasks.workunit.client.1.smithi106.stdout:9/175: dread d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:20.603 INFO:tasks.workunit.client.1.smithi106.stdout:8/166: mknod d3/d5/d13/c3d 0 2024-05-09T06:30:20.605 INFO:tasks.workunit.client.1.smithi106.stdout:9/176: mkdir d4/d6/d23/d2f/d31 0 2024-05-09T06:30:20.606 INFO:tasks.workunit.client.1.smithi106.stdout:0/182: rmdir d1/d11/d23/d13 39 2024-05-09T06:30:20.606 INFO:tasks.workunit.client.1.smithi106.stdout:0/183: readlink d1/d11/l1c 0 2024-05-09T06:30:20.606 INFO:tasks.workunit.client.1.smithi106.stdout:7/172: write d0/dc/d1a/d36/d1e/f21 [295070,104042] 0 2024-05-09T06:30:20.606 INFO:tasks.workunit.client.1.smithi106.stdout:7/173: fsync d0/fe 0 2024-05-09T06:30:20.607 INFO:tasks.workunit.client.1.smithi106.stdout:0/184: rename d1/f28 to d1/d11/f3c 0 2024-05-09T06:30:20.610 INFO:tasks.workunit.client.1.smithi106.stdout:7/174: unlink d0/dc/f2b 0 2024-05-09T06:30:20.610 INFO:tasks.workunit.client.1.smithi106.stdout:7/175: stat d0/dc/f2d 0 2024-05-09T06:30:20.610 INFO:tasks.workunit.client.1.smithi106.stdout:8/167: dread d3/d5/d13/f36 [0,4194304] 0 2024-05-09T06:30:20.611 INFO:tasks.workunit.client.1.smithi106.stdout:0/185: mkdir d1/d11/d23/d13/d2c/d3d 0 2024-05-09T06:30:20.612 INFO:tasks.workunit.client.1.smithi106.stdout:0/186: chown d1/d11/d23/d13/l17 2642 1 2024-05-09T06:30:20.612 INFO:tasks.workunit.client.1.smithi106.stdout:0/187: dread - d1/d11/d23/d13/d2c/f2f zero size 2024-05-09T06:30:20.612 INFO:tasks.workunit.client.1.smithi106.stdout:0/188: rename d1/d11 to d1/d11/d3e 22 2024-05-09T06:30:20.612 INFO:tasks.workunit.client.1.smithi106.stdout:0/189: chown d1/d11/d23/f2a 8887 1 2024-05-09T06:30:20.612 INFO:tasks.workunit.client.1.smithi106.stdout:1/198: sync 2024-05-09T06:30:20.612 INFO:tasks.workunit.client.1.smithi106.stdout:7/176: symlink d0/dc/d1a/d36/l38 0 2024-05-09T06:30:20.614 INFO:tasks.workunit.client.1.smithi106.stdout:8/168: unlink d3/d5/d7/c31 0 2024-05-09T06:30:20.615 INFO:tasks.workunit.client.1.smithi106.stdout:9/177: dread d4/d6/d23/f21 [0,4194304] 0 2024-05-09T06:30:20.615 INFO:tasks.workunit.client.1.smithi106.stdout:9/178: stat d4 0 2024-05-09T06:30:20.619 INFO:tasks.workunit.client.1.smithi106.stdout:1/199: mknod d4/d5/c4f 0 2024-05-09T06:30:20.620 INFO:tasks.workunit.client.1.smithi106.stdout:7/177: mknod d0/dc/d1a/d36/d1e/c39 0 2024-05-09T06:30:20.620 INFO:tasks.workunit.client.1.smithi106.stdout:1/200: truncate d4/f45 376435 0 2024-05-09T06:30:20.620 INFO:tasks.workunit.client.1.smithi106.stdout:1/201: chown d4/d5/d9/d13 8 1 2024-05-09T06:30:20.620 INFO:tasks.workunit.client.1.smithi106.stdout:7/178: readlink d0/l7 0 2024-05-09T06:30:20.620 INFO:tasks.workunit.client.1.smithi106.stdout:1/202: chown d4/f15 1268 1 2024-05-09T06:30:20.621 INFO:tasks.workunit.client.1.smithi106.stdout:0/190: write d1/d11/d23/f27 [2450045,64335] 0 2024-05-09T06:30:20.621 INFO:tasks.workunit.client.1.smithi106.stdout:8/169: mkdir d3/d5/d7/d15/d3e 0 2024-05-09T06:30:20.621 INFO:tasks.workunit.client.1.smithi106.stdout:8/170: truncate d3/d5/d7/d15/d16/f3b 568263 0 2024-05-09T06:30:20.622 INFO:tasks.workunit.client.1.smithi106.stdout:1/203: link d4/d5/d9/f27 d4/d5/f50 0 2024-05-09T06:30:20.626 INFO:tasks.workunit.client.1.smithi106.stdout:1/204: rename d4/d5/d9/l4d to d4/d37/d4a/l51 0 2024-05-09T06:30:20.626 INFO:tasks.workunit.client.1.smithi106.stdout:1/205: fsync d4/d5/f3a 0 2024-05-09T06:30:20.627 INFO:tasks.workunit.client.1.smithi106.stdout:0/191: fsync d1/d11/d23/f27 0 2024-05-09T06:30:20.627 INFO:tasks.workunit.client.1.smithi106.stdout:0/192: write d1/d11/d23/d13/f15 [552027,114482] 0 2024-05-09T06:30:20.627 INFO:tasks.workunit.client.1.smithi106.stdout:0/193: truncate d1/d11/d23/d13/d2c/f2f 658549 0 2024-05-09T06:30:20.627 INFO:tasks.workunit.client.1.smithi106.stdout:1/206: rename d4/d5/d9/d13/l26 to d4/d37/d4a/l52 0 2024-05-09T06:30:20.628 INFO:tasks.workunit.client.1.smithi106.stdout:1/207: fdatasync d4/f1f 0 2024-05-09T06:30:20.628 INFO:tasks.workunit.client.1.smithi106.stdout:1/208: stat d4/d5/c4f 0 2024-05-09T06:30:20.628 INFO:tasks.workunit.client.1.smithi106.stdout:1/209: creat d4/d5/d9/f53 x:0 0 0 2024-05-09T06:30:20.628 INFO:tasks.workunit.client.1.smithi106.stdout:0/194: getdents d1/d11/d23/d13/d2c 0 2024-05-09T06:30:20.630 INFO:tasks.workunit.client.1.smithi106.stdout:0/195: creat d1/d11/d23/d13/f3f x:0 0 0 2024-05-09T06:30:20.630 INFO:tasks.workunit.client.1.smithi106.stdout:5/208: sync 2024-05-09T06:30:20.630 INFO:tasks.workunit.client.1.smithi106.stdout:6/207: sync 2024-05-09T06:30:20.630 INFO:tasks.workunit.client.1.smithi106.stdout:4/169: sync 2024-05-09T06:30:20.631 INFO:tasks.workunit.client.1.smithi106.stdout:4/170: chown d7/f11 362 1 2024-05-09T06:30:20.632 INFO:tasks.workunit.client.1.smithi106.stdout:9/179: dwrite d4/d6/d1b/d2a/f20 [0,4194304] 0 2024-05-09T06:30:20.632 INFO:tasks.workunit.client.1.smithi106.stdout:0/196: unlink d1/d11/d23/d13/l17 0 2024-05-09T06:30:20.633 INFO:tasks.workunit.client.1.smithi106.stdout:5/209: rename d8/f19 to d8/d33/f39 0 2024-05-09T06:30:20.634 INFO:tasks.workunit.client.1.smithi106.stdout:4/171: mknod d7/d10/d12/c31 0 2024-05-09T06:30:20.636 INFO:tasks.workunit.client.1.smithi106.stdout:0/197: mknod d1/c40 0 2024-05-09T06:30:20.636 INFO:tasks.workunit.client.1.smithi106.stdout:0/198: truncate d1/d11/d23/d13/f3f 914130 0 2024-05-09T06:30:20.637 INFO:tasks.workunit.client.1.smithi106.stdout:6/208: rmdir d0/d17/d34 39 2024-05-09T06:30:20.639 INFO:tasks.workunit.client.1.smithi106.stdout:0/199: creat d1/d11/d23/d13/d2c/d3d/f41 x:0 0 0 2024-05-09T06:30:20.640 INFO:tasks.workunit.client.1.smithi106.stdout:6/209: mknod d0/c43 0 2024-05-09T06:30:20.641 INFO:tasks.workunit.client.1.smithi106.stdout:6/210: creat d0/d17/d34/f44 x:0 0 0 2024-05-09T06:30:20.642 INFO:tasks.workunit.client.1.smithi106.stdout:6/211: chown d0/d17/f1e 340583 1 2024-05-09T06:30:20.642 INFO:tasks.workunit.client.1.smithi106.stdout:6/212: write d0/f19 [591981,72671] 0 2024-05-09T06:30:20.644 INFO:tasks.workunit.client.1.smithi106.stdout:4/172: write d7/f9 [1737550,1726] 0 2024-05-09T06:30:20.645 INFO:tasks.workunit.client.1.smithi106.stdout:4/173: creat d7/d10/d12/d2f/f32 x:0 0 0 2024-05-09T06:30:20.662 INFO:tasks.workunit.client.1.smithi106.stdout:4/174: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:20.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/175: write d7/fb [1621801,85848] 0 2024-05-09T06:30:20.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/176: mknod d7/d10/c33 0 2024-05-09T06:30:20.677 INFO:tasks.workunit.client.1.smithi106.stdout:7/179: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:20.681 INFO:tasks.workunit.client.1.smithi106.stdout:7/180: dread d0/dc/f14 [0,4194304] 0 2024-05-09T06:30:20.682 INFO:tasks.workunit.client.1.smithi106.stdout:5/210: rmdir d8 39 2024-05-09T06:30:20.682 INFO:tasks.workunit.client.1.smithi106.stdout:5/211: write d8/f37 [73986,47267] 0 2024-05-09T06:30:20.683 INFO:tasks.workunit.client.1.smithi106.stdout:7/181: creat d0/dc/d1a/f3a x:0 0 0 2024-05-09T06:30:20.684 INFO:tasks.workunit.client.1.smithi106.stdout:5/212: mkdir d8/d33/d3a 0 2024-05-09T06:30:20.684 INFO:tasks.workunit.client.1.smithi106.stdout:5/213: truncate d8/d1c/f24 391917 0 2024-05-09T06:30:20.685 INFO:tasks.workunit.client.1.smithi106.stdout:7/182: unlink d0/dc/d1a/d36/l1f 0 2024-05-09T06:30:20.686 INFO:tasks.workunit.client.1.smithi106.stdout:5/214: creat d8/d33/f3b x:0 0 0 2024-05-09T06:30:20.687 INFO:tasks.workunit.client.1.smithi106.stdout:7/183: rmdir d0/d34 0 2024-05-09T06:30:20.688 INFO:tasks.workunit.client.1.smithi106.stdout:5/215: symlink d8/d1c/d28/d32/l3c 0 2024-05-09T06:30:20.689 INFO:tasks.workunit.client.1.smithi106.stdout:6/213: dwrite d0/d17/f29 [0,4194304] 0 2024-05-09T06:30:20.689 INFO:tasks.workunit.client.1.smithi106.stdout:6/214: creat d0/d17/d34/f45 x:0 0 0 2024-05-09T06:30:20.689 INFO:tasks.workunit.client.1.smithi106.stdout:9/180: dwrite d4/d6/d1b/d2a/f1e [0,4194304] 0 2024-05-09T06:30:20.691 INFO:tasks.workunit.client.1.smithi106.stdout:7/184: link d0/dc/d1a/d36/d30/f32 d0/dc/d1a/d36/d30/f3b 0 2024-05-09T06:30:20.691 INFO:tasks.workunit.client.1.smithi106.stdout:7/185: write d0/dc/f2d [762996,83593] 0 2024-05-09T06:30:20.691 INFO:tasks.workunit.client.1.smithi106.stdout:7/186: chown d0/dc/f14 78 1 2024-05-09T06:30:20.696 INFO:tasks.workunit.client.1.smithi106.stdout:4/177: truncate d7/fb 3466115 0 2024-05-09T06:30:20.702 INFO:tasks.workunit.client.1.smithi106.stdout:6/215: read d0/d17/f22 [198142,49828] 0 2024-05-09T06:30:20.706 INFO:tasks.workunit.client.1.smithi106.stdout:4/178: rename d7/d10/d12/l21 to d7/d28/l34 0 2024-05-09T06:30:20.707 INFO:tasks.workunit.client.1.smithi106.stdout:6/216: creat d0/d6/d8/f46 x:0 0 0 2024-05-09T06:30:20.707 INFO:tasks.workunit.client.1.smithi106.stdout:4/179: getdents d7/d28/d2a 0 2024-05-09T06:30:20.709 INFO:tasks.workunit.client.1.smithi106.stdout:6/217: mkdir d0/d6/d8/d27/d3e/d47 0 2024-05-09T06:30:20.709 INFO:tasks.workunit.client.1.smithi106.stdout:6/218: chown d0/d6/d8/f1d 452116305 1 2024-05-09T06:30:20.712 INFO:tasks.workunit.client.1.smithi106.stdout:5/216: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:30:20.715 INFO:tasks.workunit.client.1.smithi106.stdout:7/187: dwrite d0/dc/d1a/d36/d1e/f21 [0,4194304] 0 2024-05-09T06:30:20.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/217: getdents d8 0 2024-05-09T06:30:20.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/218: readlink l7 0 2024-05-09T06:30:20.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/219: read d8/fa [3204533,79406] 0 2024-05-09T06:30:20.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/220: read d8/fc [273272,29093] 0 2024-05-09T06:30:20.716 INFO:tasks.workunit.client.1.smithi106.stdout:5/221: mkdir d8/d33/d3d 0 2024-05-09T06:30:20.721 INFO:tasks.workunit.client.1.smithi106.stdout:9/181: dwrite d4/d6/d1b/d2a/f1e [0,4194304] 0 2024-05-09T06:30:20.721 INFO:tasks.workunit.client.1.smithi106.stdout:9/182: chown d4/d6/d1b/d2a/l17 3868624 1 2024-05-09T06:30:20.722 INFO:tasks.workunit.client.1.smithi106.stdout:5/222: mknod d8/d1c/d28/c3e 0 2024-05-09T06:30:20.725 INFO:tasks.workunit.client.1.smithi106.stdout:7/188: dread d0/f9 [0,4194304] 0 2024-05-09T06:30:20.727 INFO:tasks.workunit.client.1.smithi106.stdout:9/183: creat d4/d6/d23/d2f/d31/f32 x:0 0 0 2024-05-09T06:30:20.727 INFO:tasks.workunit.client.1.smithi106.stdout:9/184: truncate d4/d6/ff 1369876 0 2024-05-09T06:30:20.727 INFO:tasks.workunit.client.1.smithi106.stdout:4/180: dwrite d7/d28/f27 [0,4194304] 0 2024-05-09T06:30:20.728 INFO:tasks.workunit.client.1.smithi106.stdout:5/223: symlink d8/d33/d3a/l3f 0 2024-05-09T06:30:20.728 INFO:tasks.workunit.client.1.smithi106.stdout:5/224: readlink d8/l16 0 2024-05-09T06:30:20.729 INFO:tasks.workunit.client.1.smithi106.stdout:7/189: link d0/dc/d1a/d36/l1b d0/dc/d1a/d36/d30/l3c 0 2024-05-09T06:30:20.730 INFO:tasks.workunit.client.1.smithi106.stdout:9/185: getdents d4/d6/d1b 0 2024-05-09T06:30:20.730 INFO:tasks.workunit.client.1.smithi106.stdout:6/219: dwrite d0/d6/d40/f41 [0,4194304] 0 2024-05-09T06:30:20.733 INFO:tasks.workunit.client.1.smithi106.stdout:9/186: dread d4/d6/f15 [4194304,4194304] 0 2024-05-09T06:30:20.733 INFO:tasks.workunit.client.1.smithi106.stdout:4/181: mkdir d7/d10/d12/d2f/d35 0 2024-05-09T06:30:20.733 INFO:tasks.workunit.client.1.smithi106.stdout:2/195: sync 2024-05-09T06:30:20.733 INFO:tasks.workunit.client.1.smithi106.stdout:3/209: sync 2024-05-09T06:30:20.738 INFO:tasks.workunit.client.1.smithi106.stdout:4/182: symlink d7/d10/d12/d1c/l36 0 2024-05-09T06:30:20.741 INFO:tasks.workunit.client.1.smithi106.stdout:2/196: link d2/d5/db/d1d/f3d d2/d3f/f45 0 2024-05-09T06:30:20.743 INFO:tasks.workunit.client.1.smithi106.stdout:6/220: creat d0/d17/d21/f48 x:0 0 0 2024-05-09T06:30:20.745 INFO:tasks.workunit.client.1.smithi106.stdout:4/183: symlink d7/d10/d1a/l37 0 2024-05-09T06:30:20.746 INFO:tasks.workunit.client.1.smithi106.stdout:4/184: getdents d7/d10/d12/d2f/d35 0 2024-05-09T06:30:20.746 INFO:tasks.workunit.client.1.smithi106.stdout:5/225: dwrite d8/fc [0,4194304] 0 2024-05-09T06:30:20.747 INFO:tasks.workunit.client.1.smithi106.stdout:0/200: sync 2024-05-09T06:30:20.747 INFO:tasks.workunit.client.1.smithi106.stdout:8/171: sync 2024-05-09T06:30:20.747 INFO:tasks.workunit.client.1.smithi106.stdout:1/210: sync 2024-05-09T06:30:20.747 INFO:tasks.workunit.client.1.smithi106.stdout:9/187: dread d4/d6/f11 [4194304,4194304] 0 2024-05-09T06:30:20.748 INFO:tasks.workunit.client.1.smithi106.stdout:9/188: creat d4/d6/d23/d2f/d31/f33 x:0 0 0 2024-05-09T06:30:20.748 INFO:tasks.workunit.client.1.smithi106.stdout:9/189: truncate d4/d6/f2e 488121 0 2024-05-09T06:30:20.748 INFO:tasks.workunit.client.1.smithi106.stdout:6/221: symlink d0/d6/d8/d27/d3e/d47/l49 0 2024-05-09T06:30:20.748 INFO:tasks.workunit.client.1.smithi106.stdout:6/222: readlink d0/d17/d21/l31 0 2024-05-09T06:30:20.748 INFO:tasks.workunit.client.1.smithi106.stdout:6/223: read d0/d17/f1e [733025,70682] 0 2024-05-09T06:30:20.749 INFO:tasks.workunit.client.1.smithi106.stdout:6/224: truncate d0/d6/d40/f41 4211788 0 2024-05-09T06:30:20.750 INFO:tasks.workunit.client.1.smithi106.stdout:1/211: dread d4/d5/f21 [0,4194304] 0 2024-05-09T06:30:20.750 INFO:tasks.workunit.client.1.smithi106.stdout:1/212: chown d4/d5/d9/d13/f3e 0 1 2024-05-09T06:30:20.750 INFO:tasks.workunit.client.1.smithi106.stdout:4/185: symlink d7/d10/d12/d1c/l38 0 2024-05-09T06:30:20.752 INFO:tasks.workunit.client.1.smithi106.stdout:5/226: symlink d8/d1c/l40 0 2024-05-09T06:30:20.752 INFO:tasks.workunit.client.1.smithi106.stdout:5/227: dread - d8/f30 zero size 2024-05-09T06:30:20.752 INFO:tasks.workunit.client.1.smithi106.stdout:5/228: chown d8/d1c/f2c 61307 1 2024-05-09T06:30:20.752 INFO:tasks.workunit.client.1.smithi106.stdout:0/201: unlink d1/d11/l38 0 2024-05-09T06:30:20.754 INFO:tasks.workunit.client.1.smithi106.stdout:8/172: mknod d3/d5/c3f 0 2024-05-09T06:30:20.754 INFO:tasks.workunit.client.1.smithi106.stdout:8/173: creat d3/d5/d13/f40 x:0 0 0 2024-05-09T06:30:20.756 INFO:tasks.workunit.client.1.smithi106.stdout:9/190: creat d4/d6/f34 x:0 0 0 2024-05-09T06:30:20.757 INFO:tasks.workunit.client.1.smithi106.stdout:6/225: stat d0/d17/d3d 0 2024-05-09T06:30:20.760 INFO:tasks.workunit.client.1.smithi106.stdout:1/213: rename c3 to d4/d5/d9/d1d/c54 0 2024-05-09T06:30:20.763 INFO:tasks.workunit.client.1.smithi106.stdout:5/229: rename d8/d1c/f1f to d8/d1c/f41 0 2024-05-09T06:30:20.766 INFO:tasks.workunit.client.1.smithi106.stdout:6/226: mkdir d0/d6/d8/d4a 0 2024-05-09T06:30:20.766 INFO:tasks.workunit.client.1.smithi106.stdout:6/227: chown d0 5045197 1 2024-05-09T06:30:20.766 INFO:tasks.workunit.client.1.smithi106.stdout:0/202: rename d1/l18 to d1/d11/d23/d22/l42 0 2024-05-09T06:30:20.767 INFO:tasks.workunit.client.1.smithi106.stdout:1/214: creat d4/d37/d4a/f55 x:0 0 0 2024-05-09T06:30:20.769 INFO:tasks.workunit.client.1.smithi106.stdout:9/191: dread d4/d6/fa [0,4194304] 0 2024-05-09T06:30:20.769 INFO:tasks.workunit.client.1.smithi106.stdout:9/192: fsync d4/d6/f11 0 2024-05-09T06:30:20.769 INFO:tasks.workunit.client.1.smithi106.stdout:6/228: creat d0/d6/d8/d27/d3b/f4b x:0 0 0 2024-05-09T06:30:20.769 INFO:tasks.workunit.client.1.smithi106.stdout:1/215: dread d4/d5/d9/fc [0,4194304] 0 2024-05-09T06:30:20.770 INFO:tasks.workunit.client.1.smithi106.stdout:9/193: creat d4/d6/d23/d16/f35 x:0 0 0 2024-05-09T06:30:20.771 INFO:tasks.workunit.client.1.smithi106.stdout:9/194: chown d4/d6/f11 1 1 2024-05-09T06:30:20.771 INFO:tasks.workunit.client.1.smithi106.stdout:9/195: dread d4/d6/f2e [0,4194304] 0 2024-05-09T06:30:20.771 INFO:tasks.workunit.client.1.smithi106.stdout:9/196: rename c3 to d4/d6/d1b/c36 0 2024-05-09T06:30:20.772 INFO:tasks.workunit.client.1.smithi106.stdout:9/197: getdents d4/d6/d1b/d2a 0 2024-05-09T06:30:20.773 INFO:tasks.workunit.client.1.smithi106.stdout:5/230: write d8/fc [898070,104312] 0 2024-05-09T06:30:20.775 INFO:tasks.workunit.client.1.smithi106.stdout:5/231: creat d8/d33/d3a/f42 x:0 0 0 2024-05-09T06:30:20.776 INFO:tasks.workunit.client.1.smithi106.stdout:5/232: symlink d8/d33/l43 0 2024-05-09T06:30:20.777 INFO:tasks.workunit.client.1.smithi106.stdout:2/197: dwrite d2/d5/db/f32 [0,4194304] 0 2024-05-09T06:30:20.778 INFO:tasks.workunit.client.1.smithi106.stdout:6/229: dread d0/d6/d8/f3c [0,4194304] 0 2024-05-09T06:30:20.778 INFO:tasks.workunit.client.1.smithi106.stdout:7/190: dwrite d0/f29 [0,4194304] 0 2024-05-09T06:30:20.779 INFO:tasks.workunit.client.1.smithi106.stdout:4/186: dwrite f2 [0,4194304] 0 2024-05-09T06:30:20.780 INFO:tasks.workunit.client.1.smithi106.stdout:8/174: dwrite d3/d5/d13/f2e [0,4194304] 0 2024-05-09T06:30:20.781 INFO:tasks.workunit.client.1.smithi106.stdout:0/203: dread d1/f7 [0,4194304] 0 2024-05-09T06:30:20.781 INFO:tasks.workunit.client.1.smithi106.stdout:0/204: stat d1/f7 0 2024-05-09T06:30:20.781 INFO:tasks.workunit.client.1.smithi106.stdout:6/230: rename d0/d6/c35 to d0/d6/d40/c4c 0 2024-05-09T06:30:20.790 INFO:tasks.workunit.client.1.smithi106.stdout:4/187: rename d7/d10/d12/d2f to d7/d39 0 2024-05-09T06:30:20.790 INFO:tasks.workunit.client.1.smithi106.stdout:4/188: chown d7/f2e 59201 1 2024-05-09T06:30:20.793 INFO:tasks.workunit.client.1.smithi106.stdout:2/198: dread d2/d5/db/f1b [0,4194304] 0 2024-05-09T06:30:20.793 INFO:tasks.workunit.client.1.smithi106.stdout:2/199: dread - d2/d7/f27 zero size 2024-05-09T06:30:20.793 INFO:tasks.workunit.client.1.smithi106.stdout:2/200: chown d2/d5/db 0 1 2024-05-09T06:30:20.795 INFO:tasks.workunit.client.1.smithi106.stdout:2/201: symlink d2/d5/db/l46 0 2024-05-09T06:30:20.795 INFO:tasks.workunit.client.1.smithi106.stdout:0/205: dread d1/d11/d23/f2a [0,4194304] 0 2024-05-09T06:30:20.796 INFO:tasks.workunit.client.1.smithi106.stdout:0/206: chown d1/fb 1340237 1 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:8/175: read d3/d5/d13/f2e [3084655,25822] 0 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:2/202: creat d2/d5/db/d15/f47 x:0 0 0 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:2/203: readlink d2/d7/d2c/l31 0 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:2/204: chown d2/d5/db/d1d/f30 1266302 1 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:2/205: write f0 [1021203,56594] 0 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:2/206: chown d2/d5/db/d1d/f3d 9758307 1 2024-05-09T06:30:20.798 INFO:tasks.workunit.client.1.smithi106.stdout:2/207: truncate d2/d7/d2c/f37 729088 0 2024-05-09T06:30:20.800 INFO:tasks.workunit.client.1.smithi106.stdout:0/207: dread d1/d11/d23/f24 [0,4194304] 0 2024-05-09T06:30:20.800 INFO:tasks.workunit.client.1.smithi106.stdout:2/208: link d2/d5/c2f d2/d5/db/d1d/d23/c48 0 2024-05-09T06:30:20.801 INFO:tasks.workunit.client.1.smithi106.stdout:0/208: creat d1/f43 x:0 0 0 2024-05-09T06:30:20.802 INFO:tasks.workunit.client.1.smithi106.stdout:8/176: rename d3/d5/d7/d15/d16 to d3/d5/d13/d41 0 2024-05-09T06:30:20.803 INFO:tasks.workunit.client.1.smithi106.stdout:0/209: mknod d1/d11/c44 0 2024-05-09T06:30:20.803 INFO:tasks.workunit.client.1.smithi106.stdout:0/210: creat d1/d11/d23/d22/f45 x:0 0 0 2024-05-09T06:30:20.803 INFO:tasks.workunit.client.1.smithi106.stdout:0/211: chown d1/d11/d23/c32 14113151 1 2024-05-09T06:30:20.804 INFO:tasks.workunit.client.1.smithi106.stdout:8/177: mknod d3/d5/d7/d15/c42 0 2024-05-09T06:30:20.805 INFO:tasks.workunit.client.1.smithi106.stdout:0/212: symlink d1/d11/d23/d22/l46 0 2024-05-09T06:30:20.805 INFO:tasks.workunit.client.1.smithi106.stdout:0/213: write d1/f7 [4491560,103321] 0 2024-05-09T06:30:20.806 INFO:tasks.workunit.client.1.smithi106.stdout:8/178: mknod d3/d5/d7/c43 0 2024-05-09T06:30:20.806 INFO:tasks.workunit.client.1.smithi106.stdout:8/179: fsync d3/d5/d13/f26 0 2024-05-09T06:30:20.806 INFO:tasks.workunit.client.1.smithi106.stdout:8/180: dread d3/d5/d13/d41/f3b [0,4194304] 0 2024-05-09T06:30:20.812 INFO:tasks.workunit.client.1.smithi106.stdout:8/181: dread d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:20.812 INFO:tasks.workunit.client.1.smithi106.stdout:8/182: creat d3/d5/d7/f44 x:0 0 0 2024-05-09T06:30:20.814 INFO:tasks.workunit.client.1.smithi106.stdout:9/198: dwrite d4/d6/d1b/d2a/f26 [0,4194304] 0 2024-05-09T06:30:20.814 INFO:tasks.workunit.client.1.smithi106.stdout:0/214: dread d1/d11/d23/f1a [0,4194304] 0 2024-05-09T06:30:20.814 INFO:tasks.workunit.client.1.smithi106.stdout:2/209: dread d2/d5/db/f32 [0,4194304] 0 2024-05-09T06:30:20.815 INFO:tasks.workunit.client.1.smithi106.stdout:1/216: dwrite d4/d5/d9/f16 [0,4194304] 0 2024-05-09T06:30:20.815 INFO:tasks.workunit.client.1.smithi106.stdout:1/217: creat d4/d37/d4a/f56 x:0 0 0 2024-05-09T06:30:20.816 INFO:tasks.workunit.client.1.smithi106.stdout:1/218: creat d4/d5/d9/d13/f57 x:0 0 0 2024-05-09T06:30:20.816 INFO:tasks.workunit.client.1.smithi106.stdout:1/219: chown d4/d37/d4a/l51 5 1 2024-05-09T06:30:20.816 INFO:tasks.workunit.client.1.smithi106.stdout:7/191: dwrite d0/dc/d1a/d36/d1e/f21 [4194304,4194304] 0 2024-05-09T06:30:20.817 INFO:tasks.workunit.client.1.smithi106.stdout:7/192: truncate d0/dc/d1a/f3a 534387 0 2024-05-09T06:30:20.818 INFO:tasks.workunit.client.1.smithi106.stdout:0/215: truncate d1/f5 3960734 0 2024-05-09T06:30:20.818 INFO:tasks.workunit.client.1.smithi106.stdout:6/231: dwrite d0/d17/d34/f44 [0,4194304] 0 2024-05-09T06:30:20.818 INFO:tasks.workunit.client.1.smithi106.stdout:2/210: symlink d2/d5/db/d15/l49 0 2024-05-09T06:30:20.818 INFO:tasks.workunit.client.1.smithi106.stdout:2/211: creat d2/d5/db/d1d/f4a x:0 0 0 2024-05-09T06:30:20.820 INFO:tasks.workunit.client.1.smithi106.stdout:5/233: dwrite d8/f10 [4194304,4194304] 0 2024-05-09T06:30:20.820 INFO:tasks.workunit.client.1.smithi106.stdout:5/234: chown d8/d33/d3a/l3f 107330 1 2024-05-09T06:30:20.820 INFO:tasks.workunit.client.1.smithi106.stdout:5/235: truncate d8/d1c/f24 831762 0 2024-05-09T06:30:20.820 INFO:tasks.workunit.client.1.smithi106.stdout:5/236: write d8/d1c/d28/f2e [964251,13140] 0 2024-05-09T06:30:20.826 INFO:tasks.workunit.client.1.smithi106.stdout:9/199: dread d4/d6/d23/f21 [0,4194304] 0 2024-05-09T06:30:20.834 INFO:tasks.workunit.client.1.smithi106.stdout:8/183: dwrite d3/d5/d7/f37 [0,4194304] 0 2024-05-09T06:30:20.835 INFO:tasks.workunit.client.1.smithi106.stdout:8/184: stat d3/d5/d13/d41/f3b 0 2024-05-09T06:30:20.840 INFO:tasks.workunit.client.1.smithi106.stdout:1/220: dwrite d4/d5/d9/d1d/f3c [0,4194304] 0 2024-05-09T06:30:20.840 INFO:tasks.workunit.client.1.smithi106.stdout:6/232: link d0/d6/d8/d27/d3e/l3f d0/d6/d8/d27/d3e/d47/l4d 0 2024-05-09T06:30:20.842 INFO:tasks.workunit.client.1.smithi106.stdout:2/212: dwrite d2/d5/db/f33 [0,4194304] 0 2024-05-09T06:30:20.842 INFO:tasks.workunit.client.1.smithi106.stdout:5/237: dwrite d8/d1c/f2c [0,4194304] 0 2024-05-09T06:30:20.843 INFO:tasks.workunit.client.1.smithi106.stdout:7/193: getdents d0/dc/d1a/d36 0 2024-05-09T06:30:20.845 INFO:tasks.workunit.client.1.smithi106.stdout:7/194: dread d0/dc/f14 [0,4194304] 0 2024-05-09T06:30:20.847 INFO:tasks.workunit.client.1.smithi106.stdout:8/185: mkdir d3/d5/d13/d41/d45 0 2024-05-09T06:30:20.847 INFO:tasks.workunit.client.1.smithi106.stdout:8/186: stat d3/d5/d13/d3a 0 2024-05-09T06:30:20.847 INFO:tasks.workunit.client.1.smithi106.stdout:8/187: truncate d3/d5/d7/f44 635573 0 2024-05-09T06:30:20.856 INFO:tasks.workunit.client.1.smithi106.stdout:2/213: dwrite d2/d5/db/f33 [0,4194304] 0 2024-05-09T06:30:20.857 INFO:tasks.workunit.client.1.smithi106.stdout:5/238: mknod d8/d1c/d28/d32/c44 0 2024-05-09T06:30:20.858 INFO:tasks.workunit.client.1.smithi106.stdout:9/200: getdents d4/d6/d23/d16 0 2024-05-09T06:30:20.858 INFO:tasks.workunit.client.1.smithi106.stdout:9/201: truncate d4/d6/f2e 1247248 0 2024-05-09T06:30:20.860 INFO:tasks.workunit.client.1.smithi106.stdout:7/195: link d0/f9 d0/dc/d1a/f3d 0 2024-05-09T06:30:20.861 INFO:tasks.workunit.client.1.smithi106.stdout:8/188: rename d3/d5/d7/l2f to d3/l46 0 2024-05-09T06:30:20.862 INFO:tasks.workunit.client.1.smithi106.stdout:1/221: rmdir d4/d5/d9/d1d 39 2024-05-09T06:30:20.866 INFO:tasks.workunit.client.1.smithi106.stdout:6/233: getdents d0/d6/d8 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:5/239: getdents d8/d1c/d28 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:9/202: mknod d4/d6/c37 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:9/203: write d4/d6/d23/d16/f24 [21163,253] 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:9/204: fsync d4/d6/d23/d16/f35 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:7/196: mknod d0/dc/d1a/c3e 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:7/197: stat d0/dc/l2e 0 2024-05-09T06:30:20.867 INFO:tasks.workunit.client.1.smithi106.stdout:7/198: stat d0/dc/l2e 0 2024-05-09T06:30:20.868 INFO:tasks.workunit.client.1.smithi106.stdout:8/189: rmdir d3/d5/d13/d41 39 2024-05-09T06:30:20.868 INFO:tasks.workunit.client.1.smithi106.stdout:8/190: chown d3/d5/f3c 125 1 2024-05-09T06:30:20.869 INFO:tasks.workunit.client.1.smithi106.stdout:1/222: creat d4/d5/f58 x:0 0 0 2024-05-09T06:30:20.869 INFO:tasks.workunit.client.1.smithi106.stdout:1/223: truncate d4/d5/d9/d13/f1b 699537 0 2024-05-09T06:30:20.869 INFO:tasks.workunit.client.1.smithi106.stdout:1/224: chown d4/d5/d9/c2e 19383 1 2024-05-09T06:30:20.870 INFO:tasks.workunit.client.1.smithi106.stdout:7/199: rmdir d0 39 2024-05-09T06:30:20.870 INFO:tasks.workunit.client.1.smithi106.stdout:7/200: chown d0/f5 8354832 1 2024-05-09T06:30:20.870 INFO:tasks.workunit.client.1.smithi106.stdout:2/214: dwrite d2/d7/d2c/f37 [0,4194304] 0 2024-05-09T06:30:20.872 INFO:tasks.workunit.client.1.smithi106.stdout:8/191: mkdir d3/d5/d7/d15/d47 0 2024-05-09T06:30:20.876 INFO:tasks.workunit.client.1.smithi106.stdout:9/205: write d4/d6/f13 [3798539,36819] 0 2024-05-09T06:30:20.879 INFO:tasks.workunit.client.1.smithi106.stdout:2/215: creat d2/f4b x:0 0 0 2024-05-09T06:30:20.879 INFO:tasks.workunit.client.1.smithi106.stdout:2/216: write d2/d5/db/d1d/f30 [1091332,106793] 0 2024-05-09T06:30:20.879 INFO:tasks.workunit.client.1.smithi106.stdout:2/217: dread - d2/d5/db/d15/f47 zero size 2024-05-09T06:30:20.879 INFO:tasks.workunit.client.1.smithi106.stdout:2/218: write d2/d7/f1c [359084,45155] 0 2024-05-09T06:30:20.880 INFO:tasks.workunit.client.1.smithi106.stdout:1/225: getdents d4/d37/d3d 0 2024-05-09T06:30:20.880 INFO:tasks.workunit.client.1.smithi106.stdout:1/226: chown d4/d5/d9/f53 878 1 2024-05-09T06:30:20.880 INFO:tasks.workunit.client.1.smithi106.stdout:1/227: truncate d4/d5/d9/d13/f25 1064053 0 2024-05-09T06:30:20.880 INFO:tasks.workunit.client.1.smithi106.stdout:1/228: readlink d4/d5/d9/d1d/l34 0 2024-05-09T06:30:20.880 INFO:tasks.workunit.client.1.smithi106.stdout:1/229: chown d4/d37 7249909 1 2024-05-09T06:30:20.880 INFO:tasks.workunit.client.1.smithi106.stdout:1/230: fsync d4/d5/d9/d13/f1b 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/231: read - d4/d5/d9/f27 zero size 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/232: write d4/d5/d9/f4b [1678437,126472] 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:2/219: mknod d2/d5/c4c 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/233: write d4/fa [112911,114480] 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:2/220: truncate d2/d5/f22 1209416 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/234: creat d4/f59 x:0 0 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/235: fdatasync d4/d37/d4a/f55 0 2024-05-09T06:30:20.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/236: dread - d4/d5/d9/d13/f57 zero size 2024-05-09T06:30:20.906 INFO:tasks.workunit.client.1.smithi106.stdout:8/192: dwrite d3/d5/d13/f29 [0,4194304] 0 2024-05-09T06:30:20.906 INFO:tasks.workunit.client.1.smithi106.stdout:8/193: write d3/d5/d13/f1b [1777561,126733] 0 2024-05-09T06:30:20.907 INFO:tasks.workunit.client.1.smithi106.stdout:1/237: mkdir d4/d37/d3d/d5a 0 2024-05-09T06:30:20.909 INFO:tasks.workunit.client.1.smithi106.stdout:6/234: dwrite d0/d6/d8/d27/f3a [0,4194304] 0 2024-05-09T06:30:20.912 INFO:tasks.workunit.client.1.smithi106.stdout:3/210: sync 2024-05-09T06:30:20.912 INFO:tasks.workunit.client.1.smithi106.stdout:3/211: fdatasync f1 0 2024-05-09T06:30:20.921 INFO:tasks.workunit.client.1.smithi106.stdout:5/240: dwrite d8/d33/f39 [0,4194304] 0 2024-05-09T06:30:20.922 INFO:tasks.workunit.client.1.smithi106.stdout:5/241: chown d8/d1c/f1e 83 1 2024-05-09T06:30:20.922 INFO:tasks.workunit.client.1.smithi106.stdout:5/242: stat d8/l25 0 2024-05-09T06:30:20.922 INFO:tasks.workunit.client.1.smithi106.stdout:5/243: stat d8/d33/d3a 0 2024-05-09T06:30:20.922 INFO:tasks.workunit.client.1.smithi106.stdout:4/189: sync 2024-05-09T06:30:20.923 INFO:tasks.workunit.client.1.smithi106.stdout:9/206: dwrite d4/d6/f2b [0,4194304] 0 2024-05-09T06:30:20.926 INFO:tasks.workunit.client.1.smithi106.stdout:1/238: write d4/d5/d9/f11 [1364092,66497] 0 2024-05-09T06:30:20.926 INFO:tasks.workunit.client.1.smithi106.stdout:1/239: read - d4/d37/d4a/f56 zero size 2024-05-09T06:30:20.928 INFO:tasks.workunit.client.1.smithi106.stdout:1/240: dread d4/d5/d9/d13/f2b [0,4194304] 0 2024-05-09T06:30:20.928 INFO:tasks.workunit.client.1.smithi106.stdout:0/216: dwrite d1/d11/d23/f27 [0,4194304] 0 2024-05-09T06:30:20.929 INFO:tasks.workunit.client.1.smithi106.stdout:3/212: dread d5/d12/f15 [0,4194304] 0 2024-05-09T06:30:20.929 INFO:tasks.workunit.client.1.smithi106.stdout:2/221: dwrite d2/f26 [0,4194304] 0 2024-05-09T06:30:20.929 INFO:tasks.workunit.client.1.smithi106.stdout:0/217: fsync d1/d11/f3c 0 2024-05-09T06:30:20.929 INFO:tasks.workunit.client.1.smithi106.stdout:3/213: stat d5/l6 0 2024-05-09T06:30:20.929 INFO:tasks.workunit.client.1.smithi106.stdout:6/235: write d0/d17/f25 [1325953,39343] 0 2024-05-09T06:30:20.937 INFO:tasks.workunit.client.1.smithi106.stdout:1/241: mkdir d4/d5b 0 2024-05-09T06:30:20.939 INFO:tasks.workunit.client.1.smithi106.stdout:3/214: unlink d5/d12/f34 0 2024-05-09T06:30:20.939 INFO:tasks.workunit.client.1.smithi106.stdout:3/215: write f1 [2602424,128437] 0 2024-05-09T06:30:20.941 INFO:tasks.workunit.client.1.smithi106.stdout:0/218: mknod d1/d11/c47 0 2024-05-09T06:30:20.942 INFO:tasks.workunit.client.1.smithi106.stdout:5/244: dwrite d8/d33/f39 [0,4194304] 0 2024-05-09T06:30:20.942 INFO:tasks.workunit.client.1.smithi106.stdout:9/207: dwrite d4/d6/d23/d16/f27 [0,4194304] 0 2024-05-09T06:30:20.942 INFO:tasks.workunit.client.1.smithi106.stdout:9/208: write d4/d6/d23/f2d [1014461,74109] 0 2024-05-09T06:30:20.943 INFO:tasks.workunit.client.1.smithi106.stdout:2/222: rename d2/d5/lf to d2/d3f/l4d 0 2024-05-09T06:30:20.946 INFO:tasks.workunit.client.1.smithi106.stdout:2/223: dread d2/d5/f13 [0,4194304] 0 2024-05-09T06:30:20.946 INFO:tasks.workunit.client.1.smithi106.stdout:6/236: unlink d0/d6/d8/f14 0 2024-05-09T06:30:20.948 INFO:tasks.workunit.client.1.smithi106.stdout:4/190: getdents d7/d10 0 2024-05-09T06:30:20.948 INFO:tasks.workunit.client.1.smithi106.stdout:4/191: stat d7/c26 0 2024-05-09T06:30:20.949 INFO:tasks.workunit.client.1.smithi106.stdout:0/219: dread d1/d11/d23/d13/f14 [0,4194304] 0 2024-05-09T06:30:20.950 INFO:tasks.workunit.client.1.smithi106.stdout:1/242: mknod d4/d5/d9/d13/d2f/c5c 0 2024-05-09T06:30:20.951 INFO:tasks.workunit.client.1.smithi106.stdout:3/216: mknod d5/d12/c42 0 2024-05-09T06:30:20.951 INFO:tasks.workunit.client.1.smithi106.stdout:3/217: fsync d5/d1c/f33 0 2024-05-09T06:30:20.957 INFO:tasks.workunit.client.1.smithi106.stdout:2/224: symlink d2/d7/d2c/l4e 0 2024-05-09T06:30:20.958 INFO:tasks.workunit.client.1.smithi106.stdout:4/192: dread d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:20.959 INFO:tasks.workunit.client.1.smithi106.stdout:5/245: dwrite d8/d33/f3b [0,4194304] 0 2024-05-09T06:30:20.961 INFO:tasks.workunit.client.1.smithi106.stdout:6/237: mkdir d0/d17/d34/d4e 0 2024-05-09T06:30:20.964 INFO:tasks.workunit.client.1.smithi106.stdout:4/193: mknod d7/d28/c3a 0 2024-05-09T06:30:20.967 INFO:tasks.workunit.client.1.smithi106.stdout:2/225: write d2/d5/db/f33 [1664092,90051] 0 2024-05-09T06:30:20.967 INFO:tasks.workunit.client.1.smithi106.stdout:2/226: dread - d2/d5/f40 zero size 2024-05-09T06:30:20.972 INFO:tasks.workunit.client.1.smithi106.stdout:6/238: symlink d0/l4f 0 2024-05-09T06:30:20.974 INFO:tasks.workunit.client.1.smithi106.stdout:3/218: dwrite d5/f3b [0,4194304] 0 2024-05-09T06:30:20.974 INFO:tasks.workunit.client.1.smithi106.stdout:1/243: unlink c0 0 2024-05-09T06:30:20.976 INFO:tasks.workunit.client.1.smithi106.stdout:2/227: mkdir d2/d5/db/d15/d4f 0 2024-05-09T06:30:20.977 INFO:tasks.workunit.client.1.smithi106.stdout:5/246: dwrite d8/d33/d3a/f42 [0,4194304] 0 2024-05-09T06:30:20.978 INFO:tasks.workunit.client.1.smithi106.stdout:3/219: creat d5/d1c/d24/f43 x:0 0 0 2024-05-09T06:30:20.979 INFO:tasks.workunit.client.1.smithi106.stdout:1/244: symlink d4/d37/d3d/l5d 0 2024-05-09T06:30:20.979 INFO:tasks.workunit.client.1.smithi106.stdout:1/245: creat d4/d5/f5e x:0 0 0 2024-05-09T06:30:20.980 INFO:tasks.workunit.client.1.smithi106.stdout:2/228: link d2/f26 d2/d3f/f50 0 2024-05-09T06:30:20.982 INFO:tasks.workunit.client.1.smithi106.stdout:6/239: write d0/d6/d40/f41 [2341593,68649] 0 2024-05-09T06:30:20.983 INFO:tasks.workunit.client.1.smithi106.stdout:5/247: mkdir d8/d45 0 2024-05-09T06:30:20.984 INFO:tasks.workunit.client.1.smithi106.stdout:3/220: symlink d5/d1c/l44 0 2024-05-09T06:30:20.986 INFO:tasks.workunit.client.1.smithi106.stdout:1/246: truncate d4/d5/d9/d1d/f3c 3313202 0 2024-05-09T06:30:20.989 INFO:tasks.workunit.client.1.smithi106.stdout:2/229: rename d2/d5/l44 to d2/d5/db/d15/l51 0 2024-05-09T06:30:20.989 INFO:tasks.workunit.client.1.smithi106.stdout:5/248: rename d8/d33/d3d to d8/d33/d3d/d46 22 2024-05-09T06:30:20.990 INFO:tasks.workunit.client.1.smithi106.stdout:6/240: mkdir d0/d6/d8/d50 0 2024-05-09T06:30:20.990 INFO:tasks.workunit.client.1.smithi106.stdout:6/241: dread - d0/d17/d21/f48 zero size 2024-05-09T06:30:20.993 INFO:tasks.workunit.client.1.smithi106.stdout:1/247: rename d4/d5/d9/f22 to d4/d5/d9/f5f 0 2024-05-09T06:30:20.996 INFO:tasks.workunit.client.1.smithi106.stdout:2/230: rename d2/d5/ld to d2/d5/db/d15/l52 0 2024-05-09T06:30:20.996 INFO:tasks.workunit.client.1.smithi106.stdout:2/231: stat d2/d5/db/d1d/f30 0 2024-05-09T06:30:20.996 INFO:tasks.workunit.client.1.smithi106.stdout:2/232: chown d2/d5/db/d15/l24 63822 1 2024-05-09T06:30:20.997 INFO:tasks.workunit.client.1.smithi106.stdout:5/249: dread d8/d33/f3b [0,4194304] 0 2024-05-09T06:30:20.997 INFO:tasks.workunit.client.1.smithi106.stdout:5/250: chown d8/d33/d3a 695710 1 2024-05-09T06:30:20.999 INFO:tasks.workunit.client.1.smithi106.stdout:1/248: mkdir d4/d5/d9/d13/d60 0 2024-05-09T06:30:20.999 INFO:tasks.workunit.client.1.smithi106.stdout:1/249: write d4/f2d [787730,41054] 0 2024-05-09T06:30:20.999 INFO:tasks.workunit.client.1.smithi106.stdout:1/250: creat d4/d37/d4a/f61 x:0 0 0 2024-05-09T06:30:21.000 INFO:tasks.workunit.client.1.smithi106.stdout:5/251: mknod d8/d1c/d28/c47 0 2024-05-09T06:30:21.006 INFO:tasks.workunit.client.1.smithi106.stdout:5/252: mknod d8/d45/c48 0 2024-05-09T06:30:21.008 INFO:tasks.workunit.client.1.smithi106.stdout:5/253: rename d8/lf to d8/d33/l49 0 2024-05-09T06:30:21.010 INFO:tasks.workunit.client.1.smithi106.stdout:5/254: rename d8/f30 to d8/d33/f4a 0 2024-05-09T06:30:21.011 INFO:tasks.workunit.client.1.smithi106.stdout:5/255: link d8/d33/d3a/f42 d8/f4b 0 2024-05-09T06:30:21.019 INFO:tasks.workunit.client.1.smithi106.stdout:5/256: write d8/f10 [1747732,64156] 0 2024-05-09T06:30:21.019 INFO:tasks.workunit.client.1.smithi106.stdout:5/257: stat d8/d1c/d28/c47 0 2024-05-09T06:30:21.027 INFO:tasks.workunit.client.1.smithi106.stdout:1/251: write d4/d5/d9/d1d/f41 [64655,116029] 0 2024-05-09T06:30:21.029 INFO:tasks.workunit.client.1.smithi106.stdout:5/258: write d8/f10 [8119164,54556] 0 2024-05-09T06:30:21.030 INFO:tasks.workunit.client.1.smithi106.stdout:5/259: truncate d8/d33/d3a/f42 4032425 0 2024-05-09T06:30:21.030 INFO:tasks.workunit.client.1.smithi106.stdout:5/260: chown d8/d33/l43 212 1 2024-05-09T06:30:21.031 INFO:tasks.workunit.client.1.smithi106.stdout:5/261: truncate d8/f12 194853 0 2024-05-09T06:30:21.031 INFO:tasks.workunit.client.1.smithi106.stdout:5/262: chown l7 17734298 1 2024-05-09T06:30:21.031 INFO:tasks.workunit.client.1.smithi106.stdout:5/263: chown d8/d1c/l2d 60 1 2024-05-09T06:30:21.033 INFO:tasks.workunit.client.1.smithi106.stdout:1/252: dread d4/fa [0,4194304] 0 2024-05-09T06:30:21.033 INFO:tasks.workunit.client.1.smithi106.stdout:1/253: write d4/d37/d3d/f44 [91040,86500] 0 2024-05-09T06:30:21.033 INFO:tasks.workunit.client.1.smithi106.stdout:5/264: rmdir d8/d33/d3d 0 2024-05-09T06:30:21.035 INFO:tasks.workunit.client.1.smithi106.stdout:2/233: dwrite d2/d5/db/d1d/f4a [0,4194304] 0 2024-05-09T06:30:21.038 INFO:tasks.workunit.client.1.smithi106.stdout:7/201: sync 2024-05-09T06:30:21.039 INFO:tasks.workunit.client.1.smithi106.stdout:2/234: creat d2/d5/db/d15/d41/f53 x:0 0 0 2024-05-09T06:30:21.040 INFO:tasks.workunit.client.1.smithi106.stdout:6/242: dwrite d0/d17/f36 [4194304,4194304] 0 2024-05-09T06:30:21.041 INFO:tasks.workunit.client.1.smithi106.stdout:2/235: read d2/d5/f13 [517938,17800] 0 2024-05-09T06:30:21.043 INFO:tasks.workunit.client.1.smithi106.stdout:7/202: creat d0/dc/d1a/d36/f3f x:0 0 0 2024-05-09T06:30:21.045 INFO:tasks.workunit.client.1.smithi106.stdout:5/265: rename d8/d1c/d28 to d8/d45/d4c 0 2024-05-09T06:30:21.046 INFO:tasks.workunit.client.1.smithi106.stdout:5/266: chown d8/d45/d4c/l31 4261889 1 2024-05-09T06:30:21.048 INFO:tasks.workunit.client.1.smithi106.stdout:5/267: dread d8/f37 [0,4194304] 0 2024-05-09T06:30:21.048 INFO:tasks.workunit.client.1.smithi106.stdout:6/243: rmdir d0/d6/d8/d4a 0 2024-05-09T06:30:21.050 INFO:tasks.workunit.client.1.smithi106.stdout:1/254: dwrite d4/d5/d9/fe [0,4194304] 0 2024-05-09T06:30:21.050 INFO:tasks.workunit.client.1.smithi106.stdout:1/255: write d4/d37/d4a/f56 [623406,89196] 0 2024-05-09T06:30:21.055 INFO:tasks.workunit.client.1.smithi106.stdout:1/256: chown d4/d5/d9/d1d/f24 29 1 2024-05-09T06:30:21.057 INFO:tasks.workunit.client.1.smithi106.stdout:1/257: rmdir d4/d5/d9/d13/d2f 39 2024-05-09T06:30:21.060 INFO:tasks.workunit.client.1.smithi106.stdout:2/236: dwrite d2/f2b [0,4194304] 0 2024-05-09T06:30:21.063 INFO:tasks.workunit.client.1.smithi106.stdout:2/237: dread f0 [0,4194304] 0 2024-05-09T06:30:21.072 INFO:tasks.workunit.client.1.smithi106.stdout:0/220: sync 2024-05-09T06:30:21.072 INFO:tasks.workunit.client.1.smithi106.stdout:9/209: sync 2024-05-09T06:30:21.072 INFO:tasks.workunit.client.1.smithi106.stdout:8/194: sync 2024-05-09T06:30:21.072 INFO:tasks.workunit.client.1.smithi106.stdout:9/210: fdatasync d4/f28 0 2024-05-09T06:30:21.073 INFO:tasks.workunit.client.1.smithi106.stdout:8/195: mknod d3/d5/d13/d3a/c48 0 2024-05-09T06:30:21.074 INFO:tasks.workunit.client.1.smithi106.stdout:0/221: mknod d1/d11/d23/c48 0 2024-05-09T06:30:21.074 INFO:tasks.workunit.client.1.smithi106.stdout:0/222: creat d1/d11/d23/d22/f49 x:0 0 0 2024-05-09T06:30:21.075 INFO:tasks.workunit.client.1.smithi106.stdout:9/211: mkdir d4/d6/d23/d2f/d38 0 2024-05-09T06:30:21.076 INFO:tasks.workunit.client.1.smithi106.stdout:9/212: mkdir d4/d6/d23/d2f/d39 0 2024-05-09T06:30:21.077 INFO:tasks.workunit.client.1.smithi106.stdout:7/203: dwrite d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:21.077 INFO:tasks.workunit.client.1.smithi106.stdout:7/204: truncate d0/dc/d1a/d36/d30/f26 641104 0 2024-05-09T06:30:21.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/213: truncate d4/d6/d23/f2d 603327 0 2024-05-09T06:30:21.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/214: fdatasync d4/d6/d1b/d2a/f26 0 2024-05-09T06:30:21.080 INFO:tasks.workunit.client.1.smithi106.stdout:6/244: dwrite d0/d17/d21/f2b [0,4194304] 0 2024-05-09T06:30:21.080 INFO:tasks.workunit.client.1.smithi106.stdout:6/245: fdatasync d0/d17/d34/f44 0 2024-05-09T06:30:21.080 INFO:tasks.workunit.client.1.smithi106.stdout:7/205: creat d0/f40 x:0 0 0 2024-05-09T06:30:21.081 INFO:tasks.workunit.client.1.smithi106.stdout:5/268: dwrite d8/d1c/f1e [4194304,4194304] 0 2024-05-09T06:30:21.081 INFO:tasks.workunit.client.1.smithi106.stdout:2/238: dwrite d2/d5/f13 [0,4194304] 0 2024-05-09T06:30:21.082 INFO:tasks.workunit.client.1.smithi106.stdout:2/239: creat d2/d5/f54 x:0 0 0 2024-05-09T06:30:21.082 INFO:tasks.workunit.client.1.smithi106.stdout:2/240: write d2/d5/f54 [845409,4033] 0 2024-05-09T06:30:21.082 INFO:tasks.workunit.client.1.smithi106.stdout:9/215: truncate d4/f25 1907457 0 2024-05-09T06:30:21.083 INFO:tasks.workunit.client.1.smithi106.stdout:9/216: write d4/d6/f2e [169236,121749] 0 2024-05-09T06:30:21.083 INFO:tasks.workunit.client.1.smithi106.stdout:9/217: fdatasync d4/d6/fa 0 2024-05-09T06:30:21.083 INFO:tasks.workunit.client.1.smithi106.stdout:9/218: chown d4/d6/d23/d2f 166399 1 2024-05-09T06:30:21.084 INFO:tasks.workunit.client.1.smithi106.stdout:6/246: mknod d0/d6/d8/c51 0 2024-05-09T06:30:21.086 INFO:tasks.workunit.client.1.smithi106.stdout:7/206: symlink d0/dc/l41 0 2024-05-09T06:30:21.088 INFO:tasks.workunit.client.1.smithi106.stdout:5/269: mknod d8/d45/d4c/c4d 0 2024-05-09T06:30:21.089 INFO:tasks.workunit.client.1.smithi106.stdout:0/223: dread d1/f5 [0,4194304] 0 2024-05-09T06:30:21.089 INFO:tasks.workunit.client.1.smithi106.stdout:0/224: creat d1/f4a x:0 0 0 2024-05-09T06:30:21.090 INFO:tasks.workunit.client.1.smithi106.stdout:0/225: stat d1/d11/d23/d13/l37 0 2024-05-09T06:30:21.090 INFO:tasks.workunit.client.1.smithi106.stdout:0/226: chown d1/d11/d23/d13/d2c/d3d 230 1 2024-05-09T06:30:21.090 INFO:tasks.workunit.client.1.smithi106.stdout:0/227: write d1/d11/d23/d13/d2c/f2f [611708,62704] 0 2024-05-09T06:30:21.090 INFO:tasks.workunit.client.1.smithi106.stdout:0/228: creat d1/f4b x:0 0 0 2024-05-09T06:30:21.090 INFO:tasks.workunit.client.1.smithi106.stdout:0/229: chown d1/d11/d23/d22/l42 5 1 2024-05-09T06:30:21.093 INFO:tasks.workunit.client.1.smithi106.stdout:2/241: unlink d2/f4b 0 2024-05-09T06:30:21.093 INFO:tasks.workunit.client.1.smithi106.stdout:2/242: rename d2/d5/db/d15/d4f to d2/d5/db/d15/d4f/d55 22 2024-05-09T06:30:21.096 INFO:tasks.workunit.client.1.smithi106.stdout:7/207: creat d0/dc/d1a/d36/d1e/f42 x:0 0 0 2024-05-09T06:30:21.098 INFO:tasks.workunit.client.1.smithi106.stdout:9/219: truncate d4/d6/fa 2755076 0 2024-05-09T06:30:21.104 INFO:tasks.workunit.client.1.smithi106.stdout:8/196: dwrite d3/d5/f12 [8388608,4194304] 0 2024-05-09T06:30:21.124 INFO:tasks.workunit.client.1.smithi106.stdout:4/194: sync 2024-05-09T06:30:21.138 INFO:tasks.workunit.client.1.smithi106.stdout:5/270: dwrite d8/d1c/f41 [0,4194304] 0 2024-05-09T06:30:21.138 INFO:tasks.workunit.client.1.smithi106.stdout:5/271: fsync d8/fc 0 2024-05-09T06:30:21.158 INFO:tasks.workunit.client.1.smithi106.stdout:0/230: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:30:21.158 INFO:tasks.workunit.client.1.smithi106.stdout:9/220: dwrite d4/d6/d23/d2f/d31/f33 [0,4194304] 0 2024-05-09T06:30:21.158 INFO:tasks.workunit.client.1.smithi106.stdout:2/243: dwrite d2/d5/db/d1d/f3d [0,4194304] 0 2024-05-09T06:30:21.159 INFO:tasks.workunit.client.1.smithi106.stdout:2/244: fsync d2/fc 0 2024-05-09T06:30:21.159 INFO:tasks.workunit.client.1.smithi106.stdout:2/245: stat d2/d5/db/l3a 0 2024-05-09T06:30:21.159 INFO:tasks.workunit.client.1.smithi106.stdout:7/208: dwrite d0/f29 [0,4194304] 0 2024-05-09T06:30:21.159 INFO:tasks.workunit.client.1.smithi106.stdout:8/197: dwrite d3/d5/f12 [0,4194304] 0 2024-05-09T06:30:21.160 INFO:tasks.workunit.client.1.smithi106.stdout:8/198: chown d3/d5/d13/f29 14 1 2024-05-09T06:30:21.160 INFO:tasks.workunit.client.1.smithi106.stdout:5/272: dwrite d8/f18 [4194304,4194304] 0 2024-05-09T06:30:21.160 INFO:tasks.workunit.client.1.smithi106.stdout:5/273: fdatasync d8/f18 0 2024-05-09T06:30:21.160 INFO:tasks.workunit.client.1.smithi106.stdout:4/195: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:21.163 INFO:tasks.workunit.client.1.smithi106.stdout:9/221: rename d4/d6/f13 to d4/d6/d23/d2f/d38/f3a 0 2024-05-09T06:30:21.165 INFO:tasks.workunit.client.1.smithi106.stdout:2/246: unlink d2/d5/f22 0 2024-05-09T06:30:21.167 INFO:tasks.workunit.client.1.smithi106.stdout:0/231: write d1/f1d [523626,127878] 0 2024-05-09T06:30:21.167 INFO:tasks.workunit.client.1.smithi106.stdout:7/209: creat d0/dc/f43 x:0 0 0 2024-05-09T06:30:21.169 INFO:tasks.workunit.client.1.smithi106.stdout:8/199: rmdir d3/d5/d13/d41/d45 0 2024-05-09T06:30:21.169 INFO:tasks.workunit.client.1.smithi106.stdout:8/200: chown d3/d5/d7/d15/d47 124094434 1 2024-05-09T06:30:21.170 INFO:tasks.workunit.client.1.smithi106.stdout:8/201: dread d3/d5/d7/f44 [0,4194304] 0 2024-05-09T06:30:21.170 INFO:tasks.workunit.client.1.smithi106.stdout:8/202: truncate d3/d5/d7/f44 1142364 0 2024-05-09T06:30:21.171 INFO:tasks.workunit.client.1.smithi106.stdout:4/196: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:21.175 INFO:tasks.workunit.client.1.smithi106.stdout:9/222: creat d4/d6/d23/d16/f3b x:0 0 0 2024-05-09T06:30:21.178 INFO:tasks.workunit.client.1.smithi106.stdout:0/232: mknod d1/d11/c4c 0 2024-05-09T06:30:21.181 INFO:tasks.workunit.client.1.smithi106.stdout:8/203: creat d3/d5/d7/d15/f49 x:0 0 0 2024-05-09T06:30:21.181 INFO:tasks.workunit.client.1.smithi106.stdout:3/221: sync 2024-05-09T06:30:21.182 INFO:tasks.workunit.client.1.smithi106.stdout:5/274: truncate d8/d1c/f1e 5047470 0 2024-05-09T06:30:21.186 INFO:tasks.workunit.client.1.smithi106.stdout:2/247: dwrite d2/d3f/f50 [0,4194304] 0 2024-05-09T06:30:21.186 INFO:tasks.workunit.client.1.smithi106.stdout:2/248: creat d2/f56 x:0 0 0 2024-05-09T06:30:21.187 INFO:tasks.workunit.client.1.smithi106.stdout:2/249: chown d2/d7/f1c 8 1 2024-05-09T06:30:21.188 INFO:tasks.workunit.client.1.smithi106.stdout:8/204: creat d3/d5/d13/d41/d32/f4a x:0 0 0 2024-05-09T06:30:21.192 INFO:tasks.workunit.client.1.smithi106.stdout:2/250: symlink d2/d5/db/l57 0 2024-05-09T06:30:21.193 INFO:tasks.workunit.client.1.smithi106.stdout:8/205: creat d3/d5/d35/f4b x:0 0 0 2024-05-09T06:30:21.200 INFO:tasks.workunit.client.1.smithi106.stdout:9/223: dwrite d4/d6/ff [0,4194304] 0 2024-05-09T06:30:21.211 INFO:tasks.workunit.client.1.smithi106.stdout:9/224: write d4/d6/d1b/d2a/f20 [455419,49573] 0 2024-05-09T06:30:21.212 INFO:tasks.workunit.client.1.smithi106.stdout:9/225: write d4/d6/d23/d2f/d31/f32 [940195,39844] 0 2024-05-09T06:30:21.214 INFO:tasks.workunit.client.1.smithi106.stdout:0/233: dwrite d1/d11/d23/d22/f31 [0,4194304] 0 2024-05-09T06:30:21.214 INFO:tasks.workunit.client.1.smithi106.stdout:2/251: dwrite d2/d5/db/d1d/f4a [0,4194304] 0 2024-05-09T06:30:21.215 INFO:tasks.workunit.client.1.smithi106.stdout:4/197: dwrite d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:21.215 INFO:tasks.workunit.client.1.smithi106.stdout:2/252: fsync d2/d5/db/f33 0 2024-05-09T06:30:21.215 INFO:tasks.workunit.client.1.smithi106.stdout:4/198: fsync d7/f9 0 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:2/253: rename d2/d3f to d2/d5/db/d15/d41/d58 0 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/226: dread d4/d6/d1b/d2a/f26 [0,4194304] 0 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/227: write d4/d6/d23/d16/f3b [519298,40518] 0 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/228: chown d4/c29 2 1 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/229: stat d4/d6/c37 0 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/230: chown d4/d6/d23/d2f/d31 933 1 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/231: truncate d4/d6/fa 2985972 0 2024-05-09T06:30:21.221 INFO:tasks.workunit.client.1.smithi106.stdout:2/254: mknod d2/d7/c59 0 2024-05-09T06:30:21.223 INFO:tasks.workunit.client.1.smithi106.stdout:9/232: creat d4/d6/d23/d2f/d38/f3c x:0 0 0 2024-05-09T06:30:21.223 INFO:tasks.workunit.client.1.smithi106.stdout:9/233: creat d4/f3d x:0 0 0 2024-05-09T06:30:21.224 INFO:tasks.workunit.client.1.smithi106.stdout:6/247: sync 2024-05-09T06:30:21.224 INFO:tasks.workunit.client.1.smithi106.stdout:1/258: sync 2024-05-09T06:30:21.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/248: truncate d0/d6/fe 4151576 0 2024-05-09T06:30:21.228 INFO:tasks.workunit.client.1.smithi106.stdout:1/259: mknod d4/d5/d9/d13/d2f/c62 0 2024-05-09T06:30:21.242 INFO:tasks.workunit.client.1.smithi106.stdout:8/206: dwrite d3/d5/d7/f37 [0,4194304] 0 2024-05-09T06:30:21.242 INFO:tasks.workunit.client.1.smithi106.stdout:8/207: fdatasync d3/f6 0 2024-05-09T06:30:21.247 INFO:tasks.workunit.client.1.smithi106.stdout:4/199: dwrite d7/d28/f27 [0,4194304] 0 2024-05-09T06:30:21.250 INFO:tasks.workunit.client.1.smithi106.stdout:6/249: write d0/d17/d21/f26 [6138930,105932] 0 2024-05-09T06:30:21.265 INFO:tasks.workunit.client.1.smithi106.stdout:2/255: dwrite d2/d5/f40 [0,4194304] 0 2024-05-09T06:30:21.271 INFO:tasks.workunit.client.1.smithi106.stdout:1/260: mknod d4/d5/d9/d13/d60/c63 0 2024-05-09T06:30:21.272 INFO:tasks.workunit.client.1.smithi106.stdout:8/208: mkdir d3/d5/d13/d41/d32/d4c 0 2024-05-09T06:30:21.276 INFO:tasks.workunit.client.1.smithi106.stdout:9/234: rmdir d4 39 2024-05-09T06:30:21.277 INFO:tasks.workunit.client.1.smithi106.stdout:9/235: write d4/d6/d23/d16/f3b [1120113,70197] 0 2024-05-09T06:30:21.277 INFO:tasks.workunit.client.1.smithi106.stdout:4/200: dwrite d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:21.279 INFO:tasks.workunit.client.1.smithi106.stdout:4/201: write d7/f29 [1126880,61873] 0 2024-05-09T06:30:21.280 INFO:tasks.workunit.client.1.smithi106.stdout:6/250: truncate d0/d17/f1e 107570 0 2024-05-09T06:30:21.285 INFO:tasks.workunit.client.1.smithi106.stdout:2/256: unlink d2/d5/db/d1d/f30 0 2024-05-09T06:30:21.285 INFO:tasks.workunit.client.1.smithi106.stdout:2/257: write f0 [3789117,43442] 0 2024-05-09T06:30:21.286 INFO:tasks.workunit.client.1.smithi106.stdout:1/261: mknod d4/d5/d9/d13/c64 0 2024-05-09T06:30:21.294 INFO:tasks.workunit.client.1.smithi106.stdout:4/202: mknod d7/d10/d12/c3b 0 2024-05-09T06:30:21.297 INFO:tasks.workunit.client.1.smithi106.stdout:6/251: symlink d0/d6/d8/l52 0 2024-05-09T06:30:21.300 INFO:tasks.workunit.client.1.smithi106.stdout:1/262: mkdir d4/d5/d9/d65 0 2024-05-09T06:30:21.303 INFO:tasks.workunit.client.1.smithi106.stdout:4/203: symlink d7/d39/l3c 0 2024-05-09T06:30:21.305 INFO:tasks.workunit.client.1.smithi106.stdout:1/263: creat d4/d5/d9/d65/f66 x:0 0 0 2024-05-09T06:30:21.322 INFO:tasks.workunit.client.1.smithi106.stdout:6/252: write d0/d17/f29 [1002038,79250] 0 2024-05-09T06:30:21.324 INFO:tasks.workunit.client.1.smithi106.stdout:6/253: truncate d0/f19 1708874 0 2024-05-09T06:30:21.326 INFO:tasks.workunit.client.1.smithi106.stdout:6/254: link d0/d6/d8/l2f d0/d6/d8/d27/d3e/d47/l53 0 2024-05-09T06:30:21.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/255: link d0/d17/f1e d0/d6/d8/d27/d3e/f54 0 2024-05-09T06:30:21.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/256: chown d0/d17/f22 11690571 1 2024-05-09T06:30:21.342 INFO:tasks.workunit.client.1.smithi106.stdout:7/210: sync 2024-05-09T06:30:21.348 INFO:tasks.workunit.client.1.smithi106.stdout:7/211: getdents d0/dc/d1a/d36 0 2024-05-09T06:30:21.394 INFO:tasks.workunit.client.1.smithi106.stdout:1/264: write d4/d5/d9/d1d/f3c [508294,35298] 0 2024-05-09T06:30:21.395 INFO:tasks.workunit.client.1.smithi106.stdout:1/265: chown d4/d5/d9/fe 105 1 2024-05-09T06:30:21.521 INFO:tasks.workunit.client.1.smithi106.stdout:2/258: dwrite d2/f2b [0,4194304] 0 2024-05-09T06:30:21.524 INFO:tasks.workunit.client.1.smithi106.stdout:2/259: getdents d2/d5/db/d15/d41/d58 0 2024-05-09T06:30:21.525 INFO:tasks.workunit.client.1.smithi106.stdout:9/236: dwrite d4/d6/f34 [0,4194304] 0 2024-05-09T06:30:21.543 INFO:tasks.workunit.client.1.smithi106.stdout:2/260: dread d2/d7/d2c/f37 [0,4194304] 0 2024-05-09T06:30:21.543 INFO:tasks.workunit.client.1.smithi106.stdout:9/237: dread d4/d6/d23/d2f/d38/f3a [0,4194304] 0 2024-05-09T06:30:21.548 INFO:tasks.workunit.client.1.smithi106.stdout:9/238: creat d4/d6/d1b/f3e x:0 0 0 2024-05-09T06:30:21.551 INFO:tasks.workunit.client.1.smithi106.stdout:9/239: symlink d4/d6/d23/d2f/d31/l3f 0 2024-05-09T06:30:21.551 INFO:tasks.workunit.client.1.smithi106.stdout:9/240: write d4/d6/d23/d16/f3b [2103769,110233] 0 2024-05-09T06:30:21.552 INFO:tasks.workunit.client.1.smithi106.stdout:9/241: chown d4/d6/d23/d2f/f30 14823 1 2024-05-09T06:30:21.554 INFO:tasks.workunit.client.1.smithi106.stdout:7/212: dwrite d0/f5 [0,4194304] 0 2024-05-09T06:30:21.558 INFO:tasks.workunit.client.1.smithi106.stdout:9/242: getdents d4/d6/d23/d2f 0 2024-05-09T06:30:21.559 INFO:tasks.workunit.client.1.smithi106.stdout:2/261: dread d2/d5/f40 [0,4194304] 0 2024-05-09T06:30:21.561 INFO:tasks.workunit.client.1.smithi106.stdout:7/213: mkdir d0/dc/d1a/d36/d30/d44 0 2024-05-09T06:30:21.566 INFO:tasks.workunit.client.1.smithi106.stdout:9/243: unlink d4/d6/d23/d2f/f30 0 2024-05-09T06:30:21.566 INFO:tasks.workunit.client.1.smithi106.stdout:2/262: read d2/d5/f54 [350022,62767] 0 2024-05-09T06:30:21.570 INFO:tasks.workunit.client.1.smithi106.stdout:2/263: unlink d2/d5/db/d1d/f36 0 2024-05-09T06:30:21.573 INFO:tasks.workunit.client.1.smithi106.stdout:2/264: symlink d2/d5/db/l5a 0 2024-05-09T06:30:21.573 INFO:tasks.workunit.client.1.smithi106.stdout:2/265: chown d2/d5/db/d15/l52 3605621 1 2024-05-09T06:30:21.578 INFO:tasks.workunit.client.1.smithi106.stdout:2/266: stat d2/d5/db/d15/l51 0 2024-05-09T06:30:21.616 INFO:tasks.workunit.client.1.smithi106.stdout:4/204: dwrite d7/f29 [0,4194304] 0 2024-05-09T06:30:21.629 INFO:tasks.workunit.client.1.smithi106.stdout:2/267: write d2/f10 [1350955,51240] 0 2024-05-09T06:30:21.634 INFO:tasks.workunit.client.1.smithi106.stdout:9/244: dread d4/d6/d23/d16/f27 [0,4194304] 0 2024-05-09T06:30:21.634 INFO:tasks.workunit.client.1.smithi106.stdout:9/245: stat d4/d6/f2b 0 2024-05-09T06:30:21.634 INFO:tasks.workunit.client.1.smithi106.stdout:9/246: read d4/d6/f2e [37183,103471] 0 2024-05-09T06:30:21.640 INFO:tasks.workunit.client.1.smithi106.stdout:9/247: link d4/d6/d23/d16/f27 d4/d6/d23/d2f/d38/f40 0 2024-05-09T06:30:21.674 INFO:tasks.workunit.client.1.smithi106.stdout:7/214: dwrite d0/f40 [0,4194304] 0 2024-05-09T06:30:21.676 INFO:tasks.workunit.client.1.smithi106.stdout:2/268: write d2/fc [3868323,40563] 0 2024-05-09T06:30:21.676 INFO:tasks.workunit.client.1.smithi106.stdout:2/269: write d2/d5/db/f1b [1489376,67173] 0 2024-05-09T06:30:21.678 INFO:tasks.workunit.client.1.smithi106.stdout:7/215: mkdir d0/dc/d45 0 2024-05-09T06:30:21.696 INFO:tasks.workunit.client.1.smithi106.stdout:7/216: read d0/f40 [3340602,16632] 0 2024-05-09T06:30:21.722 INFO:tasks.workunit.client.1.smithi106.stdout:9/248: dread d4/d6/ff [0,4194304] 0 2024-05-09T06:30:21.725 INFO:tasks.workunit.client.1.smithi106.stdout:7/217: write d0/dc/f14 [593522,105069] 0 2024-05-09T06:30:21.725 INFO:tasks.workunit.client.1.smithi106.stdout:7/218: chown d0/dc/d1a/d36/l38 2507904 1 2024-05-09T06:30:21.725 INFO:tasks.workunit.client.1.smithi106.stdout:7/219: creat d0/dc/d1a/d36/d1e/f46 x:0 0 0 2024-05-09T06:30:21.770 INFO:tasks.workunit.client.1.smithi106.stdout:6/257: dwrite d0/d6/d8/f3c [0,4194304] 0 2024-05-09T06:30:21.778 INFO:tasks.workunit.client.1.smithi106.stdout:1/266: dwrite d4/d5/d9/d1d/f24 [0,4194304] 0 2024-05-09T06:30:21.793 INFO:tasks.workunit.client.1.smithi106.stdout:6/258: rename d0/d17/d21/f48 to d0/d17/d34/f55 0 2024-05-09T06:30:21.794 INFO:tasks.workunit.client.1.smithi106.stdout:6/259: write d0/d6/d8/d27/f3a [4565328,121887] 0 2024-05-09T06:30:21.798 INFO:tasks.workunit.client.1.smithi106.stdout:1/267: mkdir d4/d5/d9/d65/d67 0 2024-05-09T06:30:21.801 INFO:tasks.workunit.client.1.smithi106.stdout:2/270: dwrite d2/f10 [0,4194304] 0 2024-05-09T06:30:21.801 INFO:tasks.workunit.client.1.smithi106.stdout:2/271: readlink d2/d5/db/l46 0 2024-05-09T06:30:21.803 INFO:tasks.workunit.client.1.smithi106.stdout:2/272: symlink d2/d5/db/d15/d4f/l5b 0 2024-05-09T06:30:21.806 INFO:tasks.workunit.client.1.smithi106.stdout:2/273: symlink d2/l5c 0 2024-05-09T06:30:21.811 INFO:tasks.workunit.client.1.smithi106.stdout:1/268: dread d4/f1f [0,4194304] 0 2024-05-09T06:30:21.820 INFO:tasks.workunit.client.1.smithi106.stdout:7/220: dwrite d0/fa [0,4194304] 0 2024-05-09T06:30:21.821 INFO:tasks.workunit.client.1.smithi106.stdout:7/221: readlink d0/dc/d1a/d36/l22 0 2024-05-09T06:30:21.821 INFO:tasks.workunit.client.1.smithi106.stdout:7/222: fdatasync d0/dc/f25 0 2024-05-09T06:30:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:21 smithi106 ceph-mon[34679]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s rd, 16 MiB/s wr, 386 op/s 2024-05-09T06:30:21.826 INFO:tasks.workunit.client.1.smithi106.stdout:7/223: unlink d0/dc/d1a/d36/l22 0 2024-05-09T06:30:21.826 INFO:tasks.workunit.client.1.smithi106.stdout:7/224: write d0/dc/d1a/d36/d30/f3b [778315,20202] 0 2024-05-09T06:30:21.832 INFO:tasks.workunit.client.1.smithi106.stdout:1/269: getdents d4/d5/d9 0 2024-05-09T06:30:21.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:21 smithi046 ceph-mon[26924]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s rd, 16 MiB/s wr, 386 op/s 2024-05-09T06:30:21.855 INFO:tasks.workunit.client.1.smithi106.stdout:1/270: rmdir d4/d5/d9/d13 39 2024-05-09T06:30:21.855 INFO:tasks.workunit.client.1.smithi106.stdout:1/271: write d4/d5/f50 [282148,50507] 0 2024-05-09T06:30:21.992 INFO:tasks.workunit.client.1.smithi106.stdout:3/222: sync 2024-05-09T06:30:21.993 INFO:tasks.workunit.client.1.smithi106.stdout:0/234: sync 2024-05-09T06:30:21.997 INFO:tasks.workunit.client.1.smithi106.stdout:5/275: sync 2024-05-09T06:30:22.027 INFO:tasks.workunit.client.1.smithi106.stdout:2/274: getdents d2/d5/db/d1d 0 2024-05-09T06:30:22.027 INFO:tasks.workunit.client.1.smithi106.stdout:2/275: creat d2/d5/f5d x:0 0 0 2024-05-09T06:30:22.032 INFO:tasks.workunit.client.1.smithi106.stdout:2/276: dread d2/d5/f54 [0,4194304] 0 2024-05-09T06:30:22.033 INFO:tasks.workunit.client.1.smithi106.stdout:3/223: dwrite d5/d12/f19 [0,4194304] 0 2024-05-09T06:30:22.036 INFO:tasks.workunit.client.1.smithi106.stdout:2/277: mkdir d2/d5/db/d1d/d23/d5e 0 2024-05-09T06:30:22.046 INFO:tasks.workunit.client.1.smithi106.stdout:3/224: creat d5/d12/f45 x:0 0 0 2024-05-09T06:30:22.052 INFO:tasks.workunit.client.1.smithi106.stdout:3/225: link d5/ld d5/d1c/d21/l46 0 2024-05-09T06:30:22.052 INFO:tasks.workunit.client.1.smithi106.stdout:3/226: stat d5/d1c/f1e 0 2024-05-09T06:30:22.058 INFO:tasks.workunit.client.1.smithi106.stdout:3/227: unlink d5/d12/c3e 0 2024-05-09T06:30:22.058 INFO:tasks.workunit.client.1.smithi106.stdout:3/228: truncate d5/d1c/f1e 4364499 0 2024-05-09T06:30:22.058 INFO:tasks.workunit.client.1.smithi106.stdout:3/229: truncate d5/d1c/d24/f28 9415781 0 2024-05-09T06:30:22.067 INFO:tasks.workunit.client.1.smithi106.stdout:3/230: write d5/f3b [3609108,88691] 0 2024-05-09T06:30:22.079 INFO:tasks.workunit.client.1.smithi106.stdout:3/231: creat d5/d1c/f47 x:0 0 0 2024-05-09T06:30:22.083 INFO:tasks.workunit.client.1.smithi106.stdout:3/232: mknod d5/d1c/d21/c48 0 2024-05-09T06:30:22.091 INFO:tasks.workunit.client.1.smithi106.stdout:3/233: write d5/d1c/f1e [2247026,122183] 0 2024-05-09T06:30:22.091 INFO:tasks.workunit.client.1.smithi106.stdout:3/234: dread - d5/d12/f45 zero size 2024-05-09T06:30:22.098 INFO:tasks.workunit.client.1.smithi106.stdout:3/235: link d5/d12/f19 d5/d1c/d21/d32/f49 0 2024-05-09T06:30:22.106 INFO:tasks.workunit.client.1.smithi106.stdout:3/236: dread d5/d12/f13 [0,4194304] 0 2024-05-09T06:30:22.114 INFO:tasks.workunit.client.1.smithi106.stdout:5/276: dwrite d8/f4b [0,4194304] 0 2024-05-09T06:30:22.115 INFO:tasks.workunit.client.1.smithi106.stdout:3/237: rename d5/d1c/d21/d32/f41 to d5/d3f/f4a 0 2024-05-09T06:30:22.117 INFO:tasks.workunit.client.1.smithi106.stdout:4/205: dwrite f2 [4194304,4194304] 0 2024-05-09T06:30:22.119 INFO:tasks.workunit.client.0.smithi046.stderr:++ readlink -f fsstress 2024-05-09T06:30:22.121 INFO:tasks.workunit.client.1.smithi106.stdout:2/278: dwrite d2/f26 [4194304,4194304] 0 2024-05-09T06:30:22.121 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:30:22.121 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp 2024-05-09T06:30:22.122 INFO:tasks.workunit.client.0.smithi046.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-05-09T06:30:22.122 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-05-09T06:30:22.122 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-05-09T06:30:22.122 INFO:tasks.workunit.client.0.smithi046.stderr:++ mktemp -d -p . 2024-05-09T06:30:22.130 INFO:tasks.workunit.client.1.smithi106.stdout:3/238: link d5/d1c/d21/d32/c39 d5/d1c/d21/d32/c4b 0 2024-05-09T06:30:22.134 INFO:tasks.workunit.client.1.smithi106.stdout:2/279: write d2/d7/f25 [1070821,7607] 0 2024-05-09T06:30:22.140 INFO:tasks.workunit.client.1.smithi106.stdout:5/277: dwrite d8/d45/d4c/f2e [0,4194304] 0 2024-05-09T06:30:22.141 INFO:tasks.workunit.client.1.smithi106.stdout:3/239: write d5/fe [2680084,6217] 0 2024-05-09T06:30:22.144 INFO:tasks.workunit.client.1.smithi106.stdout:6/260: dread d0/d6/d8/f3c [0,4194304] 0 2024-05-09T06:30:22.145 INFO:tasks.workunit.client.1.smithi106.stdout:6/261: write d0/d17/f22 [467794,634] 0 2024-05-09T06:30:22.145 INFO:tasks.workunit.client.1.smithi106.stdout:6/262: read d0/d17/f1e [69161,88903] 0 2024-05-09T06:30:22.145 INFO:tasks.workunit.client.1.smithi106.stdout:6/263: readlink d0/l4f 0 2024-05-09T06:30:22.147 INFO:tasks.workunit.client.1.smithi106.stdout:2/280: rename d2/d7/d2c/f37 to d2/f5f 0 2024-05-09T06:30:22.150 INFO:tasks.workunit.client.1.smithi106.stdout:4/206: dwrite d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:22.156 INFO:tasks.workunit.client.1.smithi106.stdout:5/278: creat d8/f4e x:0 0 0 2024-05-09T06:30:22.159 INFO:tasks.workunit.client.1.smithi106.stdout:3/240: getdents d5/d12/d26 0 2024-05-09T06:30:22.163 INFO:tasks.workunit.client.1.smithi106.stdout:2/281: mkdir d2/d5/db/d15/d41/d60 0 2024-05-09T06:30:22.177 INFO:tasks.workunit.client.1.smithi106.stdout:3/241: truncate d5/fb 2579864 0 2024-05-09T06:30:22.178 INFO:tasks.workunit.client.1.smithi106.stdout:2/282: rmdir d2/d5/db/d15/d4f 39 2024-05-09T06:30:22.189 INFO:tasks.workunit.client.1.smithi106.stdout:2/283: link d2/d7/f1c d2/d5/db/d15/d41/d58/f61 0 2024-05-09T06:30:22.190 INFO:tasks.workunit.client.1.smithi106.stdout:2/284: readlink d2/d5/db/l3a 0 2024-05-09T06:30:22.191 INFO:tasks.workunit.client.1.smithi106.stdout:3/242: getdents d5/d1c/d24 0 2024-05-09T06:30:22.191 INFO:tasks.workunit.client.1.smithi106.stdout:3/243: write d5/d3f/f4a [37602,10556] 0 2024-05-09T06:30:22.191 INFO:tasks.workunit.client.1.smithi106.stdout:3/244: chown d5/d12/f19 5 1 2024-05-09T06:30:22.191 INFO:tasks.workunit.client.1.smithi106.stdout:3/245: read d5/f3b [2694072,48993] 0 2024-05-09T06:30:22.195 INFO:tasks.workunit.client.1.smithi106.stdout:2/285: mkdir d2/d7/d62 0 2024-05-09T06:30:22.195 INFO:tasks.workunit.client.1.smithi106.stdout:2/286: read d2/d5/db/d15/d41/d58/f61 [444697,87248] 0 2024-05-09T06:30:22.197 INFO:tasks.workunit.client.1.smithi106.stdout:3/246: rmdir d5/d1c/d24 39 2024-05-09T06:30:22.202 INFO:tasks.workunit.client.1.smithi106.stdout:2/287: unlink d2/d5/db/d15/l24 0 2024-05-09T06:30:22.205 INFO:tasks.workunit.client.1.smithi106.stdout:3/247: symlink d5/d1c/d21/l4c 0 2024-05-09T06:30:22.209 INFO:tasks.workunit.client.1.smithi106.stdout:2/288: dread d2/fc [0,4194304] 0 2024-05-09T06:30:22.209 INFO:tasks.workunit.client.1.smithi106.stdout:2/289: dread - d2/d7/f27 zero size 2024-05-09T06:30:22.209 INFO:tasks.workunit.client.1.smithi106.stdout:2/290: chown d2/d5/db/d1d/c39 2768548 1 2024-05-09T06:30:22.210 INFO:tasks.workunit.client.1.smithi106.stdout:3/248: truncate d5/d12/f13 2851329 0 2024-05-09T06:30:22.213 INFO:tasks.workunit.client.1.smithi106.stdout:2/291: mkdir d2/d5/db/d1d/d23/d63 0 2024-05-09T06:30:22.218 INFO:tasks.workunit.client.1.smithi106.stdout:2/292: creat d2/d5/db/d1d/d23/d5e/f64 x:0 0 0 2024-05-09T06:30:22.218 INFO:tasks.workunit.client.1.smithi106.stdout:2/293: chown d2/d7/d62 2863 1 2024-05-09T06:30:22.218 INFO:tasks.workunit.client.1.smithi106.stdout:2/294: chown d2/d5/db/d15/d41/d60 51814367 1 2024-05-09T06:30:22.219 INFO:tasks.workunit.client.1.smithi106.stdout:3/249: dread d5/d12/f19 [0,4194304] 0 2024-05-09T06:30:22.220 INFO:tasks.workunit.client.1.smithi106.stdout:2/295: symlink d2/d5/db/d1d/d23/d63/l65 0 2024-05-09T06:30:22.222 INFO:tasks.workunit.client.1.smithi106.stdout:3/250: mkdir d5/d4d 0 2024-05-09T06:30:22.224 INFO:tasks.workunit.client.1.smithi106.stdout:2/296: creat d2/d5/db/d1d/d23/f66 x:0 0 0 2024-05-09T06:30:22.226 INFO:tasks.workunit.client.1.smithi106.stdout:3/251: rmdir d5/d3f 39 2024-05-09T06:30:22.226 INFO:tasks.workunit.client.1.smithi106.stdout:3/252: readlink d5/d1c/d21/l40 0 2024-05-09T06:30:22.226 INFO:tasks.workunit.client.1.smithi106.stdout:3/253: chown d5/c16 5512208 1 2024-05-09T06:30:22.232 INFO:tasks.workunit.client.1.smithi106.stdout:4/207: truncate d7/f29 292953 0 2024-05-09T06:30:22.235 INFO:tasks.workunit.client.1.smithi106.stdout:8/209: sync 2024-05-09T06:30:22.241 INFO:tasks.workunit.client.1.smithi106.stdout:4/208: dread d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:22.241 INFO:tasks.workunit.client.1.smithi106.stdout:4/209: fsync d7/d10/d1a/f1e 0 2024-05-09T06:30:22.243 INFO:tasks.workunit.client.1.smithi106.stdout:8/210: dread d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:22.245 INFO:tasks.workunit.client.1.smithi106.stdout:8/211: write d3/d5/d13/f1b [1121418,27778] 0 2024-05-09T06:30:22.249 INFO:tasks.workunit.client.1.smithi106.stdout:2/297: getdents d2/d5/db/d15/d4f 0 2024-05-09T06:30:22.250 INFO:tasks.workunit.client.1.smithi106.stdout:2/298: dread - d2/d7/f27 zero size 2024-05-09T06:30:22.252 INFO:tasks.workunit.client.1.smithi106.stdout:2/299: symlink d2/d7/l67 0 2024-05-09T06:30:22.254 INFO:tasks.workunit.client.1.smithi106.stdout:2/300: mkdir d2/d5/db/d68 0 2024-05-09T06:30:22.255 INFO:tasks.workunit.client.1.smithi106.stdout:2/301: readlink d2/d7/d2c/l4e 0 2024-05-09T06:30:22.272 INFO:tasks.workunit.client.1.smithi106.stdout:4/210: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:22.272 INFO:tasks.workunit.client.1.smithi106.stdout:4/211: write d7/f9 [3184678,121982] 0 2024-05-09T06:30:22.272 INFO:tasks.workunit.client.1.smithi106.stdout:8/212: dwrite d3/d5/d13/d41/d32/f4a [0,4194304] 0 2024-05-09T06:30:22.272 INFO:tasks.workunit.client.1.smithi106.stdout:2/302: dwrite d2/d5/db/d1d/f3d [4194304,4194304] 0 2024-05-09T06:30:22.278 INFO:tasks.workunit.client.1.smithi106.stdout:4/212: dread d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:22.279 INFO:tasks.workunit.client.1.smithi106.stdout:8/213: mknod d3/c4d 0 2024-05-09T06:30:22.294 INFO:tasks.workunit.client.1.smithi106.stdout:2/303: symlink d2/d5/db/d1d/d23/d63/l69 0 2024-05-09T06:30:22.294 INFO:tasks.workunit.client.1.smithi106.stdout:2/304: write d2/d7/f27 [947993,105028] 0 2024-05-09T06:30:22.296 INFO:tasks.workunit.client.1.smithi106.stdout:4/213: rename l4 to d7/l3d 0 2024-05-09T06:30:22.300 INFO:tasks.workunit.client.1.smithi106.stdout:4/214: creat d7/d10/f3e x:0 0 0 2024-05-09T06:30:22.300 INFO:tasks.workunit.client.1.smithi106.stdout:4/215: dread - d7/d10/d12/d1c/f2c zero size 2024-05-09T06:30:22.301 INFO:tasks.workunit.client.1.smithi106.stdout:2/305: write d2/d5/db/d1d/f3d [3874971,104881] 0 2024-05-09T06:30:22.302 INFO:tasks.workunit.client.1.smithi106.stdout:8/214: rename d3/d5/d13/d41 to d3/d5/d35/d4e 0 2024-05-09T06:30:22.302 INFO:tasks.workunit.client.1.smithi106.stdout:8/215: chown d3/d5/d13/f1b 8025827 1 2024-05-09T06:30:22.304 INFO:tasks.workunit.client.1.smithi106.stdout:4/216: creat d7/d39/f3f x:0 0 0 2024-05-09T06:30:22.304 INFO:tasks.workunit.client.1.smithi106.stdout:4/217: creat d7/f40 x:0 0 0 2024-05-09T06:30:22.305 INFO:tasks.workunit.client.1.smithi106.stdout:2/306: mkdir d2/d5/db/d1d/d6a 0 2024-05-09T06:30:22.305 INFO:tasks.workunit.client.1.smithi106.stdout:2/307: write d2/d7/f1c [1381928,50389] 0 2024-05-09T06:30:22.308 INFO:tasks.workunit.client.1.smithi106.stdout:2/308: mknod d2/d5/db/c6b 0 2024-05-09T06:30:22.308 INFO:tasks.workunit.client.1.smithi106.stdout:2/309: write d2/d5/f13 [4272723,78937] 0 2024-05-09T06:30:22.308 INFO:tasks.workunit.client.1.smithi106.stdout:2/310: chown d2/d7/c20 0 1 2024-05-09T06:30:22.311 INFO:tasks.workunit.client.1.smithi106.stdout:2/311: mknod d2/d5/db/d1d/d23/c6c 0 2024-05-09T06:30:22.312 INFO:tasks.workunit.client.1.smithi106.stdout:4/218: dread f2 [4194304,4194304] 0 2024-05-09T06:30:22.314 INFO:tasks.workunit.client.1.smithi106.stdout:2/312: unlink d2/d5/f40 0 2024-05-09T06:30:22.314 INFO:tasks.workunit.client.1.smithi106.stdout:2/313: chown d2/d5/db/f32 3419043 1 2024-05-09T06:30:22.314 INFO:tasks.workunit.client.1.smithi106.stdout:2/314: readlink d2/d7/l67 0 2024-05-09T06:30:22.321 INFO:tasks.workunit.client.1.smithi106.stdout:4/219: dread d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:22.321 INFO:tasks.workunit.client.1.smithi106.stdout:4/220: stat d7/d10/d1a/c30 0 2024-05-09T06:30:22.321 INFO:tasks.workunit.client.1.smithi106.stdout:4/221: creat d7/f41 x:0 0 0 2024-05-09T06:30:22.327 INFO:tasks.workunit.client.1.smithi106.stdout:4/222: mknod d7/d39/c42 0 2024-05-09T06:30:22.327 INFO:tasks.workunit.client.1.smithi106.stdout:4/223: fdatasync f2 0 2024-05-09T06:30:22.327 INFO:tasks.workunit.client.1.smithi106.stdout:4/224: dread - d7/f2e zero size 2024-05-09T06:30:22.327 INFO:tasks.workunit.client.1.smithi106.stdout:4/225: dread - d7/d10/f1d zero size 2024-05-09T06:30:22.327 INFO:tasks.workunit.client.1.smithi106.stdout:4/226: dread - d7/d10/f1d zero size 2024-05-09T06:30:22.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/216: dwrite d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:22.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/217: fsync d3/d5/d13/f26 0 2024-05-09T06:30:22.331 INFO:tasks.workunit.client.1.smithi106.stdout:2/315: dwrite d2/f26 [8388608,4194304] 0 2024-05-09T06:30:22.335 INFO:tasks.workunit.client.1.smithi106.stdout:2/316: symlink d2/d5/l6d 0 2024-05-09T06:30:22.339 INFO:tasks.workunit.client.1.smithi106.stdout:2/317: symlink d2/d5/db/d1d/d23/d5e/l6e 0 2024-05-09T06:30:22.339 INFO:tasks.workunit.client.1.smithi106.stdout:2/318: write d2/d7/d2c/f34 [546450,13194] 0 2024-05-09T06:30:22.344 INFO:tasks.workunit.client.1.smithi106.stdout:4/227: dread d7/f9 [0,4194304] 0 2024-05-09T06:30:22.344 INFO:tasks.workunit.client.1.smithi106.stdout:4/228: chown d7/f41 9 1 2024-05-09T06:30:22.344 INFO:tasks.workunit.client.1.smithi106.stdout:4/229: creat d7/d10/f43 x:0 0 0 2024-05-09T06:30:22.344 INFO:tasks.workunit.client.1.smithi106.stdout:4/230: getdents d7/d39/d35 0 2024-05-09T06:30:22.347 INFO:tasks.workunit.client.1.smithi106.stdout:8/218: dwrite d3/d5/d7/f37 [4194304,4194304] 0 2024-05-09T06:30:22.370 INFO:tasks.workunit.client.1.smithi106.stdout:8/219: dwrite d3/d5/d13/f36 [4194304,4194304] 0 2024-05-09T06:30:22.370 INFO:tasks.workunit.client.1.smithi106.stdout:2/319: dwrite d2/d5/db/d15/f18 [0,4194304] 0 2024-05-09T06:30:22.376 INFO:tasks.workunit.client.1.smithi106.stdout:8/220: rename d3/d5/d7/f37 to d3/d5/d35/d4e/d32/d4c/f4f 0 2024-05-09T06:30:22.376 INFO:tasks.workunit.client.1.smithi106.stdout:8/221: truncate d3/d5/d13/f40 300355 0 2024-05-09T06:30:22.381 INFO:tasks.workunit.client.1.smithi106.stdout:8/222: mkdir d3/d5/d7/d15/d47/d50 0 2024-05-09T06:30:22.381 INFO:tasks.workunit.client.1.smithi106.stdout:8/223: fdatasync d3/d5/d13/f26 0 2024-05-09T06:30:22.385 INFO:tasks.workunit.client.1.smithi106.stdout:8/224: symlink d3/d5/d35/d4e/d32/l51 0 2024-05-09T06:30:22.385 INFO:tasks.workunit.client.1.smithi106.stdout:8/225: truncate d3/d5/d7/d15/f49 55724 0 2024-05-09T06:30:22.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/226: dread d3/d5/d7/f44 [0,4194304] 0 2024-05-09T06:30:22.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/227: mknod d3/d5/d13/c52 0 2024-05-09T06:30:22.390 INFO:tasks.workunit.client.1.smithi106.stdout:8/228: symlink d3/d5/d35/d4e/l53 0 2024-05-09T06:30:22.393 INFO:tasks.workunit.client.1.smithi106.stdout:8/229: creat d3/d5/d35/d4e/d32/d4c/f54 x:0 0 0 2024-05-09T06:30:22.396 INFO:tasks.workunit.client.1.smithi106.stdout:8/230: rmdir d3/d5/d35/d4e/d32 39 2024-05-09T06:30:22.398 INFO:tasks.workunit.client.1.smithi106.stdout:2/320: dwrite d2/d5/db/d15/d41/d58/f61 [0,4194304] 0 2024-05-09T06:30:22.427 INFO:tasks.workunit.client.1.smithi106.stdout:2/321: dwrite d2/d7/d2c/f42 [0,4194304] 0 2024-05-09T06:30:22.427 INFO:tasks.workunit.client.1.smithi106.stdout:8/231: dwrite d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:22.427 INFO:tasks.workunit.client.1.smithi106.stdout:8/232: write d3/d5/d35/d4e/d32/d4c/f54 [588744,122431] 0 2024-05-09T06:30:22.428 INFO:tasks.workunit.client.1.smithi106.stdout:2/322: dread d2/d5/f54 [0,4194304] 0 2024-05-09T06:30:22.431 INFO:tasks.workunit.client.1.smithi106.stdout:8/233: creat d3/d5/d13/d3a/f55 x:0 0 0 2024-05-09T06:30:22.431 INFO:tasks.workunit.client.1.smithi106.stdout:8/234: stat d3/d5/d35/d4e/l39 0 2024-05-09T06:30:22.432 INFO:tasks.workunit.client.1.smithi106.stdout:8/235: write d3/d5/d13/f40 [1150565,110880] 0 2024-05-09T06:30:22.433 INFO:tasks.workunit.client.1.smithi106.stdout:2/323: mknod d2/d5/c6f 0 2024-05-09T06:30:22.435 INFO:tasks.workunit.client.1.smithi106.stdout:8/236: creat d3/d5/d7/d15/d3e/f56 x:0 0 0 2024-05-09T06:30:22.442 INFO:tasks.workunit.client.1.smithi106.stdout:2/324: dread d2/d5/db/d1d/f3d [4194304,4194304] 0 2024-05-09T06:30:22.442 INFO:tasks.workunit.client.1.smithi106.stdout:2/325: write d2/d7/f25 [2158863,20693] 0 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:8/237: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:8/238: chown d3/d5/d7/ld 495737236 1 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:8/239: fsync d3/d5/d7/f44 0 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:8/240: truncate d3/f6 1514875 0 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:8/241: fsync d3/d5/d35/d4e/d32/f4a 0 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:2/326: dwrite d2/d5/db/d15/f47 [0,4194304] 0 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:2/327: chown d2/c8 1 1 2024-05-09T06:30:22.460 INFO:tasks.workunit.client.1.smithi106.stdout:2/328: creat d2/d5/db/d1d/d23/f70 x:0 0 0 2024-05-09T06:30:22.466 INFO:tasks.workunit.client.1.smithi106.stdout:2/329: creat d2/d5/db/d68/f71 x:0 0 0 2024-05-09T06:30:22.468 INFO:tasks.workunit.client.1.smithi106.stdout:3/254: dwrite f2 [0,4194304] 0 2024-05-09T06:30:22.474 INFO:tasks.workunit.client.1.smithi106.stdout:8/242: dwrite d3/d5/d7/d15/f49 [0,4194304] 0 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/330: read d2/d5/db/d15/f18 [4015604,130807] 0 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/331: write d2/d7/f27 [1227061,83807] 0 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/332: read - d2/d5/db/d68/f71 zero size 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/333: creat d2/d5/db/d15/f72 x:0 0 0 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/334: write d2/d5/db/d68/f71 [957122,45610] 0 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/335: dread - d2/d5/db/d15/d41/f53 zero size 2024-05-09T06:30:22.477 INFO:tasks.workunit.client.1.smithi106.stdout:2/336: chown d2/d7/d2c/l4e 58755325 1 2024-05-09T06:30:22.482 INFO:tasks.workunit.client.1.smithi106.stdout:3/255: dwrite d5/d1c/f47 [0,4194304] 0 2024-05-09T06:30:22.483 INFO:tasks.workunit.client.1.smithi106.stdout:3/256: chown d5/d1c 22 1 2024-05-09T06:30:22.488 INFO:tasks.workunit.client.1.smithi106.stdout:2/337: dread d2/f26 [0,4194304] 0 2024-05-09T06:30:22.488 INFO:tasks.workunit.client.1.smithi106.stdout:2/338: readlink d2/d5/db/d1d/d23/d5e/l6e 0 2024-05-09T06:30:22.488 INFO:tasks.workunit.client.1.smithi106.stdout:2/339: dread - d2/d5/f5d zero size 2024-05-09T06:30:22.489 INFO:tasks.workunit.client.1.smithi106.stdout:3/257: getdents d5/d3f 0 2024-05-09T06:30:22.491 INFO:tasks.workunit.client.1.smithi106.stdout:8/243: dwrite d3/d5/d13/f26 [0,4194304] 0 2024-05-09T06:30:22.494 INFO:tasks.workunit.client.1.smithi106.stdout:2/340: unlink d2/d5/db/f32 0 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:7/225: sync 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:5/279: sync 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:9/249: sync 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:6/264: sync 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:1/272: sync 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:0/235: sync 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:5/280: fsync d8/d1c/f29 0 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:6/265: fdatasync d0/d6/d8/f1d 0 2024-05-09T06:30:22.569 INFO:tasks.workunit.client.1.smithi106.stdout:5/281: creat d8/d33/f4f x:0 0 0 2024-05-09T06:30:22.570 INFO:tasks.workunit.client.1.smithi106.stdout:5/282: chown d8/d33/c34 615 1 2024-05-09T06:30:22.570 INFO:tasks.workunit.client.1.smithi106.stdout:9/250: write d4/d6/d23/d16/f3b [436723,32298] 0 2024-05-09T06:30:22.572 INFO:tasks.workunit.client.1.smithi106.stdout:7/226: mkdir d0/dc/d47 0 2024-05-09T06:30:22.577 INFO:tasks.workunit.client.1.smithi106.stdout:0/236: truncate d1/d11/d23/d13/d2c/f2f 324406 0 2024-05-09T06:30:22.580 INFO:tasks.workunit.client.1.smithi106.stdout:7/227: dread d0/f29 [0,4194304] 0 2024-05-09T06:30:22.580 INFO:tasks.workunit.client.1.smithi106.stdout:7/228: read d0/dc/f14 [305811,48803] 0 2024-05-09T06:30:22.581 INFO:tasks.workunit.client.1.smithi106.stdout:5/283: getdents d8/d45 0 2024-05-09T06:30:22.583 INFO:tasks.workunit.client.1.smithi106.stdout:9/251: rmdir d4/d6 39 2024-05-09T06:30:22.583 INFO:tasks.workunit.client.1.smithi106.stdout:9/252: chown d4/d6/d23/d16/f27 0 1 2024-05-09T06:30:22.586 INFO:tasks.workunit.client.1.smithi106.stdout:0/237: symlink d1/d11/d23/d22/l4d 0 2024-05-09T06:30:22.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:22 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:22.588 INFO:tasks.workunit.client.1.smithi106.stdout:6/266: mknod d0/d17/c56 0 2024-05-09T06:30:22.589 INFO:tasks.workunit.client.1.smithi106.stdout:6/267: write d0/d6/d8/f46 [365740,122215] 0 2024-05-09T06:30:22.589 INFO:tasks.workunit.client.1.smithi106.stdout:6/268: chown d0/d17/d34/f55 47493 1 2024-05-09T06:30:22.592 INFO:tasks.workunit.client.1.smithi106.stdout:7/229: rename d0/l2a to d0/dc/d1a/l48 0 2024-05-09T06:30:22.593 INFO:tasks.workunit.client.1.smithi106.stdout:4/231: fsync d7/d39/f3f 0 2024-05-09T06:30:22.594 INFO:tasks.workunit.client.1.smithi106.stdout:9/253: symlink d4/d6/d23/d2f/l41 0 2024-05-09T06:30:22.598 INFO:tasks.workunit.client.1.smithi106.stdout:5/284: dwrite d8/f10 [4194304,4194304] 0 2024-05-09T06:30:22.598 INFO:tasks.workunit.client.1.smithi106.stdout:5/285: creat d8/f50 x:0 0 0 2024-05-09T06:30:22.598 INFO:tasks.workunit.client.1.smithi106.stdout:5/286: creat d8/f51 x:0 0 0 2024-05-09T06:30:22.599 INFO:tasks.workunit.client.1.smithi106.stdout:0/238: unlink d1/d11/d23/d13/d2c/d3d/f41 0 2024-05-09T06:30:22.603 INFO:tasks.workunit.client.1.smithi106.stdout:0/239: dread d1/fb [0,4194304] 0 2024-05-09T06:30:22.603 INFO:tasks.workunit.client.1.smithi106.stdout:6/269: creat d0/d17/f57 x:0 0 0 2024-05-09T06:30:22.607 INFO:tasks.workunit.client.1.smithi106.stdout:9/254: mkdir d4/d6/d1b/d2a/d42 0 2024-05-09T06:30:22.613 INFO:tasks.workunit.client.1.smithi106.stdout:7/230: dwrite d0/dc/f14 [0,4194304] 0 2024-05-09T06:30:22.613 INFO:tasks.workunit.client.1.smithi106.stdout:7/231: write d0/dc/f25 [205323,53194] 0 2024-05-09T06:30:22.613 INFO:tasks.workunit.client.1.smithi106.stdout:0/240: write d1/d11/d23/f1a [1353080,92862] 0 2024-05-09T06:30:22.613 INFO:tasks.workunit.client.1.smithi106.stdout:0/241: creat d1/d11/d23/d22/f4e x:0 0 0 2024-05-09T06:30:22.614 INFO:tasks.workunit.client.1.smithi106.stdout:5/287: rename d8/d33/f39 to d8/d1c/f52 0 2024-05-09T06:30:22.614 INFO:tasks.workunit.client.1.smithi106.stdout:5/288: chown d8/cb 150922173 1 2024-05-09T06:30:22.614 INFO:tasks.workunit.client.1.smithi106.stdout:5/289: rename d8 to d8/d53 22 2024-05-09T06:30:22.614 INFO:tasks.workunit.client.1.smithi106.stdout:4/232: dwrite d7/d10/d1a/f1e [4194304,4194304] 0 2024-05-09T06:30:22.622 INFO:tasks.workunit.client.1.smithi106.stdout:5/290: dread d8/d45/d4c/f2e [0,4194304] 0 2024-05-09T06:30:22.623 INFO:tasks.workunit.client.1.smithi106.stdout:6/270: mknod d0/d6/d8/c58 0 2024-05-09T06:30:22.623 INFO:tasks.workunit.client.1.smithi106.stdout:6/271: fdatasync d0/d6/fe 0 2024-05-09T06:30:22.625 INFO:tasks.workunit.client.1.smithi106.stdout:9/255: mknod d4/d6/d1b/d2a/d42/c43 0 2024-05-09T06:30:22.626 INFO:tasks.workunit.client.1.smithi106.stdout:9/256: stat d4/d6/d1b/d2a/f26 0 2024-05-09T06:30:22.628 INFO:tasks.workunit.client.1.smithi106.stdout:4/233: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:22.628 INFO:tasks.workunit.client.1.smithi106.stdout:4/234: creat d7/d39/f44 x:0 0 0 2024-05-09T06:30:22.628 INFO:tasks.workunit.client.1.smithi106.stdout:4/235: chown d7/f2e 474 1 2024-05-09T06:30:22.628 INFO:tasks.workunit.client.1.smithi106.stdout:4/236: write d7/d10/f43 [103421,12383] 0 2024-05-09T06:30:22.630 INFO:tasks.workunit.client.1.smithi106.stdout:7/232: link d0/dc/d1a/d36/l37 d0/dc/d1a/d36/d30/l49 0 2024-05-09T06:30:22.633 INFO:tasks.workunit.client.1.smithi106.stdout:0/242: symlink d1/l4f 0 2024-05-09T06:30:22.633 INFO:tasks.workunit.client.1.smithi106.stdout:0/243: chown d1/d11/d23/d13/l37 100203 1 2024-05-09T06:30:22.638 INFO:tasks.workunit.client.1.smithi106.stdout:7/233: dread d0/dc/d1a/f16 [0,4194304] 0 2024-05-09T06:30:22.639 INFO:tasks.workunit.client.1.smithi106.stdout:6/272: rename d0/d6/c23 to d0/d6/d8/d27/d3e/d47/c59 0 2024-05-09T06:30:22.641 INFO:tasks.workunit.client.1.smithi106.stdout:9/257: link d4/d6/d1b/d2a/f1e d4/d6/d23/d2f/d31/f44 0 2024-05-09T06:30:22.642 INFO:tasks.workunit.client.1.smithi106.stdout:9/258: truncate d4/d6/d23/d2f/d31/f32 1011674 0 2024-05-09T06:30:22.642 INFO:tasks.workunit.client.1.smithi106.stdout:9/259: rename d4/d6/d23/d2f/d38 to d4/d6/d23/d2f/d38/d45 22 2024-05-09T06:30:22.645 INFO:tasks.workunit.client.1.smithi106.stdout:4/237: dwrite d7/d28/f27 [0,4194304] 0 2024-05-09T06:30:22.645 INFO:tasks.workunit.client.1.smithi106.stdout:4/238: readlink d7/l3d 0 2024-05-09T06:30:22.645 INFO:tasks.workunit.client.1.smithi106.stdout:4/239: creat d7/d10/d12/d1c/f45 x:0 0 0 2024-05-09T06:30:22.645 INFO:tasks.workunit.client.1.smithi106.stdout:4/240: write d7/f9 [4404688,96494] 0 2024-05-09T06:30:22.648 INFO:tasks.workunit.client.1.smithi106.stdout:0/244: dread d1/d11/d23/d22/f31 [0,4194304] 0 2024-05-09T06:30:22.655 INFO:tasks.workunit.client.1.smithi106.stdout:9/260: creat d4/d6/d23/d2f/d31/f46 x:0 0 0 2024-05-09T06:30:22.655 INFO:tasks.workunit.client.1.smithi106.stdout:6/273: dwrite d0/d17/d34/f55 [0,4194304] 0 2024-05-09T06:30:22.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/241: mkdir d7/d10/d12/d46 0 2024-05-09T06:30:22.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/242: write d7/d39/f32 [157003,120582] 0 2024-05-09T06:30:22.665 INFO:tasks.workunit.client.1.smithi106.stdout:0/245: symlink d1/l50 0 2024-05-09T06:30:22.667 INFO:tasks.workunit.client.1.smithi106.stdout:9/261: mkdir d4/d6/d23/d2f/d47 0 2024-05-09T06:30:22.667 INFO:tasks.workunit.client.1.smithi106.stdout:9/262: write d4/d6/d23/d2f/d31/f32 [1232658,62320] 0 2024-05-09T06:30:22.667 INFO:tasks.workunit.client.1.smithi106.stdout:9/263: readlink d4/l1d 0 2024-05-09T06:30:22.672 INFO:tasks.workunit.client.1.smithi106.stdout:6/274: rename d0/d6/d8/d27/d3e/l3f to d0/d6/d8/d27/l5a 0 2024-05-09T06:30:22.674 INFO:tasks.workunit.client.1.smithi106.stdout:0/246: truncate d1/f3 640055 0 2024-05-09T06:30:22.674 INFO:tasks.workunit.client.1.smithi106.stdout:0/247: chown d1/d11/l1c 56 1 2024-05-09T06:30:22.677 INFO:tasks.workunit.client.1.smithi106.stdout:9/264: dread d4/d6/d1b/d2a/f20 [0,4194304] 0 2024-05-09T06:30:22.682 INFO:tasks.workunit.client.1.smithi106.stdout:0/248: link d1/d11/l33 d1/d11/d23/d13/d2c/d3d/l51 0 2024-05-09T06:30:22.682 INFO:tasks.workunit.client.1.smithi106.stdout:0/249: fdatasync d1/d11/d23/d13/f14 0 2024-05-09T06:30:22.682 INFO:tasks.workunit.client.1.smithi106.stdout:0/250: write d1/fb [1094921,18125] 0 2024-05-09T06:30:22.683 INFO:tasks.workunit.client.1.smithi106.stdout:9/265: truncate d4/d6/d23/d2f/d38/f40 2892300 0 2024-05-09T06:30:22.683 INFO:tasks.workunit.client.1.smithi106.stdout:9/266: chown d4/d6/d23/l22 694311 1 2024-05-09T06:30:22.684 INFO:tasks.workunit.client.1.smithi106.stdout:0/251: read d1/d11/d23/d22/f31 [582560,90725] 0 2024-05-09T06:30:22.686 INFO:tasks.workunit.client.1.smithi106.stdout:9/267: link d4/d6/d1b/d2a/d42/c43 d4/c48 0 2024-05-09T06:30:22.692 INFO:tasks.workunit.client.1.smithi106.stdout:0/252: dread d1/d11/d23/d13/d2c/f2d [0,4194304] 0 2024-05-09T06:30:22.694 INFO:tasks.workunit.client.1.smithi106.stdout:6/275: dwrite d0/d6/fe [0,4194304] 0 2024-05-09T06:30:22.694 INFO:tasks.workunit.client.1.smithi106.stdout:9/268: write d4/d6/d1b/d2a/f1e [1565153,65619] 0 2024-05-09T06:30:22.697 INFO:tasks.workunit.client.1.smithi106.stdout:6/276: unlink d0/d17/f36 0 2024-05-09T06:30:22.699 INFO:tasks.workunit.client.1.smithi106.stdout:9/269: mkdir d4/d6/d23/d2f/d31/d49 0 2024-05-09T06:30:22.699 INFO:tasks.workunit.client.1.smithi106.stdout:9/270: write d4/d6/d23/d16/f35 [333719,68573] 0 2024-05-09T06:30:22.699 INFO:tasks.workunit.client.1.smithi106.stdout:9/271: readlink d4/l1d 0 2024-05-09T06:30:22.701 INFO:tasks.workunit.client.1.smithi106.stdout:0/253: getdents d1/d11/d23 0 2024-05-09T06:30:22.704 INFO:tasks.workunit.client.1.smithi106.stdout:6/277: symlink d0/d6/l5b 0 2024-05-09T06:30:22.706 INFO:tasks.workunit.client.1.smithi106.stdout:6/278: mkdir d0/d5c 0 2024-05-09T06:30:22.706 INFO:tasks.workunit.client.1.smithi106.stdout:6/279: write d0/d6/f37 [1022461,45267] 0 2024-05-09T06:30:22.707 INFO:tasks.workunit.client.1.smithi106.stdout:6/280: creat d0/d6/f5d x:0 0 0 2024-05-09T06:30:22.708 INFO:tasks.workunit.client.1.smithi106.stdout:0/254: dread d1/d11/d23/f1a [0,4194304] 0 2024-05-09T06:30:22.712 INFO:tasks.workunit.client.1.smithi106.stdout:6/281: mknod d0/d6/d8/d27/d3e/c5e 0 2024-05-09T06:30:22.714 INFO:tasks.workunit.client.1.smithi106.stdout:0/255: creat d1/d11/f52 x:0 0 0 2024-05-09T06:30:22.717 INFO:tasks.workunit.client.1.smithi106.stdout:0/256: creat d1/d11/d23/f53 x:0 0 0 2024-05-09T06:30:22.718 INFO:tasks.workunit.client.1.smithi106.stdout:9/272: dwrite d4/d6/d23/d2f/d31/f44 [0,4194304] 0 2024-05-09T06:30:22.729 INFO:tasks.workunit.client.1.smithi106.stdout:0/257: write d1/d11/f3c [491171,35775] 0 2024-05-09T06:30:22.729 INFO:tasks.workunit.client.1.smithi106.stdout:0/258: creat d1/d11/d23/d13/f54 x:0 0 0 2024-05-09T06:30:22.730 INFO:tasks.workunit.client.1.smithi106.stdout:0/259: chown d1/d11/d23/d13/l1b 2230 1 2024-05-09T06:30:22.730 INFO:tasks.workunit.client.1.smithi106.stdout:6/282: dwrite d0/d17/d21/f2b [4194304,4194304] 0 2024-05-09T06:30:22.739 INFO:tasks.workunit.client.1.smithi106.stdout:0/260: rename d1/d11/d23/f2a to d1/d11/d23/d13/d2c/d3d/f55 0 2024-05-09T06:30:22.740 INFO:tasks.workunit.client.1.smithi106.stdout:0/261: fdatasync d1/d11/d23/f24 0 2024-05-09T06:30:22.741 INFO:tasks.workunit.client.1.smithi106.stdout:0/262: dread d1/d11/d23/d13/f3f [0,4194304] 0 2024-05-09T06:30:22.741 INFO:tasks.workunit.client.1.smithi106.stdout:0/263: creat d1/d11/f56 x:0 0 0 2024-05-09T06:30:22.746 INFO:tasks.workunit.client.1.smithi106.stdout:6/283: dwrite d0/d6/f28 [0,4194304] 0 2024-05-09T06:30:22.746 INFO:tasks.workunit.client.1.smithi106.stdout:6/284: chown d0/d17/d21/f2b 1 1 2024-05-09T06:30:22.750 INFO:tasks.workunit.client.1.smithi106.stdout:0/264: mkdir d1/d11/d23/d13/d2c/d57 0 2024-05-09T06:30:22.755 INFO:tasks.workunit.client.1.smithi106.stdout:6/285: unlink d0/ca 0 2024-05-09T06:30:22.757 INFO:tasks.workunit.client.1.smithi106.stdout:0/265: mkdir d1/d11/d23/d13/d58 0 2024-05-09T06:30:22.757 INFO:tasks.workunit.client.1.smithi106.stdout:0/266: chown d1/d11/d23/d13/f15 164723 1 2024-05-09T06:30:22.757 INFO:tasks.workunit.client.1.smithi106.stdout:0/267: stat d1/d11/c44 0 2024-05-09T06:30:22.757 INFO:tasks.workunit.client.1.smithi106.stdout:0/268: creat d1/d11/d23/d22/f59 x:0 0 0 2024-05-09T06:30:22.762 INFO:tasks.workunit.client.1.smithi106.stdout:0/269: mknod d1/d11/d23/d13/d58/c5a 0 2024-05-09T06:30:22.762 INFO:tasks.workunit.client.1.smithi106.stdout:0/270: truncate d1/d11/f56 670638 0 2024-05-09T06:30:22.762 INFO:tasks.workunit.client.1.smithi106.stdout:6/286: write d0/d17/d34/f55 [69847,33166] 0 2024-05-09T06:30:22.762 INFO:tasks.workunit.client.1.smithi106.stdout:6/287: write d0/d17/f57 [486420,91385] 0 2024-05-09T06:30:22.762 INFO:tasks.workunit.client.1.smithi106.stdout:6/288: chown d0/lc 1375541327 1 2024-05-09T06:30:22.763 INFO:tasks.workunit.client.1.smithi106.stdout:6/289: write d0/d6/f37 [976481,11180] 0 2024-05-09T06:30:22.765 INFO:tasks.workunit.client.1.smithi106.stdout:0/271: rename d1/d11/f52 to d1/d11/d23/d22/f5b 0 2024-05-09T06:30:22.765 INFO:tasks.workunit.client.1.smithi106.stdout:0/272: creat d1/d11/d23/d13/f5c x:0 0 0 2024-05-09T06:30:22.789 INFO:tasks.workunit.client.1.smithi106.stdout:2/341: truncate d2/d5/db/d68/f71 497742 0 2024-05-09T06:30:22.789 INFO:tasks.workunit.client.1.smithi106.stdout:2/342: readlink d2/d5/db/d1d/d23/d63/l69 0 2024-05-09T06:30:22.789 INFO:tasks.workunit.client.1.smithi106.stdout:2/343: write f0 [1408569,47398] 0 2024-05-09T06:30:22.789 INFO:tasks.workunit.client.1.smithi106.stdout:2/344: dread - d2/d5/db/d15/f72 zero size 2024-05-09T06:30:22.789 INFO:tasks.workunit.client.1.smithi106.stdout:2/345: write d2/d7/d2c/f42 [4365684,11946] 0 2024-05-09T06:30:22.790 INFO:tasks.workunit.client.1.smithi106.stdout:2/346: fsync d2/d7/f25 0 2024-05-09T06:30:22.796 INFO:tasks.workunit.client.1.smithi106.stdout:8/244: dwrite d3/d5/d13/f26 [4194304,4194304] 0 2024-05-09T06:30:22.802 INFO:tasks.workunit.client.1.smithi106.stdout:8/245: symlink d3/d5/d35/d4e/l57 0 2024-05-09T06:30:22.804 INFO:tasks.workunit.client.1.smithi106.stdout:8/246: mkdir d3/d5/d7/d58 0 2024-05-09T06:30:22.806 INFO:tasks.workunit.client.1.smithi106.stdout:2/347: dwrite d2/d5/db/d15/f72 [0,4194304] 0 2024-05-09T06:30:22.806 INFO:tasks.workunit.client.1.smithi106.stdout:2/348: write d2/d5/db/f1b [3086236,33574] 0 2024-05-09T06:30:22.813 INFO:tasks.workunit.client.1.smithi106.stdout:8/247: rmdir d3/d5/d7/d15 39 2024-05-09T06:30:22.817 INFO:tasks.workunit.client.1.smithi106.stdout:8/248: mknod d3/d5/d7/d15/d3e/c59 0 2024-05-09T06:30:22.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:22 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:22.830 INFO:tasks.workunit.client.1.smithi106.stdout:8/249: dwrite d3/d5/f12 [0,4194304] 0 2024-05-09T06:30:22.830 INFO:tasks.workunit.client.1.smithi106.stdout:8/250: creat d3/d5/f5a x:0 0 0 2024-05-09T06:30:22.830 INFO:tasks.workunit.client.1.smithi106.stdout:8/251: fsync d3/d5/d13/f14 0 2024-05-09T06:30:22.831 INFO:tasks.workunit.client.1.smithi106.stdout:8/252: write d3/d5/d13/f40 [950525,28066] 0 2024-05-09T06:30:22.833 INFO:tasks.workunit.client.1.smithi106.stdout:8/253: rename d3/d5/d7/d15/c17 to d3/d5/d35/d4e/c5b 0 2024-05-09T06:30:22.840 INFO:tasks.workunit.client.1.smithi106.stdout:8/254: write d3/d5/d13/f26 [5109838,48322] 0 2024-05-09T06:30:22.840 INFO:tasks.workunit.client.1.smithi106.stdout:8/255: getdents d3/d5/d7/d58 0 2024-05-09T06:30:22.856 INFO:tasks.workunit.client.1.smithi106.stdout:8/256: dwrite d3/d5/f12 [4194304,4194304] 0 2024-05-09T06:30:22.871 INFO:tasks.workunit.client.1.smithi106.stdout:8/257: dwrite d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:22.873 INFO:tasks.workunit.client.1.smithi106.stdout:5/291: rmdir d8/d33 39 2024-05-09T06:30:22.881 INFO:tasks.workunit.client.1.smithi106.stdout:8/258: read d3/d5/d13/f1b [3710344,45010] 0 2024-05-09T06:30:22.881 INFO:tasks.workunit.client.1.smithi106.stdout:8/259: chown d3/d5/d35/d4e/d32/d4c/f4f 73800 1 2024-05-09T06:30:22.884 INFO:tasks.workunit.client.1.smithi106.stdout:8/260: rename d3/d5/d7/c28 to d3/d5/d7/c5c 0 2024-05-09T06:30:22.886 INFO:tasks.workunit.client.1.smithi106.stdout:7/234: write d0/dc/f14 [4698807,60002] 0 2024-05-09T06:30:22.888 INFO:tasks.workunit.client.1.smithi106.stdout:7/235: dread d0/dc/d1a/d36/d30/f3b [0,4194304] 0 2024-05-09T06:30:22.892 INFO:tasks.workunit.client.1.smithi106.stdout:7/236: truncate d0/f5 205138 0 2024-05-09T06:30:22.892 INFO:tasks.workunit.client.1.smithi106.stdout:7/237: read d0/f9 [1009763,77836] 0 2024-05-09T06:30:22.892 INFO:tasks.workunit.client.1.smithi106.stdout:7/238: truncate d0/dc/f25 721881 0 2024-05-09T06:30:22.892 INFO:tasks.workunit.client.1.smithi106.stdout:8/261: dread d3/d5/d13/f2e [0,4194304] 0 2024-05-09T06:30:22.895 INFO:tasks.workunit.client.1.smithi106.stdout:8/262: link d3/d5/d7/ld d3/d5/d7/d15/l5d 0 2024-05-09T06:30:22.897 INFO:tasks.workunit.client.1.smithi106.stdout:5/292: dwrite d8/d1c/f52 [4194304,4194304] 0 2024-05-09T06:30:22.897 INFO:tasks.workunit.client.1.smithi106.stdout:5/293: truncate d8/f51 76073 0 2024-05-09T06:30:22.899 INFO:tasks.workunit.client.1.smithi106.stdout:8/263: unlink d3/d5/d35/f4b 0 2024-05-09T06:30:22.905 INFO:tasks.workunit.client.1.smithi106.stdout:5/294: dread d8/f4b [0,4194304] 0 2024-05-09T06:30:22.905 INFO:tasks.workunit.client.1.smithi106.stdout:5/295: truncate d8/f1a 1910669 0 2024-05-09T06:30:22.907 INFO:tasks.workunit.client.1.smithi106.stdout:8/264: write d3/d5/d13/f36 [6385050,6603] 0 2024-05-09T06:30:22.913 INFO:tasks.workunit.client.1.smithi106.stdout:5/296: read d8/d1c/f41 [415224,93090] 0 2024-05-09T06:30:22.914 INFO:tasks.workunit.client.1.smithi106.stdout:8/265: symlink d3/d5/d7/d15/l5e 0 2024-05-09T06:30:22.924 INFO:tasks.workunit.client.1.smithi106.stdout:5/297: dwrite d8/d1c/f24 [0,4194304] 0 2024-05-09T06:30:22.925 INFO:tasks.workunit.client.1.smithi106.stdout:5/298: write d8/f12 [21607,87574] 0 2024-05-09T06:30:22.926 INFO:tasks.workunit.client.1.smithi106.stdout:5/299: dread d8/f51 [0,4194304] 0 2024-05-09T06:30:22.926 INFO:tasks.workunit.client.1.smithi106.stdout:5/300: fsync d8/d33/f3b 0 2024-05-09T06:30:22.929 INFO:tasks.workunit.client.1.smithi106.stdout:5/301: mknod d8/d45/d4c/c54 0 2024-05-09T06:30:22.930 INFO:tasks.workunit.client.1.smithi106.stdout:5/302: chown d8/f1a 50495693 1 2024-05-09T06:30:22.930 INFO:tasks.workunit.client.1.smithi106.stdout:5/303: read - d8/d33/f4f zero size 2024-05-09T06:30:22.932 INFO:tasks.workunit.client.1.smithi106.stdout:5/304: creat d8/d45/f55 x:0 0 0 2024-05-09T06:30:22.932 INFO:tasks.workunit.client.1.smithi106.stdout:5/305: write d8/f51 [658725,17757] 0 2024-05-09T06:30:22.948 INFO:tasks.workunit.client.1.smithi106.stdout:0/273: dwrite d1/f3 [0,4194304] 0 2024-05-09T06:30:22.949 INFO:tasks.workunit.client.1.smithi106.stdout:0/274: write d1/d11/d23/d22/f59 [784479,22859] 0 2024-05-09T06:30:22.949 INFO:tasks.workunit.client.1.smithi106.stdout:0/275: chown d1/d11/d23/f1a 4986667 1 2024-05-09T06:30:22.949 INFO:tasks.workunit.client.1.smithi106.stdout:0/276: fdatasync d1/d11/d23/d13/d2c/f2f 0 2024-05-09T06:30:22.953 INFO:tasks.workunit.client.1.smithi106.stdout:0/277: link d1/c20 d1/d11/d23/c5d 0 2024-05-09T06:30:22.953 INFO:tasks.workunit.client.1.smithi106.stdout:0/278: chown d1/d11/d23/d13/d2c/f2d 31 1 2024-05-09T06:30:22.965 INFO:tasks.workunit.client.1.smithi106.stdout:6/290: rmdir d0/d17 39 2024-05-09T06:30:22.967 INFO:tasks.workunit.client.1.smithi106.stdout:0/279: dwrite d1/d11/d23/d13/f5c [0,4194304] 0 2024-05-09T06:30:22.973 INFO:tasks.workunit.client.1.smithi106.stdout:0/280: mknod d1/d11/d23/d13/d58/c5e 0 2024-05-09T06:30:22.977 INFO:tasks.workunit.client.1.smithi106.stdout:6/291: dwrite d0/d6/f5d [0,4194304] 0 2024-05-09T06:30:22.987 INFO:tasks.workunit.client.1.smithi106.stdout:0/281: dwrite d1/d11/d23/d22/f31 [0,4194304] 0 2024-05-09T06:30:22.987 INFO:tasks.workunit.client.1.smithi106.stdout:0/282: write d1/f43 [389678,80848] 0 2024-05-09T06:30:22.987 INFO:tasks.workunit.client.1.smithi106.stdout:0/283: write d1/d11/d23/d13/f14 [3193057,51942] 0 2024-05-09T06:30:22.988 INFO:tasks.workunit.client.1.smithi106.stdout:0/284: creat d1/d11/d23/f5f x:0 0 0 2024-05-09T06:30:22.991 INFO:tasks.workunit.client.1.smithi106.stdout:6/292: rename d0/d6 to d0/d17/d34/d5f 0 2024-05-09T06:30:22.996 INFO:tasks.workunit.client.1.smithi106.stdout:0/285: rename d1/d11/d23/f24 to d1/d11/d23/d13/d58/f60 0 2024-05-09T06:30:22.996 INFO:tasks.workunit.client.1.smithi106.stdout:0/286: fdatasync d1/f4a 0 2024-05-09T06:30:22.998 INFO:tasks.workunit.client.1.smithi106.stdout:6/293: dread d0/f5 [0,4194304] 0 2024-05-09T06:30:23.000 INFO:tasks.workunit.client.1.smithi106.stdout:0/287: mknod d1/d11/d23/d22/c61 0 2024-05-09T06:30:23.002 INFO:tasks.workunit.client.1.smithi106.stdout:6/294: symlink d0/d17/d34/d5f/d40/l60 0 2024-05-09T06:30:23.002 INFO:tasks.workunit.client.1.smithi106.stdout:6/295: rename d0/d17/d34/d5f/d8/d27 to d0/d17/d34/d5f/d8/d27/d3e/d47/d61 22 2024-05-09T06:30:23.015 INFO:tasks.workunit.client.1.smithi106.stdout:0/288: dwrite d1/f43 [0,4194304] 0 2024-05-09T06:30:23.017 INFO:tasks.workunit.client.1.smithi106.stdout:0/289: symlink d1/d11/d23/d13/d2c/l62 0 2024-05-09T06:30:23.017 INFO:tasks.workunit.client.1.smithi106.stdout:0/290: readlink d1/d11/l33 0 2024-05-09T06:30:23.020 INFO:tasks.workunit.client.1.smithi106.stdout:0/291: mkdir d1/d11/d23/d13/d63 0 2024-05-09T06:30:23.020 INFO:tasks.workunit.client.1.smithi106.stdout:0/292: readlink d1/d11/l33 0 2024-05-09T06:30:23.020 INFO:tasks.workunit.client.1.smithi106.stdout:0/293: creat d1/d11/d23/f64 x:0 0 0 2024-05-09T06:30:23.020 INFO:tasks.workunit.client.1.smithi106.stdout:0/294: chown d1/d11/d23/d22/l42 101 1 2024-05-09T06:30:23.023 INFO:tasks.workunit.client.1.smithi106.stdout:0/295: mknod d1/d11/d23/c65 0 2024-05-09T06:30:23.023 INFO:tasks.workunit.client.1.smithi106.stdout:0/296: readlink d1/d11/l33 0 2024-05-09T06:30:23.026 INFO:tasks.workunit.client.1.smithi106.stdout:0/297: rename d1/d11/l1e to d1/d11/d23/d13/l66 0 2024-05-09T06:30:23.028 INFO:tasks.workunit.client.1.smithi106.stdout:0/298: symlink d1/d11/d23/d13/d63/l67 0 2024-05-09T06:30:23.030 INFO:tasks.workunit.client.1.smithi106.stdout:0/299: symlink d1/d11/d23/d13/d58/l68 0 2024-05-09T06:30:23.036 INFO:tasks.workunit.client.1.smithi106.stdout:0/300: write d1/d11/d23/d22/f31 [3965231,29524] 0 2024-05-09T06:30:23.041 INFO:tasks.workunit.client.1.smithi106.stdout:4/243: sync 2024-05-09T06:30:23.041 INFO:tasks.workunit.client.1.smithi106.stdout:1/273: sync 2024-05-09T06:30:23.041 INFO:tasks.workunit.client.1.smithi106.stdout:9/273: sync 2024-05-09T06:30:23.041 INFO:tasks.workunit.client.1.smithi106.stdout:3/258: sync 2024-05-09T06:30:23.041 INFO:tasks.workunit.client.1.smithi106.stdout:1/274: fdatasync d4/d5/d9/d13/f19 0 2024-05-09T06:30:23.041 INFO:tasks.workunit.client.1.smithi106.stdout:3/259: readlink d5/l6 0 2024-05-09T06:30:23.042 INFO:tasks.workunit.client.1.smithi106.stdout:6/296: dwrite d0/d17/d21/f2b [0,4194304] 0 2024-05-09T06:30:23.044 INFO:tasks.workunit.client.1.smithi106.stdout:1/275: link f2 d4/d5/d9/d65/d67/f68 0 2024-05-09T06:30:23.051 INFO:tasks.workunit.client.1.smithi106.stdout:1/276: creat d4/d37/d3d/f69 x:0 0 0 2024-05-09T06:30:23.054 INFO:tasks.workunit.client.1.smithi106.stdout:1/277: truncate d4/f1f 1008676 0 2024-05-09T06:30:23.055 INFO:tasks.workunit.client.1.smithi106.stdout:4/244: write f2 [6044823,6581] 0 2024-05-09T06:30:23.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/245: mkdir d7/d39/d47 0 2024-05-09T06:30:23.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/246: dread - d7/f40 zero size 2024-05-09T06:30:23.065 INFO:tasks.workunit.client.1.smithi106.stdout:0/301: dwrite d1/f3 [4194304,4194304] 0 2024-05-09T06:30:23.066 INFO:tasks.workunit.client.1.smithi106.stdout:4/247: rmdir d7/d10/d1a 39 2024-05-09T06:30:23.078 INFO:tasks.workunit.client.1.smithi106.stdout:4/248: write d7/d28/f27 [3670793,7615] 0 2024-05-09T06:30:23.078 INFO:tasks.workunit.client.1.smithi106.stdout:4/249: read - d7/d39/f44 zero size 2024-05-09T06:30:23.080 INFO:tasks.workunit.client.1.smithi106.stdout:9/274: dwrite d4/d6/d1b/f3e [0,4194304] 0 2024-05-09T06:30:23.081 INFO:tasks.workunit.client.1.smithi106.stdout:9/275: write d4/f28 [849644,79517] 0 2024-05-09T06:30:23.082 INFO:tasks.workunit.client.1.smithi106.stdout:6/297: dwrite d0/d17/f25 [0,4194304] 0 2024-05-09T06:30:23.082 INFO:tasks.workunit.client.1.smithi106.stdout:6/298: chown d0/d17/d34/d5f/d8/d27/d3e/d47/l49 98 1 2024-05-09T06:30:23.083 INFO:tasks.workunit.client.1.smithi106.stdout:3/260: dwrite d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:23.083 INFO:tasks.workunit.client.1.smithi106.stdout:1/278: dwrite d4/d5/d9/d1d/f41 [0,4194304] 0 2024-05-09T06:30:23.089 INFO:tasks.workunit.client.1.smithi106.stdout:0/302: dwrite d1/d11/d23/f27 [0,4194304] 0 2024-05-09T06:30:23.089 INFO:tasks.workunit.client.1.smithi106.stdout:1/279: mknod d4/d37/d3d/c6a 0 2024-05-09T06:30:23.095 INFO:tasks.workunit.client.1.smithi106.stdout:0/303: rename d1/la to d1/d11/d23/d13/d2c/d3d/l69 0 2024-05-09T06:30:23.095 INFO:tasks.workunit.client.1.smithi106.stdout:0/304: write d1/f4b [796390,24423] 0 2024-05-09T06:30:23.095 INFO:tasks.workunit.client.1.smithi106.stdout:0/305: write d1/d11/d23/f64 [831823,90273] 0 2024-05-09T06:30:23.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/306: symlink d1/d11/d23/d13/d2c/d57/l6a 0 2024-05-09T06:30:23.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/307: stat d1/d11/d23/f27 0 2024-05-09T06:30:23.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/308: write d1/d11/d23/f1f [3293158,14503] 0 2024-05-09T06:30:23.114 INFO:tasks.workunit.client.1.smithi106.stdout:4/250: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:23.116 INFO:tasks.workunit.client.1.smithi106.stdout:6/299: dwrite d0/d17/d34/f45 [0,4194304] 0 2024-05-09T06:30:23.116 INFO:tasks.workunit.client.1.smithi106.stdout:6/300: chown d0/d17/d34/d5f/f24 37073516 1 2024-05-09T06:30:23.116 INFO:tasks.workunit.client.1.smithi106.stdout:6/301: chown d0/d17/d34/d5f/d8/d27/d3e/d47/l4d 20711416 1 2024-05-09T06:30:23.117 INFO:tasks.workunit.client.1.smithi106.stdout:6/302: dread d0/d17/d34/d5f/d8/d27/f3a [4194304,4194304] 0 2024-05-09T06:30:23.117 INFO:tasks.workunit.client.1.smithi106.stdout:6/303: fdatasync d0/d17/f1e 0 2024-05-09T06:30:23.118 INFO:tasks.workunit.client.1.smithi106.stdout:3/261: dwrite d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:23.119 INFO:tasks.workunit.client.1.smithi106.stdout:9/276: dwrite d4/d6/d23/d2f/d31/f32 [0,4194304] 0 2024-05-09T06:30:23.120 INFO:tasks.workunit.client.1.smithi106.stdout:9/277: chown d4/d6/d1b/d2a/d42 1711886 1 2024-05-09T06:30:23.120 INFO:tasks.workunit.client.1.smithi106.stdout:0/309: dwrite d1/f3 [4194304,4194304] 0 2024-05-09T06:30:23.120 INFO:tasks.workunit.client.1.smithi106.stdout:0/310: write d1/d11/d23/f53 [214778,81466] 0 2024-05-09T06:30:23.120 INFO:tasks.workunit.client.1.smithi106.stdout:0/311: fdatasync d1/d11/d23/d13/d2c/f2d 0 2024-05-09T06:30:23.122 INFO:tasks.workunit.client.1.smithi106.stdout:6/304: mkdir d0/d17/d34/d5f/d8/d27/d3b/d62 0 2024-05-09T06:30:23.126 INFO:tasks.workunit.client.1.smithi106.stdout:3/262: symlink d5/d4d/l4e 0 2024-05-09T06:30:23.139 INFO:tasks.workunit.client.1.smithi106.stdout:9/278: rmdir d4/d6/d23/d2f/d31/d49 0 2024-05-09T06:30:23.143 INFO:tasks.workunit.client.1.smithi106.stdout:6/305: creat d0/d17/f63 x:0 0 0 2024-05-09T06:30:23.145 INFO:tasks.workunit.client.1.smithi106.stdout:3/263: creat d5/d3f/f4f x:0 0 0 2024-05-09T06:30:23.147 INFO:tasks.workunit.client.1.smithi106.stdout:9/279: creat d4/d6/d23/d2f/d39/f4a x:0 0 0 2024-05-09T06:30:23.147 INFO:tasks.workunit.client.1.smithi106.stdout:9/280: fsync d4/d6/d23/d2f/d31/f33 0 2024-05-09T06:30:23.153 INFO:tasks.workunit.client.1.smithi106.stdout:6/306: write d0/d17/d21/f26 [2639617,11762] 0 2024-05-09T06:30:23.155 INFO:tasks.workunit.client.1.smithi106.stdout:3/264: dread d5/d12/f15 [0,4194304] 0 2024-05-09T06:30:23.156 INFO:tasks.workunit.client.1.smithi106.stdout:3/265: write d5/d12/f45 [286710,96352] 0 2024-05-09T06:30:23.156 INFO:tasks.workunit.client.1.smithi106.stdout:9/281: write d4/d6/d1b/f3e [581310,121932] 0 2024-05-09T06:30:23.156 INFO:tasks.workunit.client.1.smithi106.stdout:6/307: rmdir d0/d17/d34/d5f/d8/d27/d3e 39 2024-05-09T06:30:23.159 INFO:tasks.workunit.client.1.smithi106.stdout:3/266: mknod d5/d1c/d21/d32/c50 0 2024-05-09T06:30:23.162 INFO:tasks.workunit.client.1.smithi106.stdout:6/308: unlink d0/d17/d34/d5f/d8/d27/d3e/d47/l4d 0 2024-05-09T06:30:23.163 INFO:tasks.workunit.client.1.smithi106.stdout:9/282: read d4/d6/d23/d2f/d31/f32 [879886,16209] 0 2024-05-09T06:30:23.167 INFO:tasks.workunit.client.1.smithi106.stdout:6/309: rename d0/lc to d0/d17/d34/d5f/d40/l64 0 2024-05-09T06:30:23.171 INFO:tasks.workunit.client.1.smithi106.stdout:6/310: rename d0/d17/d34/f45 to d0/d17/d34/f65 0 2024-05-09T06:30:23.171 INFO:tasks.workunit.client.1.smithi106.stdout:6/311: dread - d0/d17/d34/d5f/d8/d27/d3b/f4b zero size 2024-05-09T06:30:23.171 INFO:tasks.workunit.client.1.smithi106.stdout:6/312: chown d0/d17/f29 99 1 2024-05-09T06:30:23.174 INFO:tasks.workunit.client.1.smithi106.stdout:2/349: sync 2024-05-09T06:30:23.174 INFO:tasks.workunit.client.1.smithi106.stdout:2/350: creat d2/d5/db/d1d/d23/f73 x:0 0 0 2024-05-09T06:30:23.180 INFO:tasks.workunit.client.1.smithi106.stdout:2/351: unlink d2/d5/f13 0 2024-05-09T06:30:23.180 INFO:tasks.workunit.client.1.smithi106.stdout:9/283: dwrite d4/d6/d23/d16/f27 [0,4194304] 0 2024-05-09T06:30:23.180 INFO:tasks.workunit.client.1.smithi106.stdout:2/352: creat d2/d5/db/d15/d41/f74 x:0 0 0 2024-05-09T06:30:23.190 INFO:tasks.workunit.client.1.smithi106.stdout:2/353: dread d2/d7/d2c/f42 [0,4194304] 0 2024-05-09T06:30:23.190 INFO:tasks.workunit.client.1.smithi106.stdout:6/313: dwrite d0/d17/d21/f26 [4194304,4194304] 0 2024-05-09T06:30:23.191 INFO:tasks.workunit.client.1.smithi106.stdout:9/284: mknod d4/d6/d23/d2f/d47/c4b 0 2024-05-09T06:30:23.202 INFO:tasks.workunit.client.1.smithi106.stdout:2/354: write d2/d5/db/d15/d41/d58/f50 [2369899,20106] 0 2024-05-09T06:30:23.206 INFO:tasks.workunit.client.1.smithi106.stdout:9/285: write d4/d6/d1b/d2a/f1e [1893114,80561] 0 2024-05-09T06:30:23.208 INFO:tasks.workunit.client.1.smithi106.stdout:9/286: creat d4/d6/d23/d16/f4c x:0 0 0 2024-05-09T06:30:23.209 INFO:tasks.workunit.client.1.smithi106.stdout:9/287: fsync d4/d6/d23/f21 0 2024-05-09T06:30:23.209 INFO:tasks.workunit.client.1.smithi106.stdout:9/288: chown d4/d6/d23/d2f/d38/f40 1 1 2024-05-09T06:30:23.209 INFO:tasks.workunit.client.1.smithi106.stdout:2/355: write d2/f2b [17109,39244] 0 2024-05-09T06:30:23.210 INFO:tasks.workunit.client.1.smithi106.stdout:6/314: dwrite d0/d17/d34/f55 [4194304,4194304] 0 2024-05-09T06:30:23.211 INFO:tasks.workunit.client.1.smithi106.stdout:9/289: creat d4/d6/d23/d2f/d47/f4d x:0 0 0 2024-05-09T06:30:23.214 INFO:tasks.workunit.client.1.smithi106.stdout:2/356: link d2/d7/l3b d2/d5/db/d1d/d23/d63/l75 0 2024-05-09T06:30:23.223 INFO:tasks.workunit.client.1.smithi106.stdout:2/357: getdents d2/d7 0 2024-05-09T06:30:23.226 INFO:tasks.workunit.client.1.smithi106.stdout:6/315: dwrite d0/d17/d34/d5f/d8/f1d [0,4194304] 0 2024-05-09T06:30:23.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/316: readlink d0/d17/d34/d5f/l5b 0 2024-05-09T06:30:23.232 INFO:tasks.workunit.client.1.smithi106.stdout:6/317: mkdir d0/d66 0 2024-05-09T06:30:23.236 INFO:tasks.workunit.client.1.smithi106.stdout:6/318: mknod d0/d17/d34/d4e/c67 0 2024-05-09T06:30:23.238 INFO:tasks.workunit.client.1.smithi106.stdout:6/319: creat d0/d17/d34/d5f/d8/d27/d3e/f68 x:0 0 0 2024-05-09T06:30:23.241 INFO:tasks.workunit.client.1.smithi106.stdout:2/358: dwrite d2/d5/db/d15/d41/d58/f45 [8388608,4194304] 0 2024-05-09T06:30:23.241 INFO:tasks.workunit.client.1.smithi106.stdout:2/359: creat d2/d5/db/d68/f76 x:0 0 0 2024-05-09T06:30:23.246 INFO:tasks.workunit.client.1.smithi106.stdout:2/360: symlink d2/d5/db/d1d/l77 0 2024-05-09T06:30:23.253 INFO:tasks.workunit.client.1.smithi106.stdout:7/239: sync 2024-05-09T06:30:23.253 INFO:tasks.workunit.client.1.smithi106.stdout:7/240: dread - d0/dc/f10 zero size 2024-05-09T06:30:23.253 INFO:tasks.workunit.client.1.smithi106.stdout:7/241: creat d0/f4a x:0 0 0 2024-05-09T06:30:23.254 INFO:tasks.workunit.client.1.smithi106.stdout:2/361: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:23.254 INFO:tasks.workunit.client.1.smithi106.stdout:2/362: read d2/d5/db/d15/f18 [1009540,128613] 0 2024-05-09T06:30:23.254 INFO:tasks.workunit.client.1.smithi106.stdout:2/363: truncate d2/d5/db/d1d/d23/f70 587168 0 2024-05-09T06:30:23.254 INFO:tasks.workunit.client.1.smithi106.stdout:2/364: creat d2/d7/d2c/f78 x:0 0 0 2024-05-09T06:30:23.258 INFO:tasks.workunit.client.1.smithi106.stdout:8/266: sync 2024-05-09T06:30:23.259 INFO:tasks.workunit.client.1.smithi106.stdout:5/306: sync 2024-05-09T06:30:23.259 INFO:tasks.workunit.client.1.smithi106.stdout:5/307: chown d8/l21 3 1 2024-05-09T06:30:23.262 INFO:tasks.workunit.client.1.smithi106.stdout:8/267: link d3/d5/d7/ld d3/d5/d7/d58/l5f 0 2024-05-09T06:30:23.262 INFO:tasks.workunit.client.1.smithi106.stdout:8/268: truncate d3/f6 1920816 0 2024-05-09T06:30:23.262 INFO:tasks.workunit.client.1.smithi106.stdout:8/269: creat d3/d5/d7/f60 x:0 0 0 2024-05-09T06:30:23.270 INFO:tasks.workunit.client.1.smithi106.stdout:7/242: dwrite d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:23.271 INFO:tasks.workunit.client.1.smithi106.stdout:8/270: read d3/d5/d13/f26 [452301,21371] 0 2024-05-09T06:30:23.275 INFO:tasks.workunit.client.1.smithi106.stdout:8/271: truncate d3/d5/d13/f26 924096 0 2024-05-09T06:30:23.276 INFO:tasks.workunit.client.1.smithi106.stdout:5/308: dwrite d8/f4b [0,4194304] 0 2024-05-09T06:30:23.277 INFO:tasks.workunit.client.1.smithi106.stdout:5/309: chown d8/d33/l49 22794143 1 2024-05-09T06:30:23.278 INFO:tasks.workunit.client.1.smithi106.stdout:8/272: truncate d3/d5/d13/f36 3623711 0 2024-05-09T06:30:23.289 INFO:tasks.workunit.client.1.smithi106.stdout:0/312: getdents d1/d11/d23 0 2024-05-09T06:30:23.294 INFO:tasks.workunit.client.1.smithi106.stdout:5/310: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:30:23.294 INFO:tasks.workunit.client.1.smithi106.stdout:5/311: truncate d8/d1c/f29 5600759 0 2024-05-09T06:30:23.295 INFO:tasks.workunit.client.1.smithi106.stdout:5/312: write d8/d33/f4f [717533,29142] 0 2024-05-09T06:30:23.297 INFO:tasks.workunit.client.1.smithi106.stdout:8/273: dwrite d3/d5/d13/f40 [0,4194304] 0 2024-05-09T06:30:23.297 INFO:tasks.workunit.client.1.smithi106.stdout:0/313: dread d1/d11/d23/d13/d2c/d3d/f55 [0,4194304] 0 2024-05-09T06:30:23.299 INFO:tasks.workunit.client.1.smithi106.stdout:0/314: write d1/d11/d23/f64 [292760,78771] 0 2024-05-09T06:30:23.299 INFO:tasks.workunit.client.1.smithi106.stdout:0/315: dread - d1/d11/d23/d22/f45 zero size 2024-05-09T06:30:23.299 INFO:tasks.workunit.client.1.smithi106.stdout:0/316: truncate d1/d11/d23/d22/f5b 768054 0 2024-05-09T06:30:23.299 INFO:tasks.workunit.client.1.smithi106.stdout:5/313: mknod d8/d45/c56 0 2024-05-09T06:30:23.299 INFO:tasks.workunit.client.1.smithi106.stdout:5/314: chown d8/d33/c34 331 1 2024-05-09T06:30:23.303 INFO:tasks.workunit.client.1.smithi106.stdout:8/274: mkdir d3/d5/d35/d61 0 2024-05-09T06:30:23.305 INFO:tasks.workunit.client.1.smithi106.stdout:0/317: mknod d1/d11/c6b 0 2024-05-09T06:30:23.307 INFO:tasks.workunit.client.1.smithi106.stdout:5/315: write d8/d1c/f29 [153683,18668] 0 2024-05-09T06:30:23.307 INFO:tasks.workunit.client.1.smithi106.stdout:8/275: link d3/d5/f5a d3/d5/d7/d15/d47/f62 0 2024-05-09T06:30:23.309 INFO:tasks.workunit.client.1.smithi106.stdout:0/318: rmdir d1/d11/d23 39 2024-05-09T06:30:23.310 INFO:tasks.workunit.client.1.smithi106.stdout:8/276: getdents d3 0 2024-05-09T06:30:23.313 INFO:tasks.workunit.client.1.smithi106.stdout:0/319: mknod d1/d11/d23/c6c 0 2024-05-09T06:30:23.315 INFO:tasks.workunit.client.1.smithi106.stdout:8/277: creat d3/d5/d35/d61/f63 x:0 0 0 2024-05-09T06:30:23.316 INFO:tasks.workunit.client.1.smithi106.stdout:5/316: read d8/d1c/f52 [4532866,68241] 0 2024-05-09T06:30:23.318 INFO:tasks.workunit.client.1.smithi106.stdout:8/278: mknod d3/d5/d7/d58/c64 0 2024-05-09T06:30:23.321 INFO:tasks.workunit.client.1.smithi106.stdout:8/279: mknod d3/d5/d35/d4e/d32/d4c/c65 0 2024-05-09T06:30:23.327 INFO:tasks.workunit.client.1.smithi106.stdout:8/280: mknod d3/d5/d7/c66 0 2024-05-09T06:30:23.327 INFO:tasks.workunit.client.1.smithi106.stdout:0/320: dwrite d1/d11/d23/d13/d2c/d3d/f55 [0,4194304] 0 2024-05-09T06:30:23.332 INFO:tasks.workunit.client.1.smithi106.stdout:0/321: mkdir d1/d11/d23/d13/d2c/d6d 0 2024-05-09T06:30:23.333 INFO:tasks.workunit.client.1.smithi106.stdout:0/322: chown d1/d11/d23/c5d 344 1 2024-05-09T06:30:23.333 INFO:tasks.workunit.client.1.smithi106.stdout:0/323: fdatasync d1/f7 0 2024-05-09T06:30:23.335 INFO:tasks.workunit.client.1.smithi106.stdout:0/324: getdents d1/d11/d23/d13/d58 0 2024-05-09T06:30:23.346 INFO:tasks.workunit.client.1.smithi106.stdout:8/281: dwrite d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:23.347 INFO:tasks.workunit.client.1.smithi106.stdout:4/251: truncate d7/d28/f27 4052138 0 2024-05-09T06:30:23.349 INFO:tasks.workunit.client.1.smithi106.stdout:8/282: link d3/d5/d13/f14 d3/d5/d35/d4e/f67 0 2024-05-09T06:30:23.349 INFO:tasks.workunit.client.1.smithi106.stdout:8/283: creat d3/d5/d35/f68 x:0 0 0 2024-05-09T06:30:23.349 INFO:tasks.workunit.client.1.smithi106.stdout:8/284: rename d3/d5/d7 to d3/d5/d7/d15/d3e/d69 22 2024-05-09T06:30:23.351 INFO:tasks.workunit.client.1.smithi106.stdout:4/252: mknod d7/d39/d35/c48 0 2024-05-09T06:30:23.351 INFO:tasks.workunit.client.1.smithi106.stdout:4/253: creat d7/d10/d12/d1c/f49 x:0 0 0 2024-05-09T06:30:23.351 INFO:tasks.workunit.client.1.smithi106.stdout:4/254: readlink d7/d10/d12/d1c/l13 0 2024-05-09T06:30:23.353 INFO:tasks.workunit.client.1.smithi106.stdout:0/325: dwrite d1/fb [0,4194304] 0 2024-05-09T06:30:23.353 INFO:tasks.workunit.client.1.smithi106.stdout:0/326: creat d1/d11/d23/d22/f6e x:0 0 0 2024-05-09T06:30:23.356 INFO:tasks.workunit.client.1.smithi106.stdout:8/285: rename d3/d5/d35/d4e/f30 to d3/d5/d7/f6a 0 2024-05-09T06:30:23.361 INFO:tasks.workunit.client.1.smithi106.stdout:0/327: truncate d1/d11/d23/d22/f59 634696 0 2024-05-09T06:30:23.364 INFO:tasks.workunit.client.1.smithi106.stdout:0/328: creat d1/d11/d23/d13/d2c/d6d/f6f x:0 0 0 2024-05-09T06:30:23.367 INFO:tasks.workunit.client.1.smithi106.stdout:0/329: mkdir d1/d11/d23/d13/d2c/d6d/d70 0 2024-05-09T06:30:23.367 INFO:tasks.workunit.client.1.smithi106.stdout:4/255: dwrite d7/d39/f32 [0,4194304] 0 2024-05-09T06:30:23.376 INFO:tasks.workunit.client.1.smithi106.stdout:0/330: creat d1/d11/d23/d13/d58/f71 x:0 0 0 2024-05-09T06:30:23.376 INFO:tasks.workunit.client.1.smithi106.stdout:0/331: fdatasync d1/d11/d23/d13/d58/f71 0 2024-05-09T06:30:23.377 INFO:tasks.workunit.client.1.smithi106.stdout:4/256: dread f2 [0,4194304] 0 2024-05-09T06:30:23.377 INFO:tasks.workunit.client.1.smithi106.stdout:4/257: truncate d7/fb 4737758 0 2024-05-09T06:30:23.377 INFO:tasks.workunit.client.1.smithi106.stdout:0/332: dread d1/f4b [0,4194304] 0 2024-05-09T06:30:23.380 INFO:tasks.workunit.client.1.smithi106.stdout:0/333: symlink d1/d11/d23/d13/d2c/l72 0 2024-05-09T06:30:23.380 INFO:tasks.workunit.client.1.smithi106.stdout:0/334: creat d1/d11/d23/d13/d2c/d6d/f73 x:0 0 0 2024-05-09T06:30:23.380 INFO:tasks.workunit.client.1.smithi106.stdout:0/335: write d1/d11/f3c [4874508,72247] 0 2024-05-09T06:30:23.380 INFO:tasks.workunit.client.1.smithi106.stdout:0/336: creat d1/d11/d23/d22/f74 x:0 0 0 2024-05-09T06:30:23.380 INFO:tasks.workunit.client.1.smithi106.stdout:0/337: chown d1/d11/d23/f27 3691 1 2024-05-09T06:30:23.396 INFO:tasks.workunit.client.1.smithi106.stdout:9/290: truncate d4/d6/d23/d2f/d31/f32 596741 0 2024-05-09T06:30:23.397 INFO:tasks.workunit.client.1.smithi106.stdout:9/291: read d4/d6/d23/d16/f35 [275801,69743] 0 2024-05-09T06:30:23.397 INFO:tasks.workunit.client.1.smithi106.stdout:9/292: stat d4/d6 0 2024-05-09T06:30:23.397 INFO:tasks.workunit.client.1.smithi106.stdout:9/293: chown d4/d6/d23/d2f/d38 151781 1 2024-05-09T06:30:23.400 INFO:tasks.workunit.client.1.smithi106.stdout:9/294: creat d4/d6/d23/f4e x:0 0 0 2024-05-09T06:30:23.402 INFO:tasks.workunit.client.1.smithi106.stdout:9/295: creat d4/d6/d1b/d2a/d42/f4f x:0 0 0 2024-05-09T06:30:23.403 INFO:tasks.workunit.client.1.smithi106.stdout:9/296: creat d4/d6/d23/d2f/d31/f50 x:0 0 0 2024-05-09T06:30:23.403 INFO:tasks.workunit.client.1.smithi106.stdout:9/297: write d4/d6/d23/d2f/d31/f44 [2412647,105081] 0 2024-05-09T06:30:23.405 INFO:tasks.workunit.client.1.smithi106.stdout:9/298: getdents d4/d6/d23/d2f/d38 0 2024-05-09T06:30:23.414 INFO:tasks.workunit.client.1.smithi106.stdout:3/267: rmdir d5/d1c/d21/d32 39 2024-05-09T06:30:23.417 INFO:tasks.workunit.client.1.smithi106.stdout:3/268: truncate d5/fe 508428 0 2024-05-09T06:30:23.426 INFO:tasks.workunit.client.1.smithi106.stdout:3/269: dread d5/d12/f19 [0,4194304] 0 2024-05-09T06:30:23.476 INFO:tasks.workunit.client.1.smithi106.stdout:2/365: fsync d2/d5/db/d68/f76 0 2024-05-09T06:30:23.490 INFO:tasks.workunit.client.1.smithi106.stdout:2/366: dwrite d2/d7/f27 [0,4194304] 0 2024-05-09T06:30:23.490 INFO:tasks.workunit.client.1.smithi106.stdout:2/367: readlink d2/d7/l67 0 2024-05-09T06:30:23.496 INFO:tasks.workunit.client.1.smithi106.stdout:2/368: symlink d2/d5/l79 0 2024-05-09T06:30:23.499 INFO:tasks.workunit.client.1.smithi106.stdout:2/369: mkdir d2/d5/db/d1d/d23/d63/d7a 0 2024-05-09T06:30:23.499 INFO:tasks.workunit.client.1.smithi106.stdout:2/370: read d2/d7/f25 [3062678,63310] 0 2024-05-09T06:30:23.499 INFO:tasks.workunit.client.1.smithi106.stdout:2/371: write d2/f2b [340691,90995] 0 2024-05-09T06:30:23.499 INFO:tasks.workunit.client.1.smithi106.stdout:2/372: chown d2/d7/f1c 204 1 2024-05-09T06:30:23.503 INFO:tasks.workunit.client.1.smithi106.stdout:2/373: link d2/d5/db/d15/l52 d2/d5/db/d1d/d23/d5e/l7b 0 2024-05-09T06:30:23.504 INFO:tasks.workunit.client.1.smithi106.stdout:2/374: read - d2/d5/f5d zero size 2024-05-09T06:30:23.511 INFO:tasks.workunit.client.1.smithi106.stdout:2/375: getdents d2/d5/db/d15 0 2024-05-09T06:30:23.511 INFO:tasks.workunit.client.1.smithi106.stdout:2/376: chown d2/d5/c6f 100265941 1 2024-05-09T06:30:23.514 INFO:tasks.workunit.client.1.smithi106.stdout:8/286: unlink d3/d5/d13/f26 0 2024-05-09T06:30:23.516 INFO:tasks.workunit.client.1.smithi106.stdout:2/377: unlink d2/d7/d2c/l4e 0 2024-05-09T06:30:23.518 INFO:tasks.workunit.client.1.smithi106.stdout:8/287: truncate d3/d5/d13/f29 3625653 0 2024-05-09T06:30:23.520 INFO:tasks.workunit.client.1.smithi106.stdout:2/378: creat d2/d5/db/d15/d4f/f7c x:0 0 0 2024-05-09T06:30:23.533 INFO:tasks.workunit.client.1.smithi106.stdout:8/288: dwrite d3/d5/d7/f60 [0,4194304] 0 2024-05-09T06:30:23.533 INFO:tasks.workunit.client.1.smithi106.stdout:8/289: chown d3/d5/d35/d61/f63 33296779 1 2024-05-09T06:30:23.539 INFO:tasks.workunit.client.1.smithi106.stdout:8/290: mkdir d3/d6b 0 2024-05-09T06:30:23.545 INFO:tasks.workunit.client.1.smithi106.stdout:8/291: dread d3/d5/d7/d15/f49 [0,4194304] 0 2024-05-09T06:30:23.549 INFO:tasks.workunit.client.1.smithi106.stdout:8/292: unlink d3/d5/d35/d4e/d32/c33 0 2024-05-09T06:30:23.549 INFO:tasks.workunit.client.1.smithi106.stdout:8/293: fdatasync d3/d5/d7/f6a 0 2024-05-09T06:30:23.550 INFO:tasks.workunit.client.1.smithi106.stdout:8/294: mkdir d3/d5/d35/d61/d6c 0 2024-05-09T06:30:23.553 INFO:tasks.workunit.client.1.smithi106.stdout:8/295: unlink d3/l2c 0 2024-05-09T06:30:23.556 INFO:tasks.workunit.client.1.smithi106.stdout:8/296: link d3/d5/d35/d4e/f67 d3/d5/d7/d58/f6d 0 2024-05-09T06:30:23.556 INFO:tasks.workunit.client.1.smithi106.stdout:8/297: chown d3/d5/d7/d15 743 1 2024-05-09T06:30:23.556 INFO:tasks.workunit.client.1.smithi106.stdout:8/298: chown d3/d5/d13/f36 117641 1 2024-05-09T06:30:23.556 INFO:tasks.workunit.client.1.smithi106.stdout:8/299: dread - d3/d5/d7/d15/d47/f62 zero size 2024-05-09T06:30:23.558 INFO:tasks.workunit.client.1.smithi106.stdout:8/300: symlink d3/l6e 0 2024-05-09T06:30:23.558 INFO:tasks.workunit.client.1.smithi106.stdout:8/301: chown d3/d5/d7/c66 78 1 2024-05-09T06:30:23.558 INFO:tasks.workunit.client.1.smithi106.stdout:8/302: write d3/d5/d7/f6a [265260,22865] 0 2024-05-09T06:30:23.558 INFO:tasks.workunit.client.1.smithi106.stdout:8/303: creat d3/d5/d13/f6f x:0 0 0 2024-05-09T06:30:23.564 INFO:tasks.workunit.client.1.smithi106.stdout:8/304: dread d3/d5/d13/f36 [0,4194304] 0 2024-05-09T06:30:23.566 INFO:tasks.workunit.client.1.smithi106.stdout:8/305: dread d3/d5/d35/d4e/f67 [4194304,4194304] 0 2024-05-09T06:30:23.574 INFO:tasks.workunit.client.1.smithi106.stdout:1/280: sync 2024-05-09T06:30:23.577 INFO:tasks.workunit.client.1.smithi106.stdout:1/281: creat d4/d5/d9/d13/f6b x:0 0 0 2024-05-09T06:30:23.577 INFO:tasks.workunit.client.1.smithi106.stdout:1/282: readlink d4/d37/d4a/l52 0 2024-05-09T06:30:23.578 INFO:tasks.workunit.client.1.smithi106.stdout:1/283: read - d4/d5/f5e zero size 2024-05-09T06:30:23.578 INFO:tasks.workunit.client.1.smithi106.stdout:1/284: chown d4/d37/d4a/f56 1230 1 2024-05-09T06:30:23.579 INFO:tasks.workunit.client.1.smithi106.stdout:1/285: mknod d4/d5/d9/d13/d2f/c6c 0 2024-05-09T06:30:23.582 INFO:tasks.workunit.client.1.smithi106.stdout:1/286: mknod d4/d5/d9/c6d 0 2024-05-09T06:30:23.582 INFO:tasks.workunit.client.1.smithi106.stdout:1/287: creat d4/d37/d3d/f6e x:0 0 0 2024-05-09T06:30:23.583 INFO:tasks.workunit.client.1.smithi106.stdout:1/288: readlink d4/d37/d3d/l5d 0 2024-05-09T06:30:23.586 INFO:tasks.workunit.client.1.smithi106.stdout:1/289: mknod d4/d37/d4a/c6f 0 2024-05-09T06:30:23.588 INFO:tasks.workunit.client.1.smithi106.stdout:1/290: rmdir d4/d5/d9 39 2024-05-09T06:30:23.591 INFO:tasks.workunit.client.1.smithi106.stdout:1/291: mkdir d4/d5/d9/d13/d2f/d70 0 2024-05-09T06:30:23.591 INFO:tasks.workunit.client.1.smithi106.stdout:1/292: chown d4/d5/d9/d13/f3e 5 1 2024-05-09T06:30:23.591 INFO:tasks.workunit.client.1.smithi106.stdout:1/293: write d4/d5/d9/fe [4562772,119654] 0 2024-05-09T06:30:23.596 INFO:tasks.workunit.client.1.smithi106.stdout:1/294: rename d4/d5/d9/d1d/f47 to d4/d5/d9/d13/d60/f71 0 2024-05-09T06:30:23.597 INFO:tasks.workunit.client.1.smithi106.stdout:1/295: creat d4/d5/d9/d13/f72 x:0 0 0 2024-05-09T06:30:23.601 INFO:tasks.workunit.client.1.smithi106.stdout:1/296: dread d4/d5/d9/d1d/f3c [0,4194304] 0 2024-05-09T06:30:23.601 INFO:tasks.workunit.client.1.smithi106.stdout:4/258: truncate d7/d39/f32 1678840 0 2024-05-09T06:30:23.602 INFO:tasks.workunit.client.1.smithi106.stdout:4/259: write d7/d10/f1d [815397,37510] 0 2024-05-09T06:30:23.602 INFO:tasks.workunit.client.1.smithi106.stdout:4/260: readlink d7/d10/d1a/l37 0 2024-05-09T06:30:23.603 INFO:tasks.workunit.client.1.smithi106.stdout:1/297: link d4/f1a d4/d37/d3d/f73 0 2024-05-09T06:30:23.605 INFO:tasks.workunit.client.1.smithi106.stdout:4/261: mkdir d7/d39/d35/d4a 0 2024-05-09T06:30:23.608 INFO:tasks.workunit.client.1.smithi106.stdout:4/262: symlink d7/d39/d35/d4a/l4b 0 2024-05-09T06:30:23.611 INFO:tasks.workunit.client.1.smithi106.stdout:0/338: getdents d1/d11/d23/d13/d2c/d6d 0 2024-05-09T06:30:23.612 INFO:tasks.workunit.client.1.smithi106.stdout:1/298: dread d4/d5/d9/fe [0,4194304] 0 2024-05-09T06:30:23.612 INFO:tasks.workunit.client.1.smithi106.stdout:1/299: chown d4/d5/d9/f5f 42 1 2024-05-09T06:30:23.622 INFO:tasks.workunit.client.1.smithi106.stdout:1/300: dread d4/d5/d9/f11 [0,4194304] 0 2024-05-09T06:30:23.622 INFO:tasks.workunit.client.1.smithi106.stdout:1/301: write d4/d5/d9/d13/f2b [1152604,41869] 0 2024-05-09T06:30:23.624 INFO:tasks.workunit.client.1.smithi106.stdout:1/302: mkdir d4/d37/d74 0 2024-05-09T06:30:23.627 INFO:tasks.workunit.client.1.smithi106.stdout:1/303: mkdir d4/d5b/d75 0 2024-05-09T06:30:23.627 INFO:tasks.workunit.client.1.smithi106.stdout:6/320: sync 2024-05-09T06:30:23.630 INFO:tasks.workunit.client.1.smithi106.stdout:1/304: truncate d4/d5/f7 847521 0 2024-05-09T06:30:23.633 INFO:tasks.workunit.client.1.smithi106.stdout:1/305: truncate d4/fa 424876 0 2024-05-09T06:30:23.634 INFO:tasks.workunit.client.1.smithi106.stdout:1/306: write d4/f15 [74430,71105] 0 2024-05-09T06:30:23.636 INFO:tasks.workunit.client.1.smithi106.stdout:6/321: dread d0/d17/d34/d5f/d8/d27/f2c [0,4194304] 0 2024-05-09T06:30:23.639 INFO:tasks.workunit.client.1.smithi106.stdout:6/322: unlink d0/d17/d34/d5f/d8/d27/d3e/d47/l49 0 2024-05-09T06:30:23.639 INFO:tasks.workunit.client.1.smithi106.stdout:6/323: fsync d0/d17/d34/f44 0 2024-05-09T06:30:23.639 INFO:tasks.workunit.client.1.smithi106.stdout:6/324: chown d0/d17 0 1 2024-05-09T06:30:23.639 INFO:tasks.workunit.client.1.smithi106.stdout:6/325: dread - d0/d17/d34/d5f/d8/d27/d3b/f4b zero size 2024-05-09T06:30:23.643 INFO:tasks.workunit.client.1.smithi106.stdout:6/326: truncate d0/d17/d34/d5f/d8/f1d 3204597 0 2024-05-09T06:30:23.654 INFO:tasks.workunit.client.1.smithi106.stdout:3/270: dread d5/fe [0,4194304] 0 2024-05-09T06:30:23.656 INFO:tasks.workunit.client.1.smithi106.stdout:3/271: mknod d5/d4d/c51 0 2024-05-09T06:30:23.656 INFO:tasks.workunit.client.1.smithi106.stdout:3/272: readlink d5/l6 0 2024-05-09T06:30:23.656 INFO:tasks.workunit.client.1.smithi106.stdout:3/273: truncate d5/d3f/f4f 912195 0 2024-05-09T06:30:23.662 INFO:tasks.workunit.client.1.smithi106.stdout:6/327: dwrite d0/f19 [0,4194304] 0 2024-05-09T06:30:23.666 INFO:tasks.workunit.client.1.smithi106.stdout:3/274: write d5/d1c/f47 [4188685,17009] 0 2024-05-09T06:30:23.666 INFO:tasks.workunit.client.1.smithi106.stdout:6/328: creat d0/d17/d34/f69 x:0 0 0 2024-05-09T06:30:23.669 INFO:tasks.workunit.client.1.smithi106.stdout:3/275: mkdir d5/d1c/d24/d52 0 2024-05-09T06:30:23.669 INFO:tasks.workunit.client.1.smithi106.stdout:3/276: chown d5/d1c/f33 4797519 1 2024-05-09T06:30:23.670 INFO:tasks.workunit.client.1.smithi106.stdout:6/329: creat d0/f6a x:0 0 0 2024-05-09T06:30:23.672 INFO:tasks.workunit.client.1.smithi106.stdout:3/277: mkdir d5/d1c/d53 0 2024-05-09T06:30:23.674 INFO:tasks.workunit.client.1.smithi106.stdout:6/330: link d0/d17/d34/d5f/d8/l52 d0/d17/d3d/l6b 0 2024-05-09T06:30:23.674 INFO:tasks.workunit.client.1.smithi106.stdout:6/331: fdatasync d0/d17/d34/d5f/d40/f41 0 2024-05-09T06:30:23.674 INFO:tasks.workunit.client.1.smithi106.stdout:6/332: chown d0/d17/d34/d5f/d8/d50 0 1 2024-05-09T06:30:23.678 INFO:tasks.workunit.client.1.smithi106.stdout:6/333: mkdir d0/d17/d34/d5f/d8/d27/d3e/d6c 0 2024-05-09T06:30:23.678 INFO:tasks.workunit.client.1.smithi106.stdout:6/334: write d0/f30 [588605,96179] 0 2024-05-09T06:30:23.679 INFO:tasks.workunit.client.1.smithi106.stdout:6/335: creat d0/d17/d34/f6d x:0 0 0 2024-05-09T06:30:23.679 INFO:tasks.workunit.client.1.smithi106.stdout:3/278: dread f1 [0,4194304] 0 2024-05-09T06:30:23.682 INFO:tasks.workunit.client.1.smithi106.stdout:6/336: creat d0/d17/d34/d5f/d8/f6e x:0 0 0 2024-05-09T06:30:23.683 INFO:tasks.workunit.client.1.smithi106.stdout:3/279: getdents d5/d1c/d21/d32 0 2024-05-09T06:30:23.694 INFO:tasks.workunit.client.1.smithi106.stdout:6/337: dread d0/d17/d34/d5f/fe [0,4194304] 0 2024-05-09T06:30:23.697 INFO:tasks.workunit.client.1.smithi106.stdout:6/338: rename d0/d17/d34/d5f/d8/d27/d3e/f68 to d0/d17/d34/d5f/d8/d27/f6f 0 2024-05-09T06:30:23.706 INFO:tasks.workunit.client.1.smithi106.stdout:3/280: dwrite d5/d3f/f4a [0,4194304] 0 2024-05-09T06:30:23.710 INFO:tasks.workunit.client.1.smithi106.stdout:6/339: dread d0/d17/f25 [0,4194304] 0 2024-05-09T06:30:23.710 INFO:tasks.workunit.client.1.smithi106.stdout:6/340: creat d0/d17/d34/d5f/d8/f70 x:0 0 0 2024-05-09T06:30:23.712 INFO:tasks.workunit.client.1.smithi106.stdout:3/281: link d5/d1c/d21/l40 d5/d1c/d53/l54 0 2024-05-09T06:30:23.716 INFO:tasks.workunit.client.1.smithi106.stdout:3/282: dread d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:23.716 INFO:tasks.workunit.client.1.smithi106.stdout:6/341: unlink d0/d17/d34/d5f/d8/d27/d3e/c5e 0 2024-05-09T06:30:23.716 INFO:tasks.workunit.client.1.smithi106.stdout:3/283: getdents d5/d12/d26 0 2024-05-09T06:30:23.718 INFO:tasks.workunit.client.1.smithi106.stdout:3/284: unlink d5/d12/f15 0 2024-05-09T06:30:23.720 INFO:tasks.workunit.client.1.smithi106.stdout:6/342: rename d0/d17/d34/f55 to d0/d17/d3d/f71 0 2024-05-09T06:30:23.723 INFO:tasks.workunit.client.1.smithi106.stdout:6/343: unlink d0/d17/f22 0 2024-05-09T06:30:23.725 INFO:tasks.workunit.client.1.smithi106.stdout:3/285: write d5/d1c/d24/f35 [259105,40492] 0 2024-05-09T06:30:23.725 INFO:tasks.workunit.client.1.smithi106.stdout:3/286: getdents d5/d1c/d24/d52 0 2024-05-09T06:30:23.729 INFO:tasks.workunit.client.1.smithi106.stdout:3/287: creat d5/d1c/d24/f55 x:0 0 0 2024-05-09T06:30:23.729 INFO:tasks.workunit.client.1.smithi106.stdout:3/288: rename d5/d4d to d5/d4d/d56 22 2024-05-09T06:30:23.729 INFO:tasks.workunit.client.1.smithi106.stdout:3/289: truncate d5/d3f/f4f 1305355 0 2024-05-09T06:30:23.729 INFO:tasks.workunit.client.1.smithi106.stdout:6/344: write d0/d17/d34/d5f/fe [1466799,74674] 0 2024-05-09T06:30:23.729 INFO:tasks.workunit.client.1.smithi106.stdout:6/345: stat d0/d17/d34/d5f/d8/d27/d3e 0 2024-05-09T06:30:23.730 INFO:tasks.workunit.client.1.smithi106.stdout:6/346: stat d0/d17/d34/d5f/d8/f70 0 2024-05-09T06:30:23.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/347: dread d0/d17/d34/d5f/fb [0,4194304] 0 2024-05-09T06:30:23.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/348: dread - d0/d17/d34/f69 zero size 2024-05-09T06:30:23.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/349: chown d0/d17/d34/d5f/d8/l1b 399 1 2024-05-09T06:30:23.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/350: chown d0/d17/d34/d5f/d8/c1a 36 1 2024-05-09T06:30:23.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/351: readlink d0/d17/d34/d5f/d8/d27/l5a 0 2024-05-09T06:30:23.733 INFO:tasks.workunit.client.1.smithi106.stdout:6/352: mkdir d0/d17/d34/d72 0 2024-05-09T06:30:23.736 INFO:tasks.workunit.client.1.smithi106.stdout:6/353: mknod d0/d5c/c73 0 2024-05-09T06:30:23.742 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:23 smithi046 ceph-mon[26924]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s rd, 15 MiB/s wr, 377 op/s 2024-05-09T06:30:23.744 INFO:tasks.workunit.client.1.smithi106.stdout:3/290: dwrite d5/d1c/d24/f43 [0,4194304] 0 2024-05-09T06:30:23.748 INFO:tasks.workunit.client.1.smithi106.stdout:7/243: sync 2024-05-09T06:30:23.748 INFO:tasks.workunit.client.1.smithi106.stdout:5/317: sync 2024-05-09T06:30:23.752 INFO:tasks.workunit.client.1.smithi106.stdout:3/291: rename d5/d1c/l2e to d5/d1c/d53/l57 0 2024-05-09T06:30:23.755 INFO:tasks.workunit.client.1.smithi106.stdout:6/354: dwrite d0/d17/d3d/f71 [4194304,4194304] 0 2024-05-09T06:30:23.757 INFO:tasks.workunit.client.1.smithi106.stdout:7/244: dread d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:23.757 INFO:tasks.workunit.client.1.smithi106.stdout:7/245: fsync d0/dc/d1a/d36/d1e/f21 0 2024-05-09T06:30:23.757 INFO:tasks.workunit.client.1.smithi106.stdout:3/292: unlink d5/d1c/c2a 0 2024-05-09T06:30:23.758 INFO:tasks.workunit.client.1.smithi106.stdout:6/355: symlink d0/d66/l74 0 2024-05-09T06:30:23.758 INFO:tasks.workunit.client.1.smithi106.stdout:6/356: dread - d0/d17/d34/d5f/d8/f6e zero size 2024-05-09T06:30:23.759 INFO:tasks.workunit.client.1.smithi106.stdout:3/293: truncate d5/d12/f13 3092465 0 2024-05-09T06:30:23.765 INFO:tasks.workunit.client.1.smithi106.stdout:5/318: dwrite d8/f12 [0,4194304] 0 2024-05-09T06:30:23.765 INFO:tasks.workunit.client.1.smithi106.stdout:5/319: stat d8/d1c/l40 0 2024-05-09T06:30:23.774 INFO:tasks.workunit.client.1.smithi106.stdout:7/246: dwrite d0/f9 [0,4194304] 0 2024-05-09T06:30:23.774 INFO:tasks.workunit.client.1.smithi106.stdout:7/247: chown d0/dc/f43 192064158 1 2024-05-09T06:30:23.777 INFO:tasks.workunit.client.1.smithi106.stdout:7/248: rmdir d0/dc/d1a/d36/d30 39 2024-05-09T06:30:23.780 INFO:tasks.workunit.client.1.smithi106.stdout:7/249: unlink d0/f5 0 2024-05-09T06:30:23.782 INFO:tasks.workunit.client.1.smithi106.stdout:5/320: dwrite d8/d33/f4a [0,4194304] 0 2024-05-09T06:30:23.788 INFO:tasks.workunit.client.1.smithi106.stdout:5/321: unlink d8/d1c/l2d 0 2024-05-09T06:30:23.790 INFO:tasks.workunit.client.1.smithi106.stdout:5/322: symlink d8/d45/d4c/d32/l57 0 2024-05-09T06:30:23.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:23 smithi106 ceph-mon[34679]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.4 MiB/s rd, 15 MiB/s wr, 377 op/s 2024-05-09T06:30:23.834 INFO:tasks.workunit.client.1.smithi106.stdout:9/299: sync 2024-05-09T06:30:23.837 INFO:tasks.workunit.client.1.smithi106.stdout:9/300: getdents d4 0 2024-05-09T06:30:23.839 INFO:tasks.workunit.client.1.smithi106.stdout:4/263: write d7/d39/f32 [230139,56096] 0 2024-05-09T06:30:23.844 INFO:tasks.workunit.client.1.smithi106.stdout:4/264: mknod d7/d10/c4c 0 2024-05-09T06:30:23.846 INFO:tasks.workunit.client.1.smithi106.stdout:8/306: sync 2024-05-09T06:30:23.846 INFO:tasks.workunit.client.1.smithi106.stdout:2/379: sync 2024-05-09T06:30:23.846 INFO:tasks.workunit.client.1.smithi106.stdout:2/380: stat d2/d7/d62 0 2024-05-09T06:30:23.846 INFO:tasks.workunit.client.1.smithi106.stdout:8/307: stat d3/d5/d35/d4e/f67 0 2024-05-09T06:30:23.851 INFO:tasks.workunit.client.1.smithi106.stdout:8/308: creat d3/d5/d35/d61/d6c/f70 x:0 0 0 2024-05-09T06:30:23.851 INFO:tasks.workunit.client.1.smithi106.stdout:8/309: readlink d3/l6e 0 2024-05-09T06:30:23.855 INFO:tasks.workunit.client.1.smithi106.stdout:8/310: link d3/d5/d35/d4e/l57 d3/l71 0 2024-05-09T06:30:23.858 INFO:tasks.workunit.client.1.smithi106.stdout:9/301: dwrite d4/d6/f2b [0,4194304] 0 2024-05-09T06:30:23.858 INFO:tasks.workunit.client.1.smithi106.stdout:9/302: chown d4/d6/d23/d2f/d47/f4d 1741 1 2024-05-09T06:30:23.858 INFO:tasks.workunit.client.1.smithi106.stdout:9/303: write d4/f28 [981403,79140] 0 2024-05-09T06:30:23.858 INFO:tasks.workunit.client.1.smithi106.stdout:9/304: stat d4/d6/d23/d2f/d47/c4b 0 2024-05-09T06:30:23.861 INFO:tasks.workunit.client.1.smithi106.stdout:9/305: getdents d4/d6/d1b/d2a 0 2024-05-09T06:30:23.861 INFO:tasks.workunit.client.1.smithi106.stdout:9/306: chown d4/d6/d1b/d2a/l17 7 1 2024-05-09T06:30:23.870 INFO:tasks.workunit.client.1.smithi106.stdout:4/265: dwrite d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:23.872 INFO:tasks.workunit.client.1.smithi106.stdout:9/307: rmdir d4/d6/d1b 39 2024-05-09T06:30:23.874 INFO:tasks.workunit.client.1.smithi106.stdout:4/266: symlink d7/d10/d12/d1c/l4d 0 2024-05-09T06:30:23.879 INFO:tasks.workunit.client.1.smithi106.stdout:9/308: dread d4/d6/d23/d2f/d31/f33 [0,4194304] 0 2024-05-09T06:30:23.879 INFO:tasks.workunit.client.1.smithi106.stdout:9/309: stat d4/c29 0 2024-05-09T06:30:23.883 INFO:tasks.workunit.client.1.smithi106.stdout:9/310: mkdir d4/d6/d23/d2f/d31/d51 0 2024-05-09T06:30:23.883 INFO:tasks.workunit.client.1.smithi106.stdout:9/311: chown d4/d6/d23/d16/f24 74885 1 2024-05-09T06:30:23.883 INFO:tasks.workunit.client.1.smithi106.stdout:9/312: fdatasync d4/d6/f11 0 2024-05-09T06:30:23.883 INFO:tasks.workunit.client.1.smithi106.stdout:9/313: dread - d4/d6/d23/d2f/d31/f46 zero size 2024-05-09T06:30:23.883 INFO:tasks.workunit.client.1.smithi106.stdout:9/314: chown d4/d6/d23/d16/l2c 6 1 2024-05-09T06:30:23.886 INFO:tasks.workunit.client.1.smithi106.stdout:9/315: mknod d4/d6/d23/d2f/d31/d51/c52 0 2024-05-09T06:30:23.889 INFO:tasks.workunit.client.1.smithi106.stdout:9/316: mkdir d4/d6/d23/d53 0 2024-05-09T06:30:23.889 INFO:tasks.workunit.client.1.smithi106.stdout:9/317: fdatasync d4/d6/d23/d2f/d38/f3c 0 2024-05-09T06:30:23.895 INFO:tasks.workunit.client.1.smithi106.stdout:4/267: dwrite d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:23.898 INFO:tasks.workunit.client.1.smithi106.stdout:9/318: dread d4/d6/f34 [0,4194304] 0 2024-05-09T06:30:23.907 INFO:tasks.workunit.client.1.smithi106.stdout:6/357: fsync d0/d17/d34/f69 0 2024-05-09T06:30:23.907 INFO:tasks.workunit.client.1.smithi106.stdout:6/358: chown d0/d5c/c73 1 1 2024-05-09T06:30:23.916 INFO:tasks.workunit.client.1.smithi106.stdout:6/359: dread d0/d17/d34/f65 [0,4194304] 0 2024-05-09T06:30:23.918 INFO:tasks.workunit.client.1.smithi106.stdout:9/319: dwrite d4/f28 [0,4194304] 0 2024-05-09T06:30:23.925 INFO:tasks.workunit.client.1.smithi106.stdout:0/339: sync 2024-05-09T06:30:23.928 INFO:tasks.workunit.client.1.smithi106.stdout:0/340: mknod d1/d11/d23/d13/d2c/d6d/c75 0 2024-05-09T06:30:23.928 INFO:tasks.workunit.client.1.smithi106.stdout:0/341: readlink d1/d11/d23/l21 0 2024-05-09T06:30:23.928 INFO:tasks.workunit.client.1.smithi106.stdout:9/320: dread d4/d6/d23/d2f/d38/f40 [0,4194304] 0 2024-05-09T06:30:23.928 INFO:tasks.workunit.client.1.smithi106.stdout:9/321: dread - d4/d6/d23/f4e zero size 2024-05-09T06:30:23.930 INFO:tasks.workunit.client.1.smithi106.stdout:9/322: mkdir d4/d54 0 2024-05-09T06:30:23.930 INFO:tasks.workunit.client.1.smithi106.stdout:6/360: dwrite d0/d17/d34/d5f/f37 [0,4194304] 0 2024-05-09T06:30:23.935 INFO:tasks.workunit.client.1.smithi106.stdout:9/323: write d4/f25 [436596,60296] 0 2024-05-09T06:30:23.936 INFO:tasks.workunit.client.1.smithi106.stdout:6/361: symlink d0/d17/d21/l75 0 2024-05-09T06:30:23.938 INFO:tasks.workunit.client.1.smithi106.stdout:9/324: mknod d4/d6/d23/d2f/d47/c55 0 2024-05-09T06:30:23.948 INFO:tasks.workunit.client.1.smithi106.stdout:0/342: dwrite d1/f3 [4194304,4194304] 0 2024-05-09T06:30:23.950 INFO:tasks.workunit.client.1.smithi106.stdout:6/362: dwrite d0/f19 [0,4194304] 0 2024-05-09T06:30:23.950 INFO:tasks.workunit.client.1.smithi106.stdout:6/363: stat d0/d5c 0 2024-05-09T06:30:23.950 INFO:tasks.workunit.client.1.smithi106.stdout:6/364: fsync d0/d17/f1e 0 2024-05-09T06:30:23.953 INFO:tasks.workunit.client.1.smithi106.stdout:0/343: rmdir d1/d11/d23/d13/d63 39 2024-05-09T06:30:23.958 INFO:tasks.workunit.client.1.smithi106.stdout:0/344: mkdir d1/d11/d23/d13/d2c/d76 0 2024-05-09T06:30:23.969 INFO:tasks.workunit.client.1.smithi106.stdout:1/307: sync 2024-05-09T06:30:23.969 INFO:tasks.workunit.client.1.smithi106.stdout:1/308: getdents d4/d5/d9/d13/d2f/d70 0 2024-05-09T06:30:23.971 INFO:tasks.workunit.client.1.smithi106.stdout:1/309: truncate d4/d5/d9/d65/d67/f68 3807774 0 2024-05-09T06:30:23.972 INFO:tasks.workunit.client.1.smithi106.stdout:0/345: dwrite d1/d11/d23/f27 [0,4194304] 0 2024-05-09T06:30:23.979 INFO:tasks.workunit.client.1.smithi106.stdout:0/346: link d1/d11/d23/f27 d1/d11/d23/d13/d2c/f77 0 2024-05-09T06:30:23.983 INFO:tasks.workunit.client.1.smithi106.stdout:0/347: mknod d1/d11/d23/d13/d2c/d6d/c78 0 2024-05-09T06:30:23.983 INFO:tasks.workunit.client.1.smithi106.stdout:0/348: truncate d1/f4b 1632818 0 2024-05-09T06:30:23.986 INFO:tasks.workunit.client.1.smithi106.stdout:0/349: mkdir d1/d11/d23/d13/d58/d79 0 2024-05-09T06:30:23.989 INFO:tasks.workunit.client.1.smithi106.stdout:6/365: rename d0/d17/d3d to d0/d17/d76 0 2024-05-09T06:30:24.000 INFO:tasks.workunit.client.1.smithi106.stdout:0/350: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:24.000 INFO:tasks.workunit.client.1.smithi106.stdout:0/351: fdatasync d1/d11/f3c 0 2024-05-09T06:30:24.000 INFO:tasks.workunit.client.1.smithi106.stdout:0/352: readlink d1/d11/d23/d13/d2c/l3b 0 2024-05-09T06:30:24.009 INFO:tasks.workunit.client.1.smithi106.stdout:0/353: dread d1/f1d [0,4194304] 0 2024-05-09T06:30:24.017 INFO:tasks.workunit.client.1.smithi106.stdout:0/354: read d1/d11/d23/d13/d2c/f77 [4153501,11164] 0 2024-05-09T06:30:24.020 INFO:tasks.workunit.client.1.smithi106.stdout:0/355: unlink d1/d11/d23/c5d 0 2024-05-09T06:30:24.020 INFO:tasks.workunit.client.1.smithi106.stdout:0/356: write d1/d11/d23/d13/d58/f71 [428788,69526] 0 2024-05-09T06:30:24.032 INFO:tasks.workunit.client.1.smithi106.stdout:3/294: rename d5/d12/f13 to d5/d12/d26/f58 0 2024-05-09T06:30:24.032 INFO:tasks.workunit.client.1.smithi106.stdout:3/295: readlink d5/ld 0 2024-05-09T06:30:24.032 INFO:tasks.workunit.client.1.smithi106.stdout:3/296: chown d5 26884975 1 2024-05-09T06:30:24.032 INFO:tasks.workunit.client.1.smithi106.stdout:3/297: creat d5/d1c/d24/f59 x:0 0 0 2024-05-09T06:30:24.033 INFO:tasks.workunit.client.1.smithi106.stdout:0/357: dwrite d1/d11/d23/d13/f14 [4194304,4194304] 0 2024-05-09T06:30:24.033 INFO:tasks.workunit.client.1.smithi106.stdout:0/358: dread - d1/d11/d23/d22/f6e zero size 2024-05-09T06:30:24.035 INFO:tasks.workunit.client.1.smithi106.stdout:7/250: rename d0/l23 to d0/dc/d1a/d36/d30/l4b 0 2024-05-09T06:30:24.035 INFO:tasks.workunit.client.1.smithi106.stdout:5/323: rename d8 to d8/d45/d4c/d32/d58 22 2024-05-09T06:30:24.039 INFO:tasks.workunit.client.1.smithi106.stdout:3/298: link d5/d1c/d21/c48 d5/d1c/d24/c5a 0 2024-05-09T06:30:24.039 INFO:tasks.workunit.client.1.smithi106.stdout:3/299: write d5/d12/f19 [4266619,8887] 0 2024-05-09T06:30:24.042 INFO:tasks.workunit.client.1.smithi106.stdout:5/324: read d8/d45/d4c/f2e [595625,82318] 0 2024-05-09T06:30:24.044 INFO:tasks.workunit.client.1.smithi106.stdout:0/359: creat d1/d11/d23/d13/d58/d79/f7a x:0 0 0 2024-05-09T06:30:24.048 INFO:tasks.workunit.client.1.smithi106.stdout:8/311: rename d3/d5/d35/d4e/d32/d4c to d3/d5/d35/d72 0 2024-05-09T06:30:24.049 INFO:tasks.workunit.client.1.smithi106.stdout:7/251: dwrite d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:24.049 INFO:tasks.workunit.client.1.smithi106.stdout:3/300: write f2 [4189863,129815] 0 2024-05-09T06:30:24.051 INFO:tasks.workunit.client.1.smithi106.stdout:5/325: truncate d8/f4b 3238439 0 2024-05-09T06:30:24.051 INFO:tasks.workunit.client.1.smithi106.stdout:5/326: read d8/fc [233750,15333] 0 2024-05-09T06:30:24.054 INFO:tasks.workunit.client.1.smithi106.stdout:4/268: rename d7/d39/d35/c48 to d7/d39/d47/c4e 0 2024-05-09T06:30:24.054 INFO:tasks.workunit.client.1.smithi106.stdout:4/269: read d7/d10/f43 [51747,62044] 0 2024-05-09T06:30:24.058 INFO:tasks.workunit.client.1.smithi106.stdout:0/360: dwrite d1/d11/d23/d13/d58/d79/f7a [0,4194304] 0 2024-05-09T06:30:24.062 INFO:tasks.workunit.client.1.smithi106.stdout:7/252: truncate d0/f29 2013288 0 2024-05-09T06:30:24.065 INFO:tasks.workunit.client.1.smithi106.stdout:3/301: mkdir d5/d1c/d24/d5b 0 2024-05-09T06:30:24.065 INFO:tasks.workunit.client.1.smithi106.stdout:3/302: write f1 [7759577,123886] 0 2024-05-09T06:30:24.067 INFO:tasks.workunit.client.1.smithi106.stdout:5/327: mkdir d8/d33/d3a/d59 0 2024-05-09T06:30:24.070 INFO:tasks.workunit.client.1.smithi106.stdout:9/325: rename d4/d6/d23/f2d to d4/d6/d1b/d2a/f56 0 2024-05-09T06:30:24.071 INFO:tasks.workunit.client.1.smithi106.stdout:4/270: symlink d7/d10/l4f 0 2024-05-09T06:30:24.081 INFO:tasks.workunit.client.1.smithi106.stdout:3/303: unlink d5/d4d/l4e 0 2024-05-09T06:30:24.082 INFO:tasks.workunit.client.1.smithi106.stdout:5/328: mkdir d8/d5a 0 2024-05-09T06:30:24.082 INFO:tasks.workunit.client.1.smithi106.stdout:5/329: dread - d8/f50 zero size 2024-05-09T06:30:24.086 INFO:tasks.workunit.client.1.smithi106.stdout:9/326: creat d4/d6/d1b/d2a/d42/f57 x:0 0 0 2024-05-09T06:30:24.089 INFO:tasks.workunit.client.1.smithi106.stdout:4/271: link d7/d39/f3f d7/d28/d2a/f50 0 2024-05-09T06:30:24.089 INFO:tasks.workunit.client.1.smithi106.stdout:4/272: fsync d7/d10/d12/d1c/f2c 0 2024-05-09T06:30:24.090 INFO:tasks.workunit.client.1.smithi106.stdout:5/330: dread d8/d1c/f24 [0,4194304] 0 2024-05-09T06:30:24.090 INFO:tasks.workunit.client.1.smithi106.stdout:5/331: chown d8/d45/d4c/d32/c44 229631 1 2024-05-09T06:30:24.091 INFO:tasks.workunit.client.1.smithi106.stdout:7/253: rmdir d0/dc/d47 0 2024-05-09T06:30:24.092 INFO:tasks.workunit.client.1.smithi106.stdout:7/254: creat d0/dc/d1a/d36/d1e/f4c x:0 0 0 2024-05-09T06:30:24.094 INFO:tasks.workunit.client.1.smithi106.stdout:3/304: mknod d5/d1c/d24/d5b/c5c 0 2024-05-09T06:30:24.099 INFO:tasks.workunit.client.1.smithi106.stdout:1/310: rename d4/d5/d9 to d4/d76 0 2024-05-09T06:30:24.102 INFO:tasks.workunit.client.1.smithi106.stdout:3/305: symlink d5/d1c/d21/l5d 0 2024-05-09T06:30:24.106 INFO:tasks.workunit.client.1.smithi106.stdout:4/273: rename d7/d39/f32 to d7/d10/f51 0 2024-05-09T06:30:24.107 INFO:tasks.workunit.client.1.smithi106.stdout:4/274: fsync d7/d10/d12/d1c/f49 0 2024-05-09T06:30:24.107 INFO:tasks.workunit.client.1.smithi106.stdout:4/275: chown d7/d10/f3e 150551 1 2024-05-09T06:30:24.107 INFO:tasks.workunit.client.1.smithi106.stdout:4/276: creat d7/d10/d12/d1c/f52 x:0 0 0 2024-05-09T06:30:24.107 INFO:tasks.workunit.client.1.smithi106.stdout:4/277: write d7/f40 [1025206,14857] 0 2024-05-09T06:30:24.108 INFO:tasks.workunit.client.1.smithi106.stdout:9/327: dwrite d4/d6/d23/f4e [0,4194304] 0 2024-05-09T06:30:24.108 INFO:tasks.workunit.client.1.smithi106.stdout:9/328: write d4/d6/d23/d2f/d31/f32 [1238071,55530] 0 2024-05-09T06:30:24.116 INFO:tasks.workunit.client.1.smithi106.stdout:1/311: dwrite d4/d76/f5f [0,4194304] 0 2024-05-09T06:30:24.116 INFO:tasks.workunit.client.1.smithi106.stdout:4/278: link d7/d10/d12/d1c/l36 d7/d28/d2a/l53 0 2024-05-09T06:30:24.116 INFO:tasks.workunit.client.1.smithi106.stdout:4/279: write d7/d28/f27 [1451087,108750] 0 2024-05-09T06:30:24.123 INFO:tasks.workunit.client.1.smithi106.stdout:9/329: mkdir d4/d6/d23/d2f/d31/d51/d58 0 2024-05-09T06:30:24.125 INFO:tasks.workunit.client.1.smithi106.stdout:3/306: dwrite d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:24.129 INFO:tasks.workunit.client.1.smithi106.stdout:4/280: write d7/d10/f16 [358662,96655] 0 2024-05-09T06:30:24.130 INFO:tasks.workunit.client.1.smithi106.stdout:1/312: mknod d4/d5/c77 0 2024-05-09T06:30:24.132 INFO:tasks.workunit.client.1.smithi106.stdout:9/330: mknod d4/d54/c59 0 2024-05-09T06:30:24.135 INFO:tasks.workunit.client.1.smithi106.stdout:5/332: rename d8/d1c to d8/d45/d4c/d32/d5b 0 2024-05-09T06:30:24.142 INFO:tasks.workunit.client.1.smithi106.stdout:1/313: mknod d4/d37/d3d/c78 0 2024-05-09T06:30:24.145 INFO:tasks.workunit.client.1.smithi106.stdout:7/255: rename d0/dc/d1a/d36/d1e/f42 to d0/dc/d1a/d36/f4d 0 2024-05-09T06:30:24.147 INFO:tasks.workunit.client.1.smithi106.stdout:9/331: dwrite d4/d6/d23/d2f/d31/f32 [0,4194304] 0 2024-05-09T06:30:24.147 INFO:tasks.workunit.client.1.smithi106.stdout:9/332: truncate d4/d6/d23/d2f/d31/f46 997012 0 2024-05-09T06:30:24.150 INFO:tasks.workunit.client.1.smithi106.stdout:4/281: getdents d7 0 2024-05-09T06:30:24.153 INFO:tasks.workunit.client.1.smithi106.stdout:1/314: mkdir d4/d5b/d75/d79 0 2024-05-09T06:30:24.153 INFO:tasks.workunit.client.1.smithi106.stdout:1/315: chown d4/d76/d13/f3e 0 1 2024-05-09T06:30:24.154 INFO:tasks.workunit.client.1.smithi106.stdout:1/316: fdatasync d4/d5/f5e 0 2024-05-09T06:30:24.154 INFO:tasks.workunit.client.1.smithi106.stdout:1/317: creat d4/f7a x:0 0 0 2024-05-09T06:30:24.161 INFO:tasks.workunit.client.1.smithi106.stdout:3/307: rename d5/d1c/d21/l25 to d5/d1c/d24/d5b/l5e 0 2024-05-09T06:30:24.161 INFO:tasks.workunit.client.1.smithi106.stdout:3/308: truncate d5/fe 1406636 0 2024-05-09T06:30:24.163 INFO:tasks.workunit.client.1.smithi106.stdout:7/256: write d0/f4a [378562,60300] 0 2024-05-09T06:30:24.166 INFO:tasks.workunit.client.1.smithi106.stdout:4/282: dwrite d7/d39/f44 [0,4194304] 0 2024-05-09T06:30:24.166 INFO:tasks.workunit.client.1.smithi106.stdout:4/283: chown d7/f40 5749 1 2024-05-09T06:30:24.167 INFO:tasks.workunit.client.1.smithi106.stdout:9/333: creat d4/f5a x:0 0 0 2024-05-09T06:30:24.171 INFO:tasks.workunit.client.1.smithi106.stdout:1/318: stat d4/d76/d1d/f38 0 2024-05-09T06:30:24.171 INFO:tasks.workunit.client.1.smithi106.stdout:1/319: truncate d4/f45 875378 0 2024-05-09T06:30:24.172 INFO:tasks.workunit.client.1.smithi106.stdout:3/309: mkdir d5/d4d/d5f 0 2024-05-09T06:30:24.174 INFO:tasks.workunit.client.1.smithi106.stdout:7/257: truncate d0/f27 1908509 0 2024-05-09T06:30:24.179 INFO:tasks.workunit.client.1.smithi106.stdout:4/284: creat d7/d10/d12/d46/f54 x:0 0 0 2024-05-09T06:30:24.180 INFO:tasks.workunit.client.1.smithi106.stdout:9/334: rmdir d4/d6/d23/d2f/d31/d51 39 2024-05-09T06:30:24.180 INFO:tasks.workunit.client.1.smithi106.stdout:9/335: chown d4/d6/d23/d2f/d31/l3f 3020 1 2024-05-09T06:30:24.182 INFO:tasks.workunit.client.1.smithi106.stdout:9/336: write d4/d6/d1b/d2a/f56 [38102,1412] 0 2024-05-09T06:30:24.182 INFO:tasks.workunit.client.1.smithi106.stdout:9/337: creat d4/d6/d23/d16/f5b x:0 0 0 2024-05-09T06:30:24.182 INFO:tasks.workunit.client.1.smithi106.stdout:9/338: chown d4/d6/d23/d16/f24 30972861 1 2024-05-09T06:30:24.182 INFO:tasks.workunit.client.1.smithi106.stdout:1/320: symlink d4/d76/d13/d60/l7b 0 2024-05-09T06:30:24.183 INFO:tasks.workunit.client.1.smithi106.stdout:3/310: unlink l3 0 2024-05-09T06:30:24.185 INFO:tasks.workunit.client.1.smithi106.stdout:7/258: mknod d0/dc/c4e 0 2024-05-09T06:30:24.187 INFO:tasks.workunit.client.1.smithi106.stdout:4/285: creat d7/d10/d12/f55 x:0 0 0 2024-05-09T06:30:24.187 INFO:tasks.workunit.client.1.smithi106.stdout:4/286: dread - d7/d39/f3f zero size 2024-05-09T06:30:24.192 INFO:tasks.workunit.client.1.smithi106.stdout:9/339: link d4/d6/d23/d16/f4c d4/d6/d23/d2f/d31/f5c 0 2024-05-09T06:30:24.195 INFO:tasks.workunit.client.1.smithi106.stdout:1/321: creat d4/d76/f7c x:0 0 0 2024-05-09T06:30:24.199 INFO:tasks.workunit.client.1.smithi106.stdout:4/287: symlink d7/d39/l56 0 2024-05-09T06:30:24.199 INFO:tasks.workunit.client.1.smithi106.stdout:4/288: fdatasync d7/fb 0 2024-05-09T06:30:24.201 INFO:tasks.workunit.client.1.smithi106.stdout:9/340: symlink d4/d6/d1b/d2a/d42/l5d 0 2024-05-09T06:30:24.201 INFO:tasks.workunit.client.1.smithi106.stdout:9/341: write d4/d6/d23/d16/f35 [734276,46586] 0 2024-05-09T06:30:24.201 INFO:tasks.workunit.client.1.smithi106.stdout:9/342: write d4/d6/d23/d16/f5b [249014,129871] 0 2024-05-09T06:30:24.201 INFO:tasks.workunit.client.1.smithi106.stdout:9/343: chown d4/d6/d23/d2f/d31/d51/d58 11 1 2024-05-09T06:30:24.202 INFO:tasks.workunit.client.1.smithi106.stdout:4/289: mknod d7/d28/d2a/c57 0 2024-05-09T06:30:24.203 INFO:tasks.workunit.client.1.smithi106.stdout:4/290: fdatasync d7/d39/f3f 0 2024-05-09T06:30:24.205 INFO:tasks.workunit.client.1.smithi106.stdout:9/344: dread d4/d6/d1b/f3e [0,4194304] 0 2024-05-09T06:30:24.205 INFO:tasks.workunit.client.1.smithi106.stdout:9/345: chown d4/d6/d1b/d2a/d42/c43 98232 1 2024-05-09T06:30:24.206 INFO:tasks.workunit.client.1.smithi106.stdout:4/291: mknod d7/d39/c58 0 2024-05-09T06:30:24.209 INFO:tasks.workunit.client.1.smithi106.stdout:9/346: creat d4/d6/f5e x:0 0 0 2024-05-09T06:30:24.212 INFO:tasks.workunit.client.1.smithi106.stdout:9/347: truncate d4/d6/d23/d2f/d31/f44 1869346 0 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:1/322: dwrite d4/d76/fe [0,4194304] 0 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:9/348: dread d4/d6/d23/d2f/d38/f40 [0,4194304] 0 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:1/323: dread - d4/d5/f3a zero size 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:7/259: dwrite d0/dc/d1a/d36/d30/f26 [0,4194304] 0 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:9/349: truncate d4/d6/d1b/d2a/f20 4338046 0 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:9/350: dread - d4/d6/d23/d2f/d47/f4d zero size 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:7/260: chown d0/dc/d1a/d36/l1b 1168 1 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:7/261: read - d0/dc/f10 zero size 2024-05-09T06:30:24.218 INFO:tasks.workunit.client.1.smithi106.stdout:7/262: dread - d0/dc/f31 zero size 2024-05-09T06:30:24.233 INFO:tasks.workunit.client.1.smithi106.stdout:1/324: symlink d4/l7d 0 2024-05-09T06:30:24.247 INFO:tasks.workunit.client.1.smithi106.stdout:9/351: dwrite d4/d6/d23/d2f/d31/f46 [0,4194304] 0 2024-05-09T06:30:24.247 INFO:tasks.workunit.client.1.smithi106.stdout:9/352: write d4/f3d [446557,61111] 0 2024-05-09T06:30:24.247 INFO:tasks.workunit.client.1.smithi106.stdout:7/263: dwrite d0/dc/f10 [0,4194304] 0 2024-05-09T06:30:24.247 INFO:tasks.workunit.client.1.smithi106.stdout:7/264: fsync d0/dc/d1a/d36/f3f 0 2024-05-09T06:30:24.252 INFO:tasks.workunit.client.1.smithi106.stdout:1/325: dwrite d4/d76/d13/f20 [0,4194304] 0 2024-05-09T06:30:24.256 INFO:tasks.workunit.client.1.smithi106.stdout:7/265: symlink d0/dc/d1a/d36/d1e/l4f 0 2024-05-09T06:30:24.259 INFO:tasks.workunit.client.1.smithi106.stdout:1/326: write d4/f1f [181949,87188] 0 2024-05-09T06:30:24.259 INFO:tasks.workunit.client.1.smithi106.stdout:1/327: fsync f2 0 2024-05-09T06:30:24.259 INFO:tasks.workunit.client.1.smithi106.stdout:0/361: getdents d1/d11/d23/d13/d2c 0 2024-05-09T06:30:24.262 INFO:tasks.workunit.client.1.smithi106.stdout:7/266: mkdir d0/dc/d45/d50 0 2024-05-09T06:30:24.264 INFO:tasks.workunit.client.1.smithi106.stdout:9/353: dwrite d4/d6/f2e [0,4194304] 0 2024-05-09T06:30:24.267 INFO:tasks.workunit.client.1.smithi106.stdout:1/328: rmdir d4/d5b/d75/d79 0 2024-05-09T06:30:24.270 INFO:tasks.workunit.client.1.smithi106.stdout:0/362: rmdir d1/d11/d23/d13/d2c 39 2024-05-09T06:30:24.283 INFO:tasks.workunit.client.1.smithi106.stdout:9/354: dwrite d4/d6/d23/d16/f27 [0,4194304] 0 2024-05-09T06:30:24.287 INFO:tasks.workunit.client.1.smithi106.stdout:9/355: rmdir d4/d6/d23/d53 0 2024-05-09T06:30:24.292 INFO:tasks.workunit.client.1.smithi106.stdout:1/329: dwrite d4/d5/f50 [0,4194304] 0 2024-05-09T06:30:24.292 INFO:tasks.workunit.client.1.smithi106.stdout:0/363: dwrite d1/d11/d23/f53 [0,4194304] 0 2024-05-09T06:30:24.292 INFO:tasks.workunit.client.1.smithi106.stdout:0/364: readlink d1/d11/d23/d13/d2c/l72 0 2024-05-09T06:30:24.294 INFO:tasks.workunit.client.1.smithi106.stdout:1/330: dread d4/d76/d13/f25 [0,4194304] 0 2024-05-09T06:30:24.299 INFO:tasks.workunit.client.1.smithi106.stdout:9/356: dwrite d4/f25 [0,4194304] 0 2024-05-09T06:30:24.301 INFO:tasks.workunit.client.1.smithi106.stdout:0/365: write d1/d11/d23/f53 [3729734,81383] 0 2024-05-09T06:30:24.301 INFO:tasks.workunit.client.1.smithi106.stdout:0/366: creat d1/d11/d23/d13/d58/d79/f7b x:0 0 0 2024-05-09T06:30:24.302 INFO:tasks.workunit.client.1.smithi106.stdout:0/367: truncate d1/d11/f56 1528759 0 2024-05-09T06:30:24.302 INFO:tasks.workunit.client.1.smithi106.stdout:0/368: read d1/f1d [2285237,124652] 0 2024-05-09T06:30:24.304 INFO:tasks.workunit.client.1.smithi106.stdout:9/357: dread d4/d6/d23/d16/f3b [0,4194304] 0 2024-05-09T06:30:24.305 INFO:tasks.workunit.client.1.smithi106.stdout:0/369: mknod d1/d11/d23/d13/d2c/d6d/d70/c7c 0 2024-05-09T06:30:24.306 INFO:tasks.workunit.client.1.smithi106.stdout:1/331: write d4/d5/f50 [1050291,75065] 0 2024-05-09T06:30:24.306 INFO:tasks.workunit.client.1.smithi106.stdout:1/332: fdatasync d4/d5/f58 0 2024-05-09T06:30:24.309 INFO:tasks.workunit.client.1.smithi106.stdout:1/333: creat d4/d5b/f7e x:0 0 0 2024-05-09T06:30:24.312 INFO:tasks.workunit.client.1.smithi106.stdout:0/370: dread d1/d11/d23/d22/f31 [0,4194304] 0 2024-05-09T06:30:24.313 INFO:tasks.workunit.client.1.smithi106.stdout:1/334: creat d4/d76/d13/d2f/f7f x:0 0 0 2024-05-09T06:30:24.316 INFO:tasks.workunit.client.1.smithi106.stdout:2/381: sync 2024-05-09T06:30:24.317 INFO:tasks.workunit.client.1.smithi106.stdout:0/371: mknod d1/d11/d23/d13/d2c/d3d/c7d 0 2024-05-09T06:30:24.317 INFO:tasks.workunit.client.1.smithi106.stdout:0/372: chown d1/d11/d23/f5f 420225 1 2024-05-09T06:30:24.321 INFO:tasks.workunit.client.1.smithi106.stdout:1/335: fsync d4/d76/d1d/f4e 0 2024-05-09T06:30:24.322 INFO:tasks.workunit.client.1.smithi106.stdout:1/336: dread d4/d76/d13/f1b [0,4194304] 0 2024-05-09T06:30:24.323 INFO:tasks.workunit.client.1.smithi106.stdout:0/373: mkdir d1/d11/d23/d13/d63/d7e 0 2024-05-09T06:30:24.325 INFO:tasks.workunit.client.1.smithi106.stdout:9/358: dwrite d4/d6/d1b/d2a/f20 [4194304,4194304] 0 2024-05-09T06:30:24.327 INFO:tasks.workunit.client.1.smithi106.stdout:1/337: unlink d4/d76/d13/f57 0 2024-05-09T06:30:24.327 INFO:tasks.workunit.client.1.smithi106.stdout:1/338: truncate d4/d76/f4b 2070292 0 2024-05-09T06:30:24.330 INFO:tasks.workunit.client.1.smithi106.stdout:0/374: mkdir d1/d11/d7f 0 2024-05-09T06:30:24.332 INFO:tasks.workunit.client.1.smithi106.stdout:9/359: creat d4/d54/f5f x:0 0 0 2024-05-09T06:30:24.332 INFO:tasks.workunit.client.1.smithi106.stdout:9/360: dread - d4/d6/d23/d16/f4c zero size 2024-05-09T06:30:24.332 INFO:tasks.workunit.client.1.smithi106.stdout:9/361: truncate d4/d6/d23/d16/f5b 424543 0 2024-05-09T06:30:24.335 INFO:tasks.workunit.client.1.smithi106.stdout:8/312: rename d3/d5/d35/d72 to d3/d5/d35/d73 0 2024-05-09T06:30:24.338 INFO:tasks.workunit.client.1.smithi106.stdout:2/382: dwrite d2/d5/db/d1d/f3d [8388608,4194304] 0 2024-05-09T06:30:24.338 INFO:tasks.workunit.client.1.smithi106.stdout:2/383: dread - d2/d5/db/d15/d41/f53 zero size 2024-05-09T06:30:24.338 INFO:tasks.workunit.client.1.smithi106.stdout:2/384: write d2/f2b [2482309,86312] 0 2024-05-09T06:30:24.338 INFO:tasks.workunit.client.1.smithi106.stdout:0/375: dread d1/d11/f3c [0,4194304] 0 2024-05-09T06:30:24.338 INFO:tasks.workunit.client.1.smithi106.stdout:0/376: write d1/d11/d23/d13/f5c [4199972,23428] 0 2024-05-09T06:30:24.343 INFO:tasks.workunit.client.1.smithi106.stdout:8/313: write d3/d5/d7/f20 [3654887,79836] 0 2024-05-09T06:30:24.343 INFO:tasks.workunit.client.1.smithi106.stdout:8/314: read d3/d5/d13/f2e [1176559,91495] 0 2024-05-09T06:30:24.343 INFO:tasks.workunit.client.1.smithi106.stdout:1/339: dwrite d4/d37/d3d/f6e [0,4194304] 0 2024-05-09T06:30:24.343 INFO:tasks.workunit.client.1.smithi106.stdout:1/340: fsync d4/d76/d13/f72 0 2024-05-09T06:30:24.346 INFO:tasks.workunit.client.1.smithi106.stdout:4/292: getdents d7/d39/d35 0 2024-05-09T06:30:24.346 INFO:tasks.workunit.client.1.smithi106.stdout:4/293: write d7/d10/d12/d1c/f52 [205777,40770] 0 2024-05-09T06:30:24.351 INFO:tasks.workunit.client.1.smithi106.stdout:0/377: link d1/d11/d23/d13/d58/d79/f7b d1/d11/d23/d13/d58/f80 0 2024-05-09T06:30:24.351 INFO:tasks.workunit.client.1.smithi106.stdout:0/378: chown d1/d11/d23/d13/d2c/f77 47 1 2024-05-09T06:30:24.355 INFO:tasks.workunit.client.1.smithi106.stdout:9/362: dwrite d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:24.356 INFO:tasks.workunit.client.1.smithi106.stdout:9/363: fdatasync d4/d6/d1b/d2a/f26 0 2024-05-09T06:30:24.356 INFO:tasks.workunit.client.1.smithi106.stdout:9/364: creat d4/d6/d23/d2f/d39/f60 x:0 0 0 2024-05-09T06:30:24.379 INFO:tasks.workunit.client.1.smithi106.stdout:0/379: dwrite d1/d11/d23/d13/f15 [0,4194304] 0 2024-05-09T06:30:24.379 INFO:tasks.workunit.client.1.smithi106.stdout:0/380: fdatasync d1/d11/d23/d22/f6e 0 2024-05-09T06:30:24.380 INFO:tasks.workunit.client.1.smithi106.stdout:4/294: dwrite d7/f18 [4194304,4194304] 0 2024-05-09T06:30:24.381 INFO:tasks.workunit.client.1.smithi106.stdout:8/315: dwrite d3/d5/d7/f60 [0,4194304] 0 2024-05-09T06:30:24.381 INFO:tasks.workunit.client.1.smithi106.stdout:2/385: dwrite d2/d5/db/d15/d41/f74 [0,4194304] 0 2024-05-09T06:30:24.382 INFO:tasks.workunit.client.1.smithi106.stdout:9/365: dwrite d4/d6/d23/d16/f5b [0,4194304] 0 2024-05-09T06:30:24.384 INFO:tasks.workunit.client.1.smithi106.stdout:0/381: rmdir d1/d11/d23/d13/d2c 39 2024-05-09T06:30:24.385 INFO:tasks.workunit.client.1.smithi106.stdout:0/382: fdatasync d1/d11/d23/d13/d2c/f2f 0 2024-05-09T06:30:24.385 INFO:tasks.workunit.client.1.smithi106.stdout:0/383: chown d1/l4f 0 1 2024-05-09T06:30:24.385 INFO:tasks.workunit.client.1.smithi106.stdout:0/384: write d1/d11/d23/d13/d2c/f77 [5170903,88454] 0 2024-05-09T06:30:24.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/295: mknod d7/d28/d2a/c59 0 2024-05-09T06:30:24.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/316: write d3/d5/d35/d4e/f67 [3237546,5936] 0 2024-05-09T06:30:24.392 INFO:tasks.workunit.client.1.smithi106.stdout:8/317: write d3/d5/d7/d15/f49 [2462119,114485] 0 2024-05-09T06:30:24.394 INFO:tasks.workunit.client.1.smithi106.stdout:2/386: mkdir d2/d5/db/d7d 0 2024-05-09T06:30:24.394 INFO:tasks.workunit.client.1.smithi106.stdout:2/387: fsync d2/d7/d2c/f78 0 2024-05-09T06:30:24.401 INFO:tasks.workunit.client.1.smithi106.stdout:2/388: write d2/d5/db/d15/d41/d58/f45 [7740713,48771] 0 2024-05-09T06:30:24.407 INFO:tasks.workunit.client.1.smithi106.stdout:8/318: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:24.407 INFO:tasks.workunit.client.1.smithi106.stdout:8/319: fdatasync d3/d5/d13/f40 0 2024-05-09T06:30:24.410 INFO:tasks.workunit.client.1.smithi106.stdout:9/366: mkdir d4/d6/d1b/d2a/d61 0 2024-05-09T06:30:24.410 INFO:tasks.workunit.client.1.smithi106.stdout:9/367: creat d4/d6/d23/d2f/d47/f62 x:0 0 0 2024-05-09T06:30:24.418 INFO:tasks.workunit.client.1.smithi106.stdout:2/389: symlink d2/d5/db/d15/d41/d58/l7e 0 2024-05-09T06:30:24.425 INFO:tasks.workunit.client.1.smithi106.stdout:8/320: link d3/d5/d7/d58/l5f d3/d5/d7/d15/d47/l74 0 2024-05-09T06:30:24.428 INFO:tasks.workunit.client.1.smithi106.stdout:9/368: symlink d4/d6/d23/d2f/l63 0 2024-05-09T06:30:24.430 INFO:tasks.workunit.client.1.smithi106.stdout:0/385: getdents d1 0 2024-05-09T06:30:24.430 INFO:tasks.workunit.client.1.smithi106.stdout:0/386: truncate d1/d11/d23/d13/d2c/d6d/f73 410819 0 2024-05-09T06:30:24.437 INFO:tasks.workunit.client.1.smithi106.stdout:2/390: mknod d2/d5/db/d68/c7f 0 2024-05-09T06:30:24.437 INFO:tasks.workunit.client.1.smithi106.stdout:2/391: creat d2/d7/d2c/f80 x:0 0 0 2024-05-09T06:30:24.438 INFO:tasks.workunit.client.1.smithi106.stdout:8/321: creat d3/d5/d35/d4e/d32/f75 x:0 0 0 2024-05-09T06:30:24.438 INFO:tasks.workunit.client.1.smithi106.stdout:8/322: chown d3/d5/d7/l1c 59 1 2024-05-09T06:30:24.441 INFO:tasks.workunit.client.1.smithi106.stdout:9/369: creat d4/d6/d23/d2f/f64 x:0 0 0 2024-05-09T06:30:24.443 INFO:tasks.workunit.client.1.smithi106.stdout:0/387: rmdir d1/d11/d23/d13/d2c/d6d 39 2024-05-09T06:30:24.450 INFO:tasks.workunit.client.1.smithi106.stdout:2/392: link d2/d5/db/d1d/f3d d2/d5/db/d1d/d23/f81 0 2024-05-09T06:30:24.450 INFO:tasks.workunit.client.1.smithi106.stdout:2/393: fdatasync f0 0 2024-05-09T06:30:24.452 INFO:tasks.workunit.client.1.smithi106.stdout:9/370: creat d4/d6/d1b/f65 x:0 0 0 2024-05-09T06:30:24.452 INFO:tasks.workunit.client.1.smithi106.stdout:9/371: write d4/d6/d23/d2f/d38/f3c [536891,80385] 0 2024-05-09T06:30:24.457 INFO:tasks.workunit.client.1.smithi106.stdout:2/394: symlink d2/d7/d62/l82 0 2024-05-09T06:30:24.457 INFO:tasks.workunit.client.1.smithi106.stdout:2/395: truncate d2/d5/f5d 514652 0 2024-05-09T06:30:24.458 INFO:tasks.workunit.client.1.smithi106.stdout:2/396: chown d2/d7/l3b 1413 1 2024-05-09T06:30:24.458 INFO:tasks.workunit.client.1.smithi106.stdout:2/397: chown d2/d5/db/d15/d41/d58/f50 1080419 1 2024-05-09T06:30:24.458 INFO:tasks.workunit.client.1.smithi106.stdout:0/388: dwrite d1/d11/d23/d13/d2c/d3d/f55 [0,4194304] 0 2024-05-09T06:30:24.460 INFO:tasks.workunit.client.1.smithi106.stdout:2/398: symlink d2/d7/l83 0 2024-05-09T06:30:24.460 INFO:tasks.workunit.client.1.smithi106.stdout:2/399: chown d2/d7/d2c/l31 73618 1 2024-05-09T06:30:24.463 INFO:tasks.workunit.client.1.smithi106.stdout:0/389: link d1/d11/d23/d13/l1b d1/d11/d23/d13/d63/d7e/l81 0 2024-05-09T06:30:24.465 INFO:tasks.workunit.client.1.smithi106.stdout:2/400: mkdir d2/d5/db/d1d/d84 0 2024-05-09T06:30:24.467 INFO:tasks.workunit.client.1.smithi106.stdout:4/296: rename d7/d10/d12 to d7/d10/d1a/d5a 0 2024-05-09T06:30:24.472 INFO:tasks.workunit.client.1.smithi106.stdout:9/372: rename d4/d6/d23/d2f/d31/d51/c52 to d4/d6/c66 0 2024-05-09T06:30:24.472 INFO:tasks.workunit.client.1.smithi106.stdout:2/401: rename d2/d5/db to d2/d5/db/d15/d41/d85 22 2024-05-09T06:30:24.472 INFO:tasks.workunit.client.1.smithi106.stdout:9/373: truncate d4/f5a 160259 0 2024-05-09T06:30:24.473 INFO:tasks.workunit.client.1.smithi106.stdout:4/297: creat d7/d10/d1a/f5b x:0 0 0 2024-05-09T06:30:24.476 INFO:tasks.workunit.client.1.smithi106.stdout:4/298: symlink d7/d28/d2a/l5c 0 2024-05-09T06:30:24.480 INFO:tasks.workunit.client.1.smithi106.stdout:2/402: dread d2/d7/f27 [0,4194304] 0 2024-05-09T06:30:24.480 INFO:tasks.workunit.client.1.smithi106.stdout:4/299: dread d7/d10/f43 [0,4194304] 0 2024-05-09T06:30:24.481 INFO:tasks.workunit.client.1.smithi106.stdout:2/403: dread d2/d5/f54 [0,4194304] 0 2024-05-09T06:30:24.486 INFO:tasks.workunit.client.1.smithi106.stdout:2/404: write d2/f5f [1005224,20173] 0 2024-05-09T06:30:24.488 INFO:tasks.workunit.client.1.smithi106.stdout:2/405: creat d2/d5/db/d1d/d6a/f86 x:0 0 0 2024-05-09T06:30:24.491 INFO:tasks.workunit.client.1.smithi106.stdout:2/406: creat d2/d5/db/f87 x:0 0 0 2024-05-09T06:30:24.491 INFO:tasks.workunit.client.1.smithi106.stdout:2/407: creat d2/d5/db/f88 x:0 0 0 2024-05-09T06:30:24.493 INFO:tasks.workunit.client.1.smithi106.stdout:4/300: dwrite d7/d39/f3f [0,4194304] 0 2024-05-09T06:30:24.495 INFO:tasks.workunit.client.1.smithi106.stdout:2/408: rename d2/d5/db/d1d/d84 to d2/d7/d89 0 2024-05-09T06:30:24.502 INFO:tasks.workunit.client.1.smithi106.stdout:4/301: rename d7/d10/c4c to d7/d10/d1a/c5d 0 2024-05-09T06:30:24.502 INFO:tasks.workunit.client.1.smithi106.stdout:4/302: write d7/f11 [949484,52386] 0 2024-05-09T06:30:24.504 INFO:tasks.workunit.client.1.smithi106.stdout:2/409: link d2/d5/db/d1d/d23/f66 d2/d5/db/d1d/f8a 0 2024-05-09T06:30:24.506 INFO:tasks.workunit.client.1.smithi106.stdout:4/303: symlink d7/d28/l5e 0 2024-05-09T06:30:24.506 INFO:tasks.workunit.client.1.smithi106.stdout:4/304: chown d7/d10/d1a/c30 128777 1 2024-05-09T06:30:24.506 INFO:tasks.workunit.client.1.smithi106.stdout:4/305: truncate d7/d10/d1a/d5a/d1c/f52 319086 0 2024-05-09T06:30:24.508 INFO:tasks.workunit.client.1.smithi106.stdout:2/410: symlink d2/d5/db/d15/d41/d58/l8b 0 2024-05-09T06:30:24.511 INFO:tasks.workunit.client.1.smithi106.stdout:2/411: dread d2/d7/f27 [0,4194304] 0 2024-05-09T06:30:24.521 INFO:tasks.workunit.client.1.smithi106.stdout:4/306: dwrite d7/d39/f44 [0,4194304] 0 2024-05-09T06:30:24.523 INFO:tasks.workunit.client.1.smithi106.stdout:7/267: getdents d0/dc/d45 0 2024-05-09T06:30:24.526 INFO:tasks.workunit.client.1.smithi106.stdout:4/307: rename d7/d28/d2a/l53 to d7/d10/d1a/d5a/d1c/l5f 0 2024-05-09T06:30:24.528 INFO:tasks.workunit.client.1.smithi106.stdout:7/268: fdatasync d0/fa 0 2024-05-09T06:30:24.535 INFO:tasks.workunit.client.1.smithi106.stdout:4/308: dread d7/d10/d1a/f1e [4194304,4194304] 0 2024-05-09T06:30:24.535 INFO:tasks.workunit.client.1.smithi106.stdout:4/309: read - d7/d10/d1a/d5a/d46/f54 zero size 2024-05-09T06:30:24.535 INFO:tasks.workunit.client.1.smithi106.stdout:7/269: read d0/dc/f19 [2948327,26321] 0 2024-05-09T06:30:24.536 INFO:tasks.workunit.client.1.smithi106.stdout:7/270: dread d0/dc/f25 [0,4194304] 0 2024-05-09T06:30:24.537 INFO:tasks.workunit.client.1.smithi106.stdout:4/310: symlink d7/d39/d47/l60 0 2024-05-09T06:30:24.537 INFO:tasks.workunit.client.1.smithi106.stdout:4/311: chown d7/d28 191380 1 2024-05-09T06:30:24.537 INFO:tasks.workunit.client.1.smithi106.stdout:7/271: write d0/dc/f2d [336881,128163] 0 2024-05-09T06:30:24.540 INFO:tasks.workunit.client.1.smithi106.stdout:4/312: rename d7/d28/l34 to d7/d39/l61 0 2024-05-09T06:30:24.540 INFO:tasks.workunit.client.1.smithi106.stdout:4/313: write d7/d10/f51 [2521733,98928] 0 2024-05-09T06:30:24.540 INFO:tasks.workunit.client.1.smithi106.stdout:4/314: chown d7/d10/d1a/d5a/d46/f54 1 1 2024-05-09T06:30:24.541 INFO:tasks.workunit.client.1.smithi106.stdout:4/315: write d7/f11 [2289266,46414] 0 2024-05-09T06:30:24.541 INFO:tasks.workunit.client.1.smithi106.stdout:4/316: read d7/f29 [57068,17095] 0 2024-05-09T06:30:24.543 INFO:tasks.workunit.client.1.smithi106.stdout:4/317: fsync d7/d10/f51 0 2024-05-09T06:30:24.546 INFO:tasks.workunit.client.1.smithi106.stdout:7/272: getdents d0/dc/d1a 0 2024-05-09T06:30:24.546 INFO:tasks.workunit.client.1.smithi106.stdout:7/273: read d0/f4a [400275,62199] 0 2024-05-09T06:30:24.548 INFO:tasks.workunit.client.1.smithi106.stdout:4/318: rename d7/f40 to d7/d10/d1a/f62 0 2024-05-09T06:30:24.551 INFO:tasks.workunit.client.1.smithi106.stdout:7/274: mknod d0/dc/d1a/d36/c51 0 2024-05-09T06:30:24.553 INFO:tasks.workunit.client.1.smithi106.stdout:4/319: rmdir d7/d10/d1a/d5a/d46 39 2024-05-09T06:30:24.556 INFO:tasks.workunit.client.1.smithi106.stdout:4/320: creat d7/d10/d1a/d5a/f63 x:0 0 0 2024-05-09T06:30:24.563 INFO:tasks.workunit.client.1.smithi106.stdout:7/275: link d0/dc/f14 d0/f52 0 2024-05-09T06:30:24.564 INFO:tasks.workunit.client.1.smithi106.stdout:7/276: write d0/dc/f2d [285868,20943] 0 2024-05-09T06:30:24.564 INFO:tasks.workunit.client.1.smithi106.stdout:7/277: readlink d0/dc/d1a/d36/l38 0 2024-05-09T06:30:24.564 INFO:tasks.workunit.client.1.smithi106.stdout:7/278: write d0/dc/d1a/d36/f3f [259186,14224] 0 2024-05-09T06:30:24.566 INFO:tasks.workunit.client.1.smithi106.stdout:7/279: rmdir d0/dc/d45/d50 0 2024-05-09T06:30:24.572 INFO:tasks.workunit.client.1.smithi106.stdout:3/311: sync 2024-05-09T06:30:24.572 INFO:tasks.workunit.client.1.smithi106.stdout:5/333: sync 2024-05-09T06:30:24.572 INFO:tasks.workunit.client.1.smithi106.stdout:3/312: dread - d5/d1c/d24/f55 zero size 2024-05-09T06:30:24.572 INFO:tasks.workunit.client.1.smithi106.stdout:3/313: fdatasync d5/d12/f45 0 2024-05-09T06:30:24.572 INFO:tasks.workunit.client.1.smithi106.stdout:6/366: sync 2024-05-09T06:30:24.574 INFO:tasks.workunit.client.1.smithi106.stdout:5/334: creat d8/d45/d4c/f5c x:0 0 0 2024-05-09T06:30:24.576 INFO:tasks.workunit.client.1.smithi106.stdout:3/314: unlink c0 0 2024-05-09T06:30:24.576 INFO:tasks.workunit.client.1.smithi106.stdout:3/315: chown d5/fe 15 1 2024-05-09T06:30:24.577 INFO:tasks.workunit.client.1.smithi106.stdout:0/390: truncate d1/d11/d23/d13/f5c 599509 0 2024-05-09T06:30:24.579 INFO:tasks.workunit.client.1.smithi106.stdout:6/367: creat d0/d17/d21/f77 x:0 0 0 2024-05-09T06:30:24.582 INFO:tasks.workunit.client.1.smithi106.stdout:7/280: dwrite d0/dc/d1a/d36/d1e/f4c [0,4194304] 0 2024-05-09T06:30:24.583 INFO:tasks.workunit.client.1.smithi106.stdout:5/335: dread d8/f12 [0,4194304] 0 2024-05-09T06:30:24.590 INFO:tasks.workunit.client.1.smithi106.stdout:0/391: dwrite d1/d11/d23/d13/f54 [0,4194304] 0 2024-05-09T06:30:24.590 INFO:tasks.workunit.client.1.smithi106.stdout:0/392: creat d1/d11/d23/d13/d2c/d3d/f82 x:0 0 0 2024-05-09T06:30:24.591 INFO:tasks.workunit.client.1.smithi106.stdout:5/336: symlink d8/d45/l5d 0 2024-05-09T06:30:24.599 INFO:tasks.workunit.client.1.smithi106.stdout:0/393: mkdir d1/d11/d23/d13/d2c/d76/d83 0 2024-05-09T06:30:24.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/337: mknod d8/d33/d3a/c5e 0 2024-05-09T06:30:24.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/338: write d8/f51 [656297,110560] 0 2024-05-09T06:30:24.619 INFO:tasks.workunit.client.0.smithi046.stderr:+ T=./tmp.qblNkpa2pn 2024-05-09T06:30:24.619 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.qblNkpa2pn -l 1 -n 1000 -p 10 -v 2024-05-09T06:30:24.622 INFO:tasks.workunit.client.1.smithi106.stdout:5/339: dwrite d8/fc [0,4194304] 0 2024-05-09T06:30:24.622 INFO:tasks.workunit.client.1.smithi106.stdout:5/340: creat d8/f5f x:0 0 0 2024-05-09T06:30:24.622 INFO:tasks.workunit.client.1.smithi106.stdout:0/394: dwrite d1/d11/d23/d13/d2c/d3d/f82 [0,4194304] 0 2024-05-09T06:30:24.622 INFO:tasks.workunit.client.1.smithi106.stdout:0/395: creat d1/d11/d23/d22/f84 x:0 0 0 2024-05-09T06:30:24.624 INFO:tasks.workunit.client.1.smithi106.stdout:5/341: mkdir d8/d5a/d60 0 2024-05-09T06:30:24.630 INFO:tasks.workunit.client.1.smithi106.stdout:5/342: mknod d8/d45/c61 0 2024-05-09T06:30:24.634 INFO:tasks.workunit.client.0.smithi046.stdout:seed = 1714787403 2024-05-09T06:30:24.635 INFO:tasks.workunit.client.1.smithi106.stdout:2/412: truncate d2/d5/db/d15/d41/d58/f45 6630028 0 2024-05-09T06:30:24.635 INFO:tasks.workunit.client.1.smithi106.stdout:0/396: dwrite d1/d11/d23/d22/f59 [0,4194304] 0 2024-05-09T06:30:24.637 INFO:tasks.workunit.client.1.smithi106.stdout:5/343: dread d8/f12 [0,4194304] 0 2024-05-09T06:30:24.637 INFO:tasks.workunit.client.1.smithi106.stdout:5/344: stat d8/d45/d4c/d32/d5b/f24 0 2024-05-09T06:30:24.639 INFO:tasks.workunit.client.0.smithi046.stdout:0/0: rmdir - no directory 2024-05-09T06:30:24.640 INFO:tasks.workunit.client.1.smithi106.stdout:0/397: symlink d1/d11/d23/d13/d2c/d3d/l85 0 2024-05-09T06:30:24.640 INFO:tasks.workunit.client.1.smithi106.stdout:0/398: write d1/d11/d23/d13/d58/f71 [88070,55912] 0 2024-05-09T06:30:24.640 INFO:tasks.workunit.client.1.smithi106.stdout:0/399: fdatasync d1/d11/d23/d13/d58/d79/f7a 0 2024-05-09T06:30:24.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/0: truncate - no filename 2024-05-09T06:30:24.642 INFO:tasks.workunit.client.0.smithi046.stdout:0/1: creat f0 x:0 0 0 2024-05-09T06:30:24.642 INFO:tasks.workunit.client.0.smithi046.stdout:0/2: creat f1 x:0 0 0 2024-05-09T06:30:24.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/0: write - no filename 2024-05-09T06:30:24.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/1: chown . 209181 1 2024-05-09T06:30:24.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/2: chown . 9214 1 2024-05-09T06:30:24.648 INFO:tasks.workunit.client.1.smithi106.stdout:0/400: unlink d1/d11/d23/d13/d2c/d6d/c75 0 2024-05-09T06:30:24.649 INFO:tasks.workunit.client.1.smithi106.stdout:0/401: stat d1/f7 0 2024-05-09T06:30:24.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/1: creat f0 x:0 0 0 2024-05-09T06:30:24.653 INFO:tasks.workunit.client.1.smithi106.stdout:2/413: dwrite d2/d5/db/d1d/f8a [0,4194304] 0 2024-05-09T06:30:24.654 INFO:tasks.workunit.client.1.smithi106.stdout:0/402: rename d1/d11/d23/d13/d2c/c30 to d1/d11/c86 0 2024-05-09T06:30:24.654 INFO:tasks.workunit.client.1.smithi106.stdout:0/403: dread - d1/d11/d23/f5f zero size 2024-05-09T06:30:24.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/3: mknod c0 0 2024-05-09T06:30:24.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/4: write - no filename 2024-05-09T06:30:24.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/5: dread - no filename 2024-05-09T06:30:24.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/6: dread - no filename 2024-05-09T06:30:24.658 INFO:tasks.workunit.client.1.smithi106.stdout:2/414: symlink d2/d5/db/d1d/l8c 0 2024-05-09T06:30:24.658 INFO:tasks.workunit.client.1.smithi106.stdout:2/415: creat d2/f8d x:0 0 0 2024-05-09T06:30:24.661 INFO:tasks.workunit.client.0.smithi046.stdout:2/7: creat f1 x:0 0 0 2024-05-09T06:30:24.662 INFO:tasks.workunit.client.1.smithi106.stdout:0/404: rename d1/l4f to d1/d11/d23/d13/d63/l87 0 2024-05-09T06:30:24.662 INFO:tasks.workunit.client.1.smithi106.stdout:0/405: readlink d1/d11/d23/d22/l42 0 2024-05-09T06:30:24.663 INFO:tasks.workunit.client.0.smithi046.stdout:4/0: write - no filename 2024-05-09T06:30:24.664 INFO:tasks.workunit.client.0.smithi046.stdout:3/0: symlink l0 0 2024-05-09T06:30:24.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/1: truncate - no filename 2024-05-09T06:30:24.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/2: readlink l0 0 2024-05-09T06:30:24.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/3: dread - no filename 2024-05-09T06:30:24.666 INFO:tasks.workunit.client.1.smithi106.stdout:2/416: rename d2/d7/c20 to d2/d5/db/c8e 0 2024-05-09T06:30:24.666 INFO:tasks.workunit.client.1.smithi106.stdout:2/417: chown d2/d5/db/d1d/d23/d63/l69 3237 1 2024-05-09T06:30:24.666 INFO:tasks.workunit.client.1.smithi106.stdout:2/418: chown d2/d7/d2c 1687905 1 2024-05-09T06:30:24.667 INFO:tasks.workunit.client.0.smithi046.stdout:2/8: symlink l2 0 2024-05-09T06:30:24.668 INFO:tasks.workunit.client.1.smithi106.stdout:0/406: getdents d1/d11/d23/d13/d2c/d57 0 2024-05-09T06:30:24.668 INFO:tasks.workunit.client.1.smithi106.stdout:0/407: read d1/d11/f3c [4060337,31881] 0 2024-05-09T06:30:24.668 INFO:tasks.workunit.client.1.smithi106.stdout:0/408: readlink d1/d11/d23/d13/d2c/l62 0 2024-05-09T06:30:24.668 INFO:tasks.workunit.client.1.smithi106.stdout:0/409: write d1/d11/d23/f5f [697169,919] 0 2024-05-09T06:30:24.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/1: creat f0 x:0 0 0 2024-05-09T06:30:24.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/2: write f0 [878058,126044] 0 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:5/0: rename - no filename 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:5/1: dread - no filename 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:5/2: unlink - no file 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:5/3: dread - no filename 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/4: rename l0 to l1 0 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/5: dwrite - no filename 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/6: chown l1 18494286 1 2024-05-09T06:30:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/7: dwrite - no filename 2024-05-09T06:30:24.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/8: dread - no filename 2024-05-09T06:30:24.686 INFO:tasks.workunit.client.1.smithi106.stdout:0/410: dwrite d1/d11/d23/d22/f4e [0,4194304] 0 2024-05-09T06:30:24.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/3: rename f0 to f1 0 2024-05-09T06:30:24.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/4: mkdir d0 0 2024-05-09T06:30:24.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/4: dwrite f1 [0,4194304] 0 2024-05-09T06:30:24.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/9: symlink l2 0 2024-05-09T06:30:24.787 INFO:tasks.workunit.client.1.smithi106.stdout:0/411: creat d1/d11/d23/d13/d2c/f88 x:0 0 0 2024-05-09T06:30:24.789 INFO:tasks.workunit.client.0.smithi046.stdout:6/0: mknod c0 0 2024-05-09T06:30:24.791 INFO:tasks.workunit.client.1.smithi106.stdout:0/412: creat d1/d11/d23/d13/d2c/d76/d83/f89 x:0 0 0 2024-05-09T06:30:24.791 INFO:tasks.workunit.client.1.smithi106.stdout:0/413: fdatasync d1/d11/d23/d13/d2c/f2d 0 2024-05-09T06:30:24.791 INFO:tasks.workunit.client.1.smithi106.stdout:0/414: chown d1/d11/d23/d13/d2c/d6d/f73 1 1 2024-05-09T06:30:24.791 INFO:tasks.workunit.client.1.smithi106.stdout:0/415: fsync d1/d11/f56 0 2024-05-09T06:30:24.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/5: creat d0/f1 x:0 0 0 2024-05-09T06:30:24.793 INFO:tasks.workunit.client.1.smithi106.stdout:0/416: mkdir d1/d11/d23/d13/d8a 0 2024-05-09T06:30:24.795 INFO:tasks.workunit.client.1.smithi106.stdout:0/417: stat d1/d11/d23/d13/d2c/d3d/l51 0 2024-05-09T06:30:24.795 INFO:tasks.workunit.client.1.smithi106.stdout:1/341: sync 2024-05-09T06:30:24.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/0: getdents . 0 2024-05-09T06:30:24.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/1: chown . 182702 1 2024-05-09T06:30:24.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/2: dread - no filename 2024-05-09T06:30:24.799 INFO:tasks.workunit.client.0.smithi046.stdout:7/0: symlink l0 0 2024-05-09T06:30:24.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/1: symlink l1 0 2024-05-09T06:30:24.800 INFO:tasks.workunit.client.1.smithi106.stdout:0/418: rmdir d1/d11/d23/d13/d58/d79 39 2024-05-09T06:30:24.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/0: dread - no filename 2024-05-09T06:30:24.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/1: readlink - no filename 2024-05-09T06:30:24.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/2: dwrite - no filename 2024-05-09T06:30:24.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/1: creat f1 x:0 0 0 2024-05-09T06:30:24.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/2: write f1 [659366,45102] 0 2024-05-09T06:30:24.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/3: creat f2 x:0 0 0 2024-05-09T06:30:24.805 INFO:tasks.workunit.client.0.smithi046.stdout:6/2: creat f2 x:0 0 0 2024-05-09T06:30:24.806 INFO:tasks.workunit.client.0.smithi046.stdout:9/3: creat f0 x:0 0 0 2024-05-09T06:30:24.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/4: creat f1 x:0 0 0 2024-05-09T06:30:24.808 INFO:tasks.workunit.client.1.smithi106.stdout:1/342: dwrite d4/d5/f58 [0,4194304] 0 2024-05-09T06:30:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/4: dread f1 [0,4194304] 0 2024-05-09T06:30:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/5: fdatasync f1 0 2024-05-09T06:30:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/5: mkdir d2 0 2024-05-09T06:30:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/6: rename d2 to d2/d3 22 2024-05-09T06:30:24.813 INFO:tasks.workunit.client.0.smithi046.stdout:9/7: link f1 d2/f4 0 2024-05-09T06:30:24.813 INFO:tasks.workunit.client.0.smithi046.stdout:9/8: truncate f0 981514 0 2024-05-09T06:30:24.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/9: write f0 [90968,55602] 0 2024-05-09T06:30:24.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/10: write d2/f4 [81883,56174] 0 2024-05-09T06:30:24.814 INFO:tasks.workunit.client.1.smithi106.stdout:1/343: creat d4/d76/d13/f80 x:0 0 0 2024-05-09T06:30:24.815 INFO:tasks.workunit.client.1.smithi106.stdout:1/344: creat d4/d37/d4a/f81 x:0 0 0 2024-05-09T06:30:24.815 INFO:tasks.workunit.client.1.smithi106.stdout:1/345: creat d4/d76/d13/f82 x:0 0 0 2024-05-09T06:30:24.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/11: rename f1 to d2/f5 0 2024-05-09T06:30:24.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/12: write d2/f4 [438178,40896] 0 2024-05-09T06:30:24.818 INFO:tasks.workunit.client.1.smithi106.stdout:1/346: symlink d4/d5b/l83 0 2024-05-09T06:30:24.818 INFO:tasks.workunit.client.1.smithi106.stdout:1/347: read - d4/d76/d1d/f4e zero size 2024-05-09T06:30:24.822 INFO:tasks.workunit.client.1.smithi106.stdout:1/348: rename d4/f32 to d4/d37/d3d/f84 0 2024-05-09T06:30:24.823 INFO:tasks.workunit.client.1.smithi106.stdout:1/349: read d4/d76/f11 [450578,58405] 0 2024-05-09T06:30:24.823 INFO:tasks.workunit.client.1.smithi106.stdout:1/350: write d4/d37/d3d/f69 [378466,123025] 0 2024-05-09T06:30:24.823 INFO:tasks.workunit.client.1.smithi106.stdout:1/351: rename d4/d76/d13/d60/f71 to d4/d5b/f85 0 2024-05-09T06:30:24.824 INFO:tasks.workunit.client.1.smithi106.stdout:0/419: dwrite d1/d11/d23/f1f [4194304,4194304] 0 2024-05-09T06:30:24.825 INFO:tasks.workunit.client.1.smithi106.stdout:0/420: creat d1/d11/d23/d13/d2c/f8b x:0 0 0 2024-05-09T06:30:24.825 INFO:tasks.workunit.client.1.smithi106.stdout:0/421: stat d1/d11/d23/d13/d2c/d57/l6a 0 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/422: write d1/f43 [835251,5069] 0 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/423: creat d1/d11/f8c x:0 0 0 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/424: chown d1/d11/d23/d22/l4d 14233856 1 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/425: chown d1/f4a 215726462 1 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/426: dread - d1/d11/d23/d22/f45 zero size 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/427: chown d1/d11/d23/d13/d63/l67 796 1 2024-05-09T06:30:24.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/428: creat d1/d11/d23/d13/d58/f8d x:0 0 0 2024-05-09T06:30:24.834 INFO:tasks.workunit.client.1.smithi106.stdout:0/429: symlink d1/d11/d23/d13/d63/l8e 0 2024-05-09T06:30:24.841 INFO:tasks.workunit.client.1.smithi106.stdout:4/321: rmdir d7/d10 39 2024-05-09T06:30:24.843 INFO:tasks.workunit.client.1.smithi106.stdout:4/322: rename d7/d10/d1a/d5a/d1c/l5f to d7/d10/d1a/d5a/d46/l64 0 2024-05-09T06:30:24.843 INFO:tasks.workunit.client.1.smithi106.stdout:4/323: fsync d7/f9 0 2024-05-09T06:30:24.843 INFO:tasks.workunit.client.1.smithi106.stdout:4/324: chown d7/d39/d47/l60 315 1 2024-05-09T06:30:24.844 INFO:tasks.workunit.client.1.smithi106.stdout:4/325: creat d7/d10/f65 x:0 0 0 2024-05-09T06:30:24.845 INFO:tasks.workunit.client.1.smithi106.stdout:4/326: mkdir d7/d39/d47/d66 0 2024-05-09T06:30:24.845 INFO:tasks.workunit.client.1.smithi106.stdout:4/327: rename d7/d39/d35 to d7/d39/d35/d4a/d67 22 2024-05-09T06:30:24.845 INFO:tasks.workunit.client.1.smithi106.stdout:0/430: dwrite d1/d11/d23/d13/d58/f71 [0,4194304] 0 2024-05-09T06:30:24.846 INFO:tasks.workunit.client.1.smithi106.stdout:7/281: mkdir d0/d53 0 2024-05-09T06:30:24.846 INFO:tasks.workunit.client.1.smithi106.stdout:7/282: creat d0/dc/f54 x:0 0 0 2024-05-09T06:30:24.847 INFO:tasks.workunit.client.1.smithi106.stdout:4/328: symlink d7/d28/l68 0 2024-05-09T06:30:24.850 INFO:tasks.workunit.client.1.smithi106.stdout:7/283: symlink d0/dc/d1a/l55 0 2024-05-09T06:30:24.851 INFO:tasks.workunit.client.1.smithi106.stdout:7/284: chown d0/dc/f10 413 1 2024-05-09T06:30:24.852 INFO:tasks.workunit.client.1.smithi106.stdout:4/329: rename d7/d10/d1a/d5a/d1c/l36 to d7/d10/d1a/d5a/d46/l69 0 2024-05-09T06:30:24.853 INFO:tasks.workunit.client.1.smithi106.stdout:7/285: mknod d0/dc/d1a/d36/d1e/c56 0 2024-05-09T06:30:24.854 INFO:tasks.workunit.client.1.smithi106.stdout:7/286: rename d0/dc/f10 to d0/dc/f57 0 2024-05-09T06:30:24.854 INFO:tasks.workunit.client.1.smithi106.stdout:7/287: fdatasync d0/dc/d1a/f3a 0 2024-05-09T06:30:24.855 INFO:tasks.workunit.client.1.smithi106.stdout:7/288: write d0/dc/d1a/f3a [3791,30840] 0 2024-05-09T06:30:24.857 INFO:tasks.workunit.client.1.smithi106.stdout:7/289: truncate d0/dc/f57 3224149 0 2024-05-09T06:30:24.859 INFO:tasks.workunit.client.1.smithi106.stdout:7/290: mkdir d0/dc/d1a/d36/d30/d44/d58 0 2024-05-09T06:30:24.860 INFO:tasks.workunit.client.1.smithi106.stdout:7/291: truncate d0/dc/f14 1542597 0 2024-05-09T06:30:24.861 INFO:tasks.workunit.client.1.smithi106.stdout:6/368: getdents d0/d17/d21 0 2024-05-09T06:30:24.861 INFO:tasks.workunit.client.1.smithi106.stdout:6/369: chown d0/l38 5111 1 2024-05-09T06:30:24.862 INFO:tasks.workunit.client.1.smithi106.stdout:6/370: symlink d0/d17/d34/d5f/d8/d27/d3e/l78 0 2024-05-09T06:30:24.862 INFO:tasks.workunit.client.1.smithi106.stdout:6/371: fdatasync d0/f30 0 2024-05-09T06:30:24.864 INFO:tasks.workunit.client.1.smithi106.stdout:7/292: truncate d0/f40 2241754 0 2024-05-09T06:30:24.864 INFO:tasks.workunit.client.1.smithi106.stdout:7/293: dread - d0/dc/d1a/f2f zero size 2024-05-09T06:30:24.864 INFO:tasks.workunit.client.1.smithi106.stdout:6/372: symlink d0/d5c/l79 0 2024-05-09T06:30:24.865 INFO:tasks.workunit.client.1.smithi106.stdout:7/294: symlink d0/d53/l59 0 2024-05-09T06:30:24.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/330: dwrite d7/d10/f65 [0,4194304] 0 2024-05-09T06:30:24.866 INFO:tasks.workunit.client.1.smithi106.stdout:6/373: mknod d0/d17/d34/d5f/d8/d27/d3b/d62/c7a 0 2024-05-09T06:30:24.869 INFO:tasks.workunit.client.1.smithi106.stdout:6/374: dread d0/d17/f57 [0,4194304] 0 2024-05-09T06:30:24.888 INFO:tasks.workunit.client.1.smithi106.stdout:9/374: sync 2024-05-09T06:30:24.888 INFO:tasks.workunit.client.1.smithi106.stdout:8/323: sync 2024-05-09T06:30:24.890 INFO:tasks.workunit.client.1.smithi106.stdout:8/324: link d3/d5/d13/l21 d3/d5/d7/d15/d3e/l76 0 2024-05-09T06:30:24.892 INFO:tasks.workunit.client.1.smithi106.stdout:7/295: dwrite d0/dc/d1a/f3a [0,4194304] 0 2024-05-09T06:30:24.892 INFO:tasks.workunit.client.1.smithi106.stdout:7/296: fdatasync d0/dc/d1a/f3a 0 2024-05-09T06:30:24.892 INFO:tasks.workunit.client.1.smithi106.stdout:8/325: getdents d3/d5 0 2024-05-09T06:30:24.892 INFO:tasks.workunit.client.1.smithi106.stdout:8/326: creat d3/d5/d13/d3a/f77 x:0 0 0 2024-05-09T06:30:24.893 INFO:tasks.workunit.client.1.smithi106.stdout:4/331: dwrite d7/d39/f3f [0,4194304] 0 2024-05-09T06:30:24.894 INFO:tasks.workunit.client.1.smithi106.stdout:0/431: getdents d1/d11/d23/d13/d2c/d6d 0 2024-05-09T06:30:24.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/3: getdents . 0 2024-05-09T06:30:24.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/4: stat f0 0 2024-05-09T06:30:24.902 INFO:tasks.workunit.client.1.smithi106.stdout:7/297: dread d0/dc/d1a/f3a [0,4194304] 0 2024-05-09T06:30:24.905 INFO:tasks.workunit.client.1.smithi106.stdout:4/332: unlink d7/d10/d1a/c5d 0 2024-05-09T06:30:24.905 INFO:tasks.workunit.client.1.smithi106.stdout:4/333: chown d7/d10/l4f 201769504 1 2024-05-09T06:30:24.911 INFO:tasks.workunit.client.0.smithi046.stdout:2/9: getdents . 0 2024-05-09T06:30:24.911 INFO:tasks.workunit.client.0.smithi046.stdout:2/10: write f1 [462041,91853] 0 2024-05-09T06:30:24.914 INFO:tasks.workunit.client.1.smithi106.stdout:7/298: dread d0/f29 [0,4194304] 0 2024-05-09T06:30:24.915 INFO:tasks.workunit.client.0.smithi046.stdout:3/10: link l1 l3 0 2024-05-09T06:30:24.915 INFO:tasks.workunit.client.0.smithi046.stdout:3/11: dread - no filename 2024-05-09T06:30:24.916 INFO:tasks.workunit.client.1.smithi106.stdout:7/299: mkdir d0/dc/d1a/d5a 0 2024-05-09T06:30:24.917 INFO:tasks.workunit.client.0.smithi046.stdout:4/5: fsync f1 0 2024-05-09T06:30:24.917 INFO:tasks.workunit.client.1.smithi106.stdout:4/334: dread f2 [4194304,4194304] 0 2024-05-09T06:30:24.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/12: unlink l1 0 2024-05-09T06:30:24.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/6: link f1 f2 0 2024-05-09T06:30:24.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/7: creat f3 x:0 0 0 2024-05-09T06:30:24.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/8: creat f4 x:0 0 0 2024-05-09T06:30:24.920 INFO:tasks.workunit.client.1.smithi106.stdout:4/335: mknod d7/d10/d1a/d5a/c6a 0 2024-05-09T06:30:24.922 INFO:tasks.workunit.client.0.smithi046.stdout:3/13: mkdir d4 0 2024-05-09T06:30:24.923 INFO:tasks.workunit.client.1.smithi106.stdout:8/327: dwrite d3/d5/d13/f14 [4194304,4194304] 0 2024-05-09T06:30:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:0/5: dwrite f1 [0,4194304] 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/375: dwrite d4/d6/d1b/d2a/d42/f4f [0,4194304] 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/376: dread - d4/d6/d23/d2f/d31/f5c zero size 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/377: fsync d4/d6/d23/d2f/d39/f60 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/378: write d4/d54/f5f [1003238,118019] 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/379: creat d4/f67 x:0 0 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:2/419: dwrite d2/d5/db/d15/d41/d58/f45 [4194304,4194304] 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:2/420: creat d2/d5/db/d15/d4f/f8f x:0 0 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/380: write d4/d6/d1b/f65 [830806,107654] 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:2/421: chown d2/d5/db/c21 233755989 1 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:2/422: fdatasync d2/d5/db/d1d/f3d 0 2024-05-09T06:30:24.925 INFO:tasks.workunit.client.1.smithi106.stdout:4/336: getdents d7 0 2024-05-09T06:30:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/9: link f1 f5 0 2024-05-09T06:30:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/10: readlink - no filename 2024-05-09T06:30:24.930 INFO:tasks.workunit.client.1.smithi106.stdout:8/328: creat d3/d5/f78 x:0 0 0 2024-05-09T06:30:24.930 INFO:tasks.workunit.client.1.smithi106.stdout:2/423: dread d2/f5f [0,4194304] 0 2024-05-09T06:30:24.930 INFO:tasks.workunit.client.1.smithi106.stdout:8/329: fsync d3/d5/d7/f60 0 2024-05-09T06:30:24.931 INFO:tasks.workunit.client.0.smithi046.stdout:2/11: dread f1 [0,4194304] 0 2024-05-09T06:30:24.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/14: mkdir d4/d5 0 2024-05-09T06:30:24.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/15: rename d4/d5 to d4/d5/d6 22 2024-05-09T06:30:24.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/16: chown d4 14 1 2024-05-09T06:30:24.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/17: dread - no filename 2024-05-09T06:30:24.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/18: dwrite - no filename 2024-05-09T06:30:24.933 INFO:tasks.workunit.client.0.smithi046.stdout:2/12: read f1 [45827,52683] 0 2024-05-09T06:30:24.943 INFO:tasks.workunit.client.1.smithi106.stdout:4/337: rmdir d7/d10/d1a/d5a 39 2024-05-09T06:30:24.943 INFO:tasks.workunit.client.1.smithi106.stdout:9/381: dwrite d4/d6/d23/d16/f27 [4194304,4194304] 0 2024-05-09T06:30:24.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/3: fsync f2 0 2024-05-09T06:30:24.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/4: chown l1 161172 1 2024-05-09T06:30:24.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/5: creat f3 x:0 0 0 2024-05-09T06:30:24.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/11: truncate f2 3533984 0 2024-05-09T06:30:24.946 INFO:tasks.workunit.client.1.smithi106.stdout:2/424: unlink d2/d5/db/f1b 0 2024-05-09T06:30:24.946 INFO:tasks.workunit.client.1.smithi106.stdout:2/425: read d2/d7/f25 [1962448,91508] 0 2024-05-09T06:30:24.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/6: getdents . 0 2024-05-09T06:30:24.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/6: dread f1 [0,4194304] 0 2024-05-09T06:30:24.951 INFO:tasks.workunit.client.1.smithi106.stdout:7/300: dwrite d0/dc/d1a/f3a [0,4194304] 0 2024-05-09T06:30:24.952 INFO:tasks.workunit.client.0.smithi046.stdout:7/7: mkdir d3 0 2024-05-09T06:30:24.953 INFO:tasks.workunit.client.1.smithi106.stdout:8/330: dwrite d3/d5/d7/d15/d3e/f56 [0,4194304] 0 2024-05-09T06:30:24.953 INFO:tasks.workunit.client.0.smithi046.stdout:2/13: dwrite f1 [0,4194304] 0 2024-05-09T06:30:24.954 INFO:tasks.workunit.client.1.smithi106.stdout:9/382: mkdir d4/d6/d23/d2f/d38/d68 0 2024-05-09T06:30:24.956 INFO:tasks.workunit.client.1.smithi106.stdout:2/426: unlink d2/d5/db/d15/d4f/l5b 0 2024-05-09T06:30:24.956 INFO:tasks.workunit.client.1.smithi106.stdout:2/427: dread - d2/d5/db/d1d/d23/d5e/f64 zero size 2024-05-09T06:30:24.960 INFO:tasks.workunit.client.0.smithi046.stdout:7/8: creat d3/f4 x:0 0 0 2024-05-09T06:30:24.960 INFO:tasks.workunit.client.0.smithi046.stdout:7/9: fdatasync d3/f4 0 2024-05-09T06:30:24.960 INFO:tasks.workunit.client.0.smithi046.stdout:7/10: dread - d3/f4 zero size 2024-05-09T06:30:24.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/11: creat d3/f5 x:0 0 0 2024-05-09T06:30:24.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/12: stat d3/f5 0 2024-05-09T06:30:24.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/13: dread - d3/f5 zero size 2024-05-09T06:30:24.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/14: creat d3/f6 x:0 0 0 2024-05-09T06:30:24.965 INFO:tasks.workunit.client.0.smithi046.stdout:2/14: read f1 [3735309,104043] 0 2024-05-09T06:30:24.968 INFO:tasks.workunit.client.1.smithi106.stdout:7/301: unlink d0/dc/f54 0 2024-05-09T06:30:24.971 INFO:tasks.workunit.client.0.smithi046.stdout:2/15: creat f3 x:0 0 0 2024-05-09T06:30:24.972 INFO:tasks.workunit.client.0.smithi046.stdout:2/16: creat f4 x:0 0 0 2024-05-09T06:30:24.972 INFO:tasks.workunit.client.1.smithi106.stdout:9/383: dread d4/d6/d1b/d2a/f26 [0,4194304] 0 2024-05-09T06:30:24.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/17: symlink l5 0 2024-05-09T06:30:24.981 INFO:tasks.workunit.client.1.smithi106.stdout:3/316: sync 2024-05-09T06:30:24.981 INFO:tasks.workunit.client.1.smithi106.stdout:5/345: sync 2024-05-09T06:30:24.981 INFO:tasks.workunit.client.1.smithi106.stdout:5/346: chown d8/f12 1414 1 2024-05-09T06:30:24.982 INFO:tasks.workunit.client.1.smithi106.stdout:2/428: dwrite d2/d5/f54 [0,4194304] 0 2024-05-09T06:30:24.984 INFO:tasks.workunit.client.1.smithi106.stdout:8/331: creat d3/d6b/f79 x:0 0 0 2024-05-09T06:30:24.987 INFO:tasks.workunit.client.1.smithi106.stdout:5/347: mknod d8/d45/c62 0 2024-05-09T06:30:24.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/15: dwrite d3/f4 [0,4194304] 0 2024-05-09T06:30:24.993 INFO:tasks.workunit.client.0.smithi046.stdout:7/16: read - d3/f5 zero size 2024-05-09T06:30:24.993 INFO:tasks.workunit.client.0.smithi046.stdout:7/17: chown d3/f6 12307 1 2024-05-09T06:30:24.993 INFO:tasks.workunit.client.1.smithi106.stdout:7/302: link d0/f4a d0/f5b 0 2024-05-09T06:30:24.994 INFO:tasks.workunit.client.1.smithi106.stdout:7/303: rename d0 to d0/dc/d1a/d36/d5c 22 2024-05-09T06:30:24.994 INFO:tasks.workunit.client.1.smithi106.stdout:7/304: chown d0/dc/d1a/d36/l37 1525022 1 2024-05-09T06:30:24.994 INFO:tasks.workunit.client.1.smithi106.stdout:7/305: write d0/dc/d1a/d36/d30/f3b [800283,51274] 0 2024-05-09T06:30:24.994 INFO:tasks.workunit.client.1.smithi106.stdout:3/317: dread d5/d1c/d24/f28 [0,4194304] 0 2024-05-09T06:30:24.995 INFO:tasks.workunit.client.1.smithi106.stdout:8/332: dread d3/d5/f12 [4194304,4194304] 0 2024-05-09T06:30:24.996 INFO:tasks.workunit.client.1.smithi106.stdout:5/348: creat d8/d33/d3a/f63 x:0 0 0 2024-05-09T06:30:24.998 INFO:tasks.workunit.client.1.smithi106.stdout:9/384: dwrite d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:25.001 INFO:tasks.workunit.client.1.smithi106.stdout:8/333: mkdir d3/d6b/d7a 0 2024-05-09T06:30:25.002 INFO:tasks.workunit.client.1.smithi106.stdout:9/385: dread d4/d6/d1b/d2a/f56 [0,4194304] 0 2024-05-09T06:30:25.003 INFO:tasks.workunit.client.1.smithi106.stdout:3/318: write d5/d1c/d24/f43 [2564506,120543] 0 2024-05-09T06:30:25.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/18: dread f1 [0,4194304] 0 2024-05-09T06:30:25.004 INFO:tasks.workunit.client.1.smithi106.stdout:5/349: mknod d8/d45/d4c/c64 0 2024-05-09T06:30:25.004 INFO:tasks.workunit.client.1.smithi106.stdout:5/350: truncate d8/d45/d4c/d32/d5b/f1e 5707115 0 2024-05-09T06:30:25.004 INFO:tasks.workunit.client.1.smithi106.stdout:5/351: creat d8/d33/d3a/f65 x:0 0 0 2024-05-09T06:30:25.005 INFO:tasks.workunit.client.1.smithi106.stdout:2/429: dwrite d2/f26 [8388608,4194304] 0 2024-05-09T06:30:25.006 INFO:tasks.workunit.client.0.smithi046.stdout:2/18: dwrite f3 [0,4194304] 0 2024-05-09T06:30:25.006 INFO:tasks.workunit.client.0.smithi046.stdout:2/19: creat f6 x:0 0 0 2024-05-09T06:30:25.011 INFO:tasks.workunit.client.1.smithi106.stdout:8/334: link d3/d5/f5a d3/d5/d35/d4e/d32/f7b 0 2024-05-09T06:30:25.011 INFO:tasks.workunit.client.1.smithi106.stdout:6/375: rmdir d0/d17 39 2024-05-09T06:30:25.014 INFO:tasks.workunit.client.1.smithi106.stdout:7/306: write d0/f52 [206779,94693] 0 2024-05-09T06:30:25.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/19: dwrite d3/f5 [0,4194304] 0 2024-05-09T06:30:25.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/20: write d3/f6 [419822,74370] 0 2024-05-09T06:30:25.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/21: fdatasync d3/f4 0 2024-05-09T06:30:25.019 INFO:tasks.workunit.client.1.smithi106.stdout:1/352: sync 2024-05-09T06:30:25.020 INFO:tasks.workunit.client.1.smithi106.stdout:5/352: symlink d8/l66 0 2024-05-09T06:30:25.020 INFO:tasks.workunit.client.1.smithi106.stdout:5/353: write d8/d45/d4c/d32/d5b/f41 [2536798,114988] 0 2024-05-09T06:30:25.026 INFO:tasks.workunit.client.1.smithi106.stdout:2/430: mkdir d2/d5/db/d1d/d90 0 2024-05-09T06:30:25.026 INFO:tasks.workunit.client.1.smithi106.stdout:6/376: write d0/f19 [405948,56958] 0 2024-05-09T06:30:25.026 INFO:tasks.workunit.client.1.smithi106.stdout:2/431: fsync d2/d5/db/d1d/d23/f73 0 2024-05-09T06:30:25.026 INFO:tasks.workunit.client.1.smithi106.stdout:2/432: creat d2/d5/f91 x:0 0 0 2024-05-09T06:30:25.029 INFO:tasks.workunit.client.0.smithi046.stdout:7/22: unlink f1 0 2024-05-09T06:30:25.030 INFO:tasks.workunit.client.1.smithi106.stdout:4/338: rmdir d7/d10 39 2024-05-09T06:30:25.039 INFO:tasks.workunit.client.1.smithi106.stdout:9/386: getdents d4/d6/d1b 0 2024-05-09T06:30:25.039 INFO:tasks.workunit.client.1.smithi106.stdout:9/387: dread - d4/d6/d23/d2f/d31/f50 zero size 2024-05-09T06:30:25.042 INFO:tasks.workunit.client.1.smithi106.stdout:7/307: stat d0/l33 0 2024-05-09T06:30:25.044 INFO:tasks.workunit.client.1.smithi106.stdout:1/353: creat d4/d37/d74/f86 x:0 0 0 2024-05-09T06:30:25.048 INFO:tasks.workunit.client.1.smithi106.stdout:5/354: rename d8/l16 to d8/d45/d4c/l67 0 2024-05-09T06:30:25.048 INFO:tasks.workunit.client.1.smithi106.stdout:5/355: fdatasync d8/d33/d3a/f42 0 2024-05-09T06:30:25.048 INFO:tasks.workunit.client.0.smithi046.stdout:2/20: dwrite f3 [0,4194304] 0 2024-05-09T06:30:25.049 INFO:tasks.workunit.client.1.smithi106.stdout:8/335: dwrite d3/d5/d35/d73/f4f [0,4194304] 0 2024-05-09T06:30:25.049 INFO:tasks.workunit.client.1.smithi106.stdout:8/336: write d3/d5/d7/d15/f49 [4719066,109988] 0 2024-05-09T06:30:25.049 INFO:tasks.workunit.client.1.smithi106.stdout:2/433: dwrite d2/d5/db/d1d/d23/f81 [4194304,4194304] 0 2024-05-09T06:30:25.049 INFO:tasks.workunit.client.1.smithi106.stdout:2/434: creat d2/d5/db/d68/f92 x:0 0 0 2024-05-09T06:30:25.049 INFO:tasks.workunit.client.1.smithi106.stdout:2/435: dread - d2/d5/db/d15/d4f/f8f zero size 2024-05-09T06:30:25.050 INFO:tasks.workunit.client.1.smithi106.stdout:6/377: dwrite d0/d17/f29 [0,4194304] 0 2024-05-09T06:30:25.057 INFO:tasks.workunit.client.1.smithi106.stdout:4/339: mknod d7/d39/d47/d66/c6b 0 2024-05-09T06:30:25.057 INFO:tasks.workunit.client.1.smithi106.stdout:4/340: fdatasync d7/d10/f1d 0 2024-05-09T06:30:25.064 INFO:tasks.workunit.client.1.smithi106.stdout:5/356: creat d8/d33/d3a/d59/f68 x:0 0 0 2024-05-09T06:30:25.064 INFO:tasks.workunit.client.1.smithi106.stdout:5/357: truncate d8/d33/d3a/d59/f68 760310 0 2024-05-09T06:30:25.064 INFO:tasks.workunit.client.1.smithi106.stdout:5/358: write d8/d45/d4c/f5c [574947,67786] 0 2024-05-09T06:30:25.066 INFO:tasks.workunit.client.0.smithi046.stdout:6/6: getdents . 0 2024-05-09T06:30:25.070 INFO:tasks.workunit.client.1.smithi106.stdout:8/337: mknod d3/c7c 0 2024-05-09T06:30:25.072 INFO:tasks.workunit.client.0.smithi046.stdout:6/7: rename f2 to f4 0 2024-05-09T06:30:25.076 INFO:tasks.workunit.client.1.smithi106.stdout:6/378: creat d0/d5c/f7b x:0 0 0 2024-05-09T06:30:25.077 INFO:tasks.workunit.client.1.smithi106.stdout:6/379: getdents d0/d17/d34/d5f/d8/d50 0 2024-05-09T06:30:25.077 INFO:tasks.workunit.client.1.smithi106.stdout:6/380: truncate d0/d17/d34/d5f/d8/d27/d3b/f4b 692612 0 2024-05-09T06:30:25.077 INFO:tasks.workunit.client.0.smithi046.stdout:6/8: mknod c5 0 2024-05-09T06:30:25.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/9: write f4 [556976,25167] 0 2024-05-09T06:30:25.079 INFO:tasks.workunit.client.0.smithi046.stdout:6/10: read f4 [92220,2115] 0 2024-05-09T06:30:25.079 INFO:tasks.workunit.client.1.smithi106.stdout:4/341: truncate d7/f18 4587505 0 2024-05-09T06:30:25.081 INFO:tasks.workunit.client.0.smithi046.stdout:2/21: dwrite f6 [0,4194304] 0 2024-05-09T06:30:25.082 INFO:tasks.workunit.client.1.smithi106.stdout:5/359: mkdir d8/d45/d4c/d32/d5b/d69 0 2024-05-09T06:30:25.082 INFO:tasks.workunit.client.1.smithi106.stdout:5/360: read - d8/f50 zero size 2024-05-09T06:30:25.085 INFO:tasks.workunit.client.1.smithi106.stdout:2/436: dwrite d2/d5/db/d1d/d23/f81 [8388608,4194304] 0 2024-05-09T06:30:25.085 INFO:tasks.workunit.client.1.smithi106.stdout:2/437: truncate d2/d7/d2c/f78 739723 0 2024-05-09T06:30:25.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/23: dwrite f2 [0,4194304] 0 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:1/354: rmdir d4/d76/d13/d2f/d70 0 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:1/355: write d4/d5b/f7e [41529,48237] 0 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:1/356: creat d4/d37/d4a/f87 x:0 0 0 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:0/432: sync 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:0/433: write d1/d11/d23/d13/f3f [1469421,81734] 0 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:8/338: dread d3/d5/d13/f14 [4194304,4194304] 0 2024-05-09T06:30:25.086 INFO:tasks.workunit.client.1.smithi106.stdout:8/339: dread - d3/d5/d13/d3a/f77 zero size 2024-05-09T06:30:25.087 INFO:tasks.workunit.client.1.smithi106.stdout:7/308: dwrite d0/dc/d1a/f3a [4194304,4194304] 0 2024-05-09T06:30:25.087 INFO:tasks.workunit.client.0.smithi046.stdout:4/12: dwrite f2 [4194304,4194304] 0 2024-05-09T06:30:25.087 INFO:tasks.workunit.client.0.smithi046.stdout:0/7: dwrite f1 [4194304,4194304] 0 2024-05-09T06:30:25.088 INFO:tasks.workunit.client.1.smithi106.stdout:5/361: symlink d8/d45/l6a 0 2024-05-09T06:30:25.088 INFO:tasks.workunit.client.1.smithi106.stdout:9/388: dwrite d4/d6/f5e [0,4194304] 0 2024-05-09T06:30:25.088 INFO:tasks.workunit.client.1.smithi106.stdout:6/381: write d0/d17/d34/d5f/f28 [3750537,96996] 0 2024-05-09T06:30:25.089 INFO:tasks.workunit.client.1.smithi106.stdout:9/389: write d4/f5a [267675,83176] 0 2024-05-09T06:30:25.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/22: link f6 f7 0 2024-05-09T06:30:25.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/390: dread d4/d6/d23/d16/f3b [0,4194304] 0 2024-05-09T06:30:25.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/391: stat d4/d6/d23/d2f/d47 0 2024-05-09T06:30:25.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/392: readlink d4/d6/l9 0 2024-05-09T06:30:25.095 INFO:tasks.workunit.client.1.smithi106.stdout:5/362: dread d8/f51 [0,4194304] 0 2024-05-09T06:30:25.096 INFO:tasks.workunit.client.1.smithi106.stdout:2/438: unlink d2/d5/db/d1d/l8c 0 2024-05-09T06:30:25.101 INFO:tasks.workunit.client.0.smithi046.stdout:6/11: dwrite f4 [0,4194304] 0 2024-05-09T06:30:25.103 INFO:tasks.workunit.client.1.smithi106.stdout:0/434: symlink d1/d11/d23/d13/d2c/l8f 0 2024-05-09T06:30:25.105 INFO:tasks.workunit.client.1.smithi106.stdout:8/340: rmdir d3/d6b/d7a 0 2024-05-09T06:30:25.106 INFO:tasks.workunit.client.0.smithi046.stdout:4/13: symlink l6 0 2024-05-09T06:30:25.106 INFO:tasks.workunit.client.0.smithi046.stdout:4/14: truncate f3 172485 0 2024-05-09T06:30:25.107 INFO:tasks.workunit.client.1.smithi106.stdout:1/357: dwrite d4/d37/f43 [0,4194304] 0 2024-05-09T06:30:25.110 INFO:tasks.workunit.client.0.smithi046.stdout:0/8: symlink l2 0 2024-05-09T06:30:25.110 INFO:tasks.workunit.client.0.smithi046.stdout:0/9: dread - f0 zero size 2024-05-09T06:30:25.110 INFO:tasks.workunit.client.1.smithi106.stdout:7/309: dread d0/f13 [0,4194304] 0 2024-05-09T06:30:25.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/24: rmdir d3 39 2024-05-09T06:30:25.120 INFO:tasks.workunit.client.0.smithi046.stdout:6/12: creat f6 x:0 0 0 2024-05-09T06:30:25.120 INFO:tasks.workunit.client.0.smithi046.stdout:6/13: truncate f6 516044 0 2024-05-09T06:30:25.120 INFO:tasks.workunit.client.0.smithi046.stdout:6/14: dread f6 [0,4194304] 0 2024-05-09T06:30:25.122 INFO:tasks.workunit.client.0.smithi046.stdout:4/15: mkdir d7 0 2024-05-09T06:30:25.122 INFO:tasks.workunit.client.0.smithi046.stdout:4/16: getdents d7 0 2024-05-09T06:30:25.125 INFO:tasks.workunit.client.1.smithi106.stdout:5/363: dwrite d8/f37 [0,4194304] 0 2024-05-09T06:30:25.127 INFO:tasks.workunit.client.0.smithi046.stdout:7/25: mkdir d3/d7 0 2024-05-09T06:30:25.133 INFO:tasks.workunit.client.1.smithi106.stdout:1/358: dwrite d4/d76/f11 [0,4194304] 0 2024-05-09T06:30:25.133 INFO:tasks.workunit.client.1.smithi106.stdout:1/359: truncate d4/d76/f7c 256215 0 2024-05-09T06:30:25.133 INFO:tasks.workunit.client.1.smithi106.stdout:1/360: readlink d4/d37/d4a/l51 0 2024-05-09T06:30:25.133 INFO:tasks.workunit.client.1.smithi106.stdout:1/361: chown d4/d76/d65/f66 62 1 2024-05-09T06:30:25.134 INFO:tasks.workunit.client.0.smithi046.stdout:4/17: symlink d7/l8 0 2024-05-09T06:30:25.142 INFO:tasks.workunit.client.1.smithi106.stdout:6/382: symlink d0/d17/d34/d5f/d8/l7c 0 2024-05-09T06:30:25.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/26: dwrite d3/f4 [4194304,4194304] 0 2024-05-09T06:30:25.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/27: chown d3 31 1 2024-05-09T06:30:25.146 INFO:tasks.workunit.client.1.smithi106.stdout:9/393: mkdir d4/d54/d69 0 2024-05-09T06:30:25.148 INFO:tasks.workunit.client.0.smithi046.stdout:4/18: dread f1 [0,4194304] 0 2024-05-09T06:30:25.150 INFO:tasks.workunit.client.1.smithi106.stdout:0/435: mknod d1/d11/d23/d13/d2c/d6d/d70/c90 0 2024-05-09T06:30:25.150 INFO:tasks.workunit.client.1.smithi106.stdout:0/436: chown d1/f3 250675076 1 2024-05-09T06:30:25.151 INFO:tasks.workunit.client.1.smithi106.stdout:0/437: creat d1/d11/d23/d22/f91 x:0 0 0 2024-05-09T06:30:25.151 INFO:tasks.workunit.client.1.smithi106.stdout:0/438: dread d1/d11/d23/d22/f5b [0,4194304] 0 2024-05-09T06:30:25.151 INFO:tasks.workunit.client.0.smithi046.stdout:7/28: creat d3/f8 x:0 0 0 2024-05-09T06:30:25.152 INFO:tasks.workunit.client.0.smithi046.stdout:7/29: getdents d3/d7 0 2024-05-09T06:30:25.153 INFO:tasks.workunit.client.1.smithi106.stdout:8/341: truncate d3/d5/d13/f2e 1895331 0 2024-05-09T06:30:25.153 INFO:tasks.workunit.client.1.smithi106.stdout:6/383: write d0/d17/d34/f44 [2494724,120473] 0 2024-05-09T06:30:25.154 INFO:tasks.workunit.client.0.smithi046.stdout:4/19: creat d7/f9 x:0 0 0 2024-05-09T06:30:25.156 INFO:tasks.workunit.client.0.smithi046.stdout:6/15: dwrite f3 [0,4194304] 0 2024-05-09T06:30:25.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/30: creat d3/d7/f9 x:0 0 0 2024-05-09T06:30:25.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/31: truncate d3/f8 101794 0 2024-05-09T06:30:25.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/32: read - d3/d7/f9 zero size 2024-05-09T06:30:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:2/23: truncate f6 1253610 0 2024-05-09T06:30:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/33: dread d3/f6 [0,4194304] 0 2024-05-09T06:30:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/34: chown d3/f6 14 1 2024-05-09T06:30:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/35: creat d3/d7/fa x:0 0 0 2024-05-09T06:30:25.162 INFO:tasks.workunit.client.1.smithi106.stdout:7/310: unlink d0/dc/d1a/d36/l11 0 2024-05-09T06:30:25.166 INFO:tasks.workunit.client.0.smithi046.stdout:4/20: dread f1 [4194304,4194304] 0 2024-05-09T06:30:25.166 INFO:tasks.workunit.client.0.smithi046.stdout:4/21: creat d7/fa x:0 0 0 2024-05-09T06:30:25.169 INFO:tasks.workunit.client.1.smithi106.stdout:7/311: read d0/dc/d1a/f3a [1254347,112900] 0 2024-05-09T06:30:25.169 INFO:tasks.workunit.client.1.smithi106.stdout:7/312: chown d0/dc/d1a/d36/d1e/c56 159 1 2024-05-09T06:30:25.231 INFO:tasks.workunit.client.0.smithi046.stdout:6/16: dread f4 [0,4194304] 0 2024-05-09T06:30:25.232 INFO:tasks.workunit.client.0.smithi046.stdout:7/36: symlink d3/d7/lb 0 2024-05-09T06:30:25.240 INFO:tasks.workunit.client.0.smithi046.stdout:6/17: dread f3 [0,4194304] 0 2024-05-09T06:30:25.240 INFO:tasks.workunit.client.0.smithi046.stdout:6/18: fdatasync f6 0 2024-05-09T06:30:25.271 INFO:tasks.workunit.client.1.smithi106.stdout:0/439: dwrite d1/d11/d23/f27 [0,4194304] 0 2024-05-09T06:30:25.271 INFO:tasks.workunit.client.1.smithi106.stdout:7/313: dwrite d0/dc/f25 [0,4194304] 0 2024-05-09T06:30:25.288 INFO:tasks.workunit.client.1.smithi106.stdout:7/314: dwrite d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:25.292 INFO:tasks.workunit.client.1.smithi106.stdout:7/315: dread d0/f29 [0,4194304] 0 2024-05-09T06:30:25.307 INFO:tasks.workunit.client.1.smithi106.stdout:7/316: dwrite d0/dc/d1a/d36/d30/f32 [0,4194304] 0 2024-05-09T06:30:25.311 INFO:tasks.workunit.client.0.smithi046.stdout:4/22: rename f2 to d7/fb 0 2024-05-09T06:30:25.312 INFO:tasks.workunit.client.1.smithi106.stdout:1/362: creat d4/d76/d65/f88 x:0 0 0 2024-05-09T06:30:25.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/37: symlink d3/lc 0 2024-05-09T06:30:25.314 INFO:tasks.workunit.client.1.smithi106.stdout:9/394: symlink d4/d6/d23/d2f/l6a 0 2024-05-09T06:30:25.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/19: creat f7 x:0 0 0 2024-05-09T06:30:25.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/20: chown f7 49 1 2024-05-09T06:30:25.317 INFO:tasks.workunit.client.1.smithi106.stdout:2/439: getdents d2/d5/db/d1d/d23/d5e 0 2024-05-09T06:30:25.322 INFO:tasks.workunit.client.1.smithi106.stdout:1/363: write d4/fb [144389,13845] 0 2024-05-09T06:30:25.322 INFO:tasks.workunit.client.1.smithi106.stdout:8/342: mkdir d3/d5/d7/d15/d3e/d7d 0 2024-05-09T06:30:25.323 INFO:tasks.workunit.client.1.smithi106.stdout:9/395: dread d4/d6/d23/d2f/d31/f46 [0,4194304] 0 2024-05-09T06:30:25.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/384: creat d0/d17/d34/d5f/d8/d50/f7d x:0 0 0 2024-05-09T06:30:25.333 INFO:tasks.workunit.client.1.smithi106.stdout:6/385: dread d0/d17/d34/d5f/d8/f46 [0,4194304] 0 2024-05-09T06:30:25.334 INFO:tasks.workunit.client.1.smithi106.stdout:5/364: rmdir d8/d33/d3a 39 2024-05-09T06:30:25.334 INFO:tasks.workunit.client.1.smithi106.stdout:5/365: fsync d8/d45/f55 0 2024-05-09T06:30:25.334 INFO:tasks.workunit.client.1.smithi106.stdout:6/386: dread d0/d17/d34/d5f/d8/f46 [0,4194304] 0 2024-05-09T06:30:25.335 INFO:tasks.workunit.client.1.smithi106.stdout:3/319: sync 2024-05-09T06:30:25.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/10: truncate f1 4822432 0 2024-05-09T06:30:25.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/11: dread - f0 zero size 2024-05-09T06:30:25.344 INFO:tasks.workunit.client.1.smithi106.stdout:3/320: write d5/d12/f19 [1755613,68185] 0 2024-05-09T06:30:25.346 INFO:tasks.workunit.client.1.smithi106.stdout:0/440: mknod d1/d11/d23/d13/d2c/d76/c92 0 2024-05-09T06:30:25.353 INFO:tasks.workunit.client.1.smithi106.stdout:2/440: dwrite d2/d7/d2c/f42 [0,4194304] 0 2024-05-09T06:30:25.353 INFO:tasks.workunit.client.1.smithi106.stdout:2/441: chown d2/c8 3 1 2024-05-09T06:30:25.353 INFO:tasks.workunit.client.1.smithi106.stdout:5/366: dwrite d8/d45/d4c/f2e [0,4194304] 0 2024-05-09T06:30:25.353 INFO:tasks.workunit.client.1.smithi106.stdout:5/367: write d8/f4e [47710,58733] 0 2024-05-09T06:30:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/24: write f6 [2193253,97172] 0 2024-05-09T06:30:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/25: write f1 [2974262,82691] 0 2024-05-09T06:30:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/26: write f3 [3182453,58552] 0 2024-05-09T06:30:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/27: creat f8 x:0 0 0 2024-05-09T06:30:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/28: creat f9 x:0 0 0 2024-05-09T06:30:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/29: dread - f8 zero size 2024-05-09T06:30:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/30: dread - f8 zero size 2024-05-09T06:30:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/31: write f7 [3107207,119810] 0 2024-05-09T06:30:25.375 INFO:tasks.workunit.client.0.smithi046.stdout:2/32: dread f3 [0,4194304] 0 2024-05-09T06:30:25.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/33: readlink l2 0 2024-05-09T06:30:25.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/34: write f9 [900363,30690] 0 2024-05-09T06:30:25.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/35: read - f8 zero size 2024-05-09T06:30:25.391 INFO:tasks.workunit.client.0.smithi046.stdout:2/36: dwrite f4 [0,4194304] 0 2024-05-09T06:30:25.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/38: mkdir d3/d7/dd 0 2024-05-09T06:30:25.397 INFO:tasks.workunit.client.0.smithi046.stdout:6/21: chown l1 32306 1 2024-05-09T06:30:25.400 INFO:tasks.workunit.client.0.smithi046.stdout:2/37: write f4 [605015,117735] 0 2024-05-09T06:30:25.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/22: creat f8 x:0 0 0 2024-05-09T06:30:25.415 INFO:tasks.workunit.client.0.smithi046.stdout:7/39: dwrite d3/d7/f9 [0,4194304] 0 2024-05-09T06:30:25.416 INFO:tasks.workunit.client.0.smithi046.stdout:2/38: mkdir da 0 2024-05-09T06:30:25.426 INFO:tasks.workunit.client.0.smithi046.stdout:7/40: write d3/d7/f9 [989238,44321] 0 2024-05-09T06:30:25.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/41: read d3/f4 [370500,46654] 0 2024-05-09T06:30:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/23: mknod c9 0 2024-05-09T06:30:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/24: write f8 [361577,19403] 0 2024-05-09T06:30:25.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/42: creat d3/d7/dd/fe x:0 0 0 2024-05-09T06:30:25.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/43: write d3/d7/dd/fe [1018130,87259] 0 2024-05-09T06:30:25.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/44: read d3/f8 [84985,37402] 0 2024-05-09T06:30:25.440 INFO:tasks.workunit.client.0.smithi046.stdout:7/45: mknod d3/d7/cf 0 2024-05-09T06:30:25.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/46: chown d3/lc 6242 1 2024-05-09T06:30:25.442 INFO:tasks.workunit.client.0.smithi046.stdout:6/25: mknod ca 0 2024-05-09T06:30:25.442 INFO:tasks.workunit.client.0.smithi046.stdout:6/26: write f6 [49222,64863] 0 2024-05-09T06:30:25.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/47: mkdir d3/d7/dd/d10 0 2024-05-09T06:30:25.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/48: creat d3/d7/f11 x:0 0 0 2024-05-09T06:30:25.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/49: fsync d3/f8 0 2024-05-09T06:30:25.444 INFO:tasks.workunit.client.0.smithi046.stdout:7/50: write d3/d7/f11 [226855,117049] 0 2024-05-09T06:30:25.444 INFO:tasks.workunit.client.0.smithi046.stdout:7/51: write d3/f8 [814276,38292] 0 2024-05-09T06:30:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:7/52: dread d3/f8 [0,4194304] 0 2024-05-09T06:30:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:7/53: creat d3/f12 x:0 0 0 2024-05-09T06:30:25.489 INFO:tasks.workunit.client.0.smithi046.stdout:4/23: getdents d7 0 2024-05-09T06:30:25.489 INFO:tasks.workunit.client.0.smithi046.stdout:4/24: dread - d7/f9 zero size 2024-05-09T06:30:25.489 INFO:tasks.workunit.client.0.smithi046.stdout:4/25: write f3 [649706,110162] 0 2024-05-09T06:30:25.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/26: fdatasync d7/fa 0 2024-05-09T06:30:25.490 INFO:tasks.workunit.client.1.smithi106.stdout:7/317: getdents d0/d53 0 2024-05-09T06:30:25.491 INFO:tasks.workunit.client.1.smithi106.stdout:7/318: stat d0/dc/f25 0 2024-05-09T06:30:25.491 INFO:tasks.workunit.client.1.smithi106.stdout:7/319: fsync d0/f52 0 2024-05-09T06:30:25.493 INFO:tasks.workunit.client.1.smithi106.stdout:7/320: dread d0/dc/f2d [0,4194304] 0 2024-05-09T06:30:25.493 INFO:tasks.workunit.client.1.smithi106.stdout:7/321: creat d0/dc/d1a/d36/d1e/f5d x:0 0 0 2024-05-09T06:30:25.496 INFO:tasks.workunit.client.0.smithi046.stdout:7/54: symlink d3/l13 0 2024-05-09T06:30:25.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/27: creat d7/fc x:0 0 0 2024-05-09T06:30:25.500 INFO:tasks.workunit.client.1.smithi106.stdout:8/343: link d3/c1f d3/d5/d7/d15/d3e/d7d/c7e 0 2024-05-09T06:30:25.501 INFO:tasks.workunit.client.1.smithi106.stdout:8/344: dread d3/d5/d35/d4e/f3b [0,4194304] 0 2024-05-09T06:30:25.502 INFO:tasks.workunit.client.0.smithi046.stdout:7/55: symlink d3/d7/dd/l14 0 2024-05-09T06:30:25.502 INFO:tasks.workunit.client.0.smithi046.stdout:7/56: chown f2 1 1 2024-05-09T06:30:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/28: link l6 d7/ld 0 2024-05-09T06:30:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/29: fdatasync d7/fa 0 2024-05-09T06:30:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/30: dread - d7/f9 zero size 2024-05-09T06:30:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/31: truncate d7/fc 804732 0 2024-05-09T06:30:25.506 INFO:tasks.workunit.client.0.smithi046.stdout:7/57: rmdir d3/d7/dd/d10 0 2024-05-09T06:30:25.507 INFO:tasks.workunit.client.1.smithi106.stdout:3/321: creat d5/d1c/d53/f60 x:0 0 0 2024-05-09T06:30:25.508 INFO:tasks.workunit.client.1.smithi106.stdout:0/441: mkdir d1/d11/d23/d13/d2c/d76/d93 0 2024-05-09T06:30:25.509 INFO:tasks.workunit.client.0.smithi046.stdout:4/32: dread d7/fb [4194304,4194304] 0 2024-05-09T06:30:25.512 INFO:tasks.workunit.client.1.smithi106.stdout:2/442: mknod d2/d5/db/d15/d41/c93 0 2024-05-09T06:30:25.515 INFO:tasks.workunit.client.1.smithi106.stdout:5/368: mknod d8/d33/d3a/d59/c6b 0 2024-05-09T06:30:25.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/322: truncate d0/dc/d1a/d36/d30/f26 2757543 0 2024-05-09T06:30:25.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/323: fsync d0/dc/d1a/f3a 0 2024-05-09T06:30:25.519 INFO:tasks.workunit.client.1.smithi106.stdout:7/324: chown d0/dc/d1a/d36/d1e/f4c 2 1 2024-05-09T06:30:25.519 INFO:tasks.workunit.client.1.smithi106.stdout:4/342: sync 2024-05-09T06:30:25.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/12: fsync f1 0 2024-05-09T06:30:25.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/13: write f0 [827917,12406] 0 2024-05-09T06:30:25.522 INFO:tasks.workunit.client.1.smithi106.stdout:5/369: getdents d8/d45/d4c/d32 0 2024-05-09T06:30:25.524 INFO:tasks.workunit.client.0.smithi046.stdout:0/14: creat f3 x:0 0 0 2024-05-09T06:30:25.525 INFO:tasks.workunit.client.1.smithi106.stdout:2/443: getdents d2/d5/db/d15/d4f 0 2024-05-09T06:30:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:7/58: dwrite d3/f8 [0,4194304] 0 2024-05-09T06:30:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/33: dwrite d7/fa [0,4194304] 0 2024-05-09T06:30:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/34: chown d7/f9 33389696 1 2024-05-09T06:30:25.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/15: rename f3 to f4 0 2024-05-09T06:30:25.529 INFO:tasks.workunit.client.1.smithi106.stdout:5/370: dread d8/d45/d4c/d32/d5b/f29 [0,4194304] 0 2024-05-09T06:30:25.534 INFO:tasks.workunit.client.0.smithi046.stdout:7/59: dread d3/f5 [0,4194304] 0 2024-05-09T06:30:25.537 INFO:tasks.workunit.client.1.smithi106.stdout:2/444: rmdir d2/d7/d2c 39 2024-05-09T06:30:25.538 INFO:tasks.workunit.client.1.smithi106.stdout:2/445: truncate d2/d7/d2c/f34 957128 0 2024-05-09T06:30:25.538 INFO:tasks.workunit.client.1.smithi106.stdout:2/446: creat d2/d5/db/d1d/d6a/f94 x:0 0 0 2024-05-09T06:30:25.539 INFO:tasks.workunit.client.0.smithi046.stdout:0/16: symlink l5 0 2024-05-09T06:30:25.541 INFO:tasks.workunit.client.0.smithi046.stdout:7/60: unlink d3/d7/cf 0 2024-05-09T06:30:25.541 INFO:tasks.workunit.client.0.smithi046.stdout:7/61: creat d3/d7/dd/f15 x:0 0 0 2024-05-09T06:30:25.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/17: symlink l6 0 2024-05-09T06:30:25.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/18: creat f7 x:0 0 0 2024-05-09T06:30:25.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/19: truncate f0 1279441 0 2024-05-09T06:30:25.544 INFO:tasks.workunit.client.1.smithi106.stdout:2/447: symlink d2/d5/db/d1d/d23/d63/l95 0 2024-05-09T06:30:25.546 INFO:tasks.workunit.client.1.smithi106.stdout:5/371: dwrite d8/d33/d3a/d59/f68 [0,4194304] 0 2024-05-09T06:30:25.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/35: dwrite d7/fa [0,4194304] 0 2024-05-09T06:30:25.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/36: read f3 [218472,24025] 0 2024-05-09T06:30:25.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/37: write f4 [341356,77883] 0 2024-05-09T06:30:25.547 INFO:tasks.workunit.client.0.smithi046.stdout:7/62: mkdir d3/d7/dd/d16 0 2024-05-09T06:30:25.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/63: rmdir d3/d7/dd/d16 0 2024-05-09T06:30:25.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/38: rename l6 to d7/le 0 2024-05-09T06:30:25.557 INFO:tasks.workunit.client.1.smithi106.stdout:5/372: write d8/d45/d4c/f2e [1577848,58976] 0 2024-05-09T06:30:25.561 INFO:tasks.workunit.client.0.smithi046.stdout:4/39: mkdir d7/df 0 2024-05-09T06:30:25.561 INFO:tasks.workunit.client.0.smithi046.stdout:0/20: dwrite f1 [0,4194304] 0 2024-05-09T06:30:25.565 INFO:tasks.workunit.client.0.smithi046.stdout:4/40: mkdir d7/df/d10 0 2024-05-09T06:30:25.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/41: dread d7/fc [0,4194304] 0 2024-05-09T06:30:25.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/42: chown f5 1593719 1 2024-05-09T06:30:25.567 INFO:tasks.workunit.client.0.smithi046.stdout:0/21: rename f1 to f8 0 2024-05-09T06:30:25.567 INFO:tasks.workunit.client.0.smithi046.stdout:0/22: chown f7 37574432 1 2024-05-09T06:30:25.568 INFO:tasks.workunit.client.0.smithi046.stdout:0/23: dread - f7 zero size 2024-05-09T06:30:25.568 INFO:tasks.workunit.client.0.smithi046.stdout:0/24: readlink l2 0 2024-05-09T06:30:25.568 INFO:tasks.workunit.client.0.smithi046.stdout:0/25: write f8 [5109290,34789] 0 2024-05-09T06:30:25.570 INFO:tasks.workunit.client.1.smithi106.stdout:5/373: mkdir d8/d33/d6c 0 2024-05-09T06:30:25.573 INFO:tasks.workunit.client.1.smithi106.stdout:5/374: mkdir d8/d5a/d6d 0 2024-05-09T06:30:25.574 INFO:tasks.workunit.client.0.smithi046.stdout:0/26: dread f0 [0,4194304] 0 2024-05-09T06:30:25.574 INFO:tasks.workunit.client.0.smithi046.stdout:0/27: creat f9 x:0 0 0 2024-05-09T06:30:25.575 INFO:tasks.workunit.client.0.smithi046.stdout:0/28: write f0 [870941,26687] 0 2024-05-09T06:30:25.575 INFO:tasks.workunit.client.0.smithi046.stdout:0/29: creat fa x:0 0 0 2024-05-09T06:30:25.579 INFO:tasks.workunit.client.0.smithi046.stdout:0/30: link f7 fb 0 2024-05-09T06:30:25.584 INFO:tasks.workunit.client.1.smithi106.stdout:5/375: write d8/d45/d4c/d32/d5b/f52 [938563,126449] 0 2024-05-09T06:30:25.584 INFO:tasks.workunit.client.0.smithi046.stdout:4/43: dwrite f1 [0,4194304] 0 2024-05-09T06:30:25.593 INFO:tasks.workunit.client.1.smithi106.stdout:1/364: creat d4/d5/f89 x:0 0 0 2024-05-09T06:30:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/31: dwrite fa [0,4194304] 0 2024-05-09T06:30:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/32: creat fc x:0 0 0 2024-05-09T06:30:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/33: write f7 [954574,50537] 0 2024-05-09T06:30:25.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/34: chown f7 267216197 1 2024-05-09T06:30:25.601 INFO:tasks.workunit.client.0.smithi046.stdout:4/44: dwrite d7/fa [0,4194304] 0 2024-05-09T06:30:25.602 INFO:tasks.workunit.client.0.smithi046.stdout:4/45: dread f3 [0,4194304] 0 2024-05-09T06:30:25.603 INFO:tasks.workunit.client.0.smithi046.stdout:0/35: symlink ld 0 2024-05-09T06:30:25.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/46: symlink d7/df/d10/l11 0 2024-05-09T06:30:25.606 INFO:tasks.workunit.client.0.smithi046.stdout:4/47: dread f4 [0,4194304] 0 2024-05-09T06:30:25.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/36: unlink l5 0 2024-05-09T06:30:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/37: fsync f0 0 2024-05-09T06:30:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/38: creat fe x:0 0 0 2024-05-09T06:30:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/39: write fe [303738,51795] 0 2024-05-09T06:30:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/40: creat ff x:0 0 0 2024-05-09T06:30:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/41: readlink ld 0 2024-05-09T06:30:25.614 INFO:tasks.workunit.client.0.smithi046.stdout:4/48: dread f5 [0,4194304] 0 2024-05-09T06:30:25.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/49: mknod d7/df/c12 0 2024-05-09T06:30:25.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/50: chown d7/df/d10/l11 85 1 2024-05-09T06:30:25.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/51: rename d7/df/d10 to d7/df/d10/d13 22 2024-05-09T06:30:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/52: symlink d7/df/d10/l14 0 2024-05-09T06:30:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/53: creat d7/f15 x:0 0 0 2024-05-09T06:30:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/54: symlink d7/df/l16 0 2024-05-09T06:30:25.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/55: mknod d7/df/c17 0 2024-05-09T06:30:25.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/56: creat d7/f18 x:0 0 0 2024-05-09T06:30:25.623 INFO:tasks.workunit.client.0.smithi046.stdout:4/57: dread f4 [0,4194304] 0 2024-05-09T06:30:25.628 INFO:tasks.workunit.client.0.smithi046.stdout:0/42: dwrite f7 [0,4194304] 0 2024-05-09T06:30:25.631 INFO:tasks.workunit.client.1.smithi106.stdout:4/343: unlink d7/fb 0 2024-05-09T06:30:25.632 INFO:tasks.workunit.client.0.smithi046.stdout:0/43: rename f7 to f10 0 2024-05-09T06:30:25.633 INFO:tasks.workunit.client.0.smithi046.stdout:2/39: truncate f4 497097 0 2024-05-09T06:30:25.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/40: dread f1 [0,4194304] 0 2024-05-09T06:30:25.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/41: readlink l5 0 2024-05-09T06:30:25.643 INFO:tasks.workunit.client.0.smithi046.stdout:6/27: truncate f4 3517447 0 2024-05-09T06:30:25.646 INFO:tasks.workunit.client.0.smithi046.stdout:2/42: write f6 [1580656,6511] 0 2024-05-09T06:30:25.648 INFO:tasks.workunit.client.0.smithi046.stdout:2/43: mkdir da/db 0 2024-05-09T06:30:25.649 INFO:tasks.workunit.client.0.smithi046.stdout:2/44: mkdir da/dc 0 2024-05-09T06:30:25.652 INFO:tasks.workunit.client.1.smithi106.stdout:3/322: fsync d5/d1c/d53/f60 0 2024-05-09T06:30:25.658 INFO:tasks.workunit.client.1.smithi106.stdout:6/387: rename d0/d17/d21 to d0/d66/d7e 0 2024-05-09T06:30:25.658 INFO:tasks.workunit.client.1.smithi106.stdout:6/388: write d0/d17/d76/f71 [9350497,94825] 0 2024-05-09T06:30:25.659 INFO:tasks.workunit.client.1.smithi106.stdout:6/389: chown d0/c32 149876043 1 2024-05-09T06:30:25.659 INFO:tasks.workunit.client.1.smithi106.stdout:6/390: write d0/f19 [4348361,52125] 0 2024-05-09T06:30:25.659 INFO:tasks.workunit.client.1.smithi106.stdout:6/391: truncate d0/d17/d34/d5f/d8/f70 173982 0 2024-05-09T06:30:25.664 INFO:tasks.workunit.client.1.smithi106.stdout:6/392: link d0/d17/d34/f6d d0/d5c/f7f 0 2024-05-09T06:30:25.664 INFO:tasks.workunit.client.1.smithi106.stdout:6/393: write d0/d17/d34/d5f/d8/d50/f7d [164670,35102] 0 2024-05-09T06:30:25.666 INFO:tasks.workunit.client.0.smithi046.stdout:6/28: dwrite f7 [0,4194304] 0 2024-05-09T06:30:25.666 INFO:tasks.workunit.client.1.smithi106.stdout:6/394: mknod d0/d17/d34/d5f/d40/c80 0 2024-05-09T06:30:25.666 INFO:tasks.workunit.client.1.smithi106.stdout:6/395: fdatasync d0/d17/f29 0 2024-05-09T06:30:25.667 INFO:tasks.workunit.client.1.smithi106.stdout:6/396: read d0/f30 [346335,103347] 0 2024-05-09T06:30:25.668 INFO:tasks.workunit.client.1.smithi106.stdout:6/397: chown d0/d17/d34/d5f/d8/d27/d3e/l78 1 1 2024-05-09T06:30:25.671 INFO:tasks.workunit.client.1.smithi106.stdout:2/448: rmdir d2 39 2024-05-09T06:30:25.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/45: dwrite f6 [0,4194304] 0 2024-05-09T06:30:25.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/58: rename d7/le to d7/df/d10/l19 0 2024-05-09T06:30:25.684 INFO:tasks.workunit.client.1.smithi106.stdout:1/365: rename d4/d37/d4a/f56 to d4/f8a 0 2024-05-09T06:30:25.686 INFO:tasks.workunit.client.1.smithi106.stdout:4/344: rename d7/d28/d2a/c57 to d7/d10/d1a/d5a/d1c/c6c 0 2024-05-09T06:30:25.688 INFO:tasks.workunit.client.1.smithi106.stdout:1/366: rmdir d4/d37/d3d/d5a 0 2024-05-09T06:30:25.688 INFO:tasks.workunit.client.1.smithi106.stdout:2/449: read d2/d7/d2c/f42 [3705914,82952] 0 2024-05-09T06:30:25.689 INFO:tasks.workunit.client.1.smithi106.stdout:7/325: dwrite d0/dc/d1a/d36/d30/f26 [0,4194304] 0 2024-05-09T06:30:25.689 INFO:tasks.workunit.client.1.smithi106.stdout:6/398: rename d0/d17/d34/d5f/d8/d27/f6f to d0/d17/d34/d5f/d8/d50/f81 0 2024-05-09T06:30:25.691 INFO:tasks.workunit.client.1.smithi106.stdout:1/367: symlink d4/l8b 0 2024-05-09T06:30:25.691 INFO:tasks.workunit.client.1.smithi106.stdout:1/368: write d4/d76/f27 [3009380,5919] 0 2024-05-09T06:30:25.691 INFO:tasks.workunit.client.1.smithi106.stdout:1/369: creat d4/d5b/f8c x:0 0 0 2024-05-09T06:30:25.693 INFO:tasks.workunit.client.1.smithi106.stdout:7/326: link d0/l33 d0/dc/d1a/d36/d1e/l5e 0 2024-05-09T06:30:25.693 INFO:tasks.workunit.client.1.smithi106.stdout:7/327: write d0/f27 [2141059,51529] 0 2024-05-09T06:30:25.693 INFO:tasks.workunit.client.1.smithi106.stdout:7/328: write d0/f27 [2834589,38147] 0 2024-05-09T06:30:25.694 INFO:tasks.workunit.client.1.smithi106.stdout:4/345: read d7/d10/f65 [2657826,48403] 0 2024-05-09T06:30:25.694 INFO:tasks.workunit.client.1.smithi106.stdout:6/399: creat d0/d17/d34/f82 x:0 0 0 2024-05-09T06:30:25.699 INFO:tasks.workunit.client.1.smithi106.stdout:1/370: write d4/f1a [3503003,333] 0 2024-05-09T06:30:25.700 INFO:tasks.workunit.client.1.smithi106.stdout:7/329: creat d0/dc/d1a/d36/d30/d44/d58/f5f x:0 0 0 2024-05-09T06:30:25.700 INFO:tasks.workunit.client.1.smithi106.stdout:1/371: write d4/d76/f4b [1260914,73847] 0 2024-05-09T06:30:25.701 INFO:tasks.workunit.client.1.smithi106.stdout:2/450: dread d2/d5/db/d15/d41/d58/f45 [0,4194304] 0 2024-05-09T06:30:25.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/29: dwrite f6 [0,4194304] 0 2024-05-09T06:30:25.701 INFO:tasks.workunit.client.1.smithi106.stdout:1/372: mkdir d4/d76/d65/d8d 0 2024-05-09T06:30:25.702 INFO:tasks.workunit.client.1.smithi106.stdout:1/373: truncate d4/d76/d13/f1b 895359 0 2024-05-09T06:30:25.703 INFO:tasks.workunit.client.0.smithi046.stdout:2/46: dwrite f9 [0,4194304] 0 2024-05-09T06:30:25.703 INFO:tasks.workunit.client.0.smithi046.stdout:2/47: chown f3 39560 1 2024-05-09T06:30:25.705 INFO:tasks.workunit.client.1.smithi106.stdout:6/400: dread d0/d17/d34/d5f/d40/f41 [0,4194304] 0 2024-05-09T06:30:25.707 INFO:tasks.workunit.client.1.smithi106.stdout:1/374: rename d4/d76/d13/d60/l7b to d4/d76/d65/d67/l8e 0 2024-05-09T06:30:25.707 INFO:tasks.workunit.client.1.smithi106.stdout:1/375: chown d4/fa 5 1 2024-05-09T06:30:25.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/59: dwrite f1 [0,4194304] 0 2024-05-09T06:30:25.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/60: write d7/f15 [1044391,58511] 0 2024-05-09T06:30:25.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/61: creat d7/f1a x:0 0 0 2024-05-09T06:30:25.711 INFO:tasks.workunit.client.0.smithi046.stdout:2/48: dread f7 [0,4194304] 0 2024-05-09T06:30:25.711 INFO:tasks.workunit.client.0.smithi046.stdout:2/49: chown f7 1635443 1 2024-05-09T06:30:25.711 INFO:tasks.workunit.client.0.smithi046.stdout:2/50: chown f7 7 1 2024-05-09T06:30:25.712 INFO:tasks.workunit.client.1.smithi106.stdout:2/451: read d2/d5/f6 [100636,26672] 0 2024-05-09T06:30:25.715 INFO:tasks.workunit.client.1.smithi106.stdout:6/401: dread d0/d17/d34/d5f/d8/d27/f3a [0,4194304] 0 2024-05-09T06:30:25.716 INFO:tasks.workunit.client.1.smithi106.stdout:7/330: dwrite d0/dc/d1a/d36/d30/f32 [0,4194304] 0 2024-05-09T06:30:25.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/62: rmdir d7/df/d10 39 2024-05-09T06:30:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/30: mkdir db 0 2024-05-09T06:30:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/31: chown ca 18 1 2024-05-09T06:30:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/32: getdents db 0 2024-05-09T06:30:25.723 INFO:tasks.workunit.client.0.smithi046.stdout:2/51: rename l5 to da/dc/ld 0 2024-05-09T06:30:25.725 INFO:tasks.workunit.client.1.smithi106.stdout:1/376: mknod d4/d5/c8f 0 2024-05-09T06:30:25.725 INFO:tasks.workunit.client.1.smithi106.stdout:1/377: chown d4/d37/d3d/f40 1301 1 2024-05-09T06:30:25.725 INFO:tasks.workunit.client.1.smithi106.stdout:1/378: readlink d4/d5b/l83 0 2024-05-09T06:30:25.725 INFO:tasks.workunit.client.1.smithi106.stdout:1/379: fdatasync d4/d76/fe 0 2024-05-09T06:30:25.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/63: creat d7/df/f1b x:0 0 0 2024-05-09T06:30:25.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/64: truncate d7/f18 414699 0 2024-05-09T06:30:25.727 INFO:tasks.workunit.client.1.smithi106.stdout:2/452: symlink d2/d5/db/d15/d41/d60/l96 0 2024-05-09T06:30:25.727 INFO:tasks.workunit.client.1.smithi106.stdout:2/453: dread - d2/d5/db/d1d/d6a/f86 zero size 2024-05-09T06:30:25.728 INFO:tasks.workunit.client.1.smithi106.stdout:7/331: dwrite d0/dc/d1a/d36/f3f [0,4194304] 0 2024-05-09T06:30:25.729 INFO:tasks.workunit.client.0.smithi046.stdout:6/33: dread f7 [0,4194304] 0 2024-05-09T06:30:25.729 INFO:tasks.workunit.client.0.smithi046.stdout:6/34: getdents db 0 2024-05-09T06:30:25.730 INFO:tasks.workunit.client.1.smithi106.stdout:6/402: creat d0/d17/d34/d5f/d8/d27/d3b/d62/f83 x:0 0 0 2024-05-09T06:30:25.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/44: write fa [4395057,84800] 0 2024-05-09T06:30:25.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/403: dread d0/d17/d34/d5f/d8/f70 [0,4194304] 0 2024-05-09T06:30:25.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/404: write d0/d17/d34/f82 [787353,9635] 0 2024-05-09T06:30:25.732 INFO:tasks.workunit.client.1.smithi106.stdout:6/405: creat d0/d17/d34/d5f/d8/d27/d3b/d62/f84 x:0 0 0 2024-05-09T06:30:25.733 INFO:tasks.workunit.client.0.smithi046.stdout:6/35: creat db/fc x:0 0 0 2024-05-09T06:30:25.734 INFO:tasks.workunit.client.1.smithi106.stdout:1/380: mknod d4/d37/d74/c90 0 2024-05-09T06:30:25.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/45: mkdir d11 0 2024-05-09T06:30:25.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/46: fdatasync ff 0 2024-05-09T06:30:25.736 INFO:tasks.workunit.client.1.smithi106.stdout:1/381: read d4/f8a [89557,24769] 0 2024-05-09T06:30:25.736 INFO:tasks.workunit.client.1.smithi106.stdout:1/382: fsync d4/d5/f89 0 2024-05-09T06:30:25.739 INFO:tasks.workunit.client.1.smithi106.stdout:2/454: link d2/d5/db/c8e d2/d7/d89/c97 0 2024-05-09T06:30:25.742 INFO:tasks.workunit.client.0.smithi046.stdout:0/47: rename f8 to d11/f12 0 2024-05-09T06:30:25.742 INFO:tasks.workunit.client.0.smithi046.stdout:0/48: stat f10 0 2024-05-09T06:30:25.749 INFO:tasks.workunit.client.1.smithi106.stdout:8/345: creat d3/d5/d7/f7f x:0 0 0 2024-05-09T06:30:25.750 INFO:tasks.workunit.client.1.smithi106.stdout:8/346: link d3/d5/d13/f2e d3/d5/d35/d61/f80 0 2024-05-09T06:30:25.754 INFO:tasks.workunit.client.1.smithi106.stdout:3/323: rmdir d5/d1c/d53 39 2024-05-09T06:30:25.760 INFO:tasks.workunit.client.1.smithi106.stdout:7/332: unlink d0/dc/f25 0 2024-05-09T06:30:25.762 INFO:tasks.workunit.client.1.smithi106.stdout:5/376: creat d8/d45/d4c/f6e x:0 0 0 2024-05-09T06:30:25.764 INFO:tasks.workunit.client.1.smithi106.stdout:5/377: symlink d8/l6f 0 2024-05-09T06:30:25.764 INFO:tasks.workunit.client.1.smithi106.stdout:5/378: dread - d8/d45/d4c/f6e zero size 2024-05-09T06:30:25.764 INFO:tasks.workunit.client.1.smithi106.stdout:5/379: creat d8/d45/f70 x:0 0 0 2024-05-09T06:30:25.766 INFO:tasks.workunit.client.1.smithi106.stdout:3/324: dread d5/d1c/d24/f28 [0,4194304] 0 2024-05-09T06:30:25.766 INFO:tasks.workunit.client.1.smithi106.stdout:3/325: readlink d5/d1c/d24/l36 0 2024-05-09T06:30:25.767 INFO:tasks.workunit.client.1.smithi106.stdout:3/326: rmdir d5/d3f 39 2024-05-09T06:30:25.769 INFO:tasks.workunit.client.1.smithi106.stdout:3/327: truncate d5/d1c/d21/d32/f49 3576096 0 2024-05-09T06:30:25.770 INFO:tasks.workunit.client.1.smithi106.stdout:3/328: creat d5/d1c/d24/d5b/f61 x:0 0 0 2024-05-09T06:30:25.770 INFO:tasks.workunit.client.1.smithi106.stdout:3/329: chown d5/d1c/f2b 26439 1 2024-05-09T06:30:25.771 INFO:tasks.workunit.client.1.smithi106.stdout:3/330: symlink d5/d1c/d21/d32/l62 0 2024-05-09T06:30:25.773 INFO:tasks.workunit.client.1.smithi106.stdout:3/331: creat d5/f63 x:0 0 0 2024-05-09T06:30:25.774 INFO:tasks.workunit.client.1.smithi106.stdout:9/396: sync 2024-05-09T06:30:25.779 INFO:tasks.workunit.client.1.smithi106.stdout:7/333: write d0/dc/d1a/d36/d1e/f4c [186522,105509] 0 2024-05-09T06:30:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:4/65: dwrite d7/f1a [0,4194304] 0 2024-05-09T06:30:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:4/66: fdatasync d7/f9 0 2024-05-09T06:30:25.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/36: dwrite f7 [0,4194304] 0 2024-05-09T06:30:25.796 INFO:tasks.workunit.client.0.smithi046.stdout:4/67: symlink d7/l1c 0 2024-05-09T06:30:25.798 INFO:tasks.workunit.client.0.smithi046.stdout:4/68: mkdir d7/df/d10/d1d 0 2024-05-09T06:30:25.798 INFO:tasks.workunit.client.0.smithi046.stdout:4/69: readlink d7/df/d10/l14 0 2024-05-09T06:30:25.799 INFO:tasks.workunit.client.1.smithi106.stdout:2/455: dwrite d2/d5/db/d1d/f3d [4194304,4194304] 0 2024-05-09T06:30:25.800 INFO:tasks.workunit.client.0.smithi046.stdout:4/70: truncate d7/fa 3437746 0 2024-05-09T06:30:25.801 INFO:tasks.workunit.client.0.smithi046.stdout:2/52: dread f4 [0,4194304] 0 2024-05-09T06:30:25.803 INFO:tasks.workunit.client.1.smithi106.stdout:6/406: dwrite d0/d17/d34/d5f/d8/d27/d3b/f4b [0,4194304] 0 2024-05-09T06:30:25.806 INFO:tasks.workunit.client.1.smithi106.stdout:6/407: symlink d0/d17/d34/d5f/d8/d50/l85 0 2024-05-09T06:30:25.809 INFO:tasks.workunit.client.1.smithi106.stdout:9/397: dwrite d4/d6/d23/d2f/d47/f4d [0,4194304] 0 2024-05-09T06:30:25.809 INFO:tasks.workunit.client.1.smithi106.stdout:9/398: dread - d4/f67 zero size 2024-05-09T06:30:25.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/49: dwrite f0 [0,4194304] 0 2024-05-09T06:30:25.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/50: fdatasync fb 0 2024-05-09T06:30:25.813 INFO:tasks.workunit.client.0.smithi046.stdout:6/37: read f4 [2154178,115921] 0 2024-05-09T06:30:25.814 INFO:tasks.workunit.client.1.smithi106.stdout:6/408: getdents d0/d17/d34 0 2024-05-09T06:30:25.814 INFO:tasks.workunit.client.1.smithi106.stdout:1/383: dwrite d4/f8a [0,4194304] 0 2024-05-09T06:30:25.816 INFO:tasks.workunit.client.1.smithi106.stdout:5/380: dwrite d8/d33/f4f [0,4194304] 0 2024-05-09T06:30:25.817 INFO:tasks.workunit.client.1.smithi106.stdout:8/347: dwrite d3/d5/f78 [0,4194304] 0 2024-05-09T06:30:25.821 INFO:tasks.workunit.client.1.smithi106.stdout:3/332: dwrite f2 [0,4194304] 0 2024-05-09T06:30:25.821 INFO:tasks.workunit.client.1.smithi106.stdout:3/333: readlink d5/l6 0 2024-05-09T06:30:25.822 INFO:tasks.workunit.client.1.smithi106.stdout:9/399: truncate d4/d6/d1b/d2a/f20 5163594 0 2024-05-09T06:30:25.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:25 smithi106 ceph-mon[34679]: pgmap v19: 65 pgs: 65 active+clean; 855 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 80 MiB/s rd, 110 MiB/s wr, 764 op/s 2024-05-09T06:30:25.826 INFO:tasks.workunit.client.1.smithi106.stdout:6/409: link d0/d17/d34/d5f/d8/c42 d0/d17/d34/c86 0 2024-05-09T06:30:25.828 INFO:tasks.workunit.client.0.smithi046.stdout:4/71: dwrite d7/fc [0,4194304] 0 2024-05-09T06:30:25.828 INFO:tasks.workunit.client.0.smithi046.stdout:4/72: write d7/df/f1b [96770,103911] 0 2024-05-09T06:30:25.828 INFO:tasks.workunit.client.0.smithi046.stdout:4/73: creat d7/f1e x:0 0 0 2024-05-09T06:30:25.829 INFO:tasks.workunit.client.1.smithi106.stdout:7/334: dwrite d0/dc/d1a/d36/d30/f3b [0,4194304] 0 2024-05-09T06:30:25.829 INFO:tasks.workunit.client.0.smithi046.stdout:6/38: rename f7 to db/fd 0 2024-05-09T06:30:25.829 INFO:tasks.workunit.client.0.smithi046.stdout:6/39: write f8 [980763,129000] 0 2024-05-09T06:30:25.830 INFO:tasks.workunit.client.0.smithi046.stdout:6/40: readlink l1 0 2024-05-09T06:30:25.835 INFO:tasks.workunit.client.1.smithi106.stdout:0/442: sync 2024-05-09T06:30:25.836 INFO:tasks.workunit.client.1.smithi106.stdout:0/443: stat d1/fb 0 2024-05-09T06:30:25.836 INFO:tasks.workunit.client.1.smithi106.stdout:0/444: readlink d1/d11/d23/d22/l46 0 2024-05-09T06:30:25.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:25 smithi046 ceph-mon[26924]: pgmap v19: 65 pgs: 65 active+clean; 855 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 80 MiB/s rd, 110 MiB/s wr, 764 op/s 2024-05-09T06:30:25.837 INFO:tasks.workunit.client.1.smithi106.stdout:1/384: symlink d4/d5b/d75/l91 0 2024-05-09T06:30:25.837 INFO:tasks.workunit.client.1.smithi106.stdout:1/385: truncate d4/d5/f58 4352899 0 2024-05-09T06:30:25.842 INFO:tasks.workunit.client.1.smithi106.stdout:2/456: dwrite d2/d5/db/d15/f72 [0,4194304] 0 2024-05-09T06:30:25.843 INFO:tasks.workunit.client.1.smithi106.stdout:5/381: rmdir d8/d5a 39 2024-05-09T06:30:25.843 INFO:tasks.workunit.client.1.smithi106.stdout:5/382: read d8/d45/d4c/d32/d5b/f29 [1610880,81896] 0 2024-05-09T06:30:25.843 INFO:tasks.workunit.client.1.smithi106.stdout:5/383: write d8/d45/d4c/f5c [1632037,79840] 0 2024-05-09T06:30:25.845 INFO:tasks.workunit.client.0.smithi046.stdout:6/41: rename l1 to db/le 0 2024-05-09T06:30:25.845 INFO:tasks.workunit.client.0.smithi046.stdout:6/42: chown db/le 293807 1 2024-05-09T06:30:25.849 INFO:tasks.workunit.client.1.smithi106.stdout:8/348: creat d3/d5/d7/d15/d3e/f81 x:0 0 0 2024-05-09T06:30:25.850 INFO:tasks.workunit.client.0.smithi046.stdout:6/43: fsync f8 0 2024-05-09T06:30:25.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/51: dwrite f4 [0,4194304] 0 2024-05-09T06:30:25.851 INFO:tasks.workunit.client.0.smithi046.stdout:4/74: dwrite f4 [0,4194304] 0 2024-05-09T06:30:25.851 INFO:tasks.workunit.client.1.smithi106.stdout:9/400: dwrite d4/f3d [0,4194304] 0 2024-05-09T06:30:25.851 INFO:tasks.workunit.client.1.smithi106.stdout:1/386: dread d4/d37/d3d/f6e [0,4194304] 0 2024-05-09T06:30:25.852 INFO:tasks.workunit.client.1.smithi106.stdout:9/401: readlink d4/d6/d23/d2f/l63 0 2024-05-09T06:30:25.852 INFO:tasks.workunit.client.1.smithi106.stdout:3/334: dwrite d5/d1c/d53/f60 [0,4194304] 0 2024-05-09T06:30:25.852 INFO:tasks.workunit.client.1.smithi106.stdout:3/335: creat d5/f64 x:0 0 0 2024-05-09T06:30:25.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/44: dread f8 [0,4194304] 0 2024-05-09T06:30:25.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/45: readlink db/le 0 2024-05-09T06:30:25.858 INFO:tasks.workunit.client.1.smithi106.stdout:7/335: truncate d0/dc/d1a/f3a 2872199 0 2024-05-09T06:30:25.860 INFO:tasks.workunit.client.1.smithi106.stdout:0/445: rmdir d1/d11/d23/d13 39 2024-05-09T06:30:25.860 INFO:tasks.workunit.client.1.smithi106.stdout:6/410: write d0/d17/d34/f65 [3880565,37559] 0 2024-05-09T06:30:25.860 INFO:tasks.workunit.client.1.smithi106.stdout:0/446: write d1/d11/d23/d22/f49 [816059,74128] 0 2024-05-09T06:30:25.862 INFO:tasks.workunit.client.0.smithi046.stdout:0/52: dread f0 [0,4194304] 0 2024-05-09T06:30:25.865 INFO:tasks.workunit.client.1.smithi106.stdout:2/457: truncate d2/d5/db/d15/f1e 24407 0 2024-05-09T06:30:25.865 INFO:tasks.workunit.client.1.smithi106.stdout:2/458: stat d2/d5/db/d1d/f8a 0 2024-05-09T06:30:25.865 INFO:tasks.workunit.client.1.smithi106.stdout:2/459: readlink d2/d5/db/l3a 0 2024-05-09T06:30:25.866 INFO:tasks.workunit.client.0.smithi046.stdout:4/75: symlink d7/df/d10/l1f 0 2024-05-09T06:30:25.868 INFO:tasks.workunit.client.1.smithi106.stdout:5/384: mknod d8/d45/d4c/d32/d5b/d69/c71 0 2024-05-09T06:30:25.868 INFO:tasks.workunit.client.1.smithi106.stdout:5/385: write d8/f50 [875488,113853] 0 2024-05-09T06:30:25.868 INFO:tasks.workunit.client.0.smithi046.stdout:6/46: mkdir db/df 0 2024-05-09T06:30:25.869 INFO:tasks.workunit.client.1.smithi106.stdout:8/349: mkdir d3/d5/d35/d61/d82 0 2024-05-09T06:30:25.869 INFO:tasks.workunit.client.1.smithi106.stdout:8/350: chown d3/d5/d7/d15/d3e/f56 0 1 2024-05-09T06:30:25.870 INFO:tasks.workunit.client.0.smithi046.stdout:0/53: creat d11/f13 x:0 0 0 2024-05-09T06:30:25.870 INFO:tasks.workunit.client.0.smithi046.stdout:0/54: read - fc zero size 2024-05-09T06:30:25.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/55: creat d11/f14 x:0 0 0 2024-05-09T06:30:25.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/56: fdatasync fe 0 2024-05-09T06:30:25.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/76: mkdir d7/d20 0 2024-05-09T06:30:25.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/47: rename db/df to db/d10 0 2024-05-09T06:30:25.878 INFO:tasks.workunit.client.1.smithi106.stdout:1/387: creat d4/d37/f92 x:0 0 0 2024-05-09T06:30:25.878 INFO:tasks.workunit.client.1.smithi106.stdout:1/388: read - d4/d5/f89 zero size 2024-05-09T06:30:25.878 INFO:tasks.workunit.client.1.smithi106.stdout:1/389: creat d4/d37/f93 x:0 0 0 2024-05-09T06:30:25.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/57: dread fa [0,4194304] 0 2024-05-09T06:30:25.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/58: creat d11/f15 x:0 0 0 2024-05-09T06:30:25.881 INFO:tasks.workunit.client.1.smithi106.stdout:9/402: symlink d4/d6/d23/d2f/l6b 0 2024-05-09T06:30:25.887 INFO:tasks.workunit.client.1.smithi106.stdout:4/346: sync 2024-05-09T06:30:25.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/48: dwrite f8 [0,4194304] 0 2024-05-09T06:30:25.894 INFO:tasks.workunit.client.0.smithi046.stdout:0/59: truncate f4 4163104 0 2024-05-09T06:30:25.895 INFO:tasks.workunit.client.1.smithi106.stdout:7/336: symlink d0/dc/d1a/d36/d30/d44/d58/l60 0 2024-05-09T06:30:25.895 INFO:tasks.workunit.client.1.smithi106.stdout:7/337: readlink d0/dc/d1a/l55 0 2024-05-09T06:30:25.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/49: mknod db/c11 0 2024-05-09T06:30:25.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/60: symlink d11/l16 0 2024-05-09T06:30:25.899 INFO:tasks.workunit.client.1.smithi106.stdout:0/447: mknod d1/d11/d23/d13/d2c/d6d/c94 0 2024-05-09T06:30:25.904 INFO:tasks.workunit.client.1.smithi106.stdout:2/460: mknod d2/d5/db/d15/d4f/c98 0 2024-05-09T06:30:25.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/50: dread f3 [0,4194304] 0 2024-05-09T06:30:25.908 INFO:tasks.workunit.client.1.smithi106.stdout:5/386: rename d8/c27 to d8/d45/d4c/d32/d5b/c72 0 2024-05-09T06:30:25.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/51: symlink db/l12 0 2024-05-09T06:30:25.911 INFO:tasks.workunit.client.1.smithi106.stdout:8/351: mkdir d3/d5/d35/d61/d6c/d83 0 2024-05-09T06:30:25.911 INFO:tasks.workunit.client.1.smithi106.stdout:8/352: truncate d3/d5/d7/f7f 981186 0 2024-05-09T06:30:25.912 INFO:tasks.workunit.client.1.smithi106.stdout:0/448: dwrite d1/d11/d23/d13/f14 [8388608,4194304] 0 2024-05-09T06:30:25.914 INFO:tasks.workunit.client.0.smithi046.stdout:6/52: creat db/d10/f13 x:0 0 0 2024-05-09T06:30:25.914 INFO:tasks.workunit.client.0.smithi046.stdout:6/53: creat db/f14 x:0 0 0 2024-05-09T06:30:25.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/54: dread - db/f14 zero size 2024-05-09T06:30:25.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/55: chown f3 335499 1 2024-05-09T06:30:25.915 INFO:tasks.workunit.client.1.smithi106.stdout:1/390: chown d4/d76/d1d/l35 149377 1 2024-05-09T06:30:25.917 INFO:tasks.workunit.client.1.smithi106.stdout:9/403: mkdir d4/d6/d1b/d2a/d42/d6c 0 2024-05-09T06:30:25.917 INFO:tasks.workunit.client.1.smithi106.stdout:9/404: chown d4/d6/d23/l22 3956635 1 2024-05-09T06:30:25.917 INFO:tasks.workunit.client.1.smithi106.stdout:9/405: dread - d4/d6/d1b/d2a/d42/f57 zero size 2024-05-09T06:30:25.920 INFO:tasks.workunit.client.1.smithi106.stdout:4/347: mknod d7/c6d 0 2024-05-09T06:30:25.920 INFO:tasks.workunit.client.1.smithi106.stdout:4/348: chown d7/d10/d1a/d5a/d46/l64 1640291393 1 2024-05-09T06:30:25.921 INFO:tasks.workunit.client.1.smithi106.stdout:7/338: mknod d0/dc/c61 0 2024-05-09T06:30:25.921 INFO:tasks.workunit.client.1.smithi106.stdout:7/339: chown d0/dc/c4e 13655 1 2024-05-09T06:30:25.922 INFO:tasks.workunit.client.1.smithi106.stdout:2/461: creat d2/d5/db/d1d/d6a/f99 x:0 0 0 2024-05-09T06:30:25.922 INFO:tasks.workunit.client.1.smithi106.stdout:2/462: fdatasync d2/d7/d2c/f34 0 2024-05-09T06:30:25.922 INFO:tasks.workunit.client.1.smithi106.stdout:2/463: truncate d2/d5/f91 121793 0 2024-05-09T06:30:25.923 INFO:tasks.workunit.client.1.smithi106.stdout:1/391: write d4/d76/d1d/f24 [5134,40315] 0 2024-05-09T06:30:25.923 INFO:tasks.workunit.client.1.smithi106.stdout:5/387: truncate d8/d33/f4f 3589150 0 2024-05-09T06:30:25.923 INFO:tasks.workunit.client.1.smithi106.stdout:5/388: readlink d8/d45/d4c/l2f 0 2024-05-09T06:30:25.923 INFO:tasks.workunit.client.1.smithi106.stdout:8/353: rmdir d3/d5/d7/d15/d47 39 2024-05-09T06:30:25.927 INFO:tasks.workunit.client.1.smithi106.stdout:0/449: link d1/d11/d23/l3a d1/d11/d23/d13/d58/d79/l95 0 2024-05-09T06:30:25.927 INFO:tasks.workunit.client.1.smithi106.stdout:0/450: dread - d1/d11/d23/d13/d58/f80 zero size 2024-05-09T06:30:25.931 INFO:tasks.workunit.client.1.smithi106.stdout:9/406: getdents d4 0 2024-05-09T06:30:25.932 INFO:tasks.workunit.client.1.smithi106.stdout:8/354: dread d3/d5/f78 [0,4194304] 0 2024-05-09T06:30:25.934 INFO:tasks.workunit.client.1.smithi106.stdout:7/340: creat d0/dc/d1a/f62 x:0 0 0 2024-05-09T06:30:25.935 INFO:tasks.workunit.client.1.smithi106.stdout:2/464: mkdir d2/d7/d62/d9a 0 2024-05-09T06:30:25.935 INFO:tasks.workunit.client.0.smithi046.stdout:6/56: dwrite db/fc [0,4194304] 0 2024-05-09T06:30:25.938 INFO:tasks.workunit.client.1.smithi106.stdout:1/392: mknod d4/d76/d13/d2f/c94 0 2024-05-09T06:30:25.941 INFO:tasks.workunit.client.1.smithi106.stdout:5/389: creat d8/d5a/f73 x:0 0 0 2024-05-09T06:30:25.943 INFO:tasks.workunit.client.1.smithi106.stdout:4/349: dwrite f2 [0,4194304] 0 2024-05-09T06:30:25.943 INFO:tasks.workunit.client.1.smithi106.stdout:4/350: readlink d7/l3d 0 2024-05-09T06:30:25.943 INFO:tasks.workunit.client.1.smithi106.stdout:0/451: truncate d1/f43 12173 0 2024-05-09T06:30:25.944 INFO:tasks.workunit.client.1.smithi106.stdout:0/452: write d1/d11/d23/f1a [4523645,59714] 0 2024-05-09T06:30:25.946 INFO:tasks.workunit.client.1.smithi106.stdout:7/341: mknod d0/dc/d1a/d36/d1e/c63 0 2024-05-09T06:30:25.947 INFO:tasks.workunit.client.0.smithi046.stdout:0/61: truncate f10 3560960 0 2024-05-09T06:30:25.950 INFO:tasks.workunit.client.1.smithi106.stdout:2/465: creat d2/d5/db/d1d/f9b x:0 0 0 2024-05-09T06:30:25.950 INFO:tasks.workunit.client.1.smithi106.stdout:2/466: chown d2/d7/c1f 434677 1 2024-05-09T06:30:25.950 INFO:tasks.workunit.client.1.smithi106.stdout:8/355: dwrite d3/d5/d7/d15/d47/f62 [0,4194304] 0 2024-05-09T06:30:25.950 INFO:tasks.workunit.client.1.smithi106.stdout:8/356: write d3/d5/d7/f6a [1079201,55256] 0 2024-05-09T06:30:25.950 INFO:tasks.workunit.client.1.smithi106.stdout:8/357: stat d3/d5/d13 0 2024-05-09T06:30:25.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/57: write f6 [1628980,326] 0 2024-05-09T06:30:25.951 INFO:tasks.workunit.client.1.smithi106.stdout:1/393: symlink d4/d76/d65/l95 0 2024-05-09T06:30:25.955 INFO:tasks.workunit.client.1.smithi106.stdout:5/390: mkdir d8/d33/d74 0 2024-05-09T06:30:25.956 INFO:tasks.workunit.client.0.smithi046.stdout:0/62: rmdir d11 39 2024-05-09T06:30:25.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/58: read db/fd [2765213,123989] 0 2024-05-09T06:30:25.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/59: creat db/f15 x:0 0 0 2024-05-09T06:30:25.959 INFO:tasks.workunit.client.1.smithi106.stdout:4/351: mknod d7/d28/d2a/c6e 0 2024-05-09T06:30:25.960 INFO:tasks.workunit.client.1.smithi106.stdout:9/407: getdents d4/d6/d1b/d2a/d42 0 2024-05-09T06:30:25.961 INFO:tasks.workunit.client.1.smithi106.stdout:9/408: stat d4/d6/d23/d2f/l6b 0 2024-05-09T06:30:25.963 INFO:tasks.workunit.client.1.smithi106.stdout:0/453: mknod d1/d11/d23/d13/d2c/c96 0 2024-05-09T06:30:25.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/342: rename d0/f27 to d0/dc/d1a/d36/d30/f64 0 2024-05-09T06:30:25.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/343: write d0/dc/d1a/d36/d30/f32 [5163204,9159] 0 2024-05-09T06:30:25.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/344: readlink d0/dc/d1a/d36/d1e/l5e 0 2024-05-09T06:30:25.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/63: dread f4 [0,4194304] 0 2024-05-09T06:30:25.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/64: chown fc 562343 1 2024-05-09T06:30:25.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/65: rename ld to d11/l17 0 2024-05-09T06:30:25.975 INFO:tasks.workunit.client.1.smithi106.stdout:2/467: dwrite d2/d5/db/d15/d41/d58/f61 [0,4194304] 0 2024-05-09T06:30:25.975 INFO:tasks.workunit.client.1.smithi106.stdout:2/468: stat d2/f5f 0 2024-05-09T06:30:25.975 INFO:tasks.workunit.client.1.smithi106.stdout:1/394: link d4/d37/d4a/f87 d4/d37/d3d/f96 0 2024-05-09T06:30:25.977 INFO:tasks.workunit.client.1.smithi106.stdout:5/391: creat d8/d5a/d60/f75 x:0 0 0 2024-05-09T06:30:25.980 INFO:tasks.workunit.client.1.smithi106.stdout:4/352: unlink d7/d10/d1a/f62 0 2024-05-09T06:30:25.981 INFO:tasks.workunit.client.1.smithi106.stdout:9/409: mkdir d4/d6/d1b/d2a/d42/d6c/d6d 0 2024-05-09T06:30:25.981 INFO:tasks.workunit.client.1.smithi106.stdout:9/410: stat d4/d6/d23/d2f/d31 0 2024-05-09T06:30:25.985 INFO:tasks.workunit.client.1.smithi106.stdout:8/358: rename d3/d5/d13/f6f to d3/d5/d7/d15/d3e/d7d/f84 0 2024-05-09T06:30:25.987 INFO:tasks.workunit.client.1.smithi106.stdout:7/345: mkdir d0/dc/d1a/d36/d30/d44/d58/d65 0 2024-05-09T06:30:25.987 INFO:tasks.workunit.client.1.smithi106.stdout:7/346: chown d0/dc/d45 1726186 1 2024-05-09T06:30:25.987 INFO:tasks.workunit.client.1.smithi106.stdout:7/347: creat d0/dc/d1a/d36/d30/d44/d58/f66 x:0 0 0 2024-05-09T06:30:25.993 INFO:tasks.workunit.client.1.smithi106.stdout:2/469: mkdir d2/d5/d9c 0 2024-05-09T06:30:25.993 INFO:tasks.workunit.client.1.smithi106.stdout:8/359: read d3/d5/d13/f40 [577591,61869] 0 2024-05-09T06:30:25.994 INFO:tasks.workunit.client.1.smithi106.stdout:1/395: getdents d4/d76 0 2024-05-09T06:30:25.996 INFO:tasks.workunit.client.1.smithi106.stdout:5/392: creat d8/d33/f76 x:0 0 0 2024-05-09T06:30:25.996 INFO:tasks.workunit.client.1.smithi106.stdout:4/353: dwrite d7/d10/f3e [0,4194304] 0 2024-05-09T06:30:25.996 INFO:tasks.workunit.client.1.smithi106.stdout:4/354: write d7/d10/d1a/d5a/d1c/f49 [411457,76185] 0 2024-05-09T06:30:25.998 INFO:tasks.workunit.client.1.smithi106.stdout:9/411: creat d4/d6/d23/f6e x:0 0 0 2024-05-09T06:30:25.999 INFO:tasks.workunit.client.1.smithi106.stdout:0/454: getdents d1/d11/d23/d13/d2c/d76/d83 0 2024-05-09T06:30:25.999 INFO:tasks.workunit.client.1.smithi106.stdout:0/455: readlink d1/l50 0 2024-05-09T06:30:25.999 INFO:tasks.workunit.client.1.smithi106.stdout:0/456: write d1/f4a [382417,27790] 0 2024-05-09T06:30:26.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/60: dwrite db/fc [4194304,4194304] 0 2024-05-09T06:30:26.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/61: write f6 [4191650,60611] 0 2024-05-09T06:30:26.002 INFO:tasks.workunit.client.1.smithi106.stdout:7/348: symlink d0/d53/l67 0 2024-05-09T06:30:26.004 INFO:tasks.workunit.client.1.smithi106.stdout:2/470: unlink d2/d5/db/d1d/d23/f73 0 2024-05-09T06:30:26.008 INFO:tasks.workunit.client.1.smithi106.stdout:8/360: mknod d3/c85 0 2024-05-09T06:30:26.008 INFO:tasks.workunit.client.1.smithi106.stdout:8/361: dread - d3/d5/d7/d15/d3e/d7d/f84 zero size 2024-05-09T06:30:26.008 INFO:tasks.workunit.client.1.smithi106.stdout:8/362: dread - d3/d6b/f79 zero size 2024-05-09T06:30:26.010 INFO:tasks.workunit.client.0.smithi046.stdout:6/62: creat db/d10/f16 x:0 0 0 2024-05-09T06:30:26.013 INFO:tasks.workunit.client.0.smithi046.stdout:0/66: getdents d11 0 2024-05-09T06:30:26.014 INFO:tasks.workunit.client.1.smithi106.stdout:1/396: dwrite d4/f1f [0,4194304] 0 2024-05-09T06:30:26.015 INFO:tasks.workunit.client.1.smithi106.stdout:1/397: dread - d4/d37/d3d/f96 zero size 2024-05-09T06:30:26.015 INFO:tasks.workunit.client.1.smithi106.stdout:3/336: sync 2024-05-09T06:30:26.016 INFO:tasks.workunit.client.1.smithi106.stdout:4/355: truncate d7/d10/f65 2838118 0 2024-05-09T06:30:26.016 INFO:tasks.workunit.client.1.smithi106.stdout:4/356: chown d7/c26 1 1 2024-05-09T06:30:26.018 INFO:tasks.workunit.client.1.smithi106.stdout:9/412: creat d4/d6/d23/d2f/d38/d68/f6f x:0 0 0 2024-05-09T06:30:26.019 INFO:tasks.workunit.client.1.smithi106.stdout:7/349: chown d0/fe 1799 1 2024-05-09T06:30:26.020 INFO:tasks.workunit.client.1.smithi106.stdout:2/471: creat d2/d7/f9d x:0 0 0 2024-05-09T06:30:26.022 INFO:tasks.workunit.client.1.smithi106.stdout:8/363: mkdir d3/d5/d35/d86 0 2024-05-09T06:30:26.027 INFO:tasks.workunit.client.1.smithi106.stdout:0/457: dwrite d1/f7 [4194304,4194304] 0 2024-05-09T06:30:26.027 INFO:tasks.workunit.client.1.smithi106.stdout:0/458: stat d1/d11/d23/d22/l46 0 2024-05-09T06:30:26.031 INFO:tasks.workunit.client.1.smithi106.stdout:1/398: creat d4/d5b/d75/f97 x:0 0 0 2024-05-09T06:30:26.033 INFO:tasks.workunit.client.1.smithi106.stdout:3/337: mkdir d5/d12/d65 0 2024-05-09T06:30:26.034 INFO:tasks.workunit.client.0.smithi046.stdout:6/63: dwrite db/fd [4194304,4194304] 0 2024-05-09T06:30:26.035 INFO:tasks.workunit.client.0.smithi046.stdout:0/67: dwrite f0 [0,4194304] 0 2024-05-09T06:30:26.036 INFO:tasks.workunit.client.1.smithi106.stdout:4/357: mkdir d7/d39/d35/d6f 0 2024-05-09T06:30:26.036 INFO:tasks.workunit.client.1.smithi106.stdout:4/358: chown d7/d28/l5e 0 1 2024-05-09T06:30:26.039 INFO:tasks.workunit.client.1.smithi106.stdout:9/413: unlink d4/f28 0 2024-05-09T06:30:26.039 INFO:tasks.workunit.client.1.smithi106.stdout:6/411: sync 2024-05-09T06:30:26.039 INFO:tasks.workunit.client.1.smithi106.stdout:6/412: read d0/d17/f1e [374023,37790] 0 2024-05-09T06:30:26.047 INFO:tasks.workunit.client.1.smithi106.stdout:7/350: mkdir d0/dc/d1a/d36/d1e/d68 0 2024-05-09T06:30:26.047 INFO:tasks.workunit.client.1.smithi106.stdout:8/364: dwrite d3/d5/d13/f29 [4194304,4194304] 0 2024-05-09T06:30:26.047 INFO:tasks.workunit.client.1.smithi106.stdout:3/338: dread d5/d12/d26/f58 [0,4194304] 0 2024-05-09T06:30:26.048 INFO:tasks.workunit.client.0.smithi046.stdout:6/64: rename c5 to db/c17 0 2024-05-09T06:30:26.048 INFO:tasks.workunit.client.1.smithi106.stdout:2/472: rename d2/d5/db/d1d/d23/d63/l95 to d2/d7/d62/d9a/l9e 0 2024-05-09T06:30:26.050 INFO:tasks.workunit.client.0.smithi046.stdout:0/68: mkdir d11/d18 0 2024-05-09T06:30:26.051 INFO:tasks.workunit.client.1.smithi106.stdout:0/459: dwrite d1/d11/d23/d13/d2c/d3d/f82 [0,4194304] 0 2024-05-09T06:30:26.054 INFO:tasks.workunit.client.0.smithi046.stdout:6/65: rename db/d10/f13 to db/f18 0 2024-05-09T06:30:26.057 INFO:tasks.workunit.client.1.smithi106.stdout:8/365: dread d3/d5/d7/d15/d47/f62 [0,4194304] 0 2024-05-09T06:30:26.057 INFO:tasks.workunit.client.1.smithi106.stdout:8/366: readlink d3/d5/d7/d15/l5e 0 2024-05-09T06:30:26.057 INFO:tasks.workunit.client.1.smithi106.stdout:1/399: symlink d4/d5/l98 0 2024-05-09T06:30:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/69: mknod d11/c19 0 2024-05-09T06:30:26.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/70: fsync d11/f13 0 2024-05-09T06:30:26.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/71: truncate fc 61535 0 2024-05-09T06:30:26.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/72: read - d11/f15 zero size 2024-05-09T06:30:26.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/73: getdents d11/d18 0 2024-05-09T06:30:26.068 INFO:tasks.workunit.client.1.smithi106.stdout:0/460: rmdir d1/d11/d23/d13/d2c/d6d 39 2024-05-09T06:30:26.068 INFO:tasks.workunit.client.1.smithi106.stdout:7/351: dwrite d0/f13 [0,4194304] 0 2024-05-09T06:30:26.070 INFO:tasks.workunit.client.1.smithi106.stdout:1/400: link d4/d76/d13/d2f/l3f d4/d37/d74/l99 0 2024-05-09T06:30:26.072 INFO:tasks.workunit.client.1.smithi106.stdout:2/473: dwrite d2/d5/db/d15/d4f/f8f [0,4194304] 0 2024-05-09T06:30:26.073 INFO:tasks.workunit.client.1.smithi106.stdout:3/339: dwrite d5/fb [0,4194304] 0 2024-05-09T06:30:26.073 INFO:tasks.workunit.client.1.smithi106.stdout:3/340: write d5/d1c/d24/f35 [1314649,26305] 0 2024-05-09T06:30:26.073 INFO:tasks.workunit.client.1.smithi106.stdout:3/341: write f1 [4706567,59026] 0 2024-05-09T06:30:26.073 INFO:tasks.workunit.client.1.smithi106.stdout:3/342: write d5/d1c/d21/d32/f49 [1687048,83211] 0 2024-05-09T06:30:26.074 INFO:tasks.workunit.client.1.smithi106.stdout:7/352: unlink d0/dc/d1a/d36/d1e/l5e 0 2024-05-09T06:30:26.075 INFO:tasks.workunit.client.1.smithi106.stdout:4/359: dwrite d7/d10/f51 [0,4194304] 0 2024-05-09T06:30:26.077 INFO:tasks.workunit.client.1.smithi106.stdout:1/401: rename d4/d76/d13/d2f/l3f to d4/d76/d13/d60/l9a 0 2024-05-09T06:30:26.077 INFO:tasks.workunit.client.1.smithi106.stdout:1/402: write d4/d76/d13/d2f/f7f [358098,4659] 0 2024-05-09T06:30:26.077 INFO:tasks.workunit.client.1.smithi106.stdout:1/403: getdents d4/d76 0 2024-05-09T06:30:26.080 INFO:tasks.workunit.client.1.smithi106.stdout:6/413: dwrite d0/d17/d34/d5f/d8/d27/d3b/d62/f84 [0,4194304] 0 2024-05-09T06:30:26.085 INFO:tasks.workunit.client.1.smithi106.stdout:2/474: dread d2/f5f [0,4194304] 0 2024-05-09T06:30:26.086 INFO:tasks.workunit.client.1.smithi106.stdout:3/343: rename f1 to d5/d1c/d24/d5b/f66 0 2024-05-09T06:30:26.093 INFO:tasks.workunit.client.1.smithi106.stdout:6/414: creat d0/d17/d34/d5f/d8/d27/d3e/f87 x:0 0 0 2024-05-09T06:30:26.093 INFO:tasks.workunit.client.1.smithi106.stdout:6/415: write d0/d17/d34/d5f/d8/f6e [343192,76235] 0 2024-05-09T06:30:26.094 INFO:tasks.workunit.client.1.smithi106.stdout:2/475: symlink d2/d5/db/d1d/d90/l9f 0 2024-05-09T06:30:26.095 INFO:tasks.workunit.client.0.smithi046.stdout:6/66: dwrite db/fc [0,4194304] 0 2024-05-09T06:30:26.096 INFO:tasks.workunit.client.1.smithi106.stdout:1/404: rmdir d4/d5b/d75 39 2024-05-09T06:30:26.096 INFO:tasks.workunit.client.1.smithi106.stdout:1/405: dread - d4/d37/d3d/f96 zero size 2024-05-09T06:30:26.097 INFO:tasks.workunit.client.1.smithi106.stdout:7/353: dwrite d0/dc/d1a/f3a [0,4194304] 0 2024-05-09T06:30:26.098 INFO:tasks.workunit.client.1.smithi106.stdout:6/416: mkdir d0/d17/d34/d5f/d8/d50/d88 0 2024-05-09T06:30:26.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/74: getdents d11 0 2024-05-09T06:30:26.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/75: dread fc [0,4194304] 0 2024-05-09T06:30:26.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/461: dwrite d1/fb [0,4194304] 0 2024-05-09T06:30:26.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/462: read - d1/d11/d23/d22/f91 zero size 2024-05-09T06:30:26.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/463: chown d1/d11/d23/d13/d2c/l8f 1 1 2024-05-09T06:30:26.100 INFO:tasks.workunit.client.1.smithi106.stdout:0/464: truncate d1/d11/d23/d22/f6e 79731 0 2024-05-09T06:30:26.101 INFO:tasks.workunit.client.1.smithi106.stdout:1/406: creat d4/d76/f9b x:0 0 0 2024-05-09T06:30:26.106 INFO:tasks.workunit.client.0.smithi046.stdout:0/76: link fb d11/d18/f1a 0 2024-05-09T06:30:26.110 INFO:tasks.workunit.client.1.smithi106.stdout:7/354: creat d0/dc/f69 x:0 0 0 2024-05-09T06:30:26.114 INFO:tasks.workunit.client.0.smithi046.stdout:0/77: rename fa to d11/d18/f1b 0 2024-05-09T06:30:26.117 INFO:tasks.workunit.client.0.smithi046.stdout:6/67: dwrite db/f18 [0,4194304] 0 2024-05-09T06:30:26.120 INFO:tasks.workunit.client.1.smithi106.stdout:4/360: truncate d7/d10/f51 1544885 0 2024-05-09T06:30:26.121 INFO:tasks.workunit.client.1.smithi106.stdout:2/476: dwrite d2/d7/d2c/f80 [0,4194304] 0 2024-05-09T06:30:26.122 INFO:tasks.workunit.client.1.smithi106.stdout:3/344: dwrite d5/d1c/d21/d32/f49 [4194304,4194304] 0 2024-05-09T06:30:26.122 INFO:tasks.workunit.client.1.smithi106.stdout:3/345: chown d5/d1c/d53/f60 407 1 2024-05-09T06:30:26.126 INFO:tasks.workunit.client.1.smithi106.stdout:0/465: mknod d1/d11/d23/d13/d2c/d76/d83/c97 0 2024-05-09T06:30:26.126 INFO:tasks.workunit.client.1.smithi106.stdout:0/466: fdatasync d1/d11/d23/d13/d2c/f77 0 2024-05-09T06:30:26.126 INFO:tasks.workunit.client.1.smithi106.stdout:0/467: creat d1/d11/d23/d13/d58/f98 x:0 0 0 2024-05-09T06:30:26.126 INFO:tasks.workunit.client.1.smithi106.stdout:0/468: write d1/d11/d23/d22/f6e [112599,52583] 0 2024-05-09T06:30:26.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/68: mkdir db/d10/d19 0 2024-05-09T06:30:26.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/69: chown db/d10/f16 5 1 2024-05-09T06:30:26.129 INFO:tasks.workunit.client.1.smithi106.stdout:1/407: mkdir d4/d76/d13/d60/d9c 0 2024-05-09T06:30:26.129 INFO:tasks.workunit.client.1.smithi106.stdout:7/355: mkdir d0/dc/d1a/d36/d30/d44/d6a 0 2024-05-09T06:30:26.131 INFO:tasks.workunit.client.0.smithi046.stdout:6/70: creat db/d10/d19/f1a x:0 0 0 2024-05-09T06:30:26.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/78: dwrite f0 [0,4194304] 0 2024-05-09T06:30:26.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/79: fsync d11/f12 0 2024-05-09T06:30:26.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/80: truncate fe 432421 0 2024-05-09T06:30:26.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/81: stat d11/d18 0 2024-05-09T06:30:26.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/82: write f10 [4465003,121665] 0 2024-05-09T06:30:26.133 INFO:tasks.workunit.client.1.smithi106.stdout:6/417: rename d0/d17/d34/d5f/f37 to d0/d17/f89 0 2024-05-09T06:30:26.134 INFO:tasks.workunit.client.0.smithi046.stdout:6/71: fsync f6 0 2024-05-09T06:30:26.134 INFO:tasks.workunit.client.1.smithi106.stdout:4/361: symlink d7/d39/d35/d6f/l70 0 2024-05-09T06:30:26.134 INFO:tasks.workunit.client.1.smithi106.stdout:4/362: fdatasync d7/f41 0 2024-05-09T06:30:26.134 INFO:tasks.workunit.client.1.smithi106.stdout:4/363: dread d7/d10/f43 [0,4194304] 0 2024-05-09T06:30:26.135 INFO:tasks.workunit.client.1.smithi106.stdout:4/364: chown d7/c26 6420646 1 2024-05-09T06:30:26.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/83: mkdir d11/d18/d1c 0 2024-05-09T06:30:26.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/84: chown f0 0 1 2024-05-09T06:30:26.140 INFO:tasks.workunit.client.0.smithi046.stdout:0/85: creat d11/d18/d1c/f1d x:0 0 0 2024-05-09T06:30:26.141 INFO:tasks.workunit.client.1.smithi106.stdout:2/477: getdents d2/d7/d62 0 2024-05-09T06:30:26.141 INFO:tasks.workunit.client.1.smithi106.stdout:2/478: chown d2/d5/db/d15/f47 75128804 1 2024-05-09T06:30:26.141 INFO:tasks.workunit.client.1.smithi106.stdout:2/479: write d2/f8d [40615,40874] 0 2024-05-09T06:30:26.145 INFO:tasks.workunit.client.1.smithi106.stdout:5/393: sync 2024-05-09T06:30:26.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/86: creat d11/d18/f1e x:0 0 0 2024-05-09T06:30:26.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/87: mknod d11/d18/c1f 0 2024-05-09T06:30:26.152 INFO:tasks.workunit.client.1.smithi106.stdout:2/480: write d2/d5/db/d15/d41/f74 [2408625,60059] 0 2024-05-09T06:30:26.154 INFO:tasks.workunit.client.1.smithi106.stdout:0/469: link d1/d11/d23/d22/f49 d1/d11/d23/d22/f99 0 2024-05-09T06:30:26.156 INFO:tasks.workunit.client.1.smithi106.stdout:1/408: symlink d4/d37/d74/l9d 0 2024-05-09T06:30:26.157 INFO:tasks.workunit.client.1.smithi106.stdout:7/356: creat d0/dc/d1a/d36/d1e/d68/f6b x:0 0 0 2024-05-09T06:30:26.159 INFO:tasks.workunit.client.0.smithi046.stdout:6/72: dwrite f3 [0,4194304] 0 2024-05-09T06:30:26.159 INFO:tasks.workunit.client.0.smithi046.stdout:6/73: fdatasync db/fc 0 2024-05-09T06:30:26.159 INFO:tasks.workunit.client.0.smithi046.stdout:6/74: dread - db/d10/d19/f1a zero size 2024-05-09T06:30:26.161 INFO:tasks.workunit.client.1.smithi106.stdout:2/481: dread d2/f2b [0,4194304] 0 2024-05-09T06:30:26.161 INFO:tasks.workunit.client.1.smithi106.stdout:2/482: write d2/d5/db/d68/f71 [682766,126101] 0 2024-05-09T06:30:26.161 INFO:tasks.workunit.client.1.smithi106.stdout:2/483: readlink d2/d5/db/d15/l51 0 2024-05-09T06:30:26.165 INFO:tasks.workunit.client.1.smithi106.stdout:3/346: rename d5/d12/d26/l27 to d5/d3f/l67 0 2024-05-09T06:30:26.167 INFO:tasks.workunit.client.1.smithi106.stdout:6/418: truncate d0/d17/d34/d5f/d8/d27/f2c 3940670 0 2024-05-09T06:30:26.169 INFO:tasks.workunit.client.1.smithi106.stdout:4/365: creat d7/d10/d1a/f71 x:0 0 0 2024-05-09T06:30:26.171 INFO:tasks.workunit.client.1.smithi106.stdout:5/394: mkdir d8/d33/d3a/d77 0 2024-05-09T06:30:26.175 INFO:tasks.workunit.client.1.smithi106.stdout:0/470: unlink d1/d11/d23/d13/f14 0 2024-05-09T06:30:26.175 INFO:tasks.workunit.client.1.smithi106.stdout:9/414: sync 2024-05-09T06:30:26.175 INFO:tasks.workunit.client.1.smithi106.stdout:9/415: stat d4/d6/c37 0 2024-05-09T06:30:26.176 INFO:tasks.workunit.client.1.smithi106.stdout:6/419: dread d0/d17/d34/f65 [0,4194304] 0 2024-05-09T06:30:26.177 INFO:tasks.workunit.client.0.smithi046.stdout:0/88: dwrite ff [0,4194304] 0 2024-05-09T06:30:26.177 INFO:tasks.workunit.client.1.smithi106.stdout:7/357: dread d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:26.177 INFO:tasks.workunit.client.1.smithi106.stdout:7/358: chown d0/dc/d1a/d36/d1e/l20 53857 1 2024-05-09T06:30:26.177 INFO:tasks.workunit.client.1.smithi106.stdout:6/420: dread d0/f19 [4194304,4194304] 0 2024-05-09T06:30:26.178 INFO:tasks.workunit.client.1.smithi106.stdout:3/347: mknod d5/c68 0 2024-05-09T06:30:26.181 INFO:tasks.workunit.client.1.smithi106.stdout:5/395: truncate d8/f1a 719295 0 2024-05-09T06:30:26.183 INFO:tasks.workunit.client.1.smithi106.stdout:0/471: mknod d1/d11/d23/d13/d8a/c9a 0 2024-05-09T06:30:26.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/89: symlink d11/d18/l20 0 2024-05-09T06:30:26.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/90: readlink d11/l17 0 2024-05-09T06:30:26.185 INFO:tasks.workunit.client.1.smithi106.stdout:9/416: mkdir d4/d54/d69/d70 0 2024-05-09T06:30:26.185 INFO:tasks.workunit.client.1.smithi106.stdout:9/417: write d4/f5a [494994,5594] 0 2024-05-09T06:30:26.185 INFO:tasks.workunit.client.1.smithi106.stdout:9/418: write d4/d6/d23/d16/f27 [8896266,58875] 0 2024-05-09T06:30:26.185 INFO:tasks.workunit.client.1.smithi106.stdout:9/419: write d4/f25 [4534732,19608] 0 2024-05-09T06:30:26.186 INFO:tasks.workunit.client.1.smithi106.stdout:1/409: rmdir d4/d76 39 2024-05-09T06:30:26.188 INFO:tasks.workunit.client.1.smithi106.stdout:7/359: creat d0/dc/d1a/d5a/f6c x:0 0 0 2024-05-09T06:30:26.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/91: write d11/d18/f1b [4034760,36891] 0 2024-05-09T06:30:26.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/92: creat d11/d18/f21 x:0 0 0 2024-05-09T06:30:26.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/93: truncate d11/d18/f1a 5196286 0 2024-05-09T06:30:26.190 INFO:tasks.workunit.client.1.smithi106.stdout:6/421: rename d0/d17/d34/d5f/d8/d27/d3b/f4b to d0/f8a 0 2024-05-09T06:30:26.190 INFO:tasks.workunit.client.1.smithi106.stdout:6/422: stat d0/d17/d34/d5f/d8/d27/d3e/f87 0 2024-05-09T06:30:26.190 INFO:tasks.workunit.client.1.smithi106.stdout:2/484: dwrite d2/d5/f6 [0,4194304] 0 2024-05-09T06:30:26.191 INFO:tasks.workunit.client.1.smithi106.stdout:3/348: truncate d5/fb 4236219 0 2024-05-09T06:30:26.193 INFO:tasks.workunit.client.0.smithi046.stdout:0/94: rmdir d11 39 2024-05-09T06:30:26.194 INFO:tasks.workunit.client.1.smithi106.stdout:6/423: dread d0/f30 [0,4194304] 0 2024-05-09T06:30:26.195 INFO:tasks.workunit.client.1.smithi106.stdout:8/367: sync 2024-05-09T06:30:26.196 INFO:tasks.workunit.client.1.smithi106.stdout:0/472: dread d1/d11/d23/d13/d58/f71 [0,4194304] 0 2024-05-09T06:30:26.197 INFO:tasks.workunit.client.1.smithi106.stdout:0/473: write d1/d11/d23/d13/d58/d79/f7b [38910,45644] 0 2024-05-09T06:30:26.197 INFO:tasks.workunit.client.1.smithi106.stdout:0/474: chown d1/d11/d23/d22/f91 2091454 1 2024-05-09T06:30:26.197 INFO:tasks.workunit.client.1.smithi106.stdout:0/475: stat d1/d11/d23/d13/d2c 0 2024-05-09T06:30:26.197 INFO:tasks.workunit.client.1.smithi106.stdout:5/396: link d8/d45/d4c/d32/d5b/c72 d8/d33/d74/c78 0 2024-05-09T06:30:26.197 INFO:tasks.workunit.client.1.smithi106.stdout:5/397: fdatasync d8/f12 0 2024-05-09T06:30:26.198 INFO:tasks.workunit.client.0.smithi046.stdout:6/75: dwrite db/d10/d19/f1a [0,4194304] 0 2024-05-09T06:30:26.200 INFO:tasks.workunit.client.1.smithi106.stdout:1/410: stat d4/d76/d1d/c54 0 2024-05-09T06:30:26.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/411: dread - d4/d37/d4a/f87 zero size 2024-05-09T06:30:26.204 INFO:tasks.workunit.client.1.smithi106.stdout:8/368: dread d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:26.204 INFO:tasks.workunit.client.1.smithi106.stdout:8/369: fdatasync d3/d5/d13/f40 0 2024-05-09T06:30:26.205 INFO:tasks.workunit.client.1.smithi106.stdout:9/420: rename d4/d6/d23/d16/f27 to d4/d6/d1b/d2a/d42/d6c/d6d/f71 0 2024-05-09T06:30:26.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/76: dread db/d10/d19/f1a [0,4194304] 0 2024-05-09T06:30:26.209 INFO:tasks.workunit.client.1.smithi106.stdout:2/485: rmdir d2/d5/db/d7d 0 2024-05-09T06:30:26.212 INFO:tasks.workunit.client.1.smithi106.stdout:3/349: link d5/d1c/d24/c31 d5/d1c/d24/c69 0 2024-05-09T06:30:26.212 INFO:tasks.workunit.client.1.smithi106.stdout:3/350: stat d5/d12/c1a 0 2024-05-09T06:30:26.212 INFO:tasks.workunit.client.1.smithi106.stdout:6/424: write d0/d17/d34/f6d [897233,102417] 0 2024-05-09T06:30:26.214 INFO:tasks.workunit.client.1.smithi106.stdout:5/398: write d8/fc [2116183,65760] 0 2024-05-09T06:30:26.214 INFO:tasks.workunit.client.1.smithi106.stdout:5/399: chown d8/d45/d4c/d32/d5b/c38 15189245 1 2024-05-09T06:30:26.214 INFO:tasks.workunit.client.1.smithi106.stdout:4/366: dwrite d7/f29 [0,4194304] 0 2024-05-09T06:30:26.214 INFO:tasks.workunit.client.1.smithi106.stdout:4/367: chown d7/d39/d47/d66 800766118 1 2024-05-09T06:30:26.215 INFO:tasks.workunit.client.1.smithi106.stdout:7/360: dwrite d0/f40 [0,4194304] 0 2024-05-09T06:30:26.215 INFO:tasks.workunit.client.1.smithi106.stdout:7/361: chown d0/dc/d1a/l55 2291 1 2024-05-09T06:30:26.215 INFO:tasks.workunit.client.1.smithi106.stdout:7/362: stat d0/dc/d1a/d36/d30/d44 0 2024-05-09T06:30:26.215 INFO:tasks.workunit.client.1.smithi106.stdout:0/476: creat d1/d11/d23/d13/d58/d79/f9b x:0 0 0 2024-05-09T06:30:26.215 INFO:tasks.workunit.client.1.smithi106.stdout:0/477: write d1/d11/d23/d13/d58/d79/f7b [149753,79024] 0 2024-05-09T06:30:26.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/77: dread db/fc [4194304,4194304] 0 2024-05-09T06:30:26.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/78: readlink db/le 0 2024-05-09T06:30:26.220 INFO:tasks.workunit.client.1.smithi106.stdout:9/421: symlink d4/d6/d1b/d2a/d61/l72 0 2024-05-09T06:30:26.220 INFO:tasks.workunit.client.1.smithi106.stdout:2/486: creat d2/d5/db/d15/d4f/fa0 x:0 0 0 2024-05-09T06:30:26.221 INFO:tasks.workunit.client.1.smithi106.stdout:3/351: symlink d5/d12/d65/l6a 0 2024-05-09T06:30:26.221 INFO:tasks.workunit.client.1.smithi106.stdout:3/352: chown d5/d1c/d24/d52 3179 1 2024-05-09T06:30:26.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/95: dread d11/d18/f1a [0,4194304] 0 2024-05-09T06:30:26.223 INFO:tasks.workunit.client.0.smithi046.stdout:6/79: truncate f8 3951037 0 2024-05-09T06:30:26.223 INFO:tasks.workunit.client.0.smithi046.stdout:6/80: creat db/d10/d19/f1b x:0 0 0 2024-05-09T06:30:26.225 INFO:tasks.workunit.client.1.smithi106.stdout:6/425: mkdir d0/d17/d76/d8b 0 2024-05-09T06:30:26.226 INFO:tasks.workunit.client.0.smithi046.stdout:0/96: creat d11/f22 x:0 0 0 2024-05-09T06:30:26.228 INFO:tasks.workunit.client.1.smithi106.stdout:5/400: rename d8/d45/d4c/c47 to d8/c79 0 2024-05-09T06:30:26.231 INFO:tasks.workunit.client.1.smithi106.stdout:4/368: link d7/d10/f1d d7/d10/d1a/d5a/d1c/f72 0 2024-05-09T06:30:26.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/81: mknod db/d10/c1c 0 2024-05-09T06:30:26.235 INFO:tasks.workunit.client.1.smithi106.stdout:4/369: dread d7/d10/f51 [0,4194304] 0 2024-05-09T06:30:26.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/82: mkdir db/d10/d19/d1d 0 2024-05-09T06:30:26.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/83: write db/fc [8783370,75005] 0 2024-05-09T06:30:26.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/84: write db/f14 [422481,73966] 0 2024-05-09T06:30:26.238 INFO:tasks.workunit.client.1.smithi106.stdout:9/422: unlink d4/d6/ff 0 2024-05-09T06:30:26.241 INFO:tasks.workunit.client.1.smithi106.stdout:3/353: rmdir d5/d12/d65 39 2024-05-09T06:30:26.242 INFO:tasks.workunit.client.1.smithi106.stdout:6/426: creat d0/d66/d7e/f8c x:0 0 0 2024-05-09T06:30:26.243 INFO:tasks.workunit.client.1.smithi106.stdout:5/401: creat d8/f7a x:0 0 0 2024-05-09T06:30:26.244 INFO:tasks.workunit.client.0.smithi046.stdout:6/85: dread db/fd [0,4194304] 0 2024-05-09T06:30:26.244 INFO:tasks.workunit.client.1.smithi106.stdout:7/363: rmdir d0/dc/d1a/d5a 39 2024-05-09T06:30:26.246 INFO:tasks.workunit.client.1.smithi106.stdout:4/370: creat d7/d28/f73 x:0 0 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/86: creat db/d10/f1e x:0 0 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/87: write db/f15 [983719,101487] 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/88: fsync db/f18 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/89: fsync db/f18 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/90: write db/d10/d19/f1b [153029,29968] 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/91: truncate db/f18 4617373 0 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/92: chown db/d10 6512 1 2024-05-09T06:30:26.251 INFO:tasks.workunit.client.1.smithi106.stdout:8/370: dwrite d3/d5/d13/f40 [0,4194304] 0 2024-05-09T06:30:26.252 INFO:tasks.workunit.client.1.smithi106.stdout:9/423: creat d4/d6/d1b/d2a/f73 x:0 0 0 2024-05-09T06:30:26.252 INFO:tasks.workunit.client.1.smithi106.stdout:9/424: fdatasync d4/d6/f2b 0 2024-05-09T06:30:26.252 INFO:tasks.workunit.client.1.smithi106.stdout:3/354: dread f2 [0,4194304] 0 2024-05-09T06:30:26.252 INFO:tasks.workunit.client.1.smithi106.stdout:9/425: fsync d4/d6/d23/d16/f4c 0 2024-05-09T06:30:26.252 INFO:tasks.workunit.client.1.smithi106.stdout:9/426: creat d4/d6/d1b/d2a/f74 x:0 0 0 2024-05-09T06:30:26.252 INFO:tasks.workunit.client.1.smithi106.stdout:3/355: write f2 [4720303,76338] 0 2024-05-09T06:30:26.253 INFO:tasks.workunit.client.1.smithi106.stdout:2/487: rmdir d2/d5/db/d1d/d23 39 2024-05-09T06:30:26.254 INFO:tasks.workunit.client.1.smithi106.stdout:6/427: unlink d0/d17/d34/d5f/d40/c4c 0 2024-05-09T06:30:26.255 INFO:tasks.workunit.client.1.smithi106.stdout:5/402: write d8/d45/d4c/d32/d5b/f2c [3886663,9228] 0 2024-05-09T06:30:26.255 INFO:tasks.workunit.client.1.smithi106.stdout:0/478: dwrite d1/d11/d23/d13/d2c/f88 [0,4194304] 0 2024-05-09T06:30:26.255 INFO:tasks.workunit.client.1.smithi106.stdout:1/412: dwrite d4/d76/d13/f80 [0,4194304] 0 2024-05-09T06:30:26.256 INFO:tasks.workunit.client.1.smithi106.stdout:7/364: creat d0/dc/d1a/d36/d30/d44/d6a/f6d x:0 0 0 2024-05-09T06:30:26.256 INFO:tasks.workunit.client.1.smithi106.stdout:7/365: chown d0/dc/d1a/d36/d30/l35 234 1 2024-05-09T06:30:26.256 INFO:tasks.workunit.client.1.smithi106.stdout:4/371: mknod d7/d10/d1a/d5a/d1c/c74 0 2024-05-09T06:30:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:6/93: write db/fc [6141984,97923] 0 2024-05-09T06:30:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/97: dwrite ff [0,4194304] 0 2024-05-09T06:30:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:6/94: write f3 [5110507,86934] 0 2024-05-09T06:30:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/98: creat d11/d18/f23 x:0 0 0 2024-05-09T06:30:26.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/95: creat db/f1f x:0 0 0 2024-05-09T06:30:26.259 INFO:tasks.workunit.client.1.smithi106.stdout:5/403: dread d8/d45/d4c/d32/d5b/f29 [4194304,4194304] 0 2024-05-09T06:30:26.262 INFO:tasks.workunit.client.0.smithi046.stdout:0/99: dread fe [0,4194304] 0 2024-05-09T06:30:26.266 INFO:tasks.workunit.client.1.smithi106.stdout:9/427: truncate d4/d6/d23/d16/f35 545795 0 2024-05-09T06:30:26.266 INFO:tasks.workunit.client.1.smithi106.stdout:9/428: chown d4/d6/d1b/d2a/f74 0 1 2024-05-09T06:30:26.268 INFO:tasks.workunit.client.1.smithi106.stdout:2/488: rename d2/d5/db/d1d/c3e to d2/d7/d62/d9a/ca1 0 2024-05-09T06:30:26.270 INFO:tasks.workunit.client.1.smithi106.stdout:6/428: link d0/d17/d76/l6b d0/d5c/l8d 0 2024-05-09T06:30:26.271 INFO:tasks.workunit.client.1.smithi106.stdout:3/356: dwrite d5/f64 [0,4194304] 0 2024-05-09T06:30:26.273 INFO:tasks.workunit.client.1.smithi106.stdout:5/404: dread d8/d33/f4a [0,4194304] 0 2024-05-09T06:30:26.273 INFO:tasks.workunit.client.1.smithi106.stdout:5/405: creat d8/d45/d4c/f7b x:0 0 0 2024-05-09T06:30:26.276 INFO:tasks.workunit.client.1.smithi106.stdout:0/479: creat d1/d11/f9c x:0 0 0 2024-05-09T06:30:26.277 INFO:tasks.workunit.client.1.smithi106.stdout:1/413: symlink d4/d37/d4a/l9e 0 2024-05-09T06:30:26.277 INFO:tasks.workunit.client.1.smithi106.stdout:1/414: creat d4/d5b/f9f x:0 0 0 2024-05-09T06:30:26.278 INFO:tasks.workunit.client.1.smithi106.stdout:1/415: read d4/d76/d13/f1b [574384,46603] 0 2024-05-09T06:30:26.278 INFO:tasks.workunit.client.1.smithi106.stdout:1/416: truncate d4/d37/f93 500177 0 2024-05-09T06:30:26.279 INFO:tasks.workunit.client.1.smithi106.stdout:4/372: symlink d7/d39/d35/l75 0 2024-05-09T06:30:26.280 INFO:tasks.workunit.client.1.smithi106.stdout:4/373: write d7/d10/d1a/f71 [625277,91641] 0 2024-05-09T06:30:26.280 INFO:tasks.workunit.client.1.smithi106.stdout:2/489: mknod d2/d7/d89/ca2 0 2024-05-09T06:30:26.282 INFO:tasks.workunit.client.1.smithi106.stdout:4/374: dread d7/d10/f51 [0,4194304] 0 2024-05-09T06:30:26.284 INFO:tasks.workunit.client.1.smithi106.stdout:6/429: dread d0/d17/d76/f71 [0,4194304] 0 2024-05-09T06:30:26.284 INFO:tasks.workunit.client.1.smithi106.stdout:3/357: creat d5/d1c/f6b x:0 0 0 2024-05-09T06:30:26.285 INFO:tasks.workunit.client.1.smithi106.stdout:8/371: dwrite d3/d5/d13/d3a/f77 [0,4194304] 0 2024-05-09T06:30:26.286 INFO:tasks.workunit.client.0.smithi046.stdout:6/96: dwrite f4 [0,4194304] 0 2024-05-09T06:30:26.287 INFO:tasks.workunit.client.1.smithi106.stdout:5/406: mkdir d8/d7c 0 2024-05-09T06:30:26.289 INFO:tasks.workunit.client.1.smithi106.stdout:1/417: write d4/f8a [1005074,53394] 0 2024-05-09T06:30:26.289 INFO:tasks.workunit.client.1.smithi106.stdout:1/418: chown d4/d37/d4a/f81 2409251 1 2024-05-09T06:30:26.289 INFO:tasks.workunit.client.1.smithi106.stdout:1/419: chown d4/d37/d3d/f73 668318253 1 2024-05-09T06:30:26.289 INFO:tasks.workunit.client.1.smithi106.stdout:1/420: read d4/f1a [3681899,50446] 0 2024-05-09T06:30:26.290 INFO:tasks.workunit.client.1.smithi106.stdout:0/480: creat d1/d11/d23/d13/d2c/d6d/d70/f9d x:0 0 0 2024-05-09T06:30:26.290 INFO:tasks.workunit.client.1.smithi106.stdout:0/481: fdatasync d1/d11/d23/d13/d2c/d6d/d70/f9d 0 2024-05-09T06:30:26.291 INFO:tasks.workunit.client.1.smithi106.stdout:9/429: dread d4/d6/d23/d16/f35 [0,4194304] 0 2024-05-09T06:30:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:6/97: rename f8 to db/d10/d19/f20 0 2024-05-09T06:30:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/100: truncate f10 5111188 0 2024-05-09T06:30:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/101: dread - d11/d18/f23 zero size 2024-05-09T06:30:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/102: creat d11/f24 x:0 0 0 2024-05-09T06:30:26.299 INFO:tasks.workunit.client.1.smithi106.stdout:7/366: getdents d0/dc/d1a/d36/d1e/d68 0 2024-05-09T06:30:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:0/103: read fe [367449,12615] 0 2024-05-09T06:30:26.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/490: link d2/d5/db/d1d/d23/d5e/l7b d2/d5/db/d1d/d6a/la3 0 2024-05-09T06:30:26.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/491: fsync d2/d5/db/d1d/d6a/f94 0 2024-05-09T06:30:26.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/492: creat d2/d5/db/d15/d4f/fa4 x:0 0 0 2024-05-09T06:30:26.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/493: write d2/d5/db/d68/f76 [524960,116031] 0 2024-05-09T06:30:26.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/494: fsync d2/d5/db/d1d/f3d 0 2024-05-09T06:30:26.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/495: fdatasync d2/d5/f6 0 2024-05-09T06:30:26.305 INFO:tasks.workunit.client.0.smithi046.stdout:6/98: mknod db/d10/d19/d1d/c21 0 2024-05-09T06:30:26.305 INFO:tasks.workunit.client.0.smithi046.stdout:6/99: rename db to db/d22 22 2024-05-09T06:30:26.305 INFO:tasks.workunit.client.0.smithi046.stdout:6/100: dread - db/f1f zero size 2024-05-09T06:30:26.305 INFO:tasks.workunit.client.0.smithi046.stdout:6/101: creat db/f23 x:0 0 0 2024-05-09T06:30:26.307 INFO:tasks.workunit.client.1.smithi106.stdout:6/430: creat d0/d17/d34/d5f/d8/f8e x:0 0 0 2024-05-09T06:30:26.308 INFO:tasks.workunit.client.1.smithi106.stdout:9/430: dread d4/d6/f34 [0,4194304] 0 2024-05-09T06:30:26.308 INFO:tasks.workunit.client.1.smithi106.stdout:9/431: creat d4/d6/d1b/d2a/f75 x:0 0 0 2024-05-09T06:30:26.312 INFO:tasks.workunit.client.1.smithi106.stdout:8/372: symlink d3/d5/d35/d73/l87 0 2024-05-09T06:30:26.312 INFO:tasks.workunit.client.1.smithi106.stdout:8/373: chown d3/d5/d35/d61/d6c 6701108 1 2024-05-09T06:30:26.313 INFO:tasks.workunit.client.1.smithi106.stdout:5/407: rename d8/d33/c34 to d8/d33/d74/c7d 0 2024-05-09T06:30:26.315 INFO:tasks.workunit.client.1.smithi106.stdout:7/367: mknod d0/dc/d1a/d36/d30/d44/d58/c6e 0 2024-05-09T06:30:26.315 INFO:tasks.workunit.client.1.smithi106.stdout:7/368: chown d0/dc/d1a/d36/d30/f64 72195 1 2024-05-09T06:30:26.317 INFO:tasks.workunit.client.1.smithi106.stdout:3/358: dwrite d5/d1c/d24/f35 [0,4194304] 0 2024-05-09T06:30:26.317 INFO:tasks.workunit.client.1.smithi106.stdout:6/431: mkdir d0/d17/d34/d5f/d8/d50/d8f 0 2024-05-09T06:30:26.323 INFO:tasks.workunit.client.1.smithi106.stdout:9/432: truncate d4/d6/f2e 1642231 0 2024-05-09T06:30:26.325 INFO:tasks.workunit.client.1.smithi106.stdout:8/374: symlink d3/d5/d7/d15/d47/d50/l88 0 2024-05-09T06:30:26.325 INFO:tasks.workunit.client.1.smithi106.stdout:8/375: fsync d3/d5/d7/d15/f49 0 2024-05-09T06:30:26.325 INFO:tasks.workunit.client.1.smithi106.stdout:8/376: fsync d3/d5/d35/f68 0 2024-05-09T06:30:26.326 INFO:tasks.workunit.client.1.smithi106.stdout:5/408: rmdir d8/d33/d74 39 2024-05-09T06:30:26.327 INFO:tasks.workunit.client.1.smithi106.stdout:7/369: symlink d0/dc/d45/l6f 0 2024-05-09T06:30:26.330 INFO:tasks.workunit.client.1.smithi106.stdout:3/359: creat d5/d4d/f6c x:0 0 0 2024-05-09T06:30:26.331 INFO:tasks.workunit.client.1.smithi106.stdout:9/433: symlink d4/d6/d1b/d2a/d61/l76 0 2024-05-09T06:30:26.331 INFO:tasks.workunit.client.1.smithi106.stdout:4/375: dwrite d7/d10/d1a/d5a/d1c/f45 [0,4194304] 0 2024-05-09T06:30:26.333 INFO:tasks.workunit.client.1.smithi106.stdout:5/409: mkdir d8/d5a/d60/d7e 0 2024-05-09T06:30:26.333 INFO:tasks.workunit.client.1.smithi106.stdout:1/421: dwrite d4/d5b/f9f [0,4194304] 0 2024-05-09T06:30:26.333 INFO:tasks.workunit.client.1.smithi106.stdout:8/377: dread d3/d5/f12 [8388608,4194304] 0 2024-05-09T06:30:26.333 INFO:tasks.workunit.client.1.smithi106.stdout:0/482: dwrite d1/d11/d23/d22/f49 [0,4194304] 0 2024-05-09T06:30:26.334 INFO:tasks.workunit.client.1.smithi106.stdout:7/370: creat d0/dc/d1a/d5a/f70 x:0 0 0 2024-05-09T06:30:26.334 INFO:tasks.workunit.client.1.smithi106.stdout:2/496: dwrite f0 [0,4194304] 0 2024-05-09T06:30:26.334 INFO:tasks.workunit.client.1.smithi106.stdout:2/497: stat d2/d7/f25 0 2024-05-09T06:30:26.336 INFO:tasks.workunit.client.1.smithi106.stdout:3/360: unlink d5/d1c/f6b 0 2024-05-09T06:30:26.340 INFO:tasks.workunit.client.1.smithi106.stdout:9/434: creat d4/d6/d1b/d2a/d42/d6c/d6d/f77 x:0 0 0 2024-05-09T06:30:26.340 INFO:tasks.workunit.client.1.smithi106.stdout:9/435: fdatasync d4/d6/f15 0 2024-05-09T06:30:26.348 INFO:tasks.workunit.client.1.smithi106.stdout:4/376: creat d7/d39/d35/f76 x:0 0 0 2024-05-09T06:30:26.348 INFO:tasks.workunit.client.1.smithi106.stdout:4/377: dread - d7/d10/d1a/f5b zero size 2024-05-09T06:30:26.348 INFO:tasks.workunit.client.1.smithi106.stdout:4/378: read d7/d28/f27 [3217512,105554] 0 2024-05-09T06:30:26.352 INFO:tasks.workunit.client.1.smithi106.stdout:1/422: truncate d4/d5/f50 2515555 0 2024-05-09T06:30:26.354 INFO:tasks.workunit.client.1.smithi106.stdout:8/378: mkdir d3/d5/d35/d61/d6c/d83/d89 0 2024-05-09T06:30:26.354 INFO:tasks.workunit.client.1.smithi106.stdout:8/379: chown d3/d5/d13/d3a/c48 0 1 2024-05-09T06:30:26.357 INFO:tasks.workunit.client.1.smithi106.stdout:1/423: dread d4/f2d [0,4194304] 0 2024-05-09T06:30:26.357 INFO:tasks.workunit.client.1.smithi106.stdout:5/410: dwrite d8/d45/d4c/d32/d5b/f29 [4194304,4194304] 0 2024-05-09T06:30:26.360 INFO:tasks.workunit.client.1.smithi106.stdout:0/483: rename d1/d11/d23/d13/d58/d79/l95 to d1/d11/d23/d13/d8a/l9e 0 2024-05-09T06:30:26.360 INFO:tasks.workunit.client.1.smithi106.stdout:0/484: write d1/d11/d23/f53 [1342755,52830] 0 2024-05-09T06:30:26.362 INFO:tasks.workunit.client.0.smithi046.stdout:0/104: dwrite d11/d18/f1b [0,4194304] 0 2024-05-09T06:30:26.362 INFO:tasks.workunit.client.0.smithi046.stdout:0/105: creat d11/f25 x:0 0 0 2024-05-09T06:30:26.362 INFO:tasks.workunit.client.0.smithi046.stdout:0/106: creat d11/f26 x:0 0 0 2024-05-09T06:30:26.364 INFO:tasks.workunit.client.1.smithi106.stdout:7/371: rmdir d0/dc/d45 39 2024-05-09T06:30:26.368 INFO:tasks.workunit.client.1.smithi106.stdout:3/361: dwrite d5/d3f/f4a [0,4194304] 0 2024-05-09T06:30:26.370 INFO:tasks.workunit.client.0.smithi046.stdout:6/102: dwrite db/fc [0,4194304] 0 2024-05-09T06:30:26.370 INFO:tasks.workunit.client.0.smithi046.stdout:6/103: stat db/c11 0 2024-05-09T06:30:26.372 INFO:tasks.workunit.client.0.smithi046.stdout:0/107: mkdir d11/d18/d27 0 2024-05-09T06:30:26.373 INFO:tasks.workunit.client.1.smithi106.stdout:2/498: symlink d2/d5/db/d15/d4f/la5 0 2024-05-09T06:30:26.374 INFO:tasks.workunit.client.0.smithi046.stdout:6/104: creat db/d10/f24 x:0 0 0 2024-05-09T06:30:26.375 INFO:tasks.workunit.client.0.smithi046.stdout:6/105: creat db/f25 x:0 0 0 2024-05-09T06:30:26.381 INFO:tasks.workunit.client.1.smithi106.stdout:3/362: dread d5/d12/d26/f58 [0,4194304] 0 2024-05-09T06:30:26.381 INFO:tasks.workunit.client.1.smithi106.stdout:8/380: dwrite d3/d5/d13/f36 [0,4194304] 0 2024-05-09T06:30:26.381 INFO:tasks.workunit.client.1.smithi106.stdout:3/363: write d5/f63 [540293,106452] 0 2024-05-09T06:30:26.382 INFO:tasks.workunit.client.1.smithi106.stdout:3/364: creat d5/d1c/f6d x:0 0 0 2024-05-09T06:30:26.382 INFO:tasks.workunit.client.1.smithi106.stdout:3/365: truncate d5/d1c/f6d 923821 0 2024-05-09T06:30:26.382 INFO:tasks.workunit.client.1.smithi106.stdout:3/366: dread - d5/f3d zero size 2024-05-09T06:30:26.382 INFO:tasks.workunit.client.1.smithi106.stdout:3/367: write d5/d1c/f33 [234439,106806] 0 2024-05-09T06:30:26.383 INFO:tasks.workunit.client.1.smithi106.stdout:7/372: dwrite d0/dc/d1a/d36/d30/d44/d6a/f6d [0,4194304] 0 2024-05-09T06:30:26.383 INFO:tasks.workunit.client.1.smithi106.stdout:7/373: chown d0/dc/d1a/d36/d30/d44/d58/c6e 0 1 2024-05-09T06:30:26.383 INFO:tasks.workunit.client.1.smithi106.stdout:7/374: fdatasync d0/dc/f31 0 2024-05-09T06:30:26.384 INFO:tasks.workunit.client.0.smithi046.stdout:6/106: fsync db/d10/d19/f1b 0 2024-05-09T06:30:26.384 INFO:tasks.workunit.client.0.smithi046.stdout:6/107: fsync db/fc 0 2024-05-09T06:30:26.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/108: write d11/f12 [1104970,58861] 0 2024-05-09T06:30:26.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/109: fsync f4 0 2024-05-09T06:30:26.390 INFO:tasks.workunit.client.1.smithi106.stdout:9/436: mkdir d4/d6/d23/d78 0 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:1/424: creat d4/d76/d65/fa0 x:0 0 0 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:1/425: readlink d4/d76/d1d/l35 0 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:1/426: chown d4/d37/d3d/f96 0 1 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:9/437: dread d4/d6/d1b/d2a/f1e [0,4194304] 0 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:9/438: dread - d4/d6/d23/d2f/d31/f50 zero size 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:9/439: readlink d4/d6/l9 0 2024-05-09T06:30:26.395 INFO:tasks.workunit.client.1.smithi106.stdout:9/440: chown d4/d6/c1a 13 1 2024-05-09T06:30:26.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/110: unlink d11/f13 0 2024-05-09T06:30:26.400 INFO:tasks.workunit.client.1.smithi106.stdout:5/411: symlink d8/d33/d6c/l7f 0 2024-05-09T06:30:26.400 INFO:tasks.workunit.client.1.smithi106.stdout:5/412: dread - d8/d45/f55 zero size 2024-05-09T06:30:26.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/108: rename c0 to db/d10/d19/c26 0 2024-05-09T06:30:26.404 INFO:tasks.workunit.client.1.smithi106.stdout:4/379: rename d7/d39/l3c to d7/d10/l77 0 2024-05-09T06:30:26.404 INFO:tasks.workunit.client.1.smithi106.stdout:4/380: stat d7/d39/l56 0 2024-05-09T06:30:26.406 INFO:tasks.workunit.client.0.smithi046.stdout:0/111: unlink fb 0 2024-05-09T06:30:26.409 INFO:tasks.workunit.client.1.smithi106.stdout:0/485: mkdir d1/d11/d23/d13/d63/d7e/d9f 0 2024-05-09T06:30:26.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/109: rename f3 to db/f27 0 2024-05-09T06:30:26.417 INFO:tasks.workunit.client.1.smithi106.stdout:2/499: creat d2/d5/d9c/fa6 x:0 0 0 2024-05-09T06:30:26.417 INFO:tasks.workunit.client.1.smithi106.stdout:2/500: chown d2/f26 8807 1 2024-05-09T06:30:26.421 INFO:tasks.workunit.client.1.smithi106.stdout:0/486: read d1/d11/d23/d13/d2c/f77 [3002066,83364] 0 2024-05-09T06:30:26.422 INFO:tasks.workunit.client.1.smithi106.stdout:3/368: link d5/d1c/f2b d5/d1c/d21/d32/f6e 0 2024-05-09T06:30:26.426 INFO:tasks.workunit.client.0.smithi046.stdout:0/112: dwrite ff [0,4194304] 0 2024-05-09T06:30:26.428 INFO:tasks.workunit.client.1.smithi106.stdout:2/501: dread d2/d5/f54 [0,4194304] 0 2024-05-09T06:30:26.434 INFO:tasks.workunit.client.1.smithi106.stdout:1/427: symlink d4/d76/d65/d8d/la1 0 2024-05-09T06:30:26.440 INFO:tasks.workunit.client.0.smithi046.stdout:6/110: dwrite db/d10/f1e [0,4194304] 0 2024-05-09T06:30:26.442 INFO:tasks.workunit.client.0.smithi046.stdout:0/113: rmdir d11 39 2024-05-09T06:30:26.443 INFO:tasks.workunit.client.0.smithi046.stdout:0/114: fsync d11/d18/f1e 0 2024-05-09T06:30:26.446 INFO:tasks.workunit.client.1.smithi106.stdout:8/381: rename d3/f6 to d3/d5/f8a 0 2024-05-09T06:30:26.446 INFO:tasks.workunit.client.1.smithi106.stdout:8/382: dread - d3/d6b/f79 zero size 2024-05-09T06:30:26.449 INFO:tasks.workunit.client.1.smithi106.stdout:0/487: dwrite d1/f1d [0,4194304] 0 2024-05-09T06:30:26.449 INFO:tasks.workunit.client.1.smithi106.stdout:4/381: symlink d7/d39/l78 0 2024-05-09T06:30:26.449 INFO:tasks.workunit.client.1.smithi106.stdout:4/382: chown d7 36382 1 2024-05-09T06:30:26.455 INFO:tasks.workunit.client.0.smithi046.stdout:0/115: mkdir d11/d18/d27/d28 0 2024-05-09T06:30:26.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/116: stat d11/f24 0 2024-05-09T06:30:26.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/117: chown d11/f25 1 1 2024-05-09T06:30:26.461 INFO:tasks.workunit.client.1.smithi106.stdout:4/383: dread d7/f11 [0,4194304] 0 2024-05-09T06:30:26.461 INFO:tasks.workunit.client.1.smithi106.stdout:3/369: symlink d5/d1c/d21/l6f 0 2024-05-09T06:30:26.461 INFO:tasks.workunit.client.1.smithi106.stdout:4/384: write d7/d10/d1a/d5a/d1c/f49 [1275946,36684] 0 2024-05-09T06:30:26.461 INFO:tasks.workunit.client.1.smithi106.stdout:4/385: dread - d7/d10/d1a/d5a/f63 zero size 2024-05-09T06:30:26.461 INFO:tasks.workunit.client.1.smithi106.stdout:4/386: readlink l5 0 2024-05-09T06:30:26.462 INFO:tasks.workunit.client.1.smithi106.stdout:2/502: mknod d2/ca7 0 2024-05-09T06:30:26.462 INFO:tasks.workunit.client.1.smithi106.stdout:2/503: write d2/f10 [5194541,93366] 0 2024-05-09T06:30:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/111: dwrite db/f15 [0,4194304] 0 2024-05-09T06:30:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/112: write f6 [923278,5139] 0 2024-05-09T06:30:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/113: creat db/f28 x:0 0 0 2024-05-09T06:30:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/114: truncate db/d10/f24 620022 0 2024-05-09T06:30:26.463 INFO:tasks.workunit.client.1.smithi106.stdout:7/375: mknod d0/c71 0 2024-05-09T06:30:26.464 INFO:tasks.workunit.client.1.smithi106.stdout:7/376: fdatasync d0/f5b 0 2024-05-09T06:30:26.464 INFO:tasks.workunit.client.1.smithi106.stdout:7/377: chown d0/dc/d1a/d36/d30/f32 254779464 1 2024-05-09T06:30:26.465 INFO:tasks.workunit.client.1.smithi106.stdout:1/428: truncate d4/d76/d13/f19 2264976 0 2024-05-09T06:30:26.471 INFO:tasks.workunit.client.1.smithi106.stdout:5/413: rename d8/d33/d3a/f42 to d8/d5a/d6d/f80 0 2024-05-09T06:30:26.471 INFO:tasks.workunit.client.1.smithi106.stdout:5/414: fsync d8/f1a 0 2024-05-09T06:30:26.474 INFO:tasks.workunit.client.1.smithi106.stdout:8/383: symlink d3/d5/d35/d61/d6c/d83/d89/l8b 0 2024-05-09T06:30:26.475 INFO:tasks.workunit.client.1.smithi106.stdout:6/432: sync 2024-05-09T06:30:26.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/115: rename db/f15 to db/d10/d19/f29 0 2024-05-09T06:30:26.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/116: creat db/d10/d19/f2a x:0 0 0 2024-05-09T06:30:26.481 INFO:tasks.workunit.client.1.smithi106.stdout:5/415: read d8/f4b [155898,58462] 0 2024-05-09T06:30:26.482 INFO:tasks.workunit.client.1.smithi106.stdout:0/488: creat d1/d11/d23/d13/d63/d7e/fa0 x:0 0 0 2024-05-09T06:30:26.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/370: link d5/f3d d5/d4d/f70 0 2024-05-09T06:30:26.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/371: fdatasync d5/d1c/d24/f59 0 2024-05-09T06:30:26.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/372: chown d5/f64 154 1 2024-05-09T06:30:26.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/373: write d5/d1c/d21/d32/f6e [2449169,121178] 0 2024-05-09T06:30:26.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/374: truncate d5/d1c/f33 929819 0 2024-05-09T06:30:26.487 INFO:tasks.workunit.client.1.smithi106.stdout:2/504: mknod d2/d5/db/d1d/d6a/ca8 0 2024-05-09T06:30:26.488 INFO:tasks.workunit.client.1.smithi106.stdout:1/429: mknod d4/d5b/d75/ca2 0 2024-05-09T06:30:26.490 INFO:tasks.workunit.client.0.smithi046.stdout:0/118: dwrite ff [0,4194304] 0 2024-05-09T06:30:26.492 INFO:tasks.workunit.client.1.smithi106.stdout:8/384: mknod d3/d5/d35/d61/d6c/c8c 0 2024-05-09T06:30:26.492 INFO:tasks.workunit.client.1.smithi106.stdout:8/385: write d3/d5/d13/f36 [4970448,112234] 0 2024-05-09T06:30:26.493 INFO:tasks.workunit.client.0.smithi046.stdout:0/119: rename d11/l16 to d11/d18/d27/d28/l29 0 2024-05-09T06:30:26.495 INFO:tasks.workunit.client.1.smithi106.stdout:6/433: chown d0/d17/d34/d72 65481871 1 2024-05-09T06:30:26.496 INFO:tasks.workunit.client.1.smithi106.stdout:5/416: symlink d8/d33/d6c/l81 0 2024-05-09T06:30:26.498 INFO:tasks.workunit.client.1.smithi106.stdout:0/489: rename d1/d11/d23/d13/d2c/d76 to d1/da1 0 2024-05-09T06:30:26.499 INFO:tasks.workunit.client.1.smithi106.stdout:4/387: dwrite d7/d10/d1a/d5a/d1c/f52 [0,4194304] 0 2024-05-09T06:30:26.499 INFO:tasks.workunit.client.1.smithi106.stdout:7/378: dwrite d0/dc/d1a/d36/d30/f32 [0,4194304] 0 2024-05-09T06:30:26.499 INFO:tasks.workunit.client.1.smithi106.stdout:7/379: chown d0/d53/l67 13 1 2024-05-09T06:30:26.500 INFO:tasks.workunit.client.1.smithi106.stdout:7/380: stat d0/dc/d1a/d36/d30/d44/d58/f5f 0 2024-05-09T06:30:26.500 INFO:tasks.workunit.client.1.smithi106.stdout:7/381: read d0/dc/f2d [16255,84972] 0 2024-05-09T06:30:26.500 INFO:tasks.workunit.client.1.smithi106.stdout:7/382: truncate d0/dc/d1a/d36/d1e/f5d 47801 0 2024-05-09T06:30:26.500 INFO:tasks.workunit.client.0.smithi046.stdout:6/117: dwrite db/f1f [0,4194304] 0 2024-05-09T06:30:26.501 INFO:tasks.workunit.client.1.smithi106.stdout:3/375: unlink d5/d12/f3a 0 2024-05-09T06:30:26.502 INFO:tasks.workunit.client.1.smithi106.stdout:1/430: truncate d4/d37/d3d/f69 262350 0 2024-05-09T06:30:26.509 INFO:tasks.workunit.client.1.smithi106.stdout:8/386: symlink d3/d5/d13/d3a/l8d 0 2024-05-09T06:30:26.511 INFO:tasks.workunit.client.1.smithi106.stdout:6/434: symlink d0/d66/l90 0 2024-05-09T06:30:26.515 INFO:tasks.workunit.client.0.smithi046.stdout:6/118: dwrite db/d10/f16 [0,4194304] 0 2024-05-09T06:30:26.516 INFO:tasks.workunit.client.1.smithi106.stdout:2/505: rename d2/d5/db/d15/f1e to d2/d5/db/d15/d4f/fa9 0 2024-05-09T06:30:26.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/119: unlink db/d10/d19/f1a 0 2024-05-09T06:30:26.533 INFO:tasks.workunit.client.1.smithi106.stdout:4/388: symlink d7/d39/d35/l79 0 2024-05-09T06:30:26.534 INFO:tasks.workunit.client.1.smithi106.stdout:7/383: mkdir d0/dc/d1a/d36/d30/d44/d6a/d72 0 2024-05-09T06:30:26.534 INFO:tasks.workunit.client.1.smithi106.stdout:7/384: readlink d0/d53/l67 0 2024-05-09T06:30:26.535 INFO:tasks.workunit.client.1.smithi106.stdout:2/506: dwrite d2/f56 [0,4194304] 0 2024-05-09T06:30:26.536 INFO:tasks.workunit.client.1.smithi106.stdout:3/376: creat d5/d1c/d24/d52/f71 x:0 0 0 2024-05-09T06:30:26.538 INFO:tasks.workunit.client.1.smithi106.stdout:1/431: creat d4/d76/fa3 x:0 0 0 2024-05-09T06:30:26.539 INFO:tasks.workunit.client.1.smithi106.stdout:8/387: symlink d3/d5/d35/d73/l8e 0 2024-05-09T06:30:26.542 INFO:tasks.workunit.client.1.smithi106.stdout:5/417: rmdir d8/d5a 39 2024-05-09T06:30:26.542 INFO:tasks.workunit.client.1.smithi106.stdout:5/418: truncate d8/f7a 804819 0 2024-05-09T06:30:26.545 INFO:tasks.workunit.client.0.smithi046.stdout:6/120: dwrite db/f14 [0,4194304] 0 2024-05-09T06:30:26.546 INFO:tasks.workunit.client.1.smithi106.stdout:0/490: rename d1/d11/d23/d13/l36 to d1/d11/d23/d13/d58/d79/la2 0 2024-05-09T06:30:26.546 INFO:tasks.workunit.client.1.smithi106.stdout:0/491: write d1/d11/d23/f1a [3593185,67830] 0 2024-05-09T06:30:26.546 INFO:tasks.workunit.client.1.smithi106.stdout:0/492: write d1/d11/d23/d13/d2c/d6d/f73 [547904,91874] 0 2024-05-09T06:30:26.546 INFO:tasks.workunit.client.1.smithi106.stdout:0/493: dread - d1/d11/d23/d22/f91 zero size 2024-05-09T06:30:26.547 INFO:tasks.workunit.client.1.smithi106.stdout:4/389: mkdir d7/d10/d1a/d5a/d7a 0 2024-05-09T06:30:26.548 INFO:tasks.workunit.client.1.smithi106.stdout:7/385: mknod d0/dc/d1a/d36/d30/d44/d58/c73 0 2024-05-09T06:30:26.553 INFO:tasks.workunit.client.1.smithi106.stdout:3/377: mkdir d5/d4d/d72 0 2024-05-09T06:30:26.554 INFO:tasks.workunit.client.1.smithi106.stdout:6/435: rmdir d0/d17/d34/d5f/d8/d27/d3b/d62 39 2024-05-09T06:30:26.556 INFO:tasks.workunit.client.1.smithi106.stdout:5/419: link d8/d5a/d6d/f80 d8/d5a/d60/d7e/f82 0 2024-05-09T06:30:26.556 INFO:tasks.workunit.client.1.smithi106.stdout:5/420: fdatasync d8/d45/d4c/d32/d5b/f24 0 2024-05-09T06:30:26.558 INFO:tasks.workunit.client.1.smithi106.stdout:4/390: dread d7/d39/f44 [0,4194304] 0 2024-05-09T06:30:26.558 INFO:tasks.workunit.client.1.smithi106.stdout:4/391: write d7/d10/d1a/d5a/f63 [4266,38325] 0 2024-05-09T06:30:26.558 INFO:tasks.workunit.client.1.smithi106.stdout:4/392: stat d7/d28/d2a/f2b 0 2024-05-09T06:30:26.563 INFO:tasks.workunit.client.1.smithi106.stdout:9/441: sync 2024-05-09T06:30:26.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/121: write db/fd [5764324,65196] 0 2024-05-09T06:30:26.567 INFO:tasks.workunit.client.1.smithi106.stdout:0/494: mknod d1/d11/d23/d13/d2c/d3d/ca3 0 2024-05-09T06:30:26.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/122: write f4 [3600394,71686] 0 2024-05-09T06:30:26.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/123: creat db/f2b x:0 0 0 2024-05-09T06:30:26.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/124: chown db/d10/c1c 106090 1 2024-05-09T06:30:26.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/125: chown db/d10/f24 11612231 1 2024-05-09T06:30:26.571 INFO:tasks.workunit.client.1.smithi106.stdout:1/432: dwrite d4/d5b/d75/f97 [0,4194304] 0 2024-05-09T06:30:26.572 INFO:tasks.workunit.client.1.smithi106.stdout:8/388: dwrite d3/d5/d35/f68 [0,4194304] 0 2024-05-09T06:30:26.572 INFO:tasks.workunit.client.1.smithi106.stdout:8/389: fsync d3/d5/d7/d15/d3e/f81 0 2024-05-09T06:30:26.572 INFO:tasks.workunit.client.1.smithi106.stdout:8/390: fsync d3/d5/d7/d15/d3e/f56 0 2024-05-09T06:30:26.572 INFO:tasks.workunit.client.1.smithi106.stdout:8/391: truncate d3/d5/f8a 2342286 0 2024-05-09T06:30:26.572 INFO:tasks.workunit.client.1.smithi106.stdout:3/378: dwrite d5/d1c/d53/f60 [0,4194304] 0 2024-05-09T06:30:26.573 INFO:tasks.workunit.client.1.smithi106.stdout:7/386: creat d0/dc/d1a/d36/f74 x:0 0 0 2024-05-09T06:30:26.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/379: dread d5/d1c/d24/d5b/f66 [4194304,4194304] 0 2024-05-09T06:30:26.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/380: chown d5/d1c/d21/d32/l62 1 1 2024-05-09T06:30:26.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/381: fsync d5/fb 0 2024-05-09T06:30:26.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/382: readlink d5/d1c/d24/l36 0 2024-05-09T06:30:26.588 INFO:tasks.workunit.client.1.smithi106.stdout:6/436: rename d0/d17/d34/d5f/d8/d27/d3e/f54 to d0/d17/d76/d8b/f91 0 2024-05-09T06:30:26.588 INFO:tasks.workunit.client.1.smithi106.stdout:6/437: truncate d0/d5c/f7f 1227158 0 2024-05-09T06:30:26.588 INFO:tasks.workunit.client.1.smithi106.stdout:6/438: stat d0/d17/d34/d5f/f24 0 2024-05-09T06:30:26.588 INFO:tasks.workunit.client.1.smithi106.stdout:6/439: read d0/d17/d34/d5f/d8/d50/f7d [169082,115623] 0 2024-05-09T06:30:26.588 INFO:tasks.workunit.client.0.smithi046.stdout:6/126: symlink db/d10/d19/d1d/l2c 0 2024-05-09T06:30:26.590 INFO:tasks.workunit.client.1.smithi106.stdout:9/442: symlink d4/d54/l79 0 2024-05-09T06:30:26.590 INFO:tasks.workunit.client.1.smithi106.stdout:9/443: read d4/d6/d23/d16/f35 [84921,79918] 0 2024-05-09T06:30:26.590 INFO:tasks.workunit.client.1.smithi106.stdout:9/444: readlink d4/d6/d1b/d2a/l17 0 2024-05-09T06:30:26.590 INFO:tasks.workunit.client.1.smithi106.stdout:9/445: chown d4/d6/d23/d2f/d47/f62 15 1 2024-05-09T06:30:26.590 INFO:tasks.workunit.client.0.smithi046.stdout:6/127: mknod db/c2d 0 2024-05-09T06:30:26.594 INFO:tasks.workunit.client.0.smithi046.stdout:6/128: symlink db/d10/l2e 0 2024-05-09T06:30:26.595 INFO:tasks.workunit.client.1.smithi106.stdout:1/433: mknod d4/d37/d74/ca4 0 2024-05-09T06:30:26.595 INFO:tasks.workunit.client.1.smithi106.stdout:1/434: chown d4/d37/d74/ca4 4458396 1 2024-05-09T06:30:26.595 INFO:tasks.workunit.client.1.smithi106.stdout:1/435: chown d4/d37/d4a/f87 18234500 1 2024-05-09T06:30:26.601 INFO:tasks.workunit.client.1.smithi106.stdout:8/392: creat d3/d5/d35/d61/d6c/d83/f8f x:0 0 0 2024-05-09T06:30:26.601 INFO:tasks.workunit.client.1.smithi106.stdout:8/393: fdatasync d3/d5/d7/d15/d3e/d7d/f84 0 2024-05-09T06:30:26.601 INFO:tasks.workunit.client.1.smithi106.stdout:1/436: dread f2 [0,4194304] 0 2024-05-09T06:30:26.603 INFO:tasks.workunit.client.1.smithi106.stdout:7/387: truncate d0/dc/d1a/d36/d1e/f21 221871 0 2024-05-09T06:30:26.603 INFO:tasks.workunit.client.1.smithi106.stdout:7/388: creat d0/dc/d1a/d5a/f75 x:0 0 0 2024-05-09T06:30:26.606 INFO:tasks.workunit.client.1.smithi106.stdout:3/383: symlink d5/d4d/d72/l73 0 2024-05-09T06:30:26.606 INFO:tasks.workunit.client.1.smithi106.stdout:3/384: readlink d5/d12/d65/l6a 0 2024-05-09T06:30:26.610 INFO:tasks.workunit.client.1.smithi106.stdout:5/421: rename d8/l6f to d8/d33/d3a/l83 0 2024-05-09T06:30:26.610 INFO:tasks.workunit.client.1.smithi106.stdout:5/422: readlink d8/l21 0 2024-05-09T06:30:26.611 INFO:tasks.workunit.client.0.smithi046.stdout:6/129: dwrite db/d10/d19/f29 [0,4194304] 0 2024-05-09T06:30:26.611 INFO:tasks.workunit.client.1.smithi106.stdout:6/440: link d0/d66/d7e/l75 d0/d5c/l92 0 2024-05-09T06:30:26.612 INFO:tasks.workunit.client.1.smithi106.stdout:9/446: truncate d4/d6/d1b/d2a/f26 3418758 0 2024-05-09T06:30:26.615 INFO:tasks.workunit.client.1.smithi106.stdout:8/394: truncate d3/d5/d13/f36 2704146 0 2024-05-09T06:30:26.624 INFO:tasks.workunit.client.1.smithi106.stdout:1/437: dwrite d4/d76/f9b [0,4194304] 0 2024-05-09T06:30:26.625 INFO:tasks.workunit.client.1.smithi106.stdout:1/438: creat d4/d37/d74/fa5 x:0 0 0 2024-05-09T06:30:26.625 INFO:tasks.workunit.client.1.smithi106.stdout:1/439: write d4/f8a [4714017,130909] 0 2024-05-09T06:30:26.625 INFO:tasks.workunit.client.1.smithi106.stdout:4/393: rename d7/d10/d1a/d5a/d1c/f52 to d7/d39/f7b 0 2024-05-09T06:30:26.625 INFO:tasks.workunit.client.1.smithi106.stdout:4/394: dread - d7/d28/f73 zero size 2024-05-09T06:30:26.627 INFO:tasks.workunit.client.1.smithi106.stdout:7/389: dwrite d0/dc/d1a/d36/f74 [0,4194304] 0 2024-05-09T06:30:26.627 INFO:tasks.workunit.client.1.smithi106.stdout:9/447: write d4/d6/f15 [3665389,33766] 0 2024-05-09T06:30:26.628 INFO:tasks.workunit.client.1.smithi106.stdout:5/423: link d8/f12 d8/d33/d74/f84 0 2024-05-09T06:30:26.628 INFO:tasks.workunit.client.1.smithi106.stdout:5/424: fsync d8/f5f 0 2024-05-09T06:30:26.628 INFO:tasks.workunit.client.1.smithi106.stdout:5/425: chown d8/f37 15461643 1 2024-05-09T06:30:26.640 INFO:tasks.workunit.client.1.smithi106.stdout:9/448: dread d4/d6/d23/d16/f5b [0,4194304] 0 2024-05-09T06:30:26.642 INFO:tasks.workunit.client.1.smithi106.stdout:4/395: mkdir d7/d39/d35/d7c 0 2024-05-09T06:30:26.642 INFO:tasks.workunit.client.1.smithi106.stdout:4/396: creat d7/d28/f7d x:0 0 0 2024-05-09T06:30:26.642 INFO:tasks.workunit.client.1.smithi106.stdout:4/397: fsync d7/d39/f44 0 2024-05-09T06:30:26.642 INFO:tasks.workunit.client.1.smithi106.stdout:4/398: write d7/d28/f7d [1032610,103773] 0 2024-05-09T06:30:26.648 INFO:tasks.workunit.client.1.smithi106.stdout:6/441: getdents d0 0 2024-05-09T06:30:26.650 INFO:tasks.workunit.client.1.smithi106.stdout:5/426: mkdir d8/d45/d4c/d85 0 2024-05-09T06:30:26.651 INFO:tasks.workunit.client.1.smithi106.stdout:9/449: mknod d4/d6/d1b/c7a 0 2024-05-09T06:30:26.651 INFO:tasks.workunit.client.1.smithi106.stdout:9/450: write d4/d6/d1b/d2a/d42/d6c/d6d/f77 [107602,54863] 0 2024-05-09T06:30:26.651 INFO:tasks.workunit.client.1.smithi106.stdout:9/451: chown d4/d6/d23/d2f 250391892 1 2024-05-09T06:30:26.651 INFO:tasks.workunit.client.1.smithi106.stdout:9/452: fdatasync d4/d6/d1b/d2a/f1e 0 2024-05-09T06:30:26.652 INFO:tasks.workunit.client.1.smithi106.stdout:9/453: write d4/d6/d23/d2f/d31/f5c [691665,96376] 0 2024-05-09T06:30:26.653 INFO:tasks.workunit.client.1.smithi106.stdout:4/399: rmdir d7/d39/d47/d66 39 2024-05-09T06:30:26.654 INFO:tasks.workunit.client.1.smithi106.stdout:6/442: creat d0/d17/d34/d72/f93 x:0 0 0 2024-05-09T06:30:26.658 INFO:tasks.workunit.client.1.smithi106.stdout:9/454: creat d4/d6/d23/d2f/d31/d51/d58/f7b x:0 0 0 2024-05-09T06:30:26.658 INFO:tasks.workunit.client.1.smithi106.stdout:9/455: creat d4/d6/d23/d2f/d47/f7c x:0 0 0 2024-05-09T06:30:26.658 INFO:tasks.workunit.client.1.smithi106.stdout:9/456: chown d4/d6/d23/d2f/d47/f7c 127309740 1 2024-05-09T06:30:26.659 INFO:tasks.workunit.client.1.smithi106.stdout:9/457: write d4/d6/d23/d2f/d39/f60 [54631,9440] 0 2024-05-09T06:30:26.662 INFO:tasks.workunit.client.1.smithi106.stdout:5/427: read d8/f18 [570436,121061] 0 2024-05-09T06:30:26.665 INFO:tasks.workunit.client.1.smithi106.stdout:8/395: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:26.668 INFO:tasks.workunit.client.1.smithi106.stdout:8/396: rename d3/d5/d7/d15/d3e/f81 to d3/d5/d13/d3a/f90 0 2024-05-09T06:30:26.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/130: dwrite db/f23 [0,4194304] 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:9/458: write d4/d6/fa [1785939,77456] 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:9/459: dread - d4/f67 zero size 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:9/460: stat d4/d54/d69 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:9/461: creat d4/d6/d1b/d2a/f7d x:0 0 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:9/462: readlink d4/d6/l9 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:9/463: readlink d4/d6/l9 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:1/440: dwrite d4/d76/d13/f25 [0,4194304] 0 2024-05-09T06:30:26.671 INFO:tasks.workunit.client.1.smithi106.stdout:1/441: stat d4/d76/d65/f88 0 2024-05-09T06:30:26.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/131: rename db/d10/f24 to db/f2f 0 2024-05-09T06:30:26.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/132: mkdir db/d10/d30 0 2024-05-09T06:30:26.679 INFO:tasks.workunit.client.1.smithi106.stdout:1/442: mknod d4/d37/d74/ca6 0 2024-05-09T06:30:26.680 INFO:tasks.workunit.client.0.smithi046.stdout:6/133: truncate db/f14 4014201 0 2024-05-09T06:30:26.681 INFO:tasks.workunit.client.1.smithi106.stdout:1/443: mkdir d4/da7 0 2024-05-09T06:30:26.682 INFO:tasks.workunit.client.0.smithi046.stdout:6/134: rmdir db/d10/d19/d1d 39 2024-05-09T06:30:26.684 INFO:tasks.workunit.client.0.smithi046.stdout:6/135: symlink db/d10/d19/d1d/l31 0 2024-05-09T06:30:26.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/136: unlink db/d10/d19/d1d/l2c 0 2024-05-09T06:30:26.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/137: fdatasync db/d10/f1e 0 2024-05-09T06:30:26.689 INFO:tasks.workunit.client.1.smithi106.stdout:3/385: dwrite d5/d1c/d21/d32/f49 [0,4194304] 0 2024-05-09T06:30:26.689 INFO:tasks.workunit.client.1.smithi106.stdout:7/390: dwrite d0/dc/d1a/d36/d1e/f5d [0,4194304] 0 2024-05-09T06:30:26.689 INFO:tasks.workunit.client.1.smithi106.stdout:3/386: creat d5/d12/f74 x:0 0 0 2024-05-09T06:30:26.692 INFO:tasks.workunit.client.1.smithi106.stdout:6/443: dwrite d0/d17/f57 [0,4194304] 0 2024-05-09T06:30:26.693 INFO:tasks.workunit.client.1.smithi106.stdout:5/428: dwrite d8/d45/f55 [0,4194304] 0 2024-05-09T06:30:26.693 INFO:tasks.workunit.client.1.smithi106.stdout:5/429: fsync d8/d33/f76 0 2024-05-09T06:30:26.693 INFO:tasks.workunit.client.1.smithi106.stdout:9/464: write d4/d6/d23/d2f/d31/f5c [301386,92492] 0 2024-05-09T06:30:26.696 INFO:tasks.workunit.client.1.smithi106.stdout:1/444: dread d4/d76/d1d/f41 [0,4194304] 0 2024-05-09T06:30:26.696 INFO:tasks.workunit.client.1.smithi106.stdout:1/445: dread - d4/d5/f3a zero size 2024-05-09T06:30:26.698 INFO:tasks.workunit.client.1.smithi106.stdout:7/391: rename d0/dc/d1a/l55 to d0/d53/l76 0 2024-05-09T06:30:26.702 INFO:tasks.workunit.client.1.smithi106.stdout:4/400: dwrite d7/d28/f73 [0,4194304] 0 2024-05-09T06:30:26.704 INFO:tasks.workunit.client.1.smithi106.stdout:6/444: symlink d0/d17/d34/d5f/d8/d27/d3b/d62/l94 0 2024-05-09T06:30:26.705 INFO:tasks.workunit.client.1.smithi106.stdout:1/446: write d4/d76/d13/d2f/f42 [26338,72740] 0 2024-05-09T06:30:26.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/138: dread db/f23 [0,4194304] 0 2024-05-09T06:30:26.709 INFO:tasks.workunit.client.1.smithi106.stdout:7/392: dread d0/dc/d1a/d36/d1e/f4c [0,4194304] 0 2024-05-09T06:30:26.711 INFO:tasks.workunit.client.1.smithi106.stdout:3/387: dwrite d5/d4d/f6c [0,4194304] 0 2024-05-09T06:30:26.711 INFO:tasks.workunit.client.1.smithi106.stdout:5/430: rename l7 to d8/d5a/l86 0 2024-05-09T06:30:26.711 INFO:tasks.workunit.client.1.smithi106.stdout:5/431: chown d8/d45/c62 111 1 2024-05-09T06:30:26.716 INFO:tasks.workunit.client.1.smithi106.stdout:7/393: dread d0/f29 [0,4194304] 0 2024-05-09T06:30:26.716 INFO:tasks.workunit.client.1.smithi106.stdout:7/394: fsync d0/fe 0 2024-05-09T06:30:26.716 INFO:tasks.workunit.client.1.smithi106.stdout:7/395: write d0/dc/f69 [96691,126419] 0 2024-05-09T06:30:26.716 INFO:tasks.workunit.client.1.smithi106.stdout:1/447: dread d4/d76/d1d/f3c [0,4194304] 0 2024-05-09T06:30:26.718 INFO:tasks.workunit.client.1.smithi106.stdout:2/507: sync 2024-05-09T06:30:26.719 INFO:tasks.workunit.client.1.smithi106.stdout:9/465: getdents d4/d6/d23/d2f/d47 0 2024-05-09T06:30:26.724 INFO:tasks.workunit.client.1.smithi106.stdout:3/388: symlink d5/d4d/d5f/l75 0 2024-05-09T06:30:26.724 INFO:tasks.workunit.client.1.smithi106.stdout:3/389: creat d5/d1c/f76 x:0 0 0 2024-05-09T06:30:26.726 INFO:tasks.workunit.client.1.smithi106.stdout:4/401: rename d7/d10/d1a/d5a/d1c/f45 to d7/d10/d1a/d5a/d7a/f7e 0 2024-05-09T06:30:26.727 INFO:tasks.workunit.client.1.smithi106.stdout:7/396: mkdir d0/dc/d1a/d36/d30/d44/d6a/d72/d77 0 2024-05-09T06:30:26.729 INFO:tasks.workunit.client.1.smithi106.stdout:6/445: mkdir d0/d17/d34/d95 0 2024-05-09T06:30:26.729 INFO:tasks.workunit.client.1.smithi106.stdout:6/446: dread - d0/f6a zero size 2024-05-09T06:30:26.729 INFO:tasks.workunit.client.1.smithi106.stdout:6/447: write d0/d17/d34/d5f/f28 [2921776,5853] 0 2024-05-09T06:30:26.729 INFO:tasks.workunit.client.1.smithi106.stdout:6/448: creat d0/d5c/f96 x:0 0 0 2024-05-09T06:30:26.729 INFO:tasks.workunit.client.1.smithi106.stdout:9/466: symlink d4/d6/d23/d16/l7e 0 2024-05-09T06:30:26.733 INFO:tasks.workunit.client.1.smithi106.stdout:5/432: rename d8/f4b to d8/d45/d4c/d32/d5b/d69/f87 0 2024-05-09T06:30:26.733 INFO:tasks.workunit.client.1.smithi106.stdout:5/433: write d8/d33/d3a/f63 [245014,19018] 0 2024-05-09T06:30:26.733 INFO:tasks.workunit.client.1.smithi106.stdout:4/402: mkdir d7/d10/d1a/d5a/d7a/d7f 0 2024-05-09T06:30:26.737 INFO:tasks.workunit.client.1.smithi106.stdout:0/495: sync 2024-05-09T06:30:26.737 INFO:tasks.workunit.client.1.smithi106.stdout:6/449: mknod d0/c97 0 2024-05-09T06:30:26.737 INFO:tasks.workunit.client.1.smithi106.stdout:6/450: readlink d0/d66/l74 0 2024-05-09T06:30:26.739 INFO:tasks.workunit.client.1.smithi106.stdout:9/467: symlink d4/d6/d23/d2f/d38/l7f 0 2024-05-09T06:30:26.739 INFO:tasks.workunit.client.1.smithi106.stdout:3/390: dread d5/f64 [0,4194304] 0 2024-05-09T06:30:26.739 INFO:tasks.workunit.client.1.smithi106.stdout:3/391: stat d5/d1c/d21/l5d 0 2024-05-09T06:30:26.741 INFO:tasks.workunit.client.1.smithi106.stdout:1/448: rename d4/f7a to d4/d37/d4a/fa8 0 2024-05-09T06:30:26.744 INFO:tasks.workunit.client.1.smithi106.stdout:5/434: creat d8/d33/d3a/f88 x:0 0 0 2024-05-09T06:30:26.745 INFO:tasks.workunit.client.1.smithi106.stdout:5/435: chown d8/d45/f70 0 1 2024-05-09T06:30:26.745 INFO:tasks.workunit.client.1.smithi106.stdout:5/436: write d8/f51 [1733423,69574] 0 2024-05-09T06:30:26.745 INFO:tasks.workunit.client.1.smithi106.stdout:2/508: dwrite d2/d5/db/d15/d4f/fa4 [0,4194304] 0 2024-05-09T06:30:26.745 INFO:tasks.workunit.client.1.smithi106.stdout:9/468: unlink d4/f67 0 2024-05-09T06:30:26.746 INFO:tasks.workunit.client.1.smithi106.stdout:1/449: symlink d4/d37/d4a/la9 0 2024-05-09T06:30:26.748 INFO:tasks.workunit.client.1.smithi106.stdout:6/451: mkdir d0/d17/d34/d4e/d98 0 2024-05-09T06:30:26.753 INFO:tasks.workunit.client.0.smithi046.stdout:6/139: dwrite f4 [0,4194304] 0 2024-05-09T06:30:26.753 INFO:tasks.workunit.client.0.smithi046.stdout:6/140: chown db/d10/d19/d1d/c21 8039 1 2024-05-09T06:30:26.753 INFO:tasks.workunit.client.1.smithi106.stdout:2/509: creat d2/d5/db/d1d/d90/faa x:0 0 0 2024-05-09T06:30:26.753 INFO:tasks.workunit.client.1.smithi106.stdout:1/450: unlink d4/d76/d1d/f24 0 2024-05-09T06:30:26.754 INFO:tasks.workunit.client.1.smithi106.stdout:6/452: truncate d0/d17/d34/d5f/d8/f3c 2435569 0 2024-05-09T06:30:26.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/510: rename d2/d5/db/d15/l52 to d2/d5/db/d1d/d90/lab 0 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/451: rmdir d4/d76/d13/d2f 39 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:2/511: chown d2/d7/f27 0 1 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/452: fsync d4/d76/d13/f82 0 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/453: write d4/d5b/d75/f97 [4800865,25939] 0 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/454: chown d4/f12 12861 1 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/455: read d4/d37/d3d/f73 [707504,24003] 0 2024-05-09T06:30:26.758 INFO:tasks.workunit.client.1.smithi106.stdout:7/397: dwrite d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:26.759 INFO:tasks.workunit.client.1.smithi106.stdout:0/496: dwrite d1/d11/d23/d13/d2c/f2d [0,4194304] 0 2024-05-09T06:30:26.759 INFO:tasks.workunit.client.1.smithi106.stdout:0/497: chown d1/d11/d23/d13/d2c/d6d/c78 1442717047 1 2024-05-09T06:30:26.759 INFO:tasks.workunit.client.1.smithi106.stdout:2/512: mknod d2/d7/d89/cac 0 2024-05-09T06:30:26.759 INFO:tasks.workunit.client.1.smithi106.stdout:5/437: read d8/d33/f3b [3080622,95861] 0 2024-05-09T06:30:26.769 INFO:tasks.workunit.client.1.smithi106.stdout:1/456: dread d4/d5/ff [0,4194304] 0 2024-05-09T06:30:26.836 INFO:tasks.workunit.client.1.smithi106.stdout:4/403: dwrite d7/f2e [0,4194304] 0 2024-05-09T06:30:26.836 INFO:tasks.workunit.client.1.smithi106.stdout:7/398: rename d0/d53/l67 to d0/dc/d1a/d36/d30/d44/d58/l78 0 2024-05-09T06:30:26.836 INFO:tasks.workunit.client.1.smithi106.stdout:7/399: creat d0/dc/d1a/d36/f79 x:0 0 0 2024-05-09T06:30:26.836 INFO:tasks.workunit.client.1.smithi106.stdout:7/400: truncate d0/dc/d1a/d36/f79 561914 0 2024-05-09T06:30:26.836 INFO:tasks.workunit.client.1.smithi106.stdout:7/401: chown d0/dc/d1a/f16 454 1 2024-05-09T06:30:26.837 INFO:tasks.workunit.client.1.smithi106.stdout:0/498: symlink d1/d11/d23/d13/d58/la4 0 2024-05-09T06:30:26.838 INFO:tasks.workunit.client.1.smithi106.stdout:5/438: dread d8/f12 [0,4194304] 0 2024-05-09T06:30:26.838 INFO:tasks.workunit.client.1.smithi106.stdout:2/513: getdents d2/d5/db/d15/d41/d60 0 2024-05-09T06:30:26.838 INFO:tasks.workunit.client.1.smithi106.stdout:2/514: readlink d2/d5/db/d1d/d23/d63/l75 0 2024-05-09T06:30:26.838 INFO:tasks.workunit.client.1.smithi106.stdout:5/439: write d8/d5a/f73 [579780,11371] 0 2024-05-09T06:30:26.838 INFO:tasks.workunit.client.1.smithi106.stdout:2/515: write d2/d7/d2c/f42 [2173415,67582] 0 2024-05-09T06:30:26.839 INFO:tasks.workunit.client.1.smithi106.stdout:1/457: rmdir d4/d76/d13 39 2024-05-09T06:30:26.839 INFO:tasks.workunit.client.1.smithi106.stdout:1/458: write d4/d37/d74/fa5 [1005055,92844] 0 2024-05-09T06:30:26.839 INFO:tasks.workunit.client.1.smithi106.stdout:3/392: dwrite d5/d1c/d24/f28 [4194304,4194304] 0 2024-05-09T06:30:26.842 INFO:tasks.workunit.client.1.smithi106.stdout:6/453: dwrite d0/f6a [0,4194304] 0 2024-05-09T06:30:26.843 INFO:tasks.workunit.client.0.smithi046.stdout:6/141: write db/d10/d19/f29 [2130143,121446] 0 2024-05-09T06:30:26.843 INFO:tasks.workunit.client.1.smithi106.stdout:4/404: mkdir d7/d28/d2a/d80 0 2024-05-09T06:30:26.844 INFO:tasks.workunit.client.1.smithi106.stdout:1/459: dread d4/d5/ff [0,4194304] 0 2024-05-09T06:30:26.844 INFO:tasks.workunit.client.1.smithi106.stdout:1/460: stat d4/d76 0 2024-05-09T06:30:26.846 INFO:tasks.workunit.client.1.smithi106.stdout:5/440: dread d8/d45/d4c/f2e [0,4194304] 0 2024-05-09T06:30:26.847 INFO:tasks.workunit.client.1.smithi106.stdout:7/402: mkdir d0/d53/d7a 0 2024-05-09T06:30:26.852 INFO:tasks.workunit.client.1.smithi106.stdout:2/516: truncate d2/d5/db/d1d/f4a 1158500 0 2024-05-09T06:30:26.852 INFO:tasks.workunit.client.1.smithi106.stdout:2/517: creat d2/d7/fad x:0 0 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:3/393: symlink d5/d4d/d5f/l77 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:3/394: readlink d5/d1c/d53/l54 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:3/395: dread d5/d1c/f6d [0,4194304] 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:3/396: dread d5/fe [0,4194304] 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:6/454: creat d0/d17/d76/f99 x:0 0 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:6/455: write d0/f19 [1866293,55954] 0 2024-05-09T06:30:26.864 INFO:tasks.workunit.client.1.smithi106.stdout:6/456: chown d0/d17/d34/d5f/d8/d27/d3b 6152 1 2024-05-09T06:30:26.865 INFO:tasks.workunit.client.0.smithi046.stdout:6/142: dwrite db/d10/d19/f1b [0,4194304] 0 2024-05-09T06:30:26.865 INFO:tasks.workunit.client.1.smithi106.stdout:1/461: dwrite d4/f59 [0,4194304] 0 2024-05-09T06:30:26.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/405: link d7/d39/d35/l79 d7/d39/d47/d66/l81 0 2024-05-09T06:30:26.867 INFO:tasks.workunit.client.1.smithi106.stdout:9/469: getdents d4 0 2024-05-09T06:30:26.870 INFO:tasks.workunit.client.1.smithi106.stdout:3/397: write d5/d1c/d21/d32/f49 [1229005,81878] 0 2024-05-09T06:30:26.870 INFO:tasks.workunit.client.1.smithi106.stdout:3/398: write d5/d1c/d21/d32/f6e [9609878,29402] 0 2024-05-09T06:30:26.870 INFO:tasks.workunit.client.1.smithi106.stdout:3/399: fsync d5/d1c/f1e 0 2024-05-09T06:30:26.870 INFO:tasks.workunit.client.1.smithi106.stdout:3/400: readlink d5/d1c/d21/l40 0 2024-05-09T06:30:26.874 INFO:tasks.workunit.client.0.smithi046.stdout:6/143: creat db/d10/d19/d1d/f32 x:0 0 0 2024-05-09T06:30:26.880 INFO:tasks.workunit.client.1.smithi106.stdout:3/401: dread d5/d4d/f6c [0,4194304] 0 2024-05-09T06:30:26.880 INFO:tasks.workunit.client.1.smithi106.stdout:3/402: fdatasync d5/f63 0 2024-05-09T06:30:26.880 INFO:tasks.workunit.client.0.smithi046.stdout:6/144: link db/d10/f16 db/d10/d19/d1d/f33 0 2024-05-09T06:30:26.881 INFO:tasks.workunit.client.1.smithi106.stdout:4/406: dwrite d7/d10/d1a/d5a/d46/f54 [0,4194304] 0 2024-05-09T06:30:26.882 INFO:tasks.workunit.client.1.smithi106.stdout:7/403: mknod d0/dc/d1a/d36/c7b 0 2024-05-09T06:30:26.883 INFO:tasks.workunit.client.1.smithi106.stdout:0/499: getdents d1/d11/d23/d13/d2c 0 2024-05-09T06:30:26.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/145: mknod db/d10/c34 0 2024-05-09T06:30:26.889 INFO:tasks.workunit.client.1.smithi106.stdout:2/518: creat d2/d5/db/d1d/d23/d63/fae x:0 0 0 2024-05-09T06:30:26.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/146: dread db/f23 [0,4194304] 0 2024-05-09T06:30:26.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/147: creat db/d10/d19/f35 x:0 0 0 2024-05-09T06:30:26.891 INFO:tasks.workunit.client.1.smithi106.stdout:2/519: dread d2/d7/d2c/f34 [0,4194304] 0 2024-05-09T06:30:26.892 INFO:tasks.workunit.client.1.smithi106.stdout:0/500: dread d1/d11/d23/f53 [0,4194304] 0 2024-05-09T06:30:26.897 INFO:tasks.workunit.client.1.smithi106.stdout:1/462: mkdir d4/d76/daa 0 2024-05-09T06:30:26.897 INFO:tasks.workunit.client.1.smithi106.stdout:1/463: write d4/d76/d13/f1b [1556865,10160] 0 2024-05-09T06:30:26.897 INFO:tasks.workunit.client.1.smithi106.stdout:1/464: write d4/d76/d1d/f4e [569364,395] 0 2024-05-09T06:30:26.898 INFO:tasks.workunit.client.1.smithi106.stdout:9/470: symlink d4/d6/d1b/d2a/d42/d6c/l80 0 2024-05-09T06:30:26.898 INFO:tasks.workunit.client.1.smithi106.stdout:9/471: stat d4/d6/d1b/d2a/f56 0 2024-05-09T06:30:26.901 INFO:tasks.workunit.client.1.smithi106.stdout:3/403: truncate d5/d1c/d53/f60 3982532 0 2024-05-09T06:30:26.901 INFO:tasks.workunit.client.1.smithi106.stdout:3/404: fsync d5/d12/f74 0 2024-05-09T06:30:26.905 INFO:tasks.workunit.client.1.smithi106.stdout:4/407: truncate d7/d10/d1a/d5a/d7a/f7e 2240259 0 2024-05-09T06:30:26.907 INFO:tasks.workunit.client.1.smithi106.stdout:7/404: getdents d0/dc/d1a/d36/d30/d44 0 2024-05-09T06:30:26.909 INFO:tasks.workunit.client.1.smithi106.stdout:2/520: mkdir d2/d7/d2c/daf 0 2024-05-09T06:30:26.911 INFO:tasks.workunit.client.1.smithi106.stdout:1/465: dread d4/f59 [0,4194304] 0 2024-05-09T06:30:26.911 INFO:tasks.workunit.client.1.smithi106.stdout:4/408: mknod d7/d28/c82 0 2024-05-09T06:30:26.914 INFO:tasks.workunit.client.1.smithi106.stdout:4/409: rmdir d7/d39/d35 39 2024-05-09T06:30:26.921 INFO:tasks.workunit.client.1.smithi106.stdout:7/405: read d0/dc/d1a/d36/d30/d44/d6a/f6d [1112149,74719] 0 2024-05-09T06:30:26.923 INFO:tasks.workunit.client.1.smithi106.stdout:1/466: dread d4/d76/d13/f19 [0,4194304] 0 2024-05-09T06:30:26.927 INFO:tasks.workunit.client.1.smithi106.stdout:3/405: dread d5/d1c/f2b [8388608,4194304] 0 2024-05-09T06:30:26.928 INFO:tasks.workunit.client.1.smithi106.stdout:8/397: sync 2024-05-09T06:30:26.931 INFO:tasks.workunit.client.1.smithi106.stdout:8/398: mknod d3/d6b/c91 0 2024-05-09T06:30:26.932 INFO:tasks.workunit.client.1.smithi106.stdout:1/467: mknod d4/d76/d1d/cab 0 2024-05-09T06:30:26.934 INFO:tasks.workunit.client.1.smithi106.stdout:8/399: mkdir d3/d5/d35/d4e/d32/d92 0 2024-05-09T06:30:26.935 INFO:tasks.workunit.client.1.smithi106.stdout:4/410: dwrite d7/d39/f44 [0,4194304] 0 2024-05-09T06:30:26.936 INFO:tasks.workunit.client.1.smithi106.stdout:4/411: chown d7/d10/d1a/d5a/d1c/f72 0 1 2024-05-09T06:30:26.936 INFO:tasks.workunit.client.1.smithi106.stdout:4/412: truncate d7/d28/f27 4404788 0 2024-05-09T06:30:26.936 INFO:tasks.workunit.client.1.smithi106.stdout:8/400: truncate d3/d5/d35/d4e/d32/f4a 2491899 0 2024-05-09T06:30:26.937 INFO:tasks.workunit.client.1.smithi106.stdout:0/501: dwrite d1/f43 [0,4194304] 0 2024-05-09T06:30:26.937 INFO:tasks.workunit.client.1.smithi106.stdout:0/502: creat d1/d11/d23/d13/d63/d7e/fa5 x:0 0 0 2024-05-09T06:30:26.937 INFO:tasks.workunit.client.1.smithi106.stdout:0/503: fsync d1/d11/d23/d22/f6e 0 2024-05-09T06:30:26.937 INFO:tasks.workunit.client.1.smithi106.stdout:2/521: dwrite d2/f26 [8388608,4194304] 0 2024-05-09T06:30:26.939 INFO:tasks.workunit.client.1.smithi106.stdout:8/401: truncate d3/d5/d7/d15/d3e/f56 622625 0 2024-05-09T06:30:26.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/148: dwrite db/fd [0,4194304] 0 2024-05-09T06:30:26.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/149: stat c9 0 2024-05-09T06:30:26.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/150: creat db/f36 x:0 0 0 2024-05-09T06:30:26.943 INFO:tasks.workunit.client.1.smithi106.stdout:9/472: dwrite d4/d6/d1b/d2a/d42/d6c/d6d/f71 [0,4194304] 0 2024-05-09T06:30:26.943 INFO:tasks.workunit.client.1.smithi106.stdout:2/522: mknod d2/d5/db/d1d/d90/cb0 0 2024-05-09T06:30:26.943 INFO:tasks.workunit.client.1.smithi106.stdout:2/523: dread - d2/d5/db/d1d/f9b zero size 2024-05-09T06:30:26.944 INFO:tasks.workunit.client.1.smithi106.stdout:2/524: fdatasync d2/d5/db/d1d/d6a/f94 0 2024-05-09T06:30:26.944 INFO:tasks.workunit.client.1.smithi106.stdout:2/525: dread - d2/d5/db/f87 zero size 2024-05-09T06:30:26.946 INFO:tasks.workunit.client.1.smithi106.stdout:8/402: symlink d3/d5/d7/d15/l93 0 2024-05-09T06:30:26.947 INFO:tasks.workunit.client.1.smithi106.stdout:7/406: dwrite d0/dc/d1a/d36/f79 [0,4194304] 0 2024-05-09T06:30:26.947 INFO:tasks.workunit.client.1.smithi106.stdout:7/407: read - d0/dc/d1a/f62 zero size 2024-05-09T06:30:26.947 INFO:tasks.workunit.client.1.smithi106.stdout:7/408: truncate d0/f40 4964969 0 2024-05-09T06:30:26.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/151: unlink ca 0 2024-05-09T06:30:26.951 INFO:tasks.workunit.client.1.smithi106.stdout:2/526: symlink d2/d7/d62/d9a/lb1 0 2024-05-09T06:30:26.952 INFO:tasks.workunit.client.1.smithi106.stdout:2/527: readlink d2/d5/db/d1d/d23/d63/l69 0 2024-05-09T06:30:26.952 INFO:tasks.workunit.client.1.smithi106.stdout:1/468: dwrite d4/d37/d74/f86 [0,4194304] 0 2024-05-09T06:30:26.952 INFO:tasks.workunit.client.1.smithi106.stdout:3/406: dwrite d5/d1c/d24/f28 [4194304,4194304] 0 2024-05-09T06:30:26.952 INFO:tasks.workunit.client.1.smithi106.stdout:3/407: creat d5/d1c/d24/d52/f78 x:0 0 0 2024-05-09T06:30:26.953 INFO:tasks.workunit.client.1.smithi106.stdout:8/403: creat d3/d5/d35/d61/d6c/d83/d89/f94 x:0 0 0 2024-05-09T06:30:26.955 INFO:tasks.workunit.client.0.smithi046.stdout:6/152: truncate db/f27 3696666 0 2024-05-09T06:30:26.955 INFO:tasks.workunit.client.0.smithi046.stdout:6/153: read - db/f25 zero size 2024-05-09T06:30:26.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/154: creat db/d10/f37 x:0 0 0 2024-05-09T06:30:26.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/155: dread - db/d10/f37 zero size 2024-05-09T06:30:26.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/156: chown db/f18 1 1 2024-05-09T06:30:26.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/157: truncate db/f2b 550213 0 2024-05-09T06:30:26.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/158: dread - db/f28 zero size 2024-05-09T06:30:26.962 INFO:tasks.workunit.client.1.smithi106.stdout:0/504: rename d1/d11/d23/d13/d58/d79 to d1/d11/d23/da6 0 2024-05-09T06:30:26.962 INFO:tasks.workunit.client.1.smithi106.stdout:0/505: chown d1/d11/d23/l2b 1337789 1 2024-05-09T06:30:26.962 INFO:tasks.workunit.client.1.smithi106.stdout:0/506: fdatasync d1/d11/d23/da6/f7a 0 2024-05-09T06:30:26.962 INFO:tasks.workunit.client.1.smithi106.stdout:0/507: fsync d1/d11/d23/d13/d2c/d6d/f73 0 2024-05-09T06:30:26.968 INFO:tasks.workunit.client.0.smithi046.stdout:6/159: link db/d10/c34 db/d10/c38 0 2024-05-09T06:30:26.975 INFO:tasks.workunit.client.1.smithi106.stdout:7/409: dwrite d0/dc/d1a/d36/d1e/d68/f6b [0,4194304] 0 2024-05-09T06:30:26.975 INFO:tasks.workunit.client.1.smithi106.stdout:7/410: write d0/dc/d1a/d5a/f6c [280082,89793] 0 2024-05-09T06:30:26.976 INFO:tasks.workunit.client.1.smithi106.stdout:7/411: fsync d0/dc/d1a/f16 0 2024-05-09T06:30:26.976 INFO:tasks.workunit.client.1.smithi106.stdout:7/412: creat d0/dc/d1a/d36/d30/d44/d6a/f7c x:0 0 0 2024-05-09T06:30:26.976 INFO:tasks.workunit.client.1.smithi106.stdout:7/413: fsync d0/f13 0 2024-05-09T06:30:26.977 INFO:tasks.workunit.client.1.smithi106.stdout:8/404: link d3/d5/d35/d4e/l53 d3/d5/d35/d61/d82/l95 0 2024-05-09T06:30:26.977 INFO:tasks.workunit.client.1.smithi106.stdout:8/405: write d3/d5/d35/d61/f80 [1663134,40236] 0 2024-05-09T06:30:26.977 INFO:tasks.workunit.client.1.smithi106.stdout:3/408: dwrite d5/d1c/d24/f43 [0,4194304] 0 2024-05-09T06:30:26.978 INFO:tasks.workunit.client.1.smithi106.stdout:1/469: dwrite d4/d76/d1d/f3c [0,4194304] 0 2024-05-09T06:30:26.980 INFO:tasks.workunit.client.1.smithi106.stdout:9/473: rename d4/d6/d23/d2f/d31/f5c to d4/d6/d1b/d2a/d42/d6c/d6d/f81 0 2024-05-09T06:30:26.980 INFO:tasks.workunit.client.1.smithi106.stdout:2/528: rename d2/d5/db to d2/d5/db/d1d/d23/d63/db2 22 2024-05-09T06:30:26.980 INFO:tasks.workunit.client.1.smithi106.stdout:2/529: fsync d2/d5/db/d1d/f3d 0 2024-05-09T06:30:26.980 INFO:tasks.workunit.client.1.smithi106.stdout:2/530: creat d2/d5/db/d1d/fb3 x:0 0 0 2024-05-09T06:30:26.980 INFO:tasks.workunit.client.1.smithi106.stdout:2/531: chown d2/d5/db/d1d/f4a 1185 1 2024-05-09T06:30:26.986 INFO:tasks.workunit.client.1.smithi106.stdout:7/414: mknod d0/dc/d1a/d36/d30/d44/d58/c7d 0 2024-05-09T06:30:26.988 INFO:tasks.workunit.client.1.smithi106.stdout:8/406: dread d3/d5/d7/d15/d47/f62 [0,4194304] 0 2024-05-09T06:30:26.988 INFO:tasks.workunit.client.1.smithi106.stdout:1/470: write d4/d76/d13/f25 [442717,115035] 0 2024-05-09T06:30:26.991 INFO:tasks.workunit.client.1.smithi106.stdout:0/508: dwrite d1/d11/d23/da6/f7b [0,4194304] 0 2024-05-09T06:30:26.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/160: dwrite db/fd [0,4194304] 0 2024-05-09T06:30:26.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/161: unlink c9 0 2024-05-09T06:30:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/162: symlink db/d10/d30/l39 0 2024-05-09T06:30:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/163: read - db/f28 zero size 2024-05-09T06:30:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/164: readlink db/d10/d19/d1d/l31 0 2024-05-09T06:30:27.004 INFO:tasks.workunit.client.1.smithi106.stdout:9/474: rmdir d4/d54/d69/d70 0 2024-05-09T06:30:27.004 INFO:tasks.workunit.client.0.smithi046.stdout:6/165: symlink db/d10/l3a 0 2024-05-09T06:30:27.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/532: mknod d2/d5/cb4 0 2024-05-09T06:30:27.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/533: stat d2/d7/d89/cac 0 2024-05-09T06:30:27.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/534: creat d2/d5/db/d1d/d23/d63/fb5 x:0 0 0 2024-05-09T06:30:27.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/535: read d2/f5f [402470,101552] 0 2024-05-09T06:30:27.008 INFO:tasks.workunit.client.1.smithi106.stdout:2/536: dread - d2/d7/fad zero size 2024-05-09T06:30:27.008 INFO:tasks.workunit.client.1.smithi106.stdout:2/537: stat d2/f5f 0 2024-05-09T06:30:27.008 INFO:tasks.workunit.client.1.smithi106.stdout:2/538: fdatasync d2/d7/d2c/f42 0 2024-05-09T06:30:27.008 INFO:tasks.workunit.client.1.smithi106.stdout:4/413: truncate d7/d10/d1a/d5a/d7a/f7e 501177 0 2024-05-09T06:30:27.010 INFO:tasks.workunit.client.1.smithi106.stdout:7/415: unlink d0/dc/c61 0 2024-05-09T06:30:27.013 INFO:tasks.workunit.client.1.smithi106.stdout:8/407: mknod d3/d5/d35/d61/c96 0 2024-05-09T06:30:27.017 INFO:tasks.workunit.client.1.smithi106.stdout:8/408: fdatasync d3/d5/d35/d61/f80 0 2024-05-09T06:30:27.017 INFO:tasks.workunit.client.1.smithi106.stdout:2/539: dread d2/d7/d2c/f80 [0,4194304] 0 2024-05-09T06:30:27.018 INFO:tasks.workunit.client.1.smithi106.stdout:3/409: getdents d5/d1c 0 2024-05-09T06:30:27.021 INFO:tasks.workunit.client.1.smithi106.stdout:7/416: dread d0/fe [0,4194304] 0 2024-05-09T06:30:27.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/166: dwrite db/d10/f16 [4194304,4194304] 0 2024-05-09T06:30:27.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/167: fsync db/f18 0 2024-05-09T06:30:27.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/168: truncate db/f28 663021 0 2024-05-09T06:30:27.024 INFO:tasks.workunit.client.1.smithi106.stdout:0/509: creat d1/fa7 x:0 0 0 2024-05-09T06:30:27.026 INFO:tasks.workunit.client.1.smithi106.stdout:9/475: creat d4/d6/d23/d78/f82 x:0 0 0 2024-05-09T06:30:27.031 INFO:tasks.workunit.client.0.smithi046.stdout:6/169: symlink db/d10/l3b 0 2024-05-09T06:30:27.031 INFO:tasks.workunit.client.0.smithi046.stdout:6/170: chown db/d10/d19/d1d/c21 2921632 1 2024-05-09T06:30:27.033 INFO:tasks.workunit.client.1.smithi106.stdout:4/414: creat d7/d10/d1a/d5a/d7a/f83 x:0 0 0 2024-05-09T06:30:27.034 INFO:tasks.workunit.client.1.smithi106.stdout:1/471: getdents d4/d5 0 2024-05-09T06:30:27.034 INFO:tasks.workunit.client.1.smithi106.stdout:1/472: dread - d4/d37/d3d/f40 zero size 2024-05-09T06:30:27.035 INFO:tasks.workunit.client.1.smithi106.stdout:6/457: sync 2024-05-09T06:30:27.035 INFO:tasks.workunit.client.1.smithi106.stdout:5/441: sync 2024-05-09T06:30:27.035 INFO:tasks.workunit.client.1.smithi106.stdout:9/476: dread d4/d6/d23/d2f/d31/f46 [0,4194304] 0 2024-05-09T06:30:27.035 INFO:tasks.workunit.client.1.smithi106.stdout:9/477: chown d4/c48 251 1 2024-05-09T06:30:27.035 INFO:tasks.workunit.client.1.smithi106.stdout:5/442: write d8/d45/d4c/d32/d5b/f24 [5184924,62895] 0 2024-05-09T06:30:27.036 INFO:tasks.workunit.client.0.smithi046.stdout:6/171: mkdir db/d10/d3c 0 2024-05-09T06:30:27.036 INFO:tasks.workunit.client.0.smithi046.stdout:6/172: fsync f6 0 2024-05-09T06:30:27.037 INFO:tasks.workunit.client.1.smithi106.stdout:8/409: getdents d3/d5/d7/d58 0 2024-05-09T06:30:27.039 INFO:tasks.workunit.client.1.smithi106.stdout:2/540: mknod d2/d5/db/d1d/d90/cb6 0 2024-05-09T06:30:27.040 INFO:tasks.workunit.client.1.smithi106.stdout:7/417: truncate d0/dc/d1a/d36/d30/f26 2748462 0 2024-05-09T06:30:27.042 INFO:tasks.workunit.client.1.smithi106.stdout:0/510: mkdir d1/d11/d23/d13/d58/da8 0 2024-05-09T06:30:27.043 INFO:tasks.workunit.client.1.smithi106.stdout:1/473: read d4/d76/d1d/f3c [3335709,32486] 0 2024-05-09T06:30:27.043 INFO:tasks.workunit.client.1.smithi106.stdout:4/415: creat d7/d10/d1a/d5a/d7a/d7f/f84 x:0 0 0 2024-05-09T06:30:27.043 INFO:tasks.workunit.client.1.smithi106.stdout:4/416: creat d7/d10/d1a/f85 x:0 0 0 2024-05-09T06:30:27.043 INFO:tasks.workunit.client.1.smithi106.stdout:4/417: truncate d7/d10/d1a/d5a/d1c/f2c 590831 0 2024-05-09T06:30:27.044 INFO:tasks.workunit.client.1.smithi106.stdout:6/458: symlink d0/d17/d34/d72/l9a 0 2024-05-09T06:30:27.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/173: dread db/d10/d19/f20 [0,4194304] 0 2024-05-09T06:30:27.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/174: rename db/d10 to db/d10/d30/d3d 22 2024-05-09T06:30:27.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/175: stat db/d10/d19/d1d/f33 0 2024-05-09T06:30:27.050 INFO:tasks.workunit.client.1.smithi106.stdout:9/478: rename d4/d6/d1b/c36 to d4/d6/c83 0 2024-05-09T06:30:27.050 INFO:tasks.workunit.client.1.smithi106.stdout:9/479: creat d4/d6/d23/d2f/d38/d68/f84 x:0 0 0 2024-05-09T06:30:27.051 INFO:tasks.workunit.client.0.smithi046.stdout:6/176: mknod db/c3e 0 2024-05-09T06:30:27.055 INFO:tasks.workunit.client.1.smithi106.stdout:5/443: rmdir d8/d33/d3a/d77 0 2024-05-09T06:30:27.055 INFO:tasks.workunit.client.1.smithi106.stdout:5/444: write d8/f5f [214397,92088] 0 2024-05-09T06:30:27.055 INFO:tasks.workunit.client.1.smithi106.stdout:0/511: write d1/d11/d23/d13/d58/f80 [1298967,9962] 0 2024-05-09T06:30:27.055 INFO:tasks.workunit.client.1.smithi106.stdout:0/512: dread - d1/d11/d23/d13/d63/d7e/fa5 zero size 2024-05-09T06:30:27.056 INFO:tasks.workunit.client.1.smithi106.stdout:8/410: rmdir d3/d5/d7/d58 39 2024-05-09T06:30:27.058 INFO:tasks.workunit.client.1.smithi106.stdout:1/474: creat d4/d76/d13/d60/fac x:0 0 0 2024-05-09T06:30:27.059 INFO:tasks.workunit.client.1.smithi106.stdout:0/513: dread d1/d11/d23/d22/f6e [0,4194304] 0 2024-05-09T06:30:27.061 INFO:tasks.workunit.client.1.smithi106.stdout:6/459: dwrite d0/d17/f1e [0,4194304] 0 2024-05-09T06:30:27.061 INFO:tasks.workunit.client.1.smithi106.stdout:6/460: dread - d0/d17/d34/d72/f93 zero size 2024-05-09T06:30:27.067 INFO:tasks.workunit.client.1.smithi106.stdout:8/411: dread d3/d5/d13/f2e [0,4194304] 0 2024-05-09T06:30:27.067 INFO:tasks.workunit.client.1.smithi106.stdout:8/412: creat d3/d5/d35/d4e/d32/f97 x:0 0 0 2024-05-09T06:30:27.067 INFO:tasks.workunit.client.1.smithi106.stdout:9/480: creat d4/d54/d69/f85 x:0 0 0 2024-05-09T06:30:27.067 INFO:tasks.workunit.client.1.smithi106.stdout:5/445: creat d8/d33/d6c/f89 x:0 0 0 2024-05-09T06:30:27.068 INFO:tasks.workunit.client.1.smithi106.stdout:1/475: unlink d4/d5/f7 0 2024-05-09T06:30:27.068 INFO:tasks.workunit.client.1.smithi106.stdout:1/476: stat d4/d5b/d75/l91 0 2024-05-09T06:30:27.071 INFO:tasks.workunit.client.1.smithi106.stdout:4/418: dwrite d7/d10/d1a/d5a/d1c/f49 [0,4194304] 0 2024-05-09T06:30:27.071 INFO:tasks.workunit.client.1.smithi106.stdout:4/419: stat d7/d10/d1a/d5a/d46 0 2024-05-09T06:30:27.074 INFO:tasks.workunit.client.1.smithi106.stdout:9/481: mkdir d4/d6/d23/d2f/d38/d86 0 2024-05-09T06:30:27.076 INFO:tasks.workunit.client.1.smithi106.stdout:8/413: dread d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:27.076 INFO:tasks.workunit.client.1.smithi106.stdout:1/477: mkdir d4/d76/d65/d8d/dad 0 2024-05-09T06:30:27.079 INFO:tasks.workunit.client.1.smithi106.stdout:0/514: getdents d1/d11 0 2024-05-09T06:30:27.082 INFO:tasks.workunit.client.0.smithi046.stdout:6/177: dwrite db/f28 [0,4194304] 0 2024-05-09T06:30:27.082 INFO:tasks.workunit.client.0.smithi046.stdout:6/178: chown db 0 1 2024-05-09T06:30:27.084 INFO:tasks.workunit.client.1.smithi106.stdout:4/420: creat d7/d10/d1a/d5a/f86 x:0 0 0 2024-05-09T06:30:27.085 INFO:tasks.workunit.client.1.smithi106.stdout:2/541: rename d2/d5/db/d15/d4f to d2/d7/db7 0 2024-05-09T06:30:27.088 INFO:tasks.workunit.client.1.smithi106.stdout:8/414: mkdir d3/d5/d7/d98 0 2024-05-09T06:30:27.091 INFO:tasks.workunit.client.1.smithi106.stdout:4/421: creat d7/d39/d47/d66/f87 x:0 0 0 2024-05-09T06:30:27.095 INFO:tasks.workunit.client.1.smithi106.stdout:7/418: rename d0/dc/f14 to d0/dc/d1a/d36/d30/d44/f7e 0 2024-05-09T06:30:27.095 INFO:tasks.workunit.client.1.smithi106.stdout:7/419: fsync d0/dc/d1a/d36/d1e/f5d 0 2024-05-09T06:30:27.096 INFO:tasks.workunit.client.1.smithi106.stdout:8/415: symlink d3/d5/d7/d58/l99 0 2024-05-09T06:30:27.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/179: dread db/f28 [0,4194304] 0 2024-05-09T06:30:27.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/180: readlink db/l12 0 2024-05-09T06:30:27.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/181: stat db/f28 0 2024-05-09T06:30:27.097 INFO:tasks.workunit.client.1.smithi106.stdout:6/461: dwrite d0/d17/d34/d5f/d8/f6e [0,4194304] 0 2024-05-09T06:30:27.098 INFO:tasks.workunit.client.1.smithi106.stdout:9/482: dwrite d4/f3d [4194304,4194304] 0 2024-05-09T06:30:27.100 INFO:tasks.workunit.client.1.smithi106.stdout:5/446: rename l4 to d8/d5a/d60/l8a 0 2024-05-09T06:30:27.100 INFO:tasks.workunit.client.1.smithi106.stdout:5/447: readlink d8/d33/l43 0 2024-05-09T06:30:27.101 INFO:tasks.workunit.client.1.smithi106.stdout:5/448: chown d8/d33/d6c 43549 1 2024-05-09T06:30:27.102 INFO:tasks.workunit.client.1.smithi106.stdout:4/422: write d7/d39/f3f [1389977,65538] 0 2024-05-09T06:30:27.104 INFO:tasks.workunit.client.1.smithi106.stdout:7/420: creat d0/dc/d1a/d36/d30/d44/f7f x:0 0 0 2024-05-09T06:30:27.104 INFO:tasks.workunit.client.1.smithi106.stdout:8/416: write d3/d5/d35/f68 [874889,50255] 0 2024-05-09T06:30:27.104 INFO:tasks.workunit.client.1.smithi106.stdout:8/417: write d3/d5/d35/d4e/f3b [702772,7822] 0 2024-05-09T06:30:27.104 INFO:tasks.workunit.client.1.smithi106.stdout:8/418: creat d3/d5/d35/d4e/d32/f9a x:0 0 0 2024-05-09T06:30:27.108 INFO:tasks.workunit.client.1.smithi106.stdout:6/462: stat d0/d5c/l8d 0 2024-05-09T06:30:27.108 INFO:tasks.workunit.client.1.smithi106.stdout:6/463: creat d0/d17/d76/f9b x:0 0 0 2024-05-09T06:30:27.111 INFO:tasks.workunit.client.1.smithi106.stdout:9/483: mknod d4/d6/d1b/d2a/d61/c87 0 2024-05-09T06:30:27.112 INFO:tasks.workunit.client.1.smithi106.stdout:0/515: rename d1/d11/d23/d22/f6e to d1/d11/d23/d13/d2c/d6d/d70/fa9 0 2024-05-09T06:30:27.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/484: dread d4/d54/f5f [0,4194304] 0 2024-05-09T06:30:27.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/485: creat d4/d6/d23/d2f/d39/f88 x:0 0 0 2024-05-09T06:30:27.115 INFO:tasks.workunit.client.1.smithi106.stdout:9/486: fsync d4/d6/d23/d2f/d38/d68/f84 0 2024-05-09T06:30:27.117 INFO:tasks.workunit.client.1.smithi106.stdout:4/423: symlink d7/l88 0 2024-05-09T06:30:27.120 INFO:tasks.workunit.client.0.smithi046.stdout:6/182: truncate db/d10/f16 876460 0 2024-05-09T06:30:27.122 INFO:tasks.workunit.client.1.smithi106.stdout:7/421: rmdir d0/dc/d1a/d36/d30 39 2024-05-09T06:30:27.122 INFO:tasks.workunit.client.1.smithi106.stdout:7/422: fdatasync d0/dc/d1a/d36/d30/d44/d58/f5f 0 2024-05-09T06:30:27.125 INFO:tasks.workunit.client.1.smithi106.stdout:6/464: dwrite d0/d5c/f7b [0,4194304] 0 2024-05-09T06:30:27.127 INFO:tasks.workunit.client.1.smithi106.stdout:8/419: mkdir d3/d5/d35/d61/d6c/d83/d89/d9b 0 2024-05-09T06:30:27.128 INFO:tasks.workunit.client.1.smithi106.stdout:8/420: fsync d3/d5/d35/d73/f4f 0 2024-05-09T06:30:27.129 INFO:tasks.workunit.client.1.smithi106.stdout:9/487: dwrite d4/d6/d23/d2f/d39/f60 [0,4194304] 0 2024-05-09T06:30:27.131 INFO:tasks.workunit.client.1.smithi106.stdout:7/423: write d0/dc/d1a/d36/d1e/f5d [3640420,124112] 0 2024-05-09T06:30:27.131 INFO:tasks.workunit.client.1.smithi106.stdout:7/424: read d0/dc/f69 [34873,69307] 0 2024-05-09T06:30:27.133 INFO:tasks.workunit.client.0.smithi046.stdout:6/183: rename db/d10/d19/d1d to db/d10/d3f 0 2024-05-09T06:30:27.138 INFO:tasks.workunit.client.0.smithi046.stdout:6/184: symlink db/d10/d30/l40 0 2024-05-09T06:30:27.141 INFO:tasks.workunit.client.1.smithi106.stdout:2/542: rename d2/d5/db/d68/f71 to d2/d5/fb8 0 2024-05-09T06:30:27.142 INFO:tasks.workunit.client.1.smithi106.stdout:2/543: chown d2/d7/l67 12 1 2024-05-09T06:30:27.142 INFO:tasks.workunit.client.1.smithi106.stdout:2/544: dread - d2/d5/db/d1d/d23/d63/fae zero size 2024-05-09T06:30:27.142 INFO:tasks.workunit.client.1.smithi106.stdout:6/465: mkdir d0/d17/d34/d5f/d8/d9c 0 2024-05-09T06:30:27.143 INFO:tasks.workunit.client.1.smithi106.stdout:8/421: symlink d3/l9c 0 2024-05-09T06:30:27.147 INFO:tasks.workunit.client.1.smithi106.stdout:7/425: mkdir d0/dc/d1a/d36/d30/d44/d80 0 2024-05-09T06:30:27.147 INFO:tasks.workunit.client.1.smithi106.stdout:7/426: creat d0/dc/d1a/f81 x:0 0 0 2024-05-09T06:30:27.147 INFO:tasks.workunit.client.0.smithi046.stdout:6/185: dread db/d10/d19/f1b [0,4194304] 0 2024-05-09T06:30:27.149 INFO:tasks.workunit.client.1.smithi106.stdout:5/449: rename d8/f18 to d8/d33/d6c/f8b 0 2024-05-09T06:30:27.149 INFO:tasks.workunit.client.1.smithi106.stdout:9/488: dwrite d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:27.150 INFO:tasks.workunit.client.1.smithi106.stdout:9/489: creat d4/d6/d23/d2f/d39/f89 x:0 0 0 2024-05-09T06:30:27.150 INFO:tasks.workunit.client.1.smithi106.stdout:2/545: unlink d2/d5/db/l5a 0 2024-05-09T06:30:27.150 INFO:tasks.workunit.client.1.smithi106.stdout:2/546: fsync d2/d5/db/d1d/d23/d63/fb5 0 2024-05-09T06:30:27.152 INFO:tasks.workunit.client.0.smithi046.stdout:6/186: symlink db/d10/d3c/l41 0 2024-05-09T06:30:27.154 INFO:tasks.workunit.client.1.smithi106.stdout:6/466: creat d0/d17/d34/f9d x:0 0 0 2024-05-09T06:30:27.154 INFO:tasks.workunit.client.1.smithi106.stdout:8/422: write d3/d5/d13/f1b [3715790,100255] 0 2024-05-09T06:30:27.155 INFO:tasks.workunit.client.1.smithi106.stdout:8/423: truncate d3/d5/d13/d3a/f77 4213894 0 2024-05-09T06:30:27.160 INFO:tasks.workunit.client.1.smithi106.stdout:8/424: dread d3/d5/d7/d15/d47/f62 [0,4194304] 0 2024-05-09T06:30:27.161 INFO:tasks.workunit.client.1.smithi106.stdout:0/516: rename d1/c40 to d1/d11/d23/d22/caa 0 2024-05-09T06:30:27.161 INFO:tasks.workunit.client.1.smithi106.stdout:0/517: creat d1/d11/d23/d22/fab x:0 0 0 2024-05-09T06:30:27.163 INFO:tasks.workunit.client.1.smithi106.stdout:8/425: dread d3/d5/d35/d4e/f3b [0,4194304] 0 2024-05-09T06:30:27.163 INFO:tasks.workunit.client.1.smithi106.stdout:8/426: write d3/d5/f3c [496683,64252] 0 2024-05-09T06:30:27.166 INFO:tasks.workunit.client.1.smithi106.stdout:9/490: unlink d4/d6/d1b/d2a/d42/d6c/d6d/f71 0 2024-05-09T06:30:27.167 INFO:tasks.workunit.client.1.smithi106.stdout:6/467: symlink d0/d66/l9e 0 2024-05-09T06:30:27.170 INFO:tasks.workunit.client.1.smithi106.stdout:7/427: mknod d0/c82 0 2024-05-09T06:30:27.172 INFO:tasks.workunit.client.1.smithi106.stdout:5/450: rename d8/d33/d6c/f89 to d8/d45/d4c/d32/d5b/f8c 0 2024-05-09T06:30:27.186 INFO:tasks.workunit.client.1.smithi106.stdout:0/518: dwrite d1/d11/d23/d13/f5c [0,4194304] 0 2024-05-09T06:30:27.190 INFO:tasks.workunit.client.1.smithi106.stdout:7/428: dwrite d0/dc/f31 [0,4194304] 0 2024-05-09T06:30:27.190 INFO:tasks.workunit.client.1.smithi106.stdout:7/429: creat d0/dc/d1a/f83 x:0 0 0 2024-05-09T06:30:27.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/491: unlink d4/d6/d1b/d2a/d61/c87 0 2024-05-09T06:30:27.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/492: truncate d4/d6/d1b/d2a/d42/f57 117378 0 2024-05-09T06:30:27.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/493: write d4/d54/f5f [1410212,86732] 0 2024-05-09T06:30:27.221 INFO:tasks.workunit.client.1.smithi106.stdout:6/468: mkdir d0/d66/d7e/d9f 0 2024-05-09T06:30:27.221 INFO:tasks.workunit.client.1.smithi106.stdout:6/469: write d0/d17/d76/f99 [831263,121418] 0 2024-05-09T06:30:27.221 INFO:tasks.workunit.client.1.smithi106.stdout:6/470: getdents d0/d17/d34/d5f/d8/d9c 0 2024-05-09T06:30:27.223 INFO:tasks.workunit.client.1.smithi106.stdout:5/451: link d8/l66 d8/d45/d4c/d32/l8d 0 2024-05-09T06:30:27.224 INFO:tasks.workunit.client.1.smithi106.stdout:0/519: truncate d1/d11/d23/d22/f4e 3117733 0 2024-05-09T06:30:27.224 INFO:tasks.workunit.client.1.smithi106.stdout:0/520: fdatasync d1/d11/d23/d22/f74 0 2024-05-09T06:30:27.227 INFO:tasks.workunit.client.1.smithi106.stdout:3/410: sync 2024-05-09T06:30:27.228 INFO:tasks.workunit.client.1.smithi106.stdout:3/411: write d5/d1c/f33 [1443079,18472] 0 2024-05-09T06:30:27.228 INFO:tasks.workunit.client.1.smithi106.stdout:3/412: chown d5/fe 11 1 2024-05-09T06:30:27.231 INFO:tasks.workunit.client.1.smithi106.stdout:8/427: getdents d3/d5/d13 0 2024-05-09T06:30:27.233 INFO:tasks.workunit.client.1.smithi106.stdout:9/494: mknod d4/c8a 0 2024-05-09T06:30:27.235 INFO:tasks.workunit.client.1.smithi106.stdout:9/495: dread d4/d6/d1b/d2a/f56 [0,4194304] 0 2024-05-09T06:30:27.235 INFO:tasks.workunit.client.1.smithi106.stdout:6/471: rename d0/d5c/f7f to d0/d66/fa0 0 2024-05-09T06:30:27.236 INFO:tasks.workunit.client.1.smithi106.stdout:6/472: creat d0/d66/d7e/fa1 x:0 0 0 2024-05-09T06:30:27.237 INFO:tasks.workunit.client.1.smithi106.stdout:5/452: mknod d8/d33/d3a/c8e 0 2024-05-09T06:30:27.238 INFO:tasks.workunit.client.1.smithi106.stdout:0/521: creat d1/d11/d23/da6/fac x:0 0 0 2024-05-09T06:30:27.241 INFO:tasks.workunit.client.1.smithi106.stdout:3/413: mknod d5/d4d/d5f/c79 0 2024-05-09T06:30:27.241 INFO:tasks.workunit.client.1.smithi106.stdout:3/414: fdatasync d5/f63 0 2024-05-09T06:30:27.242 INFO:tasks.workunit.client.1.smithi106.stdout:8/428: mkdir d3/d5/d35/d73/d9d 0 2024-05-09T06:30:27.243 INFO:tasks.workunit.client.1.smithi106.stdout:9/496: mknod d4/d54/c8b 0 2024-05-09T06:30:27.248 INFO:tasks.workunit.client.1.smithi106.stdout:0/522: rmdir d1/d11/d23/d13/d8a 39 2024-05-09T06:30:27.249 INFO:tasks.workunit.client.1.smithi106.stdout:8/429: write d3/d5/d7/d15/d47/f62 [3956556,94899] 0 2024-05-09T06:30:27.249 INFO:tasks.workunit.client.1.smithi106.stdout:8/430: creat d3/d5/d13/d3a/f9e x:0 0 0 2024-05-09T06:30:27.249 INFO:tasks.workunit.client.1.smithi106.stdout:8/431: chown d3/l6e 3 1 2024-05-09T06:30:27.253 INFO:tasks.workunit.client.1.smithi106.stdout:9/497: unlink d4/d6/d23/d16/f3b 0 2024-05-09T06:30:27.255 INFO:tasks.workunit.client.1.smithi106.stdout:0/523: write d1/f43 [3144201,11855] 0 2024-05-09T06:30:27.255 INFO:tasks.workunit.client.1.smithi106.stdout:0/524: dread - d1/d11/d23/da6/f9b zero size 2024-05-09T06:30:27.258 INFO:tasks.workunit.client.1.smithi106.stdout:6/473: rmdir d0/d17/d34 39 2024-05-09T06:30:27.259 INFO:tasks.workunit.client.1.smithi106.stdout:6/474: read d0/d66/fa0 [124675,57189] 0 2024-05-09T06:30:27.259 INFO:tasks.workunit.client.1.smithi106.stdout:5/453: rmdir d8/d33/d3a 39 2024-05-09T06:30:27.259 INFO:tasks.workunit.client.1.smithi106.stdout:5/454: truncate d8/d5a/f73 666950 0 2024-05-09T06:30:27.260 INFO:tasks.workunit.client.1.smithi106.stdout:1/478: sync 2024-05-09T06:30:27.263 INFO:tasks.workunit.client.1.smithi106.stdout:8/432: symlink d3/d5/l9f 0 2024-05-09T06:30:27.263 INFO:tasks.workunit.client.1.smithi106.stdout:8/433: fdatasync d3/d5/d35/d61/d6c/d83/f8f 0 2024-05-09T06:30:27.264 INFO:tasks.workunit.client.1.smithi106.stdout:3/415: getdents d5/d1c/d24 0 2024-05-09T06:30:27.266 INFO:tasks.workunit.client.1.smithi106.stdout:6/475: write d0/d17/d34/d5f/d8/f6e [1901976,99604] 0 2024-05-09T06:30:27.272 INFO:tasks.workunit.client.1.smithi106.stdout:0/525: dwrite d1/d11/d23/d22/fab [0,4194304] 0 2024-05-09T06:30:27.272 INFO:tasks.workunit.client.1.smithi106.stdout:0/526: chown d1/d11/d23/c32 2514193 1 2024-05-09T06:30:27.275 INFO:tasks.workunit.client.1.smithi106.stdout:1/479: creat d4/da7/fae x:0 0 0 2024-05-09T06:30:27.275 INFO:tasks.workunit.client.1.smithi106.stdout:2/547: sync 2024-05-09T06:30:27.275 INFO:tasks.workunit.client.1.smithi106.stdout:4/424: sync 2024-05-09T06:30:27.276 INFO:tasks.workunit.client.1.smithi106.stdout:8/434: truncate d3/d5/d7/f60 2660687 0 2024-05-09T06:30:27.277 INFO:tasks.workunit.client.1.smithi106.stdout:6/476: symlink d0/d17/d34/d95/la2 0 2024-05-09T06:30:27.277 INFO:tasks.workunit.client.1.smithi106.stdout:6/477: getdents d0/d66/d7e/d9f 0 2024-05-09T06:30:27.282 INFO:tasks.workunit.client.1.smithi106.stdout:9/498: creat d4/d6/d23/d2f/d38/d86/f8c x:0 0 0 2024-05-09T06:30:27.282 INFO:tasks.workunit.client.1.smithi106.stdout:9/499: write d4/d6/d23/d2f/d39/f88 [862616,63187] 0 2024-05-09T06:30:27.283 INFO:tasks.workunit.client.1.smithi106.stdout:5/455: getdents d8/d45 0 2024-05-09T06:30:27.284 INFO:tasks.workunit.client.1.smithi106.stdout:1/480: rmdir d4/d76/d65/d67 39 2024-05-09T06:30:27.286 INFO:tasks.workunit.client.1.smithi106.stdout:4/425: mkdir d7/d39/d47/d89 0 2024-05-09T06:30:27.287 INFO:tasks.workunit.client.1.smithi106.stdout:4/426: write d7/d39/d35/f76 [166994,129004] 0 2024-05-09T06:30:27.287 INFO:tasks.workunit.client.1.smithi106.stdout:2/548: symlink d2/d5/db/d15/d41/d60/lb9 0 2024-05-09T06:30:27.289 INFO:tasks.workunit.client.1.smithi106.stdout:8/435: creat d3/d5/d7/d15/d3e/d7d/fa0 x:0 0 0 2024-05-09T06:30:27.289 INFO:tasks.workunit.client.1.smithi106.stdout:8/436: write d3/d5/d7/f44 [1935321,105064] 0 2024-05-09T06:30:27.289 INFO:tasks.workunit.client.1.smithi106.stdout:8/437: dread - d3/d5/d13/d3a/f90 zero size 2024-05-09T06:30:27.290 INFO:tasks.workunit.client.1.smithi106.stdout:5/456: read d8/d45/f55 [1872974,97691] 0 2024-05-09T06:30:27.291 INFO:tasks.workunit.client.1.smithi106.stdout:6/478: symlink d0/d5c/la3 0 2024-05-09T06:30:27.291 INFO:tasks.workunit.client.1.smithi106.stdout:9/500: stat d4/d6/d23/d2f/d38/f40 0 2024-05-09T06:30:27.291 INFO:tasks.workunit.client.1.smithi106.stdout:9/501: fsync d4/d6/d1b/f65 0 2024-05-09T06:30:27.291 INFO:tasks.workunit.client.1.smithi106.stdout:9/502: chown d4/d6/d1b/d2a/d42/d6c 63211 1 2024-05-09T06:30:27.291 INFO:tasks.workunit.client.1.smithi106.stdout:4/427: rename d7/d28/l5e to d7/d39/d47/d66/l8a 0 2024-05-09T06:30:27.292 INFO:tasks.workunit.client.1.smithi106.stdout:9/503: rename d4/d6/d1b/d2a to d4/d6/d1b/d2a/d42/d6c/d8d 22 2024-05-09T06:30:27.293 INFO:tasks.workunit.client.1.smithi106.stdout:2/549: creat d2/d5/db/d1d/d23/d63/d7a/fba x:0 0 0 2024-05-09T06:30:27.294 INFO:tasks.workunit.client.1.smithi106.stdout:8/438: mkdir d3/d5/d35/d61/d82/da1 0 2024-05-09T06:30:27.295 INFO:tasks.workunit.client.1.smithi106.stdout:5/457: mknod d8/d45/d4c/c8f 0 2024-05-09T06:30:27.296 INFO:tasks.workunit.client.1.smithi106.stdout:4/428: rename d7/f41 to d7/d39/d35/f8b 0 2024-05-09T06:30:27.298 INFO:tasks.workunit.client.1.smithi106.stdout:9/504: symlink d4/d6/d1b/d2a/d42/d6c/l8e 0 2024-05-09T06:30:27.298 INFO:tasks.workunit.client.1.smithi106.stdout:9/505: dread - d4/d6/d23/f6e zero size 2024-05-09T06:30:27.298 INFO:tasks.workunit.client.1.smithi106.stdout:2/550: mknod d2/d5/cbb 0 2024-05-09T06:30:27.299 INFO:tasks.workunit.client.1.smithi106.stdout:5/458: getdents d8/d45/d4c/d32 0 2024-05-09T06:30:27.300 INFO:tasks.workunit.client.1.smithi106.stdout:5/459: dread - d8/d5a/d60/f75 zero size 2024-05-09T06:30:27.303 INFO:tasks.workunit.client.1.smithi106.stdout:4/429: truncate d7/d10/d1a/d5a/d1c/f49 2803583 0 2024-05-09T06:30:27.303 INFO:tasks.workunit.client.1.smithi106.stdout:4/430: stat d7/d39/d35/d4a 0 2024-05-09T06:30:27.303 INFO:tasks.workunit.client.1.smithi106.stdout:9/506: mkdir d4/d6/d23/d78/d8f 0 2024-05-09T06:30:27.304 INFO:tasks.workunit.client.1.smithi106.stdout:2/551: mknod d2/d5/d9c/cbc 0 2024-05-09T06:30:27.305 INFO:tasks.workunit.client.1.smithi106.stdout:5/460: mknod d8/d45/c90 0 2024-05-09T06:30:27.307 INFO:tasks.workunit.client.1.smithi106.stdout:5/461: getdents d8/d5a/d60 0 2024-05-09T06:30:27.309 INFO:tasks.workunit.client.1.smithi106.stdout:6/479: dwrite d0/d17/f1e [0,4194304] 0 2024-05-09T06:30:27.309 INFO:tasks.workunit.client.1.smithi106.stdout:6/480: write d0/f8a [4278246,45947] 0 2024-05-09T06:30:27.310 INFO:tasks.workunit.client.1.smithi106.stdout:4/431: write d7/d39/d35/f76 [170950,46253] 0 2024-05-09T06:30:27.315 INFO:tasks.workunit.client.1.smithi106.stdout:2/552: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:27.317 INFO:tasks.workunit.client.1.smithi106.stdout:6/481: link d0/d17/d34/d5f/d8/d27/d3b/d62/f83 d0/d17/d34/d95/fa4 0 2024-05-09T06:30:27.318 INFO:tasks.workunit.client.1.smithi106.stdout:5/462: read d8/d33/d3a/d59/f68 [173704,105703] 0 2024-05-09T06:30:27.320 INFO:tasks.workunit.client.1.smithi106.stdout:4/432: mkdir d7/d39/d8c 0 2024-05-09T06:30:27.320 INFO:tasks.workunit.client.1.smithi106.stdout:4/433: dread - d7/d10/d1a/f5b zero size 2024-05-09T06:30:27.321 INFO:tasks.workunit.client.1.smithi106.stdout:2/553: rename d2/d5/db/d15/f72 to d2/d5/db/d1d/d90/fbd 0 2024-05-09T06:30:27.321 INFO:tasks.workunit.client.1.smithi106.stdout:2/554: truncate d2/d5/db/d1d/d90/faa 72449 0 2024-05-09T06:30:27.322 INFO:tasks.workunit.client.1.smithi106.stdout:2/555: stat d2/d5/db/d1d/d6a/f94 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:6/482: symlink d0/d17/d34/d5f/la5 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:6/483: fsync d0/f30 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:6/484: write d0/d66/d7e/f26 [8972374,110015] 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:6/485: truncate d0/d17/d34/f9d 712419 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:4/434: creat d7/d39/d8c/f8d x:0 0 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:4/435: write d7/d28/f27 [1976119,81265] 0 2024-05-09T06:30:27.324 INFO:tasks.workunit.client.1.smithi106.stdout:4/436: creat d7/d10/d1a/d5a/d7a/f8e x:0 0 0 2024-05-09T06:30:27.325 INFO:tasks.workunit.client.1.smithi106.stdout:5/463: rename d8/d33/l49 to d8/l91 0 2024-05-09T06:30:27.325 INFO:tasks.workunit.client.1.smithi106.stdout:5/464: chown d8/f51 40121 1 2024-05-09T06:30:27.326 INFO:tasks.workunit.client.1.smithi106.stdout:9/507: dwrite d4/d6/fa [0,4194304] 0 2024-05-09T06:30:27.326 INFO:tasks.workunit.client.1.smithi106.stdout:2/556: mkdir d2/d5/db/d1d/d23/d5e/dbe 0 2024-05-09T06:30:27.328 INFO:tasks.workunit.client.1.smithi106.stdout:8/439: dwrite d3/d6b/f79 [0,4194304] 0 2024-05-09T06:30:27.335 INFO:tasks.workunit.client.1.smithi106.stdout:4/437: unlink d7/d10/d1a/d5a/d7a/f7e 0 2024-05-09T06:30:27.338 INFO:tasks.workunit.client.1.smithi106.stdout:5/465: symlink d8/l92 0 2024-05-09T06:30:27.339 INFO:tasks.workunit.client.1.smithi106.stdout:6/486: dwrite d0/d17/d34/d5f/d8/f70 [0,4194304] 0 2024-05-09T06:30:27.340 INFO:tasks.workunit.client.1.smithi106.stdout:9/508: unlink d4/d6/fa 0 2024-05-09T06:30:27.341 INFO:tasks.workunit.client.1.smithi106.stdout:7/430: sync 2024-05-09T06:30:27.341 INFO:tasks.workunit.client.1.smithi106.stdout:7/431: truncate d0/dc/d1a/f83 196966 0 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:2/557: dwrite d2/d7/d2c/f34 [0,4194304] 0 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:2/558: readlink d2/d5/db/d15/d41/d58/l4d 0 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:2/559: chown d2/d5/db/c6b 222 1 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:2/560: readlink d2/d5/db/l46 0 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:2/561: chown f1 3635 1 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:2/562: readlink d2/d7/l67 0 2024-05-09T06:30:27.345 INFO:tasks.workunit.client.1.smithi106.stdout:4/438: rename f2 to d7/d10/f8f 0 2024-05-09T06:30:27.354 INFO:tasks.workunit.client.1.smithi106.stdout:5/466: truncate d8/d33/f3b 830908 0 2024-05-09T06:30:27.354 INFO:tasks.workunit.client.1.smithi106.stdout:5/467: dread - d8/d33/d3a/f88 zero size 2024-05-09T06:30:27.358 INFO:tasks.workunit.client.1.smithi106.stdout:7/432: mkdir d0/dc/d1a/d36/d30/d44/d58/d65/d84 0 2024-05-09T06:30:27.366 INFO:tasks.workunit.client.1.smithi106.stdout:7/433: write d0/dc/d1a/d36/d30/f26 [1971667,62801] 0 2024-05-09T06:30:27.366 INFO:tasks.workunit.client.1.smithi106.stdout:7/434: write d0/dc/d1a/d5a/f70 [412451,13295] 0 2024-05-09T06:30:27.366 INFO:tasks.workunit.client.1.smithi106.stdout:7/435: write d0/fa [4667916,66828] 0 2024-05-09T06:30:27.366 INFO:tasks.workunit.client.1.smithi106.stdout:2/563: link d2/f10 d2/d7/db7/fbf 0 2024-05-09T06:30:27.368 INFO:tasks.workunit.client.1.smithi106.stdout:9/509: dwrite d4/d6/d23/d2f/d31/f50 [0,4194304] 0 2024-05-09T06:30:27.368 INFO:tasks.workunit.client.1.smithi106.stdout:9/510: creat d4/d6/d23/d2f/f90 x:0 0 0 2024-05-09T06:30:27.369 INFO:tasks.workunit.client.1.smithi106.stdout:7/436: symlink d0/dc/d1a/d36/d30/d44/l85 0 2024-05-09T06:30:27.369 INFO:tasks.workunit.client.1.smithi106.stdout:7/437: chown d0/dc/d1a/d36/c51 12036 1 2024-05-09T06:30:27.370 INFO:tasks.workunit.client.1.smithi106.stdout:6/487: dwrite d0/d17/f89 [0,4194304] 0 2024-05-09T06:30:27.370 INFO:tasks.workunit.client.1.smithi106.stdout:6/488: write d0/d66/d7e/f26 [3890481,26106] 0 2024-05-09T06:30:27.370 INFO:tasks.workunit.client.1.smithi106.stdout:5/468: dwrite d8/f50 [0,4194304] 0 2024-05-09T06:30:27.370 INFO:tasks.workunit.client.1.smithi106.stdout:2/564: rename d2/d5/db/d1d/d90/cb6 to d2/d5/d9c/cc0 0 2024-05-09T06:30:27.371 INFO:tasks.workunit.client.1.smithi106.stdout:4/439: truncate d7/d28/f27 284595 0 2024-05-09T06:30:27.374 INFO:tasks.workunit.client.1.smithi106.stdout:5/469: dread d8/f1a [0,4194304] 0 2024-05-09T06:30:27.375 INFO:tasks.workunit.client.1.smithi106.stdout:5/470: chown d8/d45/d4c/l2f 1419864 1 2024-05-09T06:30:27.375 INFO:tasks.workunit.client.1.smithi106.stdout:5/471: chown d8/d45/c48 1615748935 1 2024-05-09T06:30:27.375 INFO:tasks.workunit.client.1.smithi106.stdout:5/472: truncate d8/f4e 1028790 0 2024-05-09T06:30:27.377 INFO:tasks.workunit.client.1.smithi106.stdout:9/511: mkdir d4/d54/d91 0 2024-05-09T06:30:27.378 INFO:tasks.workunit.client.1.smithi106.stdout:7/438: mkdir d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86 0 2024-05-09T06:30:27.379 INFO:tasks.workunit.client.1.smithi106.stdout:7/439: fsync d0/dc/d1a/f16 0 2024-05-09T06:30:27.379 INFO:tasks.workunit.client.1.smithi106.stdout:7/440: chown d0/dc/d1a/d36/d30/d44/l85 39730 1 2024-05-09T06:30:27.379 INFO:tasks.workunit.client.1.smithi106.stdout:7/441: dread - d0/dc/d1a/d36/d30/d44/f7f zero size 2024-05-09T06:30:27.379 INFO:tasks.workunit.client.1.smithi106.stdout:0/527: sync 2024-05-09T06:30:27.379 INFO:tasks.workunit.client.1.smithi106.stdout:1/481: sync 2024-05-09T06:30:27.379 INFO:tasks.workunit.client.1.smithi106.stdout:3/416: sync 2024-05-09T06:30:27.384 INFO:tasks.workunit.client.1.smithi106.stdout:5/473: dread d8/fa [0,4194304] 0 2024-05-09T06:30:27.385 INFO:tasks.workunit.client.1.smithi106.stdout:1/482: dread d4/d76/d13/f1b [0,4194304] 0 2024-05-09T06:30:27.385 INFO:tasks.workunit.client.1.smithi106.stdout:2/565: rename d2/d5/db/d1d/d23/f70 to d2/d5/db/d15/d41/d58/fc1 0 2024-05-09T06:30:27.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/440: creat d7/d39/d47/d89/f90 x:0 0 0 2024-05-09T06:30:27.388 INFO:tasks.workunit.client.1.smithi106.stdout:5/474: dread d8/d45/d4c/f5c [0,4194304] 0 2024-05-09T06:30:27.388 INFO:tasks.workunit.client.1.smithi106.stdout:5/475: getdents d8/d45/d4c/d85 0 2024-05-09T06:30:27.388 INFO:tasks.workunit.client.1.smithi106.stdout:6/489: dwrite d0/d5c/f96 [0,4194304] 0 2024-05-09T06:30:27.388 INFO:tasks.workunit.client.1.smithi106.stdout:9/512: link d4/d6/d23/d2f/d31/f32 d4/d6/d23/d2f/d31/f92 0 2024-05-09T06:30:27.388 INFO:tasks.workunit.client.1.smithi106.stdout:4/441: dread d7/d10/d1a/d5a/d1c/f72 [0,4194304] 0 2024-05-09T06:30:27.388 INFO:tasks.workunit.client.1.smithi106.stdout:4/442: creat d7/d28/f91 x:0 0 0 2024-05-09T06:30:27.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/442: mkdir d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87 0 2024-05-09T06:30:27.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/443: chown d0/dc/d1a/d36/d30 0 1 2024-05-09T06:30:27.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/417: dread d5/d1c/d53/f60 [0,4194304] 0 2024-05-09T06:30:27.392 INFO:tasks.workunit.client.1.smithi106.stdout:0/528: unlink d1/d11/d23/d13/d58/la4 0 2024-05-09T06:30:27.394 INFO:tasks.workunit.client.1.smithi106.stdout:1/483: getdents d4/d76/d1d 0 2024-05-09T06:30:27.397 INFO:tasks.workunit.client.1.smithi106.stdout:1/484: dread d4/d76/f4b [0,4194304] 0 2024-05-09T06:30:27.397 INFO:tasks.workunit.client.1.smithi106.stdout:1/485: write d4/d5/f89 [1035096,2709] 0 2024-05-09T06:30:27.398 INFO:tasks.workunit.client.1.smithi106.stdout:2/566: creat d2/fc2 x:0 0 0 2024-05-09T06:30:27.398 INFO:tasks.workunit.client.1.smithi106.stdout:2/567: write d2/d5/db/d1d/d90/faa [447126,37858] 0 2024-05-09T06:30:27.398 INFO:tasks.workunit.client.1.smithi106.stdout:2/568: rename d2 to d2/d5/db/d68/dc3 22 2024-05-09T06:30:27.400 INFO:tasks.workunit.client.1.smithi106.stdout:1/486: dread d4/d76/d13/f39 [0,4194304] 0 2024-05-09T06:30:27.402 INFO:tasks.workunit.client.1.smithi106.stdout:4/443: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:27.408 INFO:tasks.workunit.client.1.smithi106.stdout:5/476: mknod d8/d33/d3a/d59/c93 0 2024-05-09T06:30:27.410 INFO:tasks.workunit.client.1.smithi106.stdout:6/490: symlink d0/d17/d34/d5f/d8/d50/d8f/la6 0 2024-05-09T06:30:27.410 INFO:tasks.workunit.client.1.smithi106.stdout:6/491: stat d0/d17/d34/d5f/d8/d27/d3b/d62 0 2024-05-09T06:30:27.414 INFO:tasks.workunit.client.1.smithi106.stdout:7/444: creat d0/dc/d1a/d36/d30/d44/d6a/d72/f88 x:0 0 0 2024-05-09T06:30:27.414 INFO:tasks.workunit.client.1.smithi106.stdout:9/513: dwrite d4/d6/d1b/d2a/f26 [0,4194304] 0 2024-05-09T06:30:27.415 INFO:tasks.workunit.client.1.smithi106.stdout:3/418: mkdir d5/d4d/d7a 0 2024-05-09T06:30:27.417 INFO:tasks.workunit.client.1.smithi106.stdout:0/529: creat d1/da1/fad x:0 0 0 2024-05-09T06:30:27.418 INFO:tasks.workunit.client.1.smithi106.stdout:1/487: dwrite d4/d76/f5f [0,4194304] 0 2024-05-09T06:30:27.418 INFO:tasks.workunit.client.1.smithi106.stdout:1/488: chown d4/d76/d1d/c33 8277494 1 2024-05-09T06:30:27.418 INFO:tasks.workunit.client.1.smithi106.stdout:2/569: dwrite d2/f10 [4194304,4194304] 0 2024-05-09T06:30:27.420 INFO:tasks.workunit.client.1.smithi106.stdout:4/444: rename d7/d10/f3e to d7/d39/d47/d66/f92 0 2024-05-09T06:30:27.420 INFO:tasks.workunit.client.1.smithi106.stdout:6/492: dread d0/d17/d34/d5f/fe [0,4194304] 0 2024-05-09T06:30:27.422 INFO:tasks.workunit.client.1.smithi106.stdout:5/477: link d8/d45/d4c/l2f d8/d33/l94 0 2024-05-09T06:30:27.425 INFO:tasks.workunit.client.1.smithi106.stdout:9/514: creat d4/d54/d91/f93 x:0 0 0 2024-05-09T06:30:27.426 INFO:tasks.workunit.client.1.smithi106.stdout:9/515: getdents d4/d6/d23/d78/d8f 0 2024-05-09T06:30:27.426 INFO:tasks.workunit.client.1.smithi106.stdout:9/516: chown d4/d6/d23/d2f/d31/f32 11092290 1 2024-05-09T06:30:27.426 INFO:tasks.workunit.client.1.smithi106.stdout:9/517: fdatasync d4/d6/d23/d2f/f64 0 2024-05-09T06:30:27.427 INFO:tasks.workunit.client.1.smithi106.stdout:8/440: sync 2024-05-09T06:30:27.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/489: symlink d4/d76/d13/d60/laf 0 2024-05-09T06:30:27.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/490: truncate d4/d76/d13/d2f/f7f 476892 0 2024-05-09T06:30:27.430 INFO:tasks.workunit.client.1.smithi106.stdout:1/491: read - d4/d76/d13/f82 zero size 2024-05-09T06:30:27.432 INFO:tasks.workunit.client.1.smithi106.stdout:9/518: dread d4/d6/d23/d2f/d31/f50 [0,4194304] 0 2024-05-09T06:30:27.432 INFO:tasks.workunit.client.1.smithi106.stdout:2/570: mknod d2/d7/db7/cc4 0 2024-05-09T06:30:27.434 INFO:tasks.workunit.client.1.smithi106.stdout:4/445: creat d7/d39/d35/d4a/f93 x:0 0 0 2024-05-09T06:30:27.434 INFO:tasks.workunit.client.1.smithi106.stdout:4/446: write d7/d10/d1a/f5b [126664,69497] 0 2024-05-09T06:30:27.434 INFO:tasks.workunit.client.1.smithi106.stdout:4/447: truncate d7/d39/d35/d4a/f93 401854 0 2024-05-09T06:30:27.434 INFO:tasks.workunit.client.1.smithi106.stdout:3/419: write d5/fb [2301476,73835] 0 2024-05-09T06:30:27.435 INFO:tasks.workunit.client.1.smithi106.stdout:6/493: getdents d0/d17/d34/d95 0 2024-05-09T06:30:27.437 INFO:tasks.workunit.client.1.smithi106.stdout:5/478: mkdir d8/d45/d4c/d32/d5b/d95 0 2024-05-09T06:30:27.437 INFO:tasks.workunit.client.1.smithi106.stdout:5/479: fsync d8/f10 0 2024-05-09T06:30:27.437 INFO:tasks.workunit.client.1.smithi106.stdout:5/480: creat d8/d33/f96 x:0 0 0 2024-05-09T06:30:27.438 INFO:tasks.workunit.client.1.smithi106.stdout:5/481: chown d8/d33/d74/c7d 693 1 2024-05-09T06:30:27.438 INFO:tasks.workunit.client.1.smithi106.stdout:6/494: dread d0/d17/d34/d5f/fb [0,4194304] 0 2024-05-09T06:30:27.438 INFO:tasks.workunit.client.1.smithi106.stdout:7/445: getdents d0/dc/d1a/d36/d30/d44/d6a/d72 0 2024-05-09T06:30:27.441 INFO:tasks.workunit.client.1.smithi106.stdout:0/530: rmdir d1/d11/d23/d13/d58 39 2024-05-09T06:30:27.441 INFO:tasks.workunit.client.1.smithi106.stdout:0/531: dread - d1/d11/d23/da6/fac zero size 2024-05-09T06:30:27.444 INFO:tasks.workunit.client.1.smithi106.stdout:8/441: unlink d3/d5/f78 0 2024-05-09T06:30:27.444 INFO:tasks.workunit.client.1.smithi106.stdout:8/442: chown d3/d5/d35/d4e 504 1 2024-05-09T06:30:27.445 INFO:tasks.workunit.client.1.smithi106.stdout:4/448: dread d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:27.445 INFO:tasks.workunit.client.1.smithi106.stdout:4/449: fdatasync d7/d39/d35/f8b 0 2024-05-09T06:30:27.445 INFO:tasks.workunit.client.1.smithi106.stdout:4/450: readlink d7/l23 0 2024-05-09T06:30:27.445 INFO:tasks.workunit.client.1.smithi106.stdout:4/451: creat d7/d39/f94 x:0 0 0 2024-05-09T06:30:27.446 INFO:tasks.workunit.client.1.smithi106.stdout:1/492: creat d4/d5b/d75/fb0 x:0 0 0 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:1/493: creat d4/da7/fb1 x:0 0 0 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:3/420: dread f2 [0,4194304] 0 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:1/494: truncate d4/d5b/d75/fb0 107157 0 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:1/495: chown d4/d76/d65 13 1 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:1/496: chown d4/d5b/d75/f97 237695 1 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:1/497: readlink d4/d76/d65/l95 0 2024-05-09T06:30:27.447 INFO:tasks.workunit.client.1.smithi106.stdout:9/519: truncate d4/d6/d23/d2f/d38/f40 7671470 0 2024-05-09T06:30:27.450 INFO:tasks.workunit.client.1.smithi106.stdout:2/571: rename d2/d5/db/d1d/d23/d5e/f64 to d2/d5/db/d1d/fc5 0 2024-05-09T06:30:27.450 INFO:tasks.workunit.client.1.smithi106.stdout:2/572: chown d2/d5/db/d1d/d90/fbd 117083 1 2024-05-09T06:30:27.455 INFO:tasks.workunit.client.1.smithi106.stdout:5/482: link d8/d45/d4c/d32/d5b/l40 d8/d5a/l97 0 2024-05-09T06:30:27.455 INFO:tasks.workunit.client.1.smithi106.stdout:5/483: truncate d8/d45/d4c/f5c 1737616 0 2024-05-09T06:30:27.461 INFO:tasks.workunit.client.1.smithi106.stdout:7/446: mknod d0/dc/d1a/d36/d30/c89 0 2024-05-09T06:30:27.463 INFO:tasks.workunit.client.1.smithi106.stdout:8/443: dwrite d3/d5/d13/d3a/f9e [0,4194304] 0 2024-05-09T06:30:27.464 INFO:tasks.workunit.client.1.smithi106.stdout:0/532: symlink d1/d11/d23/d13/d8a/lae 0 2024-05-09T06:30:27.464 INFO:tasks.workunit.client.1.smithi106.stdout:0/533: creat d1/d11/d23/d13/d2c/d6d/d70/faf x:0 0 0 2024-05-09T06:30:27.469 INFO:tasks.workunit.client.1.smithi106.stdout:4/452: mknod d7/d39/d8c/c95 0 2024-05-09T06:30:27.469 INFO:tasks.workunit.client.1.smithi106.stdout:4/453: read - d7/d39/d47/d66/f87 zero size 2024-05-09T06:30:27.470 INFO:tasks.workunit.client.1.smithi106.stdout:9/520: dwrite d4/d6/d23/d2f/d47/f4d [4194304,4194304] 0 2024-05-09T06:30:27.470 INFO:tasks.workunit.client.1.smithi106.stdout:2/573: dwrite d2/d5/db/d1d/d6a/f99 [0,4194304] 0 2024-05-09T06:30:27.470 INFO:tasks.workunit.client.1.smithi106.stdout:2/574: fsync d2/d5/db/d15/d41/f74 0 2024-05-09T06:30:27.473 INFO:tasks.workunit.client.1.smithi106.stdout:3/421: creat d5/d4d/d72/f7b x:0 0 0 2024-05-09T06:30:27.473 INFO:tasks.workunit.client.1.smithi106.stdout:3/422: creat d5/f7c x:0 0 0 2024-05-09T06:30:27.473 INFO:tasks.workunit.client.1.smithi106.stdout:3/423: chown d5/d1c/d21/c48 45624 1 2024-05-09T06:30:27.477 INFO:tasks.workunit.client.1.smithi106.stdout:1/498: creat d4/d76/d65/d67/fb2 x:0 0 0 2024-05-09T06:30:27.483 INFO:tasks.workunit.client.1.smithi106.stdout:6/495: rename d0/d17/d34/d5f/f24 to d0/d17/d34/d5f/d8/d27/fa7 0 2024-05-09T06:30:27.486 INFO:tasks.workunit.client.1.smithi106.stdout:5/484: mknod d8/d7c/c98 0 2024-05-09T06:30:27.486 INFO:tasks.workunit.client.1.smithi106.stdout:5/485: getdents d8/d45/d4c/d32/d5b/d95 0 2024-05-09T06:30:27.490 INFO:tasks.workunit.client.1.smithi106.stdout:7/447: mknod d0/dc/d1a/d36/d30/d44/d6a/d72/c8a 0 2024-05-09T06:30:27.490 INFO:tasks.workunit.client.1.smithi106.stdout:5/486: dread d8/d5a/f73 [0,4194304] 0 2024-05-09T06:30:27.490 INFO:tasks.workunit.client.1.smithi106.stdout:5/487: chown d8/d45/d4c/l2f 14331 1 2024-05-09T06:30:27.490 INFO:tasks.workunit.client.1.smithi106.stdout:8/444: dwrite d3/d5/d13/d3a/f77 [0,4194304] 0 2024-05-09T06:30:27.493 INFO:tasks.workunit.client.1.smithi106.stdout:2/575: write d2/f56 [1914560,106055] 0 2024-05-09T06:30:27.494 INFO:tasks.workunit.client.1.smithi106.stdout:0/534: dwrite d1/d11/d23/d22/f84 [0,4194304] 0 2024-05-09T06:30:27.506 INFO:tasks.workunit.client.1.smithi106.stdout:2/576: write d2/d7/f27 [2647596,112721] 0 2024-05-09T06:30:27.512 INFO:tasks.workunit.client.1.smithi106.stdout:6/496: symlink d0/la8 0 2024-05-09T06:30:27.512 INFO:tasks.workunit.client.1.smithi106.stdout:6/497: chown d0/d17/d34/d5f/d8/d9c 522031 1 2024-05-09T06:30:27.512 INFO:tasks.workunit.client.1.smithi106.stdout:6/498: chown d0/d17/d34/d5f/d8/d27/d3e 360620 1 2024-05-09T06:30:27.513 INFO:tasks.workunit.client.1.smithi106.stdout:7/448: dwrite d0/dc/d1a/d36/d30/d44/d6a/f7c [0,4194304] 0 2024-05-09T06:30:27.513 INFO:tasks.workunit.client.1.smithi106.stdout:3/424: dwrite d5/d1c/d21/d32/f6e [4194304,4194304] 0 2024-05-09T06:30:27.513 INFO:tasks.workunit.client.1.smithi106.stdout:3/425: dread - d5/d1c/d24/d52/f78 zero size 2024-05-09T06:30:27.514 INFO:tasks.workunit.client.1.smithi106.stdout:4/454: dwrite d7/d39/f94 [0,4194304] 0 2024-05-09T06:30:27.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/499: dwrite d4/d37/d3d/f96 [0,4194304] 0 2024-05-09T06:30:27.514 INFO:tasks.workunit.client.1.smithi106.stdout:4/455: fsync d7/d10/f43 0 2024-05-09T06:30:27.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/500: fsync d4/d5/f21 0 2024-05-09T06:30:27.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/501: getdents d4/d76/d1d 0 2024-05-09T06:30:27.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/502: chown d4/d76/f16 0 1 2024-05-09T06:30:27.515 INFO:tasks.workunit.client.1.smithi106.stdout:5/488: rename d8/d5a/d6d to d8/d33/d3a/d59/d99 0 2024-05-09T06:30:27.516 INFO:tasks.workunit.client.1.smithi106.stdout:8/445: stat d3/d5/d35/d4e/l57 0 2024-05-09T06:30:27.517 INFO:tasks.workunit.client.1.smithi106.stdout:8/446: chown d3/d5/d35/d61 556 1 2024-05-09T06:30:27.517 INFO:tasks.workunit.client.1.smithi106.stdout:2/577: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:27.519 INFO:tasks.workunit.client.1.smithi106.stdout:2/578: dread d2/d5/fb8 [0,4194304] 0 2024-05-09T06:30:27.524 INFO:tasks.workunit.client.1.smithi106.stdout:6/499: dread d0/d66/d7e/f2b [0,4194304] 0 2024-05-09T06:30:27.524 INFO:tasks.workunit.client.1.smithi106.stdout:6/500: dread - d0/d17/d34/d5f/d8/d50/f81 zero size 2024-05-09T06:30:27.524 INFO:tasks.workunit.client.1.smithi106.stdout:6/501: stat d0/d17/d34/d5f/d8/l52 0 2024-05-09T06:30:27.540 INFO:tasks.workunit.client.1.smithi106.stdout:6/502: dwrite d0/d66/d7e/f2b [0,4194304] 0 2024-05-09T06:30:27.621 INFO:tasks.workunit.client.1.smithi106.stdout:0/535: mknod d1/d11/d23/d13/d58/cb0 0 2024-05-09T06:30:27.622 INFO:tasks.workunit.client.1.smithi106.stdout:9/521: getdents d4/d6/d23/d2f/d39 0 2024-05-09T06:30:27.629 INFO:tasks.workunit.client.1.smithi106.stdout:7/449: truncate d0/dc/d1a/d5a/f70 343526 0 2024-05-09T06:30:27.631 INFO:tasks.workunit.client.1.smithi106.stdout:3/426: mkdir d5/d1c/d7d 0 2024-05-09T06:30:27.631 INFO:tasks.workunit.client.1.smithi106.stdout:9/522: write d4/d6/d23/d2f/d38/f40 [2946976,9463] 0 2024-05-09T06:30:27.646 INFO:tasks.workunit.client.1.smithi106.stdout:1/503: mkdir d4/d76/db3 0 2024-05-09T06:30:27.649 INFO:tasks.workunit.client.1.smithi106.stdout:5/489: creat d8/d7c/f9a x:0 0 0 2024-05-09T06:30:27.652 INFO:tasks.workunit.client.1.smithi106.stdout:8/447: mknod d3/d5/d7/d15/d3e/d7d/ca2 0 2024-05-09T06:30:27.652 INFO:tasks.workunit.client.1.smithi106.stdout:9/523: dwrite d4/d6/d1b/d2a/f74 [0,4194304] 0 2024-05-09T06:30:27.652 INFO:tasks.workunit.client.1.smithi106.stdout:5/490: dread d8/f51 [0,4194304] 0 2024-05-09T06:30:27.652 INFO:tasks.workunit.client.1.smithi106.stdout:5/491: dread - d8/d7c/f9a zero size 2024-05-09T06:30:27.652 INFO:tasks.workunit.client.1.smithi106.stdout:7/450: dwrite d0/dc/f19 [0,4194304] 0 2024-05-09T06:30:27.653 INFO:tasks.workunit.client.1.smithi106.stdout:7/451: fsync d0/f29 0 2024-05-09T06:30:27.653 INFO:tasks.workunit.client.1.smithi106.stdout:7/452: dread - d0/dc/d1a/f62 zero size 2024-05-09T06:30:27.653 INFO:tasks.workunit.client.1.smithi106.stdout:7/453: chown d0/dc/d1a/f83 30244 1 2024-05-09T06:30:27.653 INFO:tasks.workunit.client.1.smithi106.stdout:7/454: creat d0/dc/f8b x:0 0 0 2024-05-09T06:30:27.653 INFO:tasks.workunit.client.1.smithi106.stdout:2/579: mkdir d2/d5/db/d15/dc6 0 2024-05-09T06:30:27.654 INFO:tasks.workunit.client.1.smithi106.stdout:2/580: truncate d2/d7/db7/f7c 959263 0 2024-05-09T06:30:27.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:27 smithi046 ceph-mon[26924]: pgmap v20: 65 pgs: 65 active+clean; 855 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 80 MiB/s rd, 108 MiB/s wr, 510 op/s 2024-05-09T06:30:27.659 INFO:tasks.workunit.client.1.smithi106.stdout:6/503: unlink d0/d17/d34/d5f/d8/l1b 0 2024-05-09T06:30:27.659 INFO:tasks.workunit.client.1.smithi106.stdout:6/504: chown d0/d17/f89 339602 1 2024-05-09T06:30:27.659 INFO:tasks.workunit.client.1.smithi106.stdout:6/505: chown d0/d66/d7e/f2b 2965002 1 2024-05-09T06:30:27.661 INFO:tasks.workunit.client.1.smithi106.stdout:0/536: creat d1/d11/d23/d13/d2c/fb1 x:0 0 0 2024-05-09T06:30:27.661 INFO:tasks.workunit.client.1.smithi106.stdout:0/537: fdatasync d1/da1/d83/f89 0 2024-05-09T06:30:27.664 INFO:tasks.workunit.client.1.smithi106.stdout:3/427: truncate d5/f3b 3066013 0 2024-05-09T06:30:27.673 INFO:tasks.workunit.client.1.smithi106.stdout:4/456: rmdir d7/d10/d1a/d5a 39 2024-05-09T06:30:27.677 INFO:tasks.workunit.client.1.smithi106.stdout:5/492: dwrite d8/d45/d4c/d32/d5b/f8c [0,4194304] 0 2024-05-09T06:30:27.677 INFO:tasks.workunit.client.1.smithi106.stdout:0/538: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:27.677 INFO:tasks.workunit.client.1.smithi106.stdout:1/504: mkdir d4/d76/d13/d2f/db4 0 2024-05-09T06:30:27.682 INFO:tasks.workunit.client.1.smithi106.stdout:8/448: link d3/d5/d35/d73/l8e d3/d5/d7/d15/la3 0 2024-05-09T06:30:27.687 INFO:tasks.workunit.client.1.smithi106.stdout:9/524: mkdir d4/d6/d23/d16/d94 0 2024-05-09T06:30:27.687 INFO:tasks.workunit.client.1.smithi106.stdout:9/525: fsync d4/d6/d23/d2f/d47/f62 0 2024-05-09T06:30:27.693 INFO:tasks.workunit.client.1.smithi106.stdout:9/526: dread d4/d6/d23/d2f/d31/f33 [0,4194304] 0 2024-05-09T06:30:27.694 INFO:tasks.workunit.client.1.smithi106.stdout:2/581: mknod d2/d5/db/d15/cc7 0 2024-05-09T06:30:27.696 INFO:tasks.workunit.client.1.smithi106.stdout:6/506: mkdir d0/d17/d34/d4e/d98/da9 0 2024-05-09T06:30:27.696 INFO:tasks.workunit.client.1.smithi106.stdout:6/507: chown d0/d17/d34/d5f/d8/f8e 2377738 1 2024-05-09T06:30:27.702 INFO:tasks.workunit.client.1.smithi106.stdout:3/428: creat d5/d1c/d21/f7e x:0 0 0 2024-05-09T06:30:27.703 INFO:tasks.workunit.client.1.smithi106.stdout:6/508: dread d0/d17/d34/d5f/f5d [0,4194304] 0 2024-05-09T06:30:27.703 INFO:tasks.workunit.client.1.smithi106.stdout:6/509: readlink d0/d17/d34/d5f/l5b 0 2024-05-09T06:30:27.708 INFO:tasks.workunit.client.1.smithi106.stdout:5/493: symlink d8/d5a/d60/l9b 0 2024-05-09T06:30:27.711 INFO:tasks.workunit.client.1.smithi106.stdout:0/539: unlink d1/da1/c92 0 2024-05-09T06:30:27.714 INFO:tasks.workunit.client.1.smithi106.stdout:1/505: truncate d4/d37/d3d/f73 2288243 0 2024-05-09T06:30:27.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/494: dread d8/f50 [0,4194304] 0 2024-05-09T06:30:27.745 INFO:tasks.workunit.client.1.smithi106.stdout:8/449: creat d3/d5/d7/d15/fa4 x:0 0 0 2024-05-09T06:30:27.746 INFO:tasks.workunit.client.1.smithi106.stdout:7/455: getdents d0/dc/d1a/d36/d30/d44/d58 0 2024-05-09T06:30:27.749 INFO:tasks.workunit.client.1.smithi106.stdout:2/582: creat d2/d5/db/d68/fc8 x:0 0 0 2024-05-09T06:30:27.751 INFO:tasks.workunit.client.1.smithi106.stdout:3/429: rename d5/d1c/d24/d5b/l5e to d5/d1c/d24/l7f 0 2024-05-09T06:30:27.751 INFO:tasks.workunit.client.1.smithi106.stdout:3/430: truncate d5/d4d/d72/f7b 126174 0 2024-05-09T06:30:27.751 INFO:tasks.workunit.client.1.smithi106.stdout:3/431: dread - d5/d1c/d21/f7e zero size 2024-05-09T06:30:27.752 INFO:tasks.workunit.client.1.smithi106.stdout:6/510: creat d0/d17/d34/d5f/d8/faa x:0 0 0 2024-05-09T06:30:27.756 INFO:tasks.workunit.client.1.smithi106.stdout:0/540: creat d1/d11/d23/d13/d58/fb2 x:0 0 0 2024-05-09T06:30:27.756 INFO:tasks.workunit.client.1.smithi106.stdout:0/541: chown d1/da1/d83/c97 1 1 2024-05-09T06:30:27.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/583: write d2/d5/f6 [1672558,129222] 0 2024-05-09T06:30:27.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/506: mkdir d4/d76/d65/d8d/db5 0 2024-05-09T06:30:27.760 INFO:tasks.workunit.client.1.smithi106.stdout:8/450: dwrite d3/d5/d13/f2e [0,4194304] 0 2024-05-09T06:30:27.760 INFO:tasks.workunit.client.1.smithi106.stdout:8/451: stat d3/d5/d13 0 2024-05-09T06:30:27.760 INFO:tasks.workunit.client.1.smithi106.stdout:8/452: truncate d3/d5/f3c 1033490 0 2024-05-09T06:30:27.761 INFO:tasks.workunit.client.1.smithi106.stdout:3/432: dread f2 [0,4194304] 0 2024-05-09T06:30:27.761 INFO:tasks.workunit.client.1.smithi106.stdout:5/495: truncate d8/d33/d3a/d59/d99/f80 1483867 0 2024-05-09T06:30:27.761 INFO:tasks.workunit.client.1.smithi106.stdout:5/496: readlink d8/d33/d6c/l7f 0 2024-05-09T06:30:27.767 INFO:tasks.workunit.client.1.smithi106.stdout:6/511: mknod d0/d17/d34/d5f/d8/d27/d3b/cab 0 2024-05-09T06:30:27.767 INFO:tasks.workunit.client.1.smithi106.stdout:2/584: write d2/d5/db/d1d/f8a [2094079,26792] 0 2024-05-09T06:30:27.768 INFO:tasks.workunit.client.1.smithi106.stdout:0/542: unlink d1/f3 0 2024-05-09T06:30:27.770 INFO:tasks.workunit.client.1.smithi106.stdout:1/507: rename d4/d76/d13/c64 to d4/d5b/d75/cb6 0 2024-05-09T06:30:27.773 INFO:tasks.workunit.client.1.smithi106.stdout:8/453: creat d3/d5/d35/d73/fa5 x:0 0 0 2024-05-09T06:30:27.773 INFO:tasks.workunit.client.1.smithi106.stdout:6/512: write d0/d17/f25 [2247721,27847] 0 2024-05-09T06:30:27.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/433: mkdir d5/d1c/d24/d80 0 2024-05-09T06:30:27.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/434: fsync d5/d1c/f47 0 2024-05-09T06:30:27.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/435: write d5/d1c/d21/f7e [23528,83333] 0 2024-05-09T06:30:27.776 INFO:tasks.workunit.client.1.smithi106.stdout:8/454: dread d3/d5/d7/f6a [0,4194304] 0 2024-05-09T06:30:27.776 INFO:tasks.workunit.client.1.smithi106.stdout:8/455: creat d3/d5/d35/d61/d6c/fa6 x:0 0 0 2024-05-09T06:30:27.778 INFO:tasks.workunit.client.1.smithi106.stdout:5/497: mknod d8/d45/d4c/d32/c9c 0 2024-05-09T06:30:27.778 INFO:tasks.workunit.client.1.smithi106.stdout:5/498: fdatasync d8/d45/d4c/d32/d5b/f1e 0 2024-05-09T06:30:27.778 INFO:tasks.workunit.client.1.smithi106.stdout:0/543: dread d1/f1d [0,4194304] 0 2024-05-09T06:30:27.792 INFO:tasks.workunit.client.1.smithi106.stdout:7/456: truncate d0/f9 2695752 0 2024-05-09T06:30:27.792 INFO:tasks.workunit.client.1.smithi106.stdout:7/457: chown d0/fe 38 1 2024-05-09T06:30:27.799 INFO:tasks.workunit.client.1.smithi106.stdout:2/585: rename d2/d5/l43 to d2/d5/db/d1d/lc9 0 2024-05-09T06:30:27.799 INFO:tasks.workunit.client.1.smithi106.stdout:8/456: dwrite d3/d5/d7/d15/d3e/d7d/fa0 [0,4194304] 0 2024-05-09T06:30:27.802 INFO:tasks.workunit.client.1.smithi106.stdout:1/508: symlink d4/d5b/lb7 0 2024-05-09T06:30:27.806 INFO:tasks.workunit.client.1.smithi106.stdout:6/513: rmdir d0/d17/d34/d5f/d40 39 2024-05-09T06:30:27.806 INFO:tasks.workunit.client.1.smithi106.stdout:6/514: fsync d0/d17/f1e 0 2024-05-09T06:30:27.808 INFO:tasks.workunit.client.1.smithi106.stdout:3/436: mkdir d5/d12/d65/d81 0 2024-05-09T06:30:27.813 INFO:tasks.workunit.client.1.smithi106.stdout:0/544: link d1/d11/d23/d13/d63/d7e/fa5 d1/da1/fb3 0 2024-05-09T06:30:27.813 INFO:tasks.workunit.client.1.smithi106.stdout:0/545: chown d1/f1d 5285 1 2024-05-09T06:30:27.814 INFO:tasks.workunit.client.1.smithi106.stdout:2/586: dwrite d2/d5/db/d68/f76 [0,4194304] 0 2024-05-09T06:30:27.816 INFO:tasks.workunit.client.1.smithi106.stdout:5/499: rename d8/d33/d3a/l3f to d8/d33/d74/l9d 0 2024-05-09T06:30:27.816 INFO:tasks.workunit.client.1.smithi106.stdout:5/500: fdatasync d8/f37 0 2024-05-09T06:30:27.817 INFO:tasks.workunit.client.1.smithi106.stdout:5/501: fdatasync d8/d45/d4c/d32/d5b/d69/f87 0 2024-05-09T06:30:27.819 INFO:tasks.workunit.client.1.smithi106.stdout:4/457: sync 2024-05-09T06:30:27.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:27 smithi106 ceph-mon[34679]: pgmap v20: 65 pgs: 65 active+clean; 855 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 80 MiB/s rd, 108 MiB/s wr, 510 op/s 2024-05-09T06:30:27.828 INFO:tasks.workunit.client.1.smithi106.stdout:8/457: dread d3/d5/f8a [0,4194304] 0 2024-05-09T06:30:27.829 INFO:tasks.workunit.client.1.smithi106.stdout:6/515: mknod d0/d17/d34/d5f/d8/d9c/cac 0 2024-05-09T06:30:27.835 INFO:tasks.workunit.client.1.smithi106.stdout:3/437: truncate d5/d1c/f6d 140370 0 2024-05-09T06:30:27.838 INFO:tasks.workunit.client.1.smithi106.stdout:0/546: symlink d1/d11/d23/d13/d2c/d6d/d70/lb4 0 2024-05-09T06:30:27.847 INFO:tasks.workunit.client.1.smithi106.stdout:2/587: creat d2/d5/db/d15/fca x:0 0 0 2024-05-09T06:30:27.847 INFO:tasks.workunit.client.1.smithi106.stdout:2/588: read d2/f5f [3254967,52315] 0 2024-05-09T06:30:27.847 INFO:tasks.workunit.client.1.smithi106.stdout:2/589: readlink d2/d5/db/d15/l51 0 2024-05-09T06:30:27.850 INFO:tasks.workunit.client.1.smithi106.stdout:7/458: link d0/l7 d0/dc/d1a/d36/l8c 0 2024-05-09T06:30:27.851 INFO:tasks.workunit.client.1.smithi106.stdout:7/459: fsync d0/dc/d1a/f83 0 2024-05-09T06:30:27.851 INFO:tasks.workunit.client.1.smithi106.stdout:9/527: sync 2024-05-09T06:30:27.853 INFO:tasks.workunit.client.1.smithi106.stdout:1/509: rename d4/d5/f21 to d4/d76/fb8 0 2024-05-09T06:30:27.853 INFO:tasks.workunit.client.1.smithi106.stdout:1/510: creat d4/d5b/d75/fb9 x:0 0 0 2024-05-09T06:30:27.854 INFO:tasks.workunit.client.1.smithi106.stdout:1/511: fsync d4/d76/f53 0 2024-05-09T06:30:27.856 INFO:tasks.workunit.client.1.smithi106.stdout:5/502: mknod d8/d5a/d60/c9e 0 2024-05-09T06:30:27.858 INFO:tasks.workunit.client.1.smithi106.stdout:4/458: symlink d7/d39/l96 0 2024-05-09T06:30:27.862 INFO:tasks.workunit.client.1.smithi106.stdout:0/547: dwrite d1/d11/d23/d13/d2c/f2f [0,4194304] 0 2024-05-09T06:30:27.862 INFO:tasks.workunit.client.1.smithi106.stdout:0/548: fsync d1/d11/d23/d13/d58/f98 0 2024-05-09T06:30:27.862 INFO:tasks.workunit.client.1.smithi106.stdout:0/549: chown d1/cd 146946 1 2024-05-09T06:30:27.863 INFO:tasks.workunit.client.1.smithi106.stdout:0/550: write d1/f5 [3918277,118979] 0 2024-05-09T06:30:27.863 INFO:tasks.workunit.client.1.smithi106.stdout:6/516: mkdir d0/d17/d34/d5f/d8/d27/d3b/dad 0 2024-05-09T06:30:27.867 INFO:tasks.workunit.client.1.smithi106.stdout:4/459: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:27.867 INFO:tasks.workunit.client.1.smithi106.stdout:4/460: readlink d7/l88 0 2024-05-09T06:30:27.869 INFO:tasks.workunit.client.1.smithi106.stdout:6/517: dread d0/d17/d34/d5f/d8/f3c [0,4194304] 0 2024-05-09T06:30:27.870 INFO:tasks.workunit.client.1.smithi106.stdout:3/438: unlink d5/d1c/d53/l57 0 2024-05-09T06:30:27.874 INFO:tasks.workunit.client.1.smithi106.stdout:2/590: creat d2/d7/d62/d9a/fcb x:0 0 0 2024-05-09T06:30:27.878 INFO:tasks.workunit.client.1.smithi106.stdout:7/460: symlink d0/dc/d45/l8d 0 2024-05-09T06:30:27.878 INFO:tasks.workunit.client.1.smithi106.stdout:7/461: write d0/dc/d1a/d36/f74 [4726618,34558] 0 2024-05-09T06:30:27.878 INFO:tasks.workunit.client.1.smithi106.stdout:7/462: creat d0/dc/d1a/d36/d30/d44/d6a/f8e x:0 0 0 2024-05-09T06:30:27.879 INFO:tasks.workunit.client.1.smithi106.stdout:7/463: dread - d0/dc/d1a/f81 zero size 2024-05-09T06:30:27.879 INFO:tasks.workunit.client.1.smithi106.stdout:7/464: chown d0/dc/d1a/d36/l38 22 1 2024-05-09T06:30:27.881 INFO:tasks.workunit.client.1.smithi106.stdout:9/528: dread - d4/d6/d23/d2f/d38/d68/f6f zero size 2024-05-09T06:30:27.881 INFO:tasks.workunit.client.1.smithi106.stdout:9/529: write d4/d6/d1b/d2a/f75 [50820,114537] 0 2024-05-09T06:30:27.881 INFO:tasks.workunit.client.1.smithi106.stdout:9/530: fsync d4/d6/d23/d16/f4c 0 2024-05-09T06:30:27.887 INFO:tasks.workunit.client.1.smithi106.stdout:4/461: dwrite d7/d28/f91 [0,4194304] 0 2024-05-09T06:30:27.887 INFO:tasks.workunit.client.1.smithi106.stdout:1/512: creat d4/d76/d65/d8d/dad/fba x:0 0 0 2024-05-09T06:30:27.887 INFO:tasks.workunit.client.1.smithi106.stdout:5/503: symlink d8/d45/d4c/d32/d5b/d95/l9f 0 2024-05-09T06:30:27.888 INFO:tasks.workunit.client.1.smithi106.stdout:8/458: getdents d3/d5/d35/d4e/d32 0 2024-05-09T06:30:27.889 INFO:tasks.workunit.client.1.smithi106.stdout:8/459: chown d3/d5/d7/d15/l5e 1692 1 2024-05-09T06:30:27.889 INFO:tasks.workunit.client.1.smithi106.stdout:5/504: dread d8/d33/d3a/d59/d99/f80 [0,4194304] 0 2024-05-09T06:30:27.890 INFO:tasks.workunit.client.1.smithi106.stdout:5/505: fdatasync d8/d45/d4c/d32/d5b/d69/f87 0 2024-05-09T06:30:27.897 INFO:tasks.workunit.client.1.smithi106.stdout:0/551: creat d1/d11/d23/d13/d58/da8/fb5 x:0 0 0 2024-05-09T06:30:27.898 INFO:tasks.workunit.client.1.smithi106.stdout:0/552: write d1/f4a [246756,72959] 0 2024-05-09T06:30:27.898 INFO:tasks.workunit.client.1.smithi106.stdout:0/553: creat d1/d11/d23/d13/d58/da8/fb6 x:0 0 0 2024-05-09T06:30:27.900 INFO:tasks.workunit.client.1.smithi106.stdout:6/518: unlink d0/l4f 0 2024-05-09T06:30:27.906 INFO:tasks.workunit.client.1.smithi106.stdout:2/591: mkdir d2/d5/db/d15/d41/d60/dcc 0 2024-05-09T06:30:27.907 INFO:tasks.workunit.client.1.smithi106.stdout:2/592: readlink d2/d7/d62/l82 0 2024-05-09T06:30:27.912 INFO:tasks.workunit.client.1.smithi106.stdout:7/465: rename d0/dc/f31 to d0/dc/d1a/d36/d30/d44/d58/d65/f8f 0 2024-05-09T06:30:27.914 INFO:tasks.workunit.client.1.smithi106.stdout:9/531: getdents d4 0 2024-05-09T06:30:27.923 INFO:tasks.workunit.client.1.smithi106.stdout:5/506: creat d8/d45/d4c/d85/fa0 x:0 0 0 2024-05-09T06:30:27.923 INFO:tasks.workunit.client.1.smithi106.stdout:5/507: chown d8/cb 404534 1 2024-05-09T06:30:27.923 INFO:tasks.workunit.client.1.smithi106.stdout:9/532: dread d4/d6/f15 [0,4194304] 0 2024-05-09T06:30:27.924 INFO:tasks.workunit.client.1.smithi106.stdout:9/533: dread d4/d6/d1b/d2a/d42/d6c/d6d/f77 [0,4194304] 0 2024-05-09T06:30:27.930 INFO:tasks.workunit.client.1.smithi106.stdout:0/554: unlink d1/d11/d23/f27 0 2024-05-09T06:30:27.933 INFO:tasks.workunit.client.1.smithi106.stdout:6/519: creat d0/d17/d34/fae x:0 0 0 2024-05-09T06:30:27.934 INFO:tasks.workunit.client.1.smithi106.stdout:6/520: creat d0/d5c/faf x:0 0 0 2024-05-09T06:30:27.935 INFO:tasks.workunit.client.1.smithi106.stdout:6/521: dread d0/d17/d34/d5f/fb [0,4194304] 0 2024-05-09T06:30:27.939 INFO:tasks.workunit.client.1.smithi106.stdout:3/439: rmdir d5/d4d 39 2024-05-09T06:30:27.939 INFO:tasks.workunit.client.1.smithi106.stdout:3/440: truncate d5/d1c/f47 5149396 0 2024-05-09T06:30:27.942 INFO:tasks.workunit.client.1.smithi106.stdout:2/593: mknod d2/d5/db/d1d/d23/d63/ccd 0 2024-05-09T06:30:27.946 INFO:tasks.workunit.client.1.smithi106.stdout:4/462: rename d7/d39/d47/d66/f92 to d7/d10/d1a/d5a/f97 0 2024-05-09T06:30:27.946 INFO:tasks.workunit.client.1.smithi106.stdout:4/463: write d7/d10/d1a/d5a/d7a/f83 [857408,93813] 0 2024-05-09T06:30:27.948 INFO:tasks.workunit.client.1.smithi106.stdout:7/466: creat d0/f90 x:0 0 0 2024-05-09T06:30:27.950 INFO:tasks.workunit.client.1.smithi106.stdout:5/508: mknod d8/d33/d3a/d59/d99/ca1 0 2024-05-09T06:30:27.952 INFO:tasks.workunit.client.1.smithi106.stdout:0/555: symlink d1/d11/lb7 0 2024-05-09T06:30:27.956 INFO:tasks.workunit.client.1.smithi106.stdout:3/441: symlink d5/d12/l82 0 2024-05-09T06:30:27.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/442: chown d5/d1c/l37 849094905 1 2024-05-09T06:30:27.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/443: fsync d5/d4d/d72/f7b 0 2024-05-09T06:30:27.958 INFO:tasks.workunit.client.1.smithi106.stdout:2/594: creat d2/d5/db/d15/d41/fce x:0 0 0 2024-05-09T06:30:27.962 INFO:tasks.workunit.client.1.smithi106.stdout:4/464: mknod d7/d10/c98 0 2024-05-09T06:30:27.965 INFO:tasks.workunit.client.1.smithi106.stdout:7/467: link d0/dc/d1a/f83 d0/dc/d1a/d36/d30/f91 0 2024-05-09T06:30:27.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/468: write d0/dc/d1a/d36/d1e/f4c [4546614,100908] 0 2024-05-09T06:30:27.968 INFO:tasks.workunit.client.1.smithi106.stdout:5/509: link d8/d45/d4c/c3e d8/d45/d4c/d32/d5b/d69/ca2 0 2024-05-09T06:30:27.972 INFO:tasks.workunit.client.1.smithi106.stdout:0/556: symlink d1/da1/d93/lb8 0 2024-05-09T06:30:27.974 INFO:tasks.workunit.client.1.smithi106.stdout:6/522: mknod d0/d17/d34/cb0 0 2024-05-09T06:30:27.978 INFO:tasks.workunit.client.1.smithi106.stdout:3/444: mknod d5/d1c/d7d/c83 0 2024-05-09T06:30:27.981 INFO:tasks.workunit.client.1.smithi106.stdout:0/557: write d1/f7 [1196627,2714] 0 2024-05-09T06:30:27.981 INFO:tasks.workunit.client.1.smithi106.stdout:0/558: stat d1/d11/d23/d22 0 2024-05-09T06:30:27.983 INFO:tasks.workunit.client.1.smithi106.stdout:2/595: link d2/d5/c4c d2/d5/db/d1d/d23/d63/d7a/ccf 0 2024-05-09T06:30:27.985 INFO:tasks.workunit.client.1.smithi106.stdout:4/465: dwrite d7/d10/f8f [0,4194304] 0 2024-05-09T06:30:27.985 INFO:tasks.workunit.client.1.smithi106.stdout:4/466: stat d7/d10/d1a/d5a/d7a/d7f 0 2024-05-09T06:30:27.988 INFO:tasks.workunit.client.1.smithi106.stdout:6/523: getdents d0/d17/d34/d72 0 2024-05-09T06:30:27.991 INFO:tasks.workunit.client.1.smithi106.stdout:7/469: dwrite d0/dc/f8b [0,4194304] 0 2024-05-09T06:30:27.992 INFO:tasks.workunit.client.1.smithi106.stdout:3/445: symlink d5/d1c/d7d/l84 0 2024-05-09T06:30:27.992 INFO:tasks.workunit.client.1.smithi106.stdout:3/446: stat d5/d1c/f33 0 2024-05-09T06:30:27.992 INFO:tasks.workunit.client.1.smithi106.stdout:3/447: chown d5/d4d/d72/f7b 84756 1 2024-05-09T06:30:27.998 INFO:tasks.workunit.client.1.smithi106.stdout:2/596: creat d2/d5/db/d15/d41/d60/dcc/fd0 x:0 0 0 2024-05-09T06:30:27.998 INFO:tasks.workunit.client.1.smithi106.stdout:0/559: dwrite d1/da1/fb3 [0,4194304] 0 2024-05-09T06:30:27.999 INFO:tasks.workunit.client.1.smithi106.stdout:2/597: dread d2/d7/db7/f7c [0,4194304] 0 2024-05-09T06:30:28.007 INFO:tasks.workunit.client.1.smithi106.stdout:7/470: dwrite d0/f90 [0,4194304] 0 2024-05-09T06:30:28.007 INFO:tasks.workunit.client.1.smithi106.stdout:7/471: write d0/dc/d1a/d36/d30/d44/d6a/f6d [1452378,77234] 0 2024-05-09T06:30:28.007 INFO:tasks.workunit.client.1.smithi106.stdout:7/472: write d0/dc/d1a/f81 [421488,121272] 0 2024-05-09T06:30:28.010 INFO:tasks.workunit.client.1.smithi106.stdout:4/467: creat d7/d39/d35/f99 x:0 0 0 2024-05-09T06:30:28.010 INFO:tasks.workunit.client.1.smithi106.stdout:4/468: creat d7/d39/d35/f9a x:0 0 0 2024-05-09T06:30:28.012 INFO:tasks.workunit.client.1.smithi106.stdout:4/469: dread d7/d10/d1a/d5a/d1c/f72 [0,4194304] 0 2024-05-09T06:30:28.012 INFO:tasks.workunit.client.1.smithi106.stdout:4/470: fsync d7/d10/d1a/d5a/d1c/f49 0 2024-05-09T06:30:28.013 INFO:tasks.workunit.client.1.smithi106.stdout:1/513: rename d4/d37/d4a to d4/d76/d13/dbb 0 2024-05-09T06:30:28.013 INFO:tasks.workunit.client.1.smithi106.stdout:1/514: chown d4/d37 0 1 2024-05-09T06:30:28.023 INFO:tasks.workunit.client.1.smithi106.stdout:0/560: creat d1/d11/d23/d13/d63/d7e/d9f/fb9 x:0 0 0 2024-05-09T06:30:28.031 INFO:tasks.workunit.client.1.smithi106.stdout:7/473: creat d0/dc/d1a/d36/d1e/d68/f92 x:0 0 0 2024-05-09T06:30:28.036 INFO:tasks.workunit.client.1.smithi106.stdout:8/460: rename d3/d5/d13/f2e to d3/d5/d7/d15/fa7 0 2024-05-09T06:30:28.038 INFO:tasks.workunit.client.1.smithi106.stdout:1/515: mkdir d4/d76/d65/dbc 0 2024-05-09T06:30:28.040 INFO:tasks.workunit.client.1.smithi106.stdout:0/561: mknod d1/d11/d23/cba 0 2024-05-09T06:30:28.048 INFO:tasks.workunit.client.1.smithi106.stdout:1/516: mkdir d4/dbd 0 2024-05-09T06:30:28.049 INFO:tasks.workunit.client.1.smithi106.stdout:1/517: readlink d4/d76/d13/d60/l9a 0 2024-05-09T06:30:28.049 INFO:tasks.workunit.client.1.smithi106.stdout:1/518: write d4/d76/d13/f2b [1500651,64298] 0 2024-05-09T06:30:28.050 INFO:tasks.workunit.client.1.smithi106.stdout:0/562: mknod d1/d11/d23/d13/d63/cbb 0 2024-05-09T06:30:28.062 INFO:tasks.workunit.client.1.smithi106.stdout:4/471: rmdir d7/d39/d35 39 2024-05-09T06:30:28.063 INFO:tasks.workunit.client.1.smithi106.stdout:4/472: dread d7/d10/d1a/f5b [0,4194304] 0 2024-05-09T06:30:28.074 INFO:tasks.workunit.client.1.smithi106.stdout:1/519: mkdir d4/d76/d13/d60/d9c/dbe 0 2024-05-09T06:30:28.075 INFO:tasks.workunit.client.1.smithi106.stdout:0/563: mkdir d1/d11/d23/d22/dbc 0 2024-05-09T06:30:28.075 INFO:tasks.workunit.client.1.smithi106.stdout:0/564: chown d1/d11/d23/d13/d2c 11566 1 2024-05-09T06:30:28.080 INFO:tasks.workunit.client.1.smithi106.stdout:9/534: rename d4/d6 to d4/d54/d69/d95 0 2024-05-09T06:30:28.082 INFO:tasks.workunit.client.1.smithi106.stdout:0/565: symlink d1/da1/d83/lbd 0 2024-05-09T06:30:28.086 INFO:tasks.workunit.client.1.smithi106.stdout:1/520: dwrite d4/d76/f53 [0,4194304] 0 2024-05-09T06:30:28.089 INFO:tasks.workunit.client.1.smithi106.stdout:0/566: mkdir d1/d11/d23/d13/d2c/d3d/dbe 0 2024-05-09T06:30:28.096 INFO:tasks.workunit.client.1.smithi106.stdout:6/524: rename d0/d17/d34/d5f to d0/d17/d34/d4e/d98/da9/db1 0 2024-05-09T06:30:28.101 INFO:tasks.workunit.client.1.smithi106.stdout:1/521: mknod d4/da7/cbf 0 2024-05-09T06:30:28.102 INFO:tasks.workunit.client.1.smithi106.stdout:1/522: chown d4/d76/d13/dbb/c6f 119015907 1 2024-05-09T06:30:28.102 INFO:tasks.workunit.client.1.smithi106.stdout:1/523: fsync d4/d5/f89 0 2024-05-09T06:30:28.102 INFO:tasks.workunit.client.1.smithi106.stdout:1/524: chown d4/d5/l98 7149661 1 2024-05-09T06:30:28.103 INFO:tasks.workunit.client.1.smithi106.stdout:9/535: truncate d4/d54/d69/d95/d23/d2f/d38/f3a 1065222 0 2024-05-09T06:30:28.105 INFO:tasks.workunit.client.1.smithi106.stdout:0/567: rmdir d1/da1/d83 39 2024-05-09T06:30:28.105 INFO:tasks.workunit.client.1.smithi106.stdout:0/568: dread - d1/d11/d23/d22/f74 zero size 2024-05-09T06:30:28.105 INFO:tasks.workunit.client.1.smithi106.stdout:0/569: creat d1/d11/d23/d13/d58/fbf x:0 0 0 2024-05-09T06:30:28.109 INFO:tasks.workunit.client.1.smithi106.stdout:6/525: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d6c/fb2 x:0 0 0 2024-05-09T06:30:28.115 INFO:tasks.workunit.client.1.smithi106.stdout:5/510: sync 2024-05-09T06:30:28.116 INFO:tasks.workunit.client.1.smithi106.stdout:9/536: symlink d4/d54/d69/d95/d23/d78/d8f/l96 0 2024-05-09T06:30:28.116 INFO:tasks.workunit.client.1.smithi106.stdout:9/537: chown d4/c8a 1855593 1 2024-05-09T06:30:28.123 INFO:tasks.workunit.client.1.smithi106.stdout:0/570: dwrite d1/d11/d23/d22/f31 [4194304,4194304] 0 2024-05-09T06:30:28.123 INFO:tasks.workunit.client.1.smithi106.stdout:5/511: truncate d8/d45/d4c/d32/d5b/f2c 1897092 0 2024-05-09T06:30:28.127 INFO:tasks.workunit.client.1.smithi106.stdout:6/526: dwrite d0/d5c/faf [0,4194304] 0 2024-05-09T06:30:28.127 INFO:tasks.workunit.client.1.smithi106.stdout:9/538: truncate d4/d54/d69/d95/f11 5708979 0 2024-05-09T06:30:28.131 INFO:tasks.workunit.client.1.smithi106.stdout:3/448: rename d5/d1c/d53 to d5/d85 0 2024-05-09T06:30:28.131 INFO:tasks.workunit.client.1.smithi106.stdout:2/598: rename d2/d5/db to d2/d5/db/d68/dd1 22 2024-05-09T06:30:28.131 INFO:tasks.workunit.client.1.smithi106.stdout:2/599: dread - d2/d5/db/d15/d41/d60/dcc/fd0 zero size 2024-05-09T06:30:28.131 INFO:tasks.workunit.client.1.smithi106.stdout:2/600: fdatasync d2/d7/d2c/f80 0 2024-05-09T06:30:28.140 INFO:tasks.workunit.client.1.smithi106.stdout:5/512: dwrite d8/d45/d4c/f5c [0,4194304] 0 2024-05-09T06:30:28.142 INFO:tasks.workunit.client.1.smithi106.stdout:6/527: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/fb3 x:0 0 0 2024-05-09T06:30:28.143 INFO:tasks.workunit.client.1.smithi106.stdout:9/539: stat d4/f25 0 2024-05-09T06:30:28.145 INFO:tasks.workunit.client.1.smithi106.stdout:7/474: rename d0/dc/d1a/d36/d30/d44/d58/c73 to d0/dc/d1a/d36/d30/d44/c93 0 2024-05-09T06:30:28.145 INFO:tasks.workunit.client.1.smithi106.stdout:8/461: rename d3/d5/d35/d4e/d32 to d3/d5/d35/d4e/d32/d92/da8 22 2024-05-09T06:30:28.151 INFO:tasks.workunit.client.1.smithi106.stdout:3/449: mknod d5/c86 0 2024-05-09T06:30:28.154 INFO:tasks.workunit.client.1.smithi106.stdout:2/601: creat d2/d5/db/d1d/d23/d5e/fd2 x:0 0 0 2024-05-09T06:30:28.154 INFO:tasks.workunit.client.1.smithi106.stdout:2/602: write d2/d5/db/d1d/d23/d63/fae [519205,96852] 0 2024-05-09T06:30:28.156 INFO:tasks.workunit.client.1.smithi106.stdout:0/571: rmdir d1/d11/d23/d13/d58/da8 39 2024-05-09T06:30:28.167 INFO:tasks.workunit.client.1.smithi106.stdout:5/513: mknod d8/d45/d4c/d32/ca3 0 2024-05-09T06:30:28.167 INFO:tasks.workunit.client.1.smithi106.stdout:5/514: write d8/d5a/d60/d7e/f82 [774104,53089] 0 2024-05-09T06:30:28.171 INFO:tasks.workunit.client.1.smithi106.stdout:6/528: mkdir d0/d17/d34/d95/db4 0 2024-05-09T06:30:28.172 INFO:tasks.workunit.client.1.smithi106.stdout:9/540: creat d4/d54/d69/d95/d1b/d2a/d42/f97 x:0 0 0 2024-05-09T06:30:28.173 INFO:tasks.workunit.client.1.smithi106.stdout:5/515: dread d8/d33/d3a/d59/d99/f80 [0,4194304] 0 2024-05-09T06:30:28.173 INFO:tasks.workunit.client.1.smithi106.stdout:5/516: truncate d8/d45/f70 870448 0 2024-05-09T06:30:28.173 INFO:tasks.workunit.client.1.smithi106.stdout:5/517: chown d8/d45/d4c/d32/d5b/f41 0 1 2024-05-09T06:30:28.173 INFO:tasks.workunit.client.1.smithi106.stdout:5/518: readlink d8/d45/d4c/d32/d5b/l22 0 2024-05-09T06:30:28.175 INFO:tasks.workunit.client.1.smithi106.stdout:7/475: getdents d0/dc/d1a/d36/d30/d44/d58/d65/d84 0 2024-05-09T06:30:28.178 INFO:tasks.workunit.client.1.smithi106.stdout:4/473: rename d7/f11 to d7/d39/d35/f9b 0 2024-05-09T06:30:28.181 INFO:tasks.workunit.client.1.smithi106.stdout:8/462: mkdir d3/d5/d35/d73/d9d/da9 0 2024-05-09T06:30:28.181 INFO:tasks.workunit.client.1.smithi106.stdout:8/463: truncate d3/d5/d13/f36 3505594 0 2024-05-09T06:30:28.187 INFO:tasks.workunit.client.1.smithi106.stdout:6/529: dwrite d0/d66/fa0 [0,4194304] 0 2024-05-09T06:30:28.187 INFO:tasks.workunit.client.1.smithi106.stdout:6/530: fsync d0/d17/d76/f71 0 2024-05-09T06:30:28.188 INFO:tasks.workunit.client.1.smithi106.stdout:3/450: symlink d5/d4d/d5f/l87 0 2024-05-09T06:30:28.188 INFO:tasks.workunit.client.1.smithi106.stdout:3/451: chown d5/d1c/d21/l46 1 1 2024-05-09T06:30:28.188 INFO:tasks.workunit.client.1.smithi106.stdout:3/452: write d5/d1c/d24/d5b/f66 [8924279,4731] 0 2024-05-09T06:30:28.194 INFO:tasks.workunit.client.1.smithi106.stdout:0/572: creat d1/d11/d23/d13/d8a/fc0 x:0 0 0 2024-05-09T06:30:28.198 INFO:tasks.workunit.client.1.smithi106.stdout:6/531: dread d0/d17/f89 [0,4194304] 0 2024-05-09T06:30:28.198 INFO:tasks.workunit.client.1.smithi106.stdout:9/541: getdents d4/d54/d69/d95/d23/d16 0 2024-05-09T06:30:28.198 INFO:tasks.workunit.client.1.smithi106.stdout:5/519: dwrite d8/d33/d3a/d59/f68 [0,4194304] 0 2024-05-09T06:30:28.200 INFO:tasks.workunit.client.1.smithi106.stdout:1/525: rename d4/f15 to d4/d76/d13/d60/d9c/dbe/fc0 0 2024-05-09T06:30:28.200 INFO:tasks.workunit.client.1.smithi106.stdout:1/526: creat d4/d5b/d75/fc1 x:0 0 0 2024-05-09T06:30:28.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/527: write d4/d76/fa3 [510741,35983] 0 2024-05-09T06:30:28.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/528: fdatasync d4/da7/fae 0 2024-05-09T06:30:28.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/529: dread - d4/d5b/f8c zero size 2024-05-09T06:30:28.202 INFO:tasks.workunit.client.1.smithi106.stdout:4/474: mkdir d7/d39/d35/d6f/d9c 0 2024-05-09T06:30:28.209 INFO:tasks.workunit.client.1.smithi106.stdout:3/453: mknod d5/d1c/d24/d52/c88 0 2024-05-09T06:30:28.220 INFO:tasks.workunit.client.1.smithi106.stdout:7/476: dwrite d0/dc/d1a/d36/d1e/d68/f6b [0,4194304] 0 2024-05-09T06:30:28.220 INFO:tasks.workunit.client.1.smithi106.stdout:7/477: chown d0/dc/d1a/d36/d30/f32 446584 1 2024-05-09T06:30:28.220 INFO:tasks.workunit.client.1.smithi106.stdout:9/542: dwrite d4/d54/d69/d95/f2e [0,4194304] 0 2024-05-09T06:30:28.220 INFO:tasks.workunit.client.1.smithi106.stdout:1/530: dwrite d4/d76/f53 [0,4194304] 0 2024-05-09T06:30:28.220 INFO:tasks.workunit.client.1.smithi106.stdout:1/531: dread - d4/d76/d13/d60/fac zero size 2024-05-09T06:30:28.226 INFO:tasks.workunit.client.1.smithi106.stdout:0/573: mkdir d1/d11/d23/d13/d8a/dc1 0 2024-05-09T06:30:28.226 INFO:tasks.workunit.client.1.smithi106.stdout:0/574: write d1/d11/d23/f64 [1933065,43619] 0 2024-05-09T06:30:28.227 INFO:tasks.workunit.client.1.smithi106.stdout:0/575: write d1/f7 [4125989,113043] 0 2024-05-09T06:30:28.228 INFO:tasks.workunit.client.1.smithi106.stdout:6/532: creat d0/fb5 x:0 0 0 2024-05-09T06:30:28.231 INFO:tasks.workunit.client.1.smithi106.stdout:5/520: creat d8/d45/d4c/d32/d5b/d95/fa4 x:0 0 0 2024-05-09T06:30:28.240 INFO:tasks.workunit.client.1.smithi106.stdout:4/475: unlink d7/d10/d1a/d5a/d1c/l13 0 2024-05-09T06:30:28.243 INFO:tasks.workunit.client.1.smithi106.stdout:3/454: mkdir d5/d1c/d24/d89 0 2024-05-09T06:30:28.243 INFO:tasks.workunit.client.1.smithi106.stdout:3/455: fdatasync d5/d1c/f76 0 2024-05-09T06:30:28.245 INFO:tasks.workunit.client.1.smithi106.stdout:5/521: dwrite d8/d7c/f9a [0,4194304] 0 2024-05-09T06:30:28.245 INFO:tasks.workunit.client.1.smithi106.stdout:5/522: write d8/d45/d4c/f6e [874672,16822] 0 2024-05-09T06:30:28.246 INFO:tasks.workunit.client.1.smithi106.stdout:3/456: write d5/d1c/d24/f28 [8462860,75146] 0 2024-05-09T06:30:28.252 INFO:tasks.workunit.client.1.smithi106.stdout:4/476: dread d7/d10/d1a/d5a/d1c/f49 [0,4194304] 0 2024-05-09T06:30:28.252 INFO:tasks.workunit.client.1.smithi106.stdout:4/477: fsync d7/d28/d2a/f2b 0 2024-05-09T06:30:28.252 INFO:tasks.workunit.client.1.smithi106.stdout:4/478: truncate d7/d10/d1a/d5a/f55 105888 0 2024-05-09T06:30:28.252 INFO:tasks.workunit.client.1.smithi106.stdout:4/479: stat d7/d39/f3f 0 2024-05-09T06:30:28.253 INFO:tasks.workunit.client.1.smithi106.stdout:7/478: truncate d0/dc/d1a/d5a/f70 32312 0 2024-05-09T06:30:28.258 INFO:tasks.workunit.client.1.smithi106.stdout:9/543: creat d4/f98 x:0 0 0 2024-05-09T06:30:28.262 INFO:tasks.workunit.client.1.smithi106.stdout:1/532: symlink d4/d5/lc2 0 2024-05-09T06:30:28.262 INFO:tasks.workunit.client.1.smithi106.stdout:1/533: creat d4/d37/d3d/fc3 x:0 0 0 2024-05-09T06:30:28.272 INFO:tasks.workunit.client.1.smithi106.stdout:0/576: link d1/d11/d23/d13/d2c/d3d/l85 d1/d11/d23/d13/d58/lc2 0 2024-05-09T06:30:28.276 INFO:tasks.workunit.client.1.smithi106.stdout:6/533: rename d0/d17/d76/l6b to d0/d17/d34/d4e/d98/lb6 0 2024-05-09T06:30:28.276 INFO:tasks.workunit.client.1.smithi106.stdout:6/534: chown d0/d66/l90 759968 1 2024-05-09T06:30:28.276 INFO:tasks.workunit.client.1.smithi106.stdout:6/535: chown d0/d5c/l92 359 1 2024-05-09T06:30:28.279 INFO:tasks.workunit.client.1.smithi106.stdout:7/479: dwrite d0/dc/d1a/d36/d30/d44/d58/f5f [0,4194304] 0 2024-05-09T06:30:28.279 INFO:tasks.workunit.client.1.smithi106.stdout:7/480: write d0/dc/d1a/d36/d30/d44/f7f [339051,87368] 0 2024-05-09T06:30:28.279 INFO:tasks.workunit.client.1.smithi106.stdout:7/481: creat d0/dc/d1a/d5a/f94 x:0 0 0 2024-05-09T06:30:28.279 INFO:tasks.workunit.client.1.smithi106.stdout:3/457: dwrite d5/d1c/d24/d52/f71 [0,4194304] 0 2024-05-09T06:30:28.285 INFO:tasks.workunit.client.1.smithi106.stdout:4/480: dwrite d7/d39/d35/f76 [0,4194304] 0 2024-05-09T06:30:28.302 INFO:tasks.workunit.client.1.smithi106.stdout:1/534: mknod d4/d76/daa/cc4 0 2024-05-09T06:30:28.303 INFO:tasks.workunit.client.1.smithi106.stdout:1/535: read d4/f2d [597334,51590] 0 2024-05-09T06:30:28.306 INFO:tasks.workunit.client.1.smithi106.stdout:2/603: write d2/d7/db7/fa9 [572432,42120] 0 2024-05-09T06:30:28.307 INFO:tasks.workunit.client.1.smithi106.stdout:0/577: truncate d1/d11/f56 685193 0 2024-05-09T06:30:28.313 INFO:tasks.workunit.client.1.smithi106.stdout:1/536: dread d4/f14 [0,4194304] 0 2024-05-09T06:30:28.313 INFO:tasks.workunit.client.1.smithi106.stdout:1/537: fdatasync d4/f14 0 2024-05-09T06:30:28.320 INFO:tasks.workunit.client.1.smithi106.stdout:3/458: rmdir d5/d12/d26 39 2024-05-09T06:30:28.327 INFO:tasks.workunit.client.1.smithi106.stdout:2/604: mkdir d2/d5/d9c/dd3 0 2024-05-09T06:30:28.329 INFO:tasks.workunit.client.1.smithi106.stdout:2/605: dread d2/d5/db/d1d/d23/d63/fae [0,4194304] 0 2024-05-09T06:30:28.330 INFO:tasks.workunit.client.1.smithi106.stdout:2/606: dread d2/d7/d2c/f78 [0,4194304] 0 2024-05-09T06:30:28.330 INFO:tasks.workunit.client.1.smithi106.stdout:2/607: write d2/d5/db/d1d/f9b [749348,35990] 0 2024-05-09T06:30:28.330 INFO:tasks.workunit.client.1.smithi106.stdout:2/608: write d2/d5/db/d15/d41/d60/dcc/fd0 [715494,38133] 0 2024-05-09T06:30:28.330 INFO:tasks.workunit.client.1.smithi106.stdout:0/578: mknod d1/cc3 0 2024-05-09T06:30:28.332 INFO:tasks.workunit.client.1.smithi106.stdout:6/536: getdents d0/d17/d34 0 2024-05-09T06:30:28.337 INFO:tasks.workunit.client.1.smithi106.stdout:9/544: rename d4/d54/d69/d95/d1b to d4/d54/d69/d99 0 2024-05-09T06:30:28.341 INFO:tasks.workunit.client.1.smithi106.stdout:6/537: dread d0/d17/d34/d4e/d98/da9/db1/d8/d27/f2c [0,4194304] 0 2024-05-09T06:30:28.341 INFO:tasks.workunit.client.1.smithi106.stdout:6/538: write d0/d66/fa0 [4896342,58290] 0 2024-05-09T06:30:28.343 INFO:tasks.workunit.client.1.smithi106.stdout:1/538: dread d4/d76/d1d/f38 [0,4194304] 0 2024-05-09T06:30:28.343 INFO:tasks.workunit.client.1.smithi106.stdout:1/539: dread - d4/d76/d13/d60/fac zero size 2024-05-09T06:30:28.345 INFO:tasks.workunit.client.1.smithi106.stdout:0/579: mkdir d1/d11/d23/d13/d63/dc4 0 2024-05-09T06:30:28.347 INFO:tasks.workunit.client.1.smithi106.stdout:3/459: rename d5/d1c/d7d/l84 to d5/d4d/d5f/l8a 0 2024-05-09T06:30:28.348 INFO:tasks.workunit.client.1.smithi106.stdout:3/460: write d5/d12/f74 [1040356,22850] 0 2024-05-09T06:30:28.348 INFO:tasks.workunit.client.1.smithi106.stdout:6/539: write d0/d17/d76/d8b/f91 [1673632,124209] 0 2024-05-09T06:30:28.348 INFO:tasks.workunit.client.1.smithi106.stdout:6/540: write d0/d17/d34/d4e/d98/da9/db1/fe [1455249,56844] 0 2024-05-09T06:30:28.349 INFO:tasks.workunit.client.1.smithi106.stdout:9/545: mkdir d4/d54/d69/d95/d23/d78/d8f/d9a 0 2024-05-09T06:30:28.350 INFO:tasks.workunit.client.1.smithi106.stdout:9/546: stat d4/d54/d69/d95/d23/d16/l7e 0 2024-05-09T06:30:28.350 INFO:tasks.workunit.client.1.smithi106.stdout:9/547: stat d4/d54/d69/d95/d23/l22 0 2024-05-09T06:30:28.362 INFO:tasks.workunit.client.1.smithi106.stdout:1/540: rmdir d4 39 2024-05-09T06:30:28.365 INFO:tasks.workunit.client.1.smithi106.stdout:0/580: symlink d1/d11/d23/d13/lc5 0 2024-05-09T06:30:28.368 INFO:tasks.workunit.client.1.smithi106.stdout:3/461: mknod d5/d1c/d24/d52/c8b 0 2024-05-09T06:30:28.374 INFO:tasks.workunit.client.1.smithi106.stdout:6/541: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/cb7 0 2024-05-09T06:30:28.374 INFO:tasks.workunit.client.1.smithi106.stdout:6/542: readlink d0/d66/d7e/l2e 0 2024-05-09T06:30:28.375 INFO:tasks.workunit.client.1.smithi106.stdout:8/464: sync 2024-05-09T06:30:28.375 INFO:tasks.workunit.client.1.smithi106.stdout:8/465: dread - d3/d5/d35/d4e/d32/f75 zero size 2024-05-09T06:30:28.376 INFO:tasks.workunit.client.1.smithi106.stdout:6/543: dread d0/d17/d34/d4e/d98/da9/db1/fb [0,4194304] 0 2024-05-09T06:30:28.380 INFO:tasks.workunit.client.1.smithi106.stdout:1/541: rename d4/d5b/f7e to d4/d76/d13/d60/fc5 0 2024-05-09T06:30:28.380 INFO:tasks.workunit.client.1.smithi106.stdout:1/542: fsync d4/d76/d13/f25 0 2024-05-09T06:30:28.380 INFO:tasks.workunit.client.1.smithi106.stdout:1/543: creat d4/d37/d74/fc6 x:0 0 0 2024-05-09T06:30:28.380 INFO:tasks.workunit.client.1.smithi106.stdout:1/544: read d4/d76/d13/d2f/f42 [2770434,50276] 0 2024-05-09T06:30:28.381 INFO:tasks.workunit.client.1.smithi106.stdout:1/545: chown d4/d37/d3d/f96 24219113 1 2024-05-09T06:30:28.381 INFO:tasks.workunit.client.1.smithi106.stdout:1/546: write d4/d76/d13/d60/fc5 [441789,398] 0 2024-05-09T06:30:28.384 INFO:tasks.workunit.client.1.smithi106.stdout:3/462: mkdir d5/d1c/d24/d89/d8c 0 2024-05-09T06:30:28.384 INFO:tasks.workunit.client.1.smithi106.stdout:6/544: dread d0/d5c/faf [0,4194304] 0 2024-05-09T06:30:28.385 INFO:tasks.workunit.client.1.smithi106.stdout:8/466: creat d3/d5/d7/d98/faa x:0 0 0 2024-05-09T06:30:28.387 INFO:tasks.workunit.client.1.smithi106.stdout:1/547: dread d4/d5b/f9f [0,4194304] 0 2024-05-09T06:30:28.392 INFO:tasks.workunit.client.1.smithi106.stdout:6/545: mknod d0/d17/d34/d4e/d98/da9/db1/d8/cb8 0 2024-05-09T06:30:28.393 INFO:tasks.workunit.client.1.smithi106.stdout:6/546: write d0/f19 [677666,98883] 0 2024-05-09T06:30:28.398 INFO:tasks.workunit.client.1.smithi106.stdout:8/467: link d3/l23 d3/d5/d35/d4e/lab 0 2024-05-09T06:30:28.398 INFO:tasks.workunit.client.1.smithi106.stdout:8/468: chown d3/d5/d7/c19 0 1 2024-05-09T06:30:28.401 INFO:tasks.workunit.client.1.smithi106.stdout:1/548: symlink d4/d76/d65/d8d/db5/lc7 0 2024-05-09T06:30:28.402 INFO:tasks.workunit.client.1.smithi106.stdout:1/549: dread - d4/d76/d65/d67/fb2 zero size 2024-05-09T06:30:28.406 INFO:tasks.workunit.client.1.smithi106.stdout:0/581: link d1/d11/f56 d1/da1/fc6 0 2024-05-09T06:30:28.408 INFO:tasks.workunit.client.1.smithi106.stdout:8/469: rmdir d3/d5/d35/d86 0 2024-05-09T06:30:28.412 INFO:tasks.workunit.client.1.smithi106.stdout:1/550: symlink d4/d37/d74/lc8 0 2024-05-09T06:30:28.412 INFO:tasks.workunit.client.1.smithi106.stdout:1/551: write d4/fa [388872,125536] 0 2024-05-09T06:30:28.413 INFO:tasks.workunit.client.1.smithi106.stdout:8/470: creat d3/d5/d35/d4e/d32/fac x:0 0 0 2024-05-09T06:30:28.413 INFO:tasks.workunit.client.1.smithi106.stdout:8/471: truncate d3/d5/d13/d3a/f90 504536 0 2024-05-09T06:30:28.413 INFO:tasks.workunit.client.1.smithi106.stdout:8/472: truncate d3/d5/d35/d61/f63 492883 0 2024-05-09T06:30:28.413 INFO:tasks.workunit.client.1.smithi106.stdout:8/473: creat d3/d5/d35/d73/fad x:0 0 0 2024-05-09T06:30:28.419 INFO:tasks.workunit.client.1.smithi106.stdout:8/474: rmdir d3/d5/d7/d15/d47/d50 39 2024-05-09T06:30:28.420 INFO:tasks.workunit.client.1.smithi106.stdout:6/547: dwrite d0/d17/d34/d95/fa4 [0,4194304] 0 2024-05-09T06:30:28.421 INFO:tasks.workunit.client.1.smithi106.stdout:6/548: chown d0/d17/d34/d4e/d98/da9/db1/d8/d27/l5a 233 1 2024-05-09T06:30:28.421 INFO:tasks.workunit.client.1.smithi106.stdout:6/549: creat d0/d5c/fb9 x:0 0 0 2024-05-09T06:30:28.421 INFO:tasks.workunit.client.1.smithi106.stdout:2/609: rmdir d2/d5/d9c 39 2024-05-09T06:30:28.421 INFO:tasks.workunit.client.1.smithi106.stdout:2/610: truncate d2/f8d 802879 0 2024-05-09T06:30:28.423 INFO:tasks.workunit.client.1.smithi106.stdout:0/582: dwrite d1/d11/d23/d13/d58/f71 [4194304,4194304] 0 2024-05-09T06:30:28.424 INFO:tasks.workunit.client.1.smithi106.stdout:1/552: dread d4/d76/d13/f80 [0,4194304] 0 2024-05-09T06:30:28.424 INFO:tasks.workunit.client.1.smithi106.stdout:0/583: stat d1/d11/d23/d13/d63/d7e/fa5 0 2024-05-09T06:30:28.424 INFO:tasks.workunit.client.1.smithi106.stdout:8/475: link d3/d5/d7/d15/fa7 d3/d5/d7/d98/fae 0 2024-05-09T06:30:28.424 INFO:tasks.workunit.client.1.smithi106.stdout:8/476: write d3/d5/f5a [3531880,71362] 0 2024-05-09T06:30:28.430 INFO:tasks.workunit.client.1.smithi106.stdout:8/477: write d3/d5/d35/d61/f80 [2004802,95538] 0 2024-05-09T06:30:28.430 INFO:tasks.workunit.client.1.smithi106.stdout:8/478: chown d3/d5/d13/d3a/f77 0 1 2024-05-09T06:30:28.437 INFO:tasks.workunit.client.1.smithi106.stdout:3/463: rename d5/d4d/d5f/l8a to d5/d4d/d5f/l8d 0 2024-05-09T06:30:28.438 INFO:tasks.workunit.client.1.smithi106.stdout:6/550: getdents d0/d17/d34/d95 0 2024-05-09T06:30:28.442 INFO:tasks.workunit.client.1.smithi106.stdout:2/611: mknod d2/d5/db/d1d/d23/d63/d7a/cd4 0 2024-05-09T06:30:28.442 INFO:tasks.workunit.client.1.smithi106.stdout:2/612: read d2/f26 [2126121,118860] 0 2024-05-09T06:30:28.445 INFO:tasks.workunit.client.1.smithi106.stdout:5/523: sync 2024-05-09T06:30:28.447 INFO:tasks.workunit.client.1.smithi106.stdout:5/524: dread d8/d45/d4c/f6e [0,4194304] 0 2024-05-09T06:30:28.451 INFO:tasks.workunit.client.1.smithi106.stdout:1/553: truncate d4/d76/f5f 4112516 0 2024-05-09T06:30:28.452 INFO:tasks.workunit.client.1.smithi106.stdout:1/554: truncate d4/d76/d13/d2f/f7f 1354156 0 2024-05-09T06:30:28.454 INFO:tasks.workunit.client.1.smithi106.stdout:0/584: creat d1/d11/fc7 x:0 0 0 2024-05-09T06:30:28.456 INFO:tasks.workunit.client.1.smithi106.stdout:5/525: write d8/f10 [5053274,66155] 0 2024-05-09T06:30:28.463 INFO:tasks.workunit.client.1.smithi106.stdout:0/585: write d1/d11/d23/d13/d63/d7e/fa5 [3284042,124552] 0 2024-05-09T06:30:28.463 INFO:tasks.workunit.client.1.smithi106.stdout:3/464: unlink d5/fe 0 2024-05-09T06:30:28.465 INFO:tasks.workunit.client.1.smithi106.stdout:6/551: rmdir d0/d17/d34/d4e 39 2024-05-09T06:30:28.467 INFO:tasks.workunit.client.1.smithi106.stdout:2/613: unlink d2/d5/db/c29 0 2024-05-09T06:30:28.470 INFO:tasks.workunit.client.1.smithi106.stdout:5/526: dwrite d8/d45/d4c/d32/d5b/f41 [0,4194304] 0 2024-05-09T06:30:28.470 INFO:tasks.workunit.client.1.smithi106.stdout:5/527: readlink d8/d45/d4c/l2f 0 2024-05-09T06:30:28.470 INFO:tasks.workunit.client.1.smithi106.stdout:5/528: write d8/d45/d4c/d85/fa0 [552321,31353] 0 2024-05-09T06:30:28.471 INFO:tasks.workunit.client.1.smithi106.stdout:1/555: link d4/d76/d1d/f38 d4/d76/d13/dbb/fc9 0 2024-05-09T06:30:28.477 INFO:tasks.workunit.client.1.smithi106.stdout:3/465: mkdir d5/d1c/d24/d89/d8e 0 2024-05-09T06:30:28.480 INFO:tasks.workunit.client.1.smithi106.stdout:6/552: symlink d0/d17/d34/d4e/d98/da9/db1/lba 0 2024-05-09T06:30:28.484 INFO:tasks.workunit.client.1.smithi106.stdout:2/614: unlink d2/d5/db/d1d/d23/c48 0 2024-05-09T06:30:28.484 INFO:tasks.workunit.client.1.smithi106.stdout:0/586: dwrite d1/d11/d23/d13/d2c/d6d/f73 [0,4194304] 0 2024-05-09T06:30:28.488 INFO:tasks.workunit.client.1.smithi106.stdout:5/529: dwrite d8/f7a [0,4194304] 0 2024-05-09T06:30:28.489 INFO:tasks.workunit.client.1.smithi106.stdout:5/530: dread d8/f1a [0,4194304] 0 2024-05-09T06:30:28.490 INFO:tasks.workunit.client.1.smithi106.stdout:5/531: write d8/f12 [470239,93866] 0 2024-05-09T06:30:28.490 INFO:tasks.workunit.client.1.smithi106.stdout:5/532: write d8/d33/f3b [892528,6882] 0 2024-05-09T06:30:28.490 INFO:tasks.workunit.client.1.smithi106.stdout:5/533: readlink d8/l21 0 2024-05-09T06:30:28.497 INFO:tasks.workunit.client.1.smithi106.stdout:6/553: unlink d0/d17/d34/d4e/d98/da9/db1/d8/f46 0 2024-05-09T06:30:28.507 INFO:tasks.workunit.client.1.smithi106.stdout:0/587: link d1/f4b d1/d11/d23/d13/d58/fc8 0 2024-05-09T06:30:28.513 INFO:tasks.workunit.client.1.smithi106.stdout:5/534: mknod d8/d33/ca5 0 2024-05-09T06:30:28.521 INFO:tasks.workunit.client.1.smithi106.stdout:5/535: dread d8/d33/f4f [0,4194304] 0 2024-05-09T06:30:28.521 INFO:tasks.workunit.client.1.smithi106.stdout:5/536: chown d8/d45/d4c/d32/d5b/f41 64 1 2024-05-09T06:30:28.522 INFO:tasks.workunit.client.1.smithi106.stdout:0/588: rmdir d1/d11/d23/d13/d63/dc4 0 2024-05-09T06:30:28.523 INFO:tasks.workunit.client.1.smithi106.stdout:0/589: getdents d1/d11/d23/d13/d2c/d57 0 2024-05-09T06:30:28.523 INFO:tasks.workunit.client.1.smithi106.stdout:0/590: creat d1/d11/d23/d13/d8a/fc9 x:0 0 0 2024-05-09T06:30:28.523 INFO:tasks.workunit.client.1.smithi106.stdout:0/591: fdatasync d1/d11/d23/d13/d63/d7e/fa5 0 2024-05-09T06:30:28.524 INFO:tasks.workunit.client.1.smithi106.stdout:6/554: rmdir d0/d5c 39 2024-05-09T06:30:28.525 INFO:tasks.workunit.client.1.smithi106.stdout:6/555: chown d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/f84 291466228 1 2024-05-09T06:30:28.525 INFO:tasks.workunit.client.1.smithi106.stdout:2/615: rmdir d2/d5/db/d1d/d23/d63 39 2024-05-09T06:30:28.530 INFO:tasks.workunit.client.1.smithi106.stdout:5/537: symlink d8/d5a/d60/d7e/la6 0 2024-05-09T06:30:28.535 INFO:tasks.workunit.client.1.smithi106.stdout:0/592: unlink d1/d11/d23/f1f 0 2024-05-09T06:30:28.537 INFO:tasks.workunit.client.1.smithi106.stdout:6/556: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d27/dbb 0 2024-05-09T06:30:28.537 INFO:tasks.workunit.client.1.smithi106.stdout:6/557: write d0/d17/f1e [527706,13906] 0 2024-05-09T06:30:28.540 INFO:tasks.workunit.client.1.smithi106.stdout:0/593: symlink d1/d11/lca 0 2024-05-09T06:30:28.543 INFO:tasks.workunit.client.1.smithi106.stdout:6/558: getdents d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88 0 2024-05-09T06:30:28.545 INFO:tasks.workunit.client.1.smithi106.stdout:5/538: rmdir d8/d45/d4c/d85 39 2024-05-09T06:30:28.545 INFO:tasks.workunit.client.1.smithi106.stdout:5/539: fdatasync d8/d45/d4c/d32/d5b/f8c 0 2024-05-09T06:30:28.545 INFO:tasks.workunit.client.1.smithi106.stdout:7/482: sync 2024-05-09T06:30:28.547 INFO:tasks.workunit.client.1.smithi106.stdout:4/481: sync 2024-05-09T06:30:28.547 INFO:tasks.workunit.client.1.smithi106.stdout:9/548: sync 2024-05-09T06:30:28.547 INFO:tasks.workunit.client.1.smithi106.stdout:9/549: chown d4/d54/d69/d99/f3e 10 1 2024-05-09T06:30:28.547 INFO:tasks.workunit.client.1.smithi106.stdout:9/550: write d4/d54/d69/d95/d23/d16/f24 [169612,32841] 0 2024-05-09T06:30:28.547 INFO:tasks.workunit.client.1.smithi106.stdout:9/551: fsync d4/d54/d69/d95/f2e 0 2024-05-09T06:30:28.548 INFO:tasks.workunit.client.1.smithi106.stdout:2/616: dwrite d2/d7/d2c/f42 [0,4194304] 0 2024-05-09T06:30:28.548 INFO:tasks.workunit.client.1.smithi106.stdout:2/617: stat d2/d5/db/d1d/c28 0 2024-05-09T06:30:28.548 INFO:tasks.workunit.client.1.smithi106.stdout:0/594: link d1/da1/fad d1/d11/d23/d22/fcb 0 2024-05-09T06:30:28.557 INFO:tasks.workunit.client.1.smithi106.stdout:2/618: truncate d2/d7/db7/f7c 205082 0 2024-05-09T06:30:28.557 INFO:tasks.workunit.client.1.smithi106.stdout:7/483: write d0/dc/d1a/d36/d30/f32 [3162671,1122] 0 2024-05-09T06:30:28.557 INFO:tasks.workunit.client.1.smithi106.stdout:2/619: creat d2/d7/fd5 x:0 0 0 2024-05-09T06:30:28.558 INFO:tasks.workunit.client.1.smithi106.stdout:2/620: write d2/d7/db7/fa0 [420083,29475] 0 2024-05-09T06:30:28.558 INFO:tasks.workunit.client.1.smithi106.stdout:4/482: rmdir d7/d39/d47/d66 39 2024-05-09T06:30:28.559 INFO:tasks.workunit.client.1.smithi106.stdout:9/552: write d4/d54/d69/d95/f2b [3950264,74425] 0 2024-05-09T06:30:28.562 INFO:tasks.workunit.client.1.smithi106.stdout:5/540: dread d8/d45/d4c/d32/d5b/f52 [0,4194304] 0 2024-05-09T06:30:28.562 INFO:tasks.workunit.client.1.smithi106.stdout:5/541: stat d8/f10 0 2024-05-09T06:30:28.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/621: mkdir d2/d5/db/d15/dd6 0 2024-05-09T06:30:28.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/622: dread - d2/d5/db/d1d/d23/d63/fb5 zero size 2024-05-09T06:30:28.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/623: fdatasync d2/d7/f25 0 2024-05-09T06:30:28.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/624: chown d2/d5/db/d1d/d90/lab 58216617 1 2024-05-09T06:30:28.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/625: creat d2/d7/fd7 x:0 0 0 2024-05-09T06:30:28.567 INFO:tasks.workunit.client.1.smithi106.stdout:4/483: read d7/d39/f7b [1095625,19986] 0 2024-05-09T06:30:28.568 INFO:tasks.workunit.client.1.smithi106.stdout:9/553: mknod d4/d54/d69/d99/d2a/d42/d6c/d6d/c9b 0 2024-05-09T06:30:28.571 INFO:tasks.workunit.client.1.smithi106.stdout:5/542: link d8/f51 d8/d45/d4c/d32/d5b/d95/fa7 0 2024-05-09T06:30:28.572 INFO:tasks.workunit.client.1.smithi106.stdout:6/559: dwrite d0/fb5 [0,4194304] 0 2024-05-09T06:30:28.576 INFO:tasks.workunit.client.1.smithi106.stdout:0/595: dwrite d1/d11/d23/d13/d58/f71 [0,4194304] 0 2024-05-09T06:30:28.577 INFO:tasks.workunit.client.1.smithi106.stdout:2/626: creat d2/d5/fd8 x:0 0 0 2024-05-09T06:30:28.578 INFO:tasks.workunit.client.1.smithi106.stdout:7/484: dwrite d0/dc/d1a/d36/f3f [0,4194304] 0 2024-05-09T06:30:28.578 INFO:tasks.workunit.client.1.smithi106.stdout:7/485: read d0/dc/d1a/d36/d30/d44/d6a/f6d [181953,118637] 0 2024-05-09T06:30:28.578 INFO:tasks.workunit.client.1.smithi106.stdout:7/486: chown d0/dc/d1a/c3e 737 1 2024-05-09T06:30:28.579 INFO:tasks.workunit.client.1.smithi106.stdout:9/554: rmdir d4/d54/d69/d95/d23/d16 39 2024-05-09T06:30:28.580 INFO:tasks.workunit.client.1.smithi106.stdout:5/543: getdents d8/d45/d4c/d32/d5b/d69 0 2024-05-09T06:30:28.585 INFO:tasks.workunit.client.1.smithi106.stdout:4/484: dwrite d7/d10/f51 [0,4194304] 0 2024-05-09T06:30:28.587 INFO:tasks.workunit.client.1.smithi106.stdout:6/560: creat d0/d66/fbc x:0 0 0 2024-05-09T06:30:28.587 INFO:tasks.workunit.client.1.smithi106.stdout:6/561: write d0/d17/f57 [5191114,65933] 0 2024-05-09T06:30:28.590 INFO:tasks.workunit.client.1.smithi106.stdout:0/596: truncate d1/d11/d23/d13/d58/f60 144498 0 2024-05-09T06:30:28.592 INFO:tasks.workunit.client.1.smithi106.stdout:2/627: rmdir d2/d5/db/d15/d41/d60 39 2024-05-09T06:30:28.596 INFO:tasks.workunit.client.1.smithi106.stdout:5/544: dwrite d8/f51 [0,4194304] 0 2024-05-09T06:30:28.597 INFO:tasks.workunit.client.1.smithi106.stdout:8/479: sync 2024-05-09T06:30:28.603 INFO:tasks.workunit.client.1.smithi106.stdout:5/545: dread d8/d45/d4c/f2e [0,4194304] 0 2024-05-09T06:30:28.609 INFO:tasks.workunit.client.1.smithi106.stdout:2/628: dwrite d2/d5/db/d68/fc8 [0,4194304] 0 2024-05-09T06:30:28.609 INFO:tasks.workunit.client.1.smithi106.stdout:9/555: mkdir d4/d54/d91/d9c 0 2024-05-09T06:30:28.609 INFO:tasks.workunit.client.1.smithi106.stdout:9/556: chown d4/d54/d69/d95/d23/d16/f24 11 1 2024-05-09T06:30:28.613 INFO:tasks.workunit.client.1.smithi106.stdout:4/485: mkdir d7/d39/d35/d6f/d9d 0 2024-05-09T06:30:28.613 INFO:tasks.workunit.client.1.smithi106.stdout:8/480: dwrite d3/d5/d35/d61/d6c/f70 [0,4194304] 0 2024-05-09T06:30:28.619 INFO:tasks.workunit.client.1.smithi106.stdout:9/557: dread d4/d54/d69/d95/d23/f21 [0,4194304] 0 2024-05-09T06:30:28.619 INFO:tasks.workunit.client.1.smithi106.stdout:0/597: mknod d1/d11/ccc 0 2024-05-09T06:30:28.628 INFO:tasks.workunit.client.1.smithi106.stdout:5/546: mkdir d8/d5a/d60/da8 0 2024-05-09T06:30:28.635 INFO:tasks.workunit.client.1.smithi106.stdout:2/629: unlink d2/d7/d2c/c2d 0 2024-05-09T06:30:28.636 INFO:tasks.workunit.client.1.smithi106.stdout:2/630: read d2/d5/db/d1d/f8a [1074030,27448] 0 2024-05-09T06:30:28.637 INFO:tasks.workunit.client.1.smithi106.stdout:4/486: rename d7/d10/d1a/d5a/c19 to d7/d10/d1a/d5a/c9e 0 2024-05-09T06:30:28.642 INFO:tasks.workunit.client.1.smithi106.stdout:8/481: symlink d3/d5/d7/d58/laf 0 2024-05-09T06:30:28.644 INFO:tasks.workunit.client.1.smithi106.stdout:6/562: link d0/d17/d34/d4e/d98/da9/db1/d8/d27/c2a d0/d17/cbd 0 2024-05-09T06:30:28.644 INFO:tasks.workunit.client.1.smithi106.stdout:6/563: stat d0/d17/d34/d4e/d98/da9/db1/f28 0 2024-05-09T06:30:28.646 INFO:tasks.workunit.client.1.smithi106.stdout:9/558: unlink d4/d54/l79 0 2024-05-09T06:30:28.650 INFO:tasks.workunit.client.1.smithi106.stdout:0/598: rename d1/d11/d23/d22/l46 to d1/d11/d23/d13/d2c/d6d/lcd 0 2024-05-09T06:30:28.651 INFO:tasks.workunit.client.1.smithi106.stdout:5/547: mknod d8/d33/d3a/ca9 0 2024-05-09T06:30:28.651 INFO:tasks.workunit.client.1.smithi106.stdout:5/548: chown d8/d33/d74 93991235 1 2024-05-09T06:30:28.655 INFO:tasks.workunit.client.1.smithi106.stdout:2/631: link d2/d5/db/c21 d2/d5/db/d1d/d23/d63/d7a/cd9 0 2024-05-09T06:30:28.655 INFO:tasks.workunit.client.1.smithi106.stdout:2/632: write d2/d5/db/d1d/d23/d63/fb5 [987572,5808] 0 2024-05-09T06:30:28.655 INFO:tasks.workunit.client.1.smithi106.stdout:1/556: sync 2024-05-09T06:30:28.658 INFO:tasks.workunit.client.1.smithi106.stdout:4/487: creat d7/d28/d2a/f9f x:0 0 0 2024-05-09T06:30:28.658 INFO:tasks.workunit.client.1.smithi106.stdout:2/633: dread d2/d5/fb8 [0,4194304] 0 2024-05-09T06:30:28.659 INFO:tasks.workunit.client.1.smithi106.stdout:2/634: fsync d2/d5/db/d15/f47 0 2024-05-09T06:30:28.659 INFO:tasks.workunit.client.1.smithi106.stdout:2/635: chown d2/d7/db7/fa0 58 1 2024-05-09T06:30:28.663 INFO:tasks.workunit.client.1.smithi106.stdout:8/482: rename d3/d5/d35/d4e/f3b to d3/d5/d35/d61/d6c/d83/d89/fb0 0 2024-05-09T06:30:28.664 INFO:tasks.workunit.client.1.smithi106.stdout:8/483: chown d3/d5/d13/d3a/l8d 0 1 2024-05-09T06:30:28.666 INFO:tasks.workunit.client.1.smithi106.stdout:0/599: mkdir d1/d11/d23/d13/d2c/d6d/dce 0 2024-05-09T06:30:28.666 INFO:tasks.workunit.client.1.smithi106.stdout:0/600: creat d1/d11/d23/d22/fcf x:0 0 0 2024-05-09T06:30:28.668 INFO:tasks.workunit.client.1.smithi106.stdout:5/549: mkdir d8/d5a/d60/da8/daa 0 2024-05-09T06:30:28.672 INFO:tasks.workunit.client.1.smithi106.stdout:9/559: dwrite d4/d54/d69/f85 [0,4194304] 0 2024-05-09T06:30:28.672 INFO:tasks.workunit.client.1.smithi106.stdout:6/564: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d50/f7d [0,4194304] 0 2024-05-09T06:30:28.672 INFO:tasks.workunit.client.1.smithi106.stdout:4/488: link d7/d10/d1a/d5a/d1c/c25 d7/d39/d47/d89/ca0 0 2024-05-09T06:30:28.676 INFO:tasks.workunit.client.1.smithi106.stdout:2/636: unlink d2/d5/db/d15/d41/d60/lb9 0 2024-05-09T06:30:28.676 INFO:tasks.workunit.client.1.smithi106.stdout:2/637: readlink d2/d5/db/d1d/l77 0 2024-05-09T06:30:28.680 INFO:tasks.workunit.client.1.smithi106.stdout:1/557: dwrite f2 [0,4194304] 0 2024-05-09T06:30:28.681 INFO:tasks.workunit.client.1.smithi106.stdout:5/550: creat d8/d45/d4c/d32/d5b/d69/fab x:0 0 0 2024-05-09T06:30:28.682 INFO:tasks.workunit.client.1.smithi106.stdout:4/489: dread d7/d10/f51 [0,4194304] 0 2024-05-09T06:30:28.682 INFO:tasks.workunit.client.1.smithi106.stdout:4/490: truncate d7/d39/f7b 4984057 0 2024-05-09T06:30:28.683 INFO:tasks.workunit.client.1.smithi106.stdout:7/487: truncate d0/dc/d1a/d36/f3f 3854951 0 2024-05-09T06:30:28.685 INFO:tasks.workunit.client.1.smithi106.stdout:8/484: dwrite d3/d5/d13/f36 [0,4194304] 0 2024-05-09T06:30:28.685 INFO:tasks.workunit.client.1.smithi106.stdout:0/601: dwrite d1/f4a [0,4194304] 0 2024-05-09T06:30:28.697 INFO:tasks.workunit.client.1.smithi106.stdout:6/565: creat d0/d17/d34/fbe x:0 0 0 2024-05-09T06:30:28.701 INFO:tasks.workunit.client.1.smithi106.stdout:2/638: mkdir d2/d5/db/d1d/d23/d63/d7a/dda 0 2024-05-09T06:30:28.702 INFO:tasks.workunit.client.1.smithi106.stdout:1/558: creat d4/d76/d13/d2f/fca x:0 0 0 2024-05-09T06:30:28.702 INFO:tasks.workunit.client.1.smithi106.stdout:1/559: write f2 [4881511,28611] 0 2024-05-09T06:30:28.704 INFO:tasks.workunit.client.1.smithi106.stdout:7/488: dwrite d0/fa [4194304,4194304] 0 2024-05-09T06:30:28.705 INFO:tasks.workunit.client.1.smithi106.stdout:5/551: mknod d8/d33/d74/cac 0 2024-05-09T06:30:28.705 INFO:tasks.workunit.client.1.smithi106.stdout:5/552: dread - d8/d45/d4c/d32/d5b/d95/fa4 zero size 2024-05-09T06:30:28.711 INFO:tasks.workunit.client.1.smithi106.stdout:8/485: dwrite d3/d5/d7/d15/d3e/d7d/fa0 [0,4194304] 0 2024-05-09T06:30:28.711 INFO:tasks.workunit.client.1.smithi106.stdout:8/486: readlink d3/l27 0 2024-05-09T06:30:28.711 INFO:tasks.workunit.client.1.smithi106.stdout:8/487: readlink d3/d5/d35/d73/l8e 0 2024-05-09T06:30:28.713 INFO:tasks.workunit.client.1.smithi106.stdout:7/489: dread d0/dc/f8b [0,4194304] 0 2024-05-09T06:30:28.717 INFO:tasks.workunit.client.1.smithi106.stdout:9/560: getdents d4/d54/d91 0 2024-05-09T06:30:28.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/566: unlink d0/f5 0 2024-05-09T06:30:28.724 INFO:tasks.workunit.client.1.smithi106.stdout:2/639: mknod d2/d5/db/d1d/d23/d5e/cdb 0 2024-05-09T06:30:28.725 INFO:tasks.workunit.client.1.smithi106.stdout:2/640: dread d2/d7/db7/f7c [0,4194304] 0 2024-05-09T06:30:28.727 INFO:tasks.workunit.client.1.smithi106.stdout:1/560: mknod d4/d5b/ccb 0 2024-05-09T06:30:28.727 INFO:tasks.workunit.client.1.smithi106.stdout:1/561: fdatasync d4/d76/d13/f25 0 2024-05-09T06:30:28.731 INFO:tasks.workunit.client.1.smithi106.stdout:5/553: mknod d8/d33/d6c/cad 0 2024-05-09T06:30:28.732 INFO:tasks.workunit.client.1.smithi106.stdout:5/554: dread d8/f1a [0,4194304] 0 2024-05-09T06:30:28.745 INFO:tasks.workunit.client.1.smithi106.stdout:4/491: rmdir d7 39 2024-05-09T06:30:28.746 INFO:tasks.workunit.client.1.smithi106.stdout:5/555: dwrite d8/d45/f55 [0,4194304] 0 2024-05-09T06:30:28.747 INFO:tasks.workunit.client.1.smithi106.stdout:3/466: sync 2024-05-09T06:30:28.748 INFO:tasks.workunit.client.1.smithi106.stdout:3/467: write d5/f63 [1016607,128282] 0 2024-05-09T06:30:28.749 INFO:tasks.workunit.client.1.smithi106.stdout:7/490: creat d0/dc/d1a/d36/d30/d44/d80/f95 x:0 0 0 2024-05-09T06:30:28.751 INFO:tasks.workunit.client.1.smithi106.stdout:0/602: getdents d1/d11/d23/d13/d2c 0 2024-05-09T06:30:28.753 INFO:tasks.workunit.client.1.smithi106.stdout:9/561: creat d4/d54/d69/d95/d23/d2f/d47/f9d x:0 0 0 2024-05-09T06:30:28.755 INFO:tasks.workunit.client.1.smithi106.stdout:6/567: link d0/d17/d34/fae d0/d17/d34/fbf 0 2024-05-09T06:30:28.756 INFO:tasks.workunit.client.1.smithi106.stdout:6/568: readlink d0/l38 0 2024-05-09T06:30:28.756 INFO:tasks.workunit.client.1.smithi106.stdout:6/569: stat d0/d17/d34/d4e/d98/da9/db1/l5b 0 2024-05-09T06:30:28.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/641: mknod d2/d5/db/d68/cdc 0 2024-05-09T06:30:28.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/642: dread - d2/fc2 zero size 2024-05-09T06:30:28.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/643: write d2/d7/fd5 [2374,87504] 0 2024-05-09T06:30:28.762 INFO:tasks.workunit.client.1.smithi106.stdout:9/562: write d4/f25 [2530913,72625] 0 2024-05-09T06:30:28.762 INFO:tasks.workunit.client.1.smithi106.stdout:9/563: chown d4/d54/d69/d95/d23/d2f/d31/f44 31399 1 2024-05-09T06:30:28.768 INFO:tasks.workunit.client.1.smithi106.stdout:4/492: mkdir d7/d39/d8c/da1 0 2024-05-09T06:30:28.770 INFO:tasks.workunit.client.1.smithi106.stdout:4/493: dread d7/d10/d1a/d5a/d7a/f83 [0,4194304] 0 2024-05-09T06:30:28.770 INFO:tasks.workunit.client.1.smithi106.stdout:5/556: mkdir d8/d5a/d60/d7e/dae 0 2024-05-09T06:30:28.771 INFO:tasks.workunit.client.1.smithi106.stdout:4/494: readlink l5 0 2024-05-09T06:30:28.771 INFO:tasks.workunit.client.1.smithi106.stdout:4/495: chown d7/d10/f43 51354661 1 2024-05-09T06:30:28.772 INFO:tasks.workunit.client.1.smithi106.stdout:8/488: getdents d3/d5/d35/d61/d6c/d83 0 2024-05-09T06:30:28.774 INFO:tasks.workunit.client.1.smithi106.stdout:3/468: mkdir d5/d8f 0 2024-05-09T06:30:28.775 INFO:tasks.workunit.client.1.smithi106.stdout:8/489: dread d3/d5/d35/d4e/f67 [0,4194304] 0 2024-05-09T06:30:28.775 INFO:tasks.workunit.client.1.smithi106.stdout:8/490: truncate d3/d5/d35/d61/d6c/d83/d89/f94 477839 0 2024-05-09T06:30:28.775 INFO:tasks.workunit.client.1.smithi106.stdout:8/491: write d3/d5/d7/d15/d47/f62 [111845,61543] 0 2024-05-09T06:30:28.776 INFO:tasks.workunit.client.1.smithi106.stdout:7/491: truncate d0/dc/f57 1851996 0 2024-05-09T06:30:28.778 INFO:tasks.workunit.client.1.smithi106.stdout:0/603: rename d1/d11/d23/d13/d2c/l62 to d1/d11/d23/d13/d63/ld0 0 2024-05-09T06:30:28.780 INFO:tasks.workunit.client.1.smithi106.stdout:6/570: getdents d0/d17/d76/d8b 0 2024-05-09T06:30:28.781 INFO:tasks.workunit.client.1.smithi106.stdout:8/492: dread d3/d5/d13/f36 [0,4194304] 0 2024-05-09T06:30:28.781 INFO:tasks.workunit.client.1.smithi106.stdout:9/564: symlink d4/d54/d69/d95/d23/l9e 0 2024-05-09T06:30:28.783 INFO:tasks.workunit.client.1.smithi106.stdout:5/557: truncate d8/f37 3429373 0 2024-05-09T06:30:28.783 INFO:tasks.workunit.client.1.smithi106.stdout:5/558: fsync d8/d33/d74/f84 0 2024-05-09T06:30:28.786 INFO:tasks.workunit.client.1.smithi106.stdout:4/496: link d7/d10/d1a/d5a/f55 d7/d10/d1a/fa2 0 2024-05-09T06:30:28.787 INFO:tasks.workunit.client.1.smithi106.stdout:3/469: mkdir d5/d12/d26/d90 0 2024-05-09T06:30:28.792 INFO:tasks.workunit.client.1.smithi106.stdout:7/492: mknod d0/dc/d1a/d36/d1e/d68/c96 0 2024-05-09T06:30:28.792 INFO:tasks.workunit.client.1.smithi106.stdout:7/493: write d0/dc/d1a/d5a/f6c [752530,52055] 0 2024-05-09T06:30:28.796 INFO:tasks.workunit.client.1.smithi106.stdout:2/644: rename d2/d7/f9d to d2/d7/d2c/fdd 0 2024-05-09T06:30:28.796 INFO:tasks.workunit.client.1.smithi106.stdout:3/470: dread d5/d12/f19 [4194304,4194304] 0 2024-05-09T06:30:28.800 INFO:tasks.workunit.client.1.smithi106.stdout:0/604: unlink d1/d11/d23/d22/l29 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:6/571: dwrite d0/f30 [4194304,4194304] 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:6/572: fdatasync d0/d17/d34/fbe 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:6/573: stat d0/d17/d34/d4e/d98/da9/db1/d8/d27/f3a 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/494: dread d0/f90 [0,4194304] 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/495: stat d0/dc/d1a/d36/d1e/c56 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/496: dread - d0/dc/d1a/d36/f4d zero size 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/497: truncate d0/dc/d1a/d36/f4d 1026975 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:8/493: symlink d3/d6b/lb1 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/498: dread d0/dc/d1a/d36/d30/f91 [0,4194304] 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/499: chown d0/dc/c4e 2107170473 1 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:7/500: creat d0/dc/d1a/d5a/f97 x:0 0 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:4/497: dwrite d7/d28/f73 [0,4194304] 0 2024-05-09T06:30:28.803 INFO:tasks.workunit.client.1.smithi106.stdout:4/498: read - d7/d39/d8c/f8d zero size 2024-05-09T06:30:28.804 INFO:tasks.workunit.client.1.smithi106.stdout:4/499: stat d7/d39/l96 0 2024-05-09T06:30:28.805 INFO:tasks.workunit.client.1.smithi106.stdout:9/565: getdents d4/d54/d69/d95/d23/d2f 0 2024-05-09T06:30:28.809 INFO:tasks.workunit.client.1.smithi106.stdout:5/559: rename d8/d45/d4c/d32/d5b/d95/fa7 to d8/d33/d3a/d59/faf 0 2024-05-09T06:30:28.810 INFO:tasks.workunit.client.1.smithi106.stdout:3/471: read d5/d1c/d24/d52/f71 [3405309,128540] 0 2024-05-09T06:30:28.810 INFO:tasks.workunit.client.1.smithi106.stdout:5/560: dread d8/d33/d3a/f63 [0,4194304] 0 2024-05-09T06:30:28.811 INFO:tasks.workunit.client.1.smithi106.stdout:2/645: truncate d2/d5/db/d1d/f8a 1952976 0 2024-05-09T06:30:28.813 INFO:tasks.workunit.client.1.smithi106.stdout:0/605: write d1/d11/d23/d13/d2c/d6d/f6f [919335,89754] 0 2024-05-09T06:30:28.813 INFO:tasks.workunit.client.1.smithi106.stdout:0/606: stat d1/d11/d23/d13/d58/cb0 0 2024-05-09T06:30:28.813 INFO:tasks.workunit.client.1.smithi106.stdout:0/607: creat d1/d11/d23/d22/fd1 x:0 0 0 2024-05-09T06:30:28.816 INFO:tasks.workunit.client.1.smithi106.stdout:6/574: unlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/l94 0 2024-05-09T06:30:28.820 INFO:tasks.workunit.client.1.smithi106.stdout:7/501: symlink d0/dc/d1a/d5a/l98 0 2024-05-09T06:30:28.822 INFO:tasks.workunit.client.1.smithi106.stdout:9/566: symlink d4/d54/d69/d95/d23/d78/d8f/l9f 0 2024-05-09T06:30:28.822 INFO:tasks.workunit.client.1.smithi106.stdout:9/567: write d4/d54/d69/d95/d23/f6e [737463,433] 0 2024-05-09T06:30:28.825 INFO:tasks.workunit.client.1.smithi106.stdout:3/472: truncate d5/d1c/d24/d5b/f66 2800207 0 2024-05-09T06:30:28.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/561: truncate d8/d45/d4c/d32/d5b/f41 2283148 0 2024-05-09T06:30:28.829 INFO:tasks.workunit.client.1.smithi106.stdout:3/473: read d5/d85/f60 [3236744,117118] 0 2024-05-09T06:30:28.829 INFO:tasks.workunit.client.1.smithi106.stdout:3/474: write f2 [5722513,47507] 0 2024-05-09T06:30:28.830 INFO:tasks.workunit.client.1.smithi106.stdout:2/646: symlink d2/d5/db/d1d/d23/d63/d7a/lde 0 2024-05-09T06:30:28.830 INFO:tasks.workunit.client.1.smithi106.stdout:2/647: dread - d2/d5/fd8 zero size 2024-05-09T06:30:28.831 INFO:tasks.workunit.client.1.smithi106.stdout:9/568: dread d4/d54/d69/f85 [0,4194304] 0 2024-05-09T06:30:28.831 INFO:tasks.workunit.client.1.smithi106.stdout:8/494: dwrite d3/d5/f12 [0,4194304] 0 2024-05-09T06:30:28.831 INFO:tasks.workunit.client.1.smithi106.stdout:8/495: chown d3/d5/d35/d61/d6c/d83/d89 12 1 2024-05-09T06:30:28.832 INFO:tasks.workunit.client.1.smithi106.stdout:4/500: dwrite d7/d10/f43 [0,4194304] 0 2024-05-09T06:30:28.834 INFO:tasks.workunit.client.1.smithi106.stdout:6/575: dwrite d0/d66/fbc [0,4194304] 0 2024-05-09T06:30:28.838 INFO:tasks.workunit.client.1.smithi106.stdout:0/608: creat d1/d11/d23/d13/d63/fd2 x:0 0 0 2024-05-09T06:30:28.841 INFO:tasks.workunit.client.1.smithi106.stdout:5/562: creat d8/d5a/d60/da8/daa/fb0 x:0 0 0 2024-05-09T06:30:28.849 INFO:tasks.workunit.client.1.smithi106.stdout:2/648: mkdir d2/d5/db/d15/d41/d58/ddf 0 2024-05-09T06:30:28.849 INFO:tasks.workunit.client.1.smithi106.stdout:2/649: creat d2/d5/db/d15/d41/fe0 x:0 0 0 2024-05-09T06:30:28.849 INFO:tasks.workunit.client.1.smithi106.stdout:2/650: dread - d2/d5/db/f88 zero size 2024-05-09T06:30:28.850 INFO:tasks.workunit.client.1.smithi106.stdout:7/502: dwrite d0/dc/d1a/d5a/f6c [0,4194304] 0 2024-05-09T06:30:28.851 INFO:tasks.workunit.client.1.smithi106.stdout:4/501: dwrite d7/d28/d2a/f2b [0,4194304] 0 2024-05-09T06:30:28.852 INFO:tasks.workunit.client.1.smithi106.stdout:9/569: mknod d4/d54/d69/d95/d23/d78/d8f/d9a/ca0 0 2024-05-09T06:30:28.859 INFO:tasks.workunit.client.1.smithi106.stdout:4/502: dread d7/d39/f3f [0,4194304] 0 2024-05-09T06:30:28.885 INFO:tasks.workunit.client.1.smithi106.stdout:3/475: write d5/f3b [1538198,86068] 0 2024-05-09T06:30:28.888 INFO:tasks.workunit.client.1.smithi106.stdout:6/576: symlink d0/d5c/lc0 0 2024-05-09T06:30:28.888 INFO:tasks.workunit.client.1.smithi106.stdout:6/577: truncate d0/d5c/f7b 4216614 0 2024-05-09T06:30:28.889 INFO:tasks.workunit.client.1.smithi106.stdout:0/609: rename d1/d11/d23/l2b to d1/d11/d23/ld3 0 2024-05-09T06:30:28.891 INFO:tasks.workunit.client.1.smithi106.stdout:5/563: creat d8/d5a/d60/d7e/dae/fb1 x:0 0 0 2024-05-09T06:30:28.894 INFO:tasks.workunit.client.1.smithi106.stdout:2/651: creat d2/d7/d2c/daf/fe1 x:0 0 0 2024-05-09T06:30:28.897 INFO:tasks.workunit.client.1.smithi106.stdout:7/503: creat d0/dc/d1a/d36/d30/d44/d58/d65/f99 x:0 0 0 2024-05-09T06:30:28.902 INFO:tasks.workunit.client.1.smithi106.stdout:9/570: rename d4/c8a to d4/d54/d69/d95/d23/d2f/d31/d51/d58/ca1 0 2024-05-09T06:30:28.904 INFO:tasks.workunit.client.1.smithi106.stdout:4/503: symlink d7/d39/d8c/da1/la3 0 2024-05-09T06:30:28.904 INFO:tasks.workunit.client.1.smithi106.stdout:7/504: dread d0/dc/d1a/d36/f79 [0,4194304] 0 2024-05-09T06:30:28.907 INFO:tasks.workunit.client.1.smithi106.stdout:3/476: unlink f2 0 2024-05-09T06:30:28.907 INFO:tasks.workunit.client.1.smithi106.stdout:3/477: creat d5/d1c/d21/f91 x:0 0 0 2024-05-09T06:30:28.909 INFO:tasks.workunit.client.1.smithi106.stdout:6/578: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d6c/fc1 x:0 0 0 2024-05-09T06:30:28.909 INFO:tasks.workunit.client.1.smithi106.stdout:6/579: rename d0 to d0/d17/d34/d4e/dc2 22 2024-05-09T06:30:28.910 INFO:tasks.workunit.client.1.smithi106.stdout:7/505: write d0/dc/d1a/f3d [1716208,17327] 0 2024-05-09T06:30:28.910 INFO:tasks.workunit.client.1.smithi106.stdout:0/610: write d1/d11/d23/d13/d2c/d3d/f55 [4838056,39616] 0 2024-05-09T06:30:28.913 INFO:tasks.workunit.client.1.smithi106.stdout:5/564: truncate d8/d45/d4c/d32/d5b/f52 5695925 0 2024-05-09T06:30:28.913 INFO:tasks.workunit.client.1.smithi106.stdout:5/565: chown d8/f51 252249006 1 2024-05-09T06:30:28.914 INFO:tasks.workunit.client.1.smithi106.stdout:4/504: dread d7/f2e [0,4194304] 0 2024-05-09T06:30:28.914 INFO:tasks.workunit.client.1.smithi106.stdout:4/505: readlink d7/d10/d1a/d5a/d1c/l38 0 2024-05-09T06:30:28.914 INFO:tasks.workunit.client.1.smithi106.stdout:4/506: write d7/d10/d1a/d5a/f86 [756516,53377] 0 2024-05-09T06:30:28.914 INFO:tasks.workunit.client.1.smithi106.stdout:2/652: getdents d2/d5/db/d15/d41/d58 0 2024-05-09T06:30:28.917 INFO:tasks.workunit.client.1.smithi106.stdout:9/571: mkdir d4/d54/d69/d95/d23/d2f/d31/d51/da2 0 2024-05-09T06:30:28.917 INFO:tasks.workunit.client.1.smithi106.stdout:9/572: chown d4/d54/d69/d99/c7a 207 1 2024-05-09T06:30:28.917 INFO:tasks.workunit.client.1.smithi106.stdout:9/573: chown d4/d54/d69/d95/d23/f4e 33591 1 2024-05-09T06:30:28.918 INFO:tasks.workunit.client.1.smithi106.stdout:1/562: sync 2024-05-09T06:30:28.919 INFO:tasks.workunit.client.1.smithi106.stdout:1/563: chown d4/d37/d74/ca4 0 1 2024-05-09T06:30:28.919 INFO:tasks.workunit.client.1.smithi106.stdout:1/564: fdatasync d4/d5b/d75/fb9 0 2024-05-09T06:30:28.921 INFO:tasks.workunit.client.1.smithi106.stdout:3/478: mkdir d5/d12/d65/d81/d92 0 2024-05-09T06:30:28.924 INFO:tasks.workunit.client.1.smithi106.stdout:6/580: link d0/l20 d0/d17/d34/d4e/d98/da9/lc3 0 2024-05-09T06:30:28.932 INFO:tasks.workunit.client.1.smithi106.stdout:0/611: creat d1/d11/d23/d13/d2c/d6d/dce/fd4 x:0 0 0 2024-05-09T06:30:28.933 INFO:tasks.workunit.client.1.smithi106.stdout:5/566: dwrite d8/d45/d4c/d32/d5b/f41 [0,4194304] 0 2024-05-09T06:30:28.933 INFO:tasks.workunit.client.1.smithi106.stdout:5/567: creat d8/d5a/d60/da8/daa/fb2 x:0 0 0 2024-05-09T06:30:28.934 INFO:tasks.workunit.client.1.smithi106.stdout:0/612: write d1/d11/d23/d13/d58/fc8 [177154,92289] 0 2024-05-09T06:30:28.934 INFO:tasks.workunit.client.1.smithi106.stdout:0/613: dread - d1/d11/d23/d13/d2c/d6d/dce/fd4 zero size 2024-05-09T06:30:28.934 INFO:tasks.workunit.client.1.smithi106.stdout:0/614: chown d1 1478 1 2024-05-09T06:30:28.934 INFO:tasks.workunit.client.1.smithi106.stdout:0/615: chown d1/d11/d23/d13/d63/l87 975509 1 2024-05-09T06:30:28.935 INFO:tasks.workunit.client.1.smithi106.stdout:3/479: dread d5/d1c/d21/d32/f49 [0,4194304] 0 2024-05-09T06:30:28.936 INFO:tasks.workunit.client.1.smithi106.stdout:0/616: dread d1/d11/f56 [0,4194304] 0 2024-05-09T06:30:28.936 INFO:tasks.workunit.client.1.smithi106.stdout:0/617: fsync d1/d11/d23/d22/f91 0 2024-05-09T06:30:28.936 INFO:tasks.workunit.client.1.smithi106.stdout:0/618: chown d1/d11/d23/d22/f49 801 1 2024-05-09T06:30:28.936 INFO:tasks.workunit.client.1.smithi106.stdout:2/653: dwrite d2/d5/db/d1d/d23/f81 [4194304,4194304] 0 2024-05-09T06:30:28.936 INFO:tasks.workunit.client.1.smithi106.stdout:2/654: fdatasync d2/d5/db/d1d/d23/d63/fae 0 2024-05-09T06:30:28.937 INFO:tasks.workunit.client.1.smithi106.stdout:4/507: rename d7/d39/d35/f8b to d7/d39/d35/d6f/fa4 0 2024-05-09T06:30:28.937 INFO:tasks.workunit.client.1.smithi106.stdout:4/508: chown d7/d28/d2a/f9f 12 1 2024-05-09T06:30:28.943 INFO:tasks.workunit.client.1.smithi106.stdout:1/565: dwrite d4/d37/d3d/f96 [0,4194304] 0 2024-05-09T06:30:28.943 INFO:tasks.workunit.client.1.smithi106.stdout:1/566: chown d4/d5/lc2 503745043 1 2024-05-09T06:30:28.944 INFO:tasks.workunit.client.1.smithi106.stdout:1/567: write d4/d5b/d75/fb9 [651835,69100] 0 2024-05-09T06:30:28.945 INFO:tasks.workunit.client.1.smithi106.stdout:3/480: dread d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:28.945 INFO:tasks.workunit.client.1.smithi106.stdout:3/481: truncate d5/d1c/f76 954016 0 2024-05-09T06:30:28.946 INFO:tasks.workunit.client.1.smithi106.stdout:6/581: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/cc4 0 2024-05-09T06:30:28.947 INFO:tasks.workunit.client.1.smithi106.stdout:2/655: write d2/d5/db/d68/fc8 [2677126,116803] 0 2024-05-09T06:30:28.953 INFO:tasks.workunit.client.1.smithi106.stdout:0/619: read d1/f5 [1851934,100985] 0 2024-05-09T06:30:28.955 INFO:tasks.workunit.client.1.smithi106.stdout:5/568: dwrite d8/d5a/d60/f75 [0,4194304] 0 2024-05-09T06:30:28.955 INFO:tasks.workunit.client.1.smithi106.stdout:5/569: readlink d8/d45/l6a 0 2024-05-09T06:30:28.957 INFO:tasks.workunit.client.1.smithi106.stdout:4/509: dwrite d7/f29 [0,4194304] 0 2024-05-09T06:30:28.958 INFO:tasks.workunit.client.1.smithi106.stdout:9/574: rename d4/f5a to d4/d54/d69/d99/d2a/d61/fa3 0 2024-05-09T06:30:28.958 INFO:tasks.workunit.client.1.smithi106.stdout:9/575: fsync d4/d54/d69/d95/d23/d2f/f90 0 2024-05-09T06:30:28.958 INFO:tasks.workunit.client.1.smithi106.stdout:9/576: dread - d4/d54/d69/d95/d23/d2f/d47/f9d zero size 2024-05-09T06:30:28.961 INFO:tasks.workunit.client.1.smithi106.stdout:1/568: symlink d4/d76/d13/lcc 0 2024-05-09T06:30:28.965 INFO:tasks.workunit.client.1.smithi106.stdout:3/482: link d5/d4d/c51 d5/d4d/c93 0 2024-05-09T06:30:28.967 INFO:tasks.workunit.client.1.smithi106.stdout:2/656: link d2/d7/fd7 d2/d5/db/d15/dc6/fe2 0 2024-05-09T06:30:28.969 INFO:tasks.workunit.client.1.smithi106.stdout:0/620: creat d1/d11/d23/d13/d8a/dc1/fd5 x:0 0 0 2024-05-09T06:30:28.972 INFO:tasks.workunit.client.1.smithi106.stdout:0/621: dread d1/f4b [0,4194304] 0 2024-05-09T06:30:28.974 INFO:tasks.workunit.client.1.smithi106.stdout:5/570: unlink d8/d45/d4c/d32/d5b/c38 0 2024-05-09T06:30:28.983 INFO:tasks.workunit.client.1.smithi106.stdout:4/510: symlink d7/d28/d2a/d80/la5 0 2024-05-09T06:30:28.985 INFO:tasks.workunit.client.1.smithi106.stdout:6/582: rename d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47/c59 to d0/d17/d34/cc5 0 2024-05-09T06:30:28.991 INFO:tasks.workunit.client.1.smithi106.stdout:1/569: creat d4/dbd/fcd x:0 0 0 2024-05-09T06:30:28.991 INFO:tasks.workunit.client.1.smithi106.stdout:1/570: creat d4/d76/d13/d2f/fce x:0 0 0 2024-05-09T06:30:28.991 INFO:tasks.workunit.client.1.smithi106.stdout:1/571: fdatasync d4/d37/f92 0 2024-05-09T06:30:28.991 INFO:tasks.workunit.client.1.smithi106.stdout:1/572: write d4/f8a [5216749,2726] 0 2024-05-09T06:30:29.003 INFO:tasks.workunit.client.1.smithi106.stdout:2/657: mknod d2/d5/db/d68/ce3 0 2024-05-09T06:30:29.003 INFO:tasks.workunit.client.1.smithi106.stdout:2/658: fdatasync d2/d5/db/f33 0 2024-05-09T06:30:29.004 INFO:tasks.workunit.client.1.smithi106.stdout:5/571: creat d8/d33/d3a/fb3 x:0 0 0 2024-05-09T06:30:29.009 INFO:tasks.workunit.client.1.smithi106.stdout:6/583: symlink d0/d17/d34/d4e/d98/da9/db1/d40/lc6 0 2024-05-09T06:30:29.014 INFO:tasks.workunit.client.1.smithi106.stdout:4/511: dwrite d7/d39/f94 [0,4194304] 0 2024-05-09T06:30:29.015 INFO:tasks.workunit.client.1.smithi106.stdout:3/483: dwrite d5/d1c/d24/d52/f71 [4194304,4194304] 0 2024-05-09T06:30:29.015 INFO:tasks.workunit.client.1.smithi106.stdout:4/512: dread d7/d10/d1a/d5a/d1c/f2c [0,4194304] 0 2024-05-09T06:30:29.019 INFO:tasks.workunit.client.1.smithi106.stdout:9/577: rmdir d4 39 2024-05-09T06:30:29.019 INFO:tasks.workunit.client.1.smithi106.stdout:5/572: dwrite d8/d45/d4c/f5c [0,4194304] 0 2024-05-09T06:30:29.023 INFO:tasks.workunit.client.1.smithi106.stdout:2/659: symlink d2/d5/db/d15/d41/le4 0 2024-05-09T06:30:29.023 INFO:tasks.workunit.client.1.smithi106.stdout:2/660: creat d2/d5/db/d1d/d6a/fe5 x:0 0 0 2024-05-09T06:30:29.023 INFO:tasks.workunit.client.1.smithi106.stdout:8/496: sync 2024-05-09T06:30:29.023 INFO:tasks.workunit.client.1.smithi106.stdout:8/497: read d3/d5/d35/d4e/d32/f7b [819092,125494] 0 2024-05-09T06:30:29.024 INFO:tasks.workunit.client.1.smithi106.stdout:8/498: dread d3/d5/f8a [0,4194304] 0 2024-05-09T06:30:29.031 INFO:tasks.workunit.client.1.smithi106.stdout:6/584: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fc7 x:0 0 0 2024-05-09T06:30:29.034 INFO:tasks.workunit.client.1.smithi106.stdout:7/506: sync 2024-05-09T06:30:29.035 INFO:tasks.workunit.client.1.smithi106.stdout:5/573: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:30:29.038 INFO:tasks.workunit.client.1.smithi106.stdout:3/484: write d5/d3f/f4f [240918,108822] 0 2024-05-09T06:30:29.040 INFO:tasks.workunit.client.1.smithi106.stdout:4/513: link d7/d10/d1a/d5a/d7a/f8e d7/d28/d2a/d80/fa6 0 2024-05-09T06:30:29.042 INFO:tasks.workunit.client.1.smithi106.stdout:9/578: creat d4/d54/d69/d99/d2a/d42/d6c/fa4 x:0 0 0 2024-05-09T06:30:29.047 INFO:tasks.workunit.client.1.smithi106.stdout:2/661: mknod d2/d5/db/d1d/d23/ce6 0 2024-05-09T06:30:29.048 INFO:tasks.workunit.client.1.smithi106.stdout:2/662: chown d2/d7/db7/fbf 8620154 1 2024-05-09T06:30:29.049 INFO:tasks.workunit.client.1.smithi106.stdout:0/622: rename d1/d11/d23/d13/d63 to d1/d11/d23/d13/d58/da8/dd6 0 2024-05-09T06:30:29.050 INFO:tasks.workunit.client.1.smithi106.stdout:0/623: chown d1/d11/c19 225034506 1 2024-05-09T06:30:29.054 INFO:tasks.workunit.client.1.smithi106.stdout:5/574: dwrite d8/d33/d6c/f8b [0,4194304] 0 2024-05-09T06:30:29.055 INFO:tasks.workunit.client.1.smithi106.stdout:3/485: chown d5/d4d/d5f 239121 1 2024-05-09T06:30:29.057 INFO:tasks.workunit.client.1.smithi106.stdout:0/624: dread d1/f43 [0,4194304] 0 2024-05-09T06:30:29.058 INFO:tasks.workunit.client.1.smithi106.stdout:4/514: mkdir d7/d10/d1a/d5a/d1c/da7 0 2024-05-09T06:30:29.058 INFO:tasks.workunit.client.1.smithi106.stdout:4/515: write d7/d39/d47/d66/f87 [413918,21936] 0 2024-05-09T06:30:29.063 INFO:tasks.workunit.client.1.smithi106.stdout:3/486: dread d5/d1c/d24/f35 [0,4194304] 0 2024-05-09T06:30:29.063 INFO:tasks.workunit.client.1.smithi106.stdout:9/579: link d4/d54/d69/d95/d23/f21 d4/d54/d69/d95/d23/d78/d8f/d9a/fa5 0 2024-05-09T06:30:29.063 INFO:tasks.workunit.client.1.smithi106.stdout:9/580: write d4/d54/d69/d99/d2a/f75 [756709,63970] 0 2024-05-09T06:30:29.065 INFO:tasks.workunit.client.1.smithi106.stdout:2/663: unlink d2/f5f 0 2024-05-09T06:30:29.067 INFO:tasks.workunit.client.1.smithi106.stdout:4/516: dread d7/d10/d1a/d5a/f97 [0,4194304] 0 2024-05-09T06:30:29.068 INFO:tasks.workunit.client.1.smithi106.stdout:1/573: rename d4/d5/c4f to d4/dbd/ccf 0 2024-05-09T06:30:29.070 INFO:tasks.workunit.client.1.smithi106.stdout:5/575: truncate d8/d45/d4c/d32/d5b/f29 1328351 0 2024-05-09T06:30:29.070 INFO:tasks.workunit.client.1.smithi106.stdout:4/517: dread d7/d39/d35/d4a/f93 [0,4194304] 0 2024-05-09T06:30:29.071 INFO:tasks.workunit.client.1.smithi106.stdout:4/518: dread - d7/d10/d1a/d5a/d7a/d7f/f84 zero size 2024-05-09T06:30:29.073 INFO:tasks.workunit.client.1.smithi106.stdout:0/625: symlink d1/d11/d23/d13/d2c/d6d/d70/ld7 0 2024-05-09T06:30:29.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:28 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:29.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:28 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:29.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:28 smithi106 ceph-mon[34679]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-05-09T06:30:29.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:28 smithi106 ceph-mon[34679]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-05-09T06:30:29.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:28 smithi106 ceph-mon[34679]: pgmap v21: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 121 MiB/s rd, 161 MiB/s wr, 619 op/s 2024-05-09T06:30:29.080 INFO:tasks.workunit.client.1.smithi106.stdout:8/499: rename d3/d5/d13/c52 to d3/d5/d13/d3a/cb2 0 2024-05-09T06:30:29.083 INFO:tasks.workunit.client.1.smithi106.stdout:2/664: dwrite d2/d5/db/d1d/d23/f66 [0,4194304] 0 2024-05-09T06:30:29.083 INFO:tasks.workunit.client.1.smithi106.stdout:2/665: creat d2/d5/db/d1d/d23/d5e/fe7 x:0 0 0 2024-05-09T06:30:29.085 INFO:tasks.workunit.client.1.smithi106.stdout:4/519: mkdir d7/d39/d35/d7c/da8 0 2024-05-09T06:30:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:28 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:28 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:28 smithi046 ceph-mon[26924]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-05-09T06:30:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:28 smithi046 ceph-mon[26924]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-05-09T06:30:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:28 smithi046 ceph-mon[26924]: pgmap v21: 65 pgs: 65 active+clean; 1.2 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 121 MiB/s rd, 161 MiB/s wr, 619 op/s 2024-05-09T06:30:29.092 INFO:tasks.workunit.client.1.smithi106.stdout:3/487: creat d5/d12/d65/d81/f94 x:0 0 0 2024-05-09T06:30:29.092 INFO:tasks.workunit.client.1.smithi106.stdout:3/488: read d5/d1c/d24/d5b/f66 [2222695,91545] 0 2024-05-09T06:30:29.092 INFO:tasks.workunit.client.1.smithi106.stdout:3/489: creat d5/d1c/d24/d5b/f95 x:0 0 0 2024-05-09T06:30:29.096 INFO:tasks.workunit.client.1.smithi106.stdout:6/585: rename d0/d17/d34/d4e/d98/da9/db1/d8/d27/fa7 to d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/fc8 0 2024-05-09T06:30:29.103 INFO:tasks.workunit.client.1.smithi106.stdout:8/500: dwrite d3/d5/d35/d61/d6c/f70 [0,4194304] 0 2024-05-09T06:30:29.104 INFO:tasks.workunit.client.1.smithi106.stdout:8/501: readlink d3/d5/d35/d61/d6c/d83/d89/l8b 0 2024-05-09T06:30:29.104 INFO:tasks.workunit.client.1.smithi106.stdout:4/520: dwrite d7/d28/f91 [0,4194304] 0 2024-05-09T06:30:29.124 INFO:tasks.workunit.client.1.smithi106.stdout:2/666: mkdir d2/d5/db/d1d/d23/d5e/de8 0 2024-05-09T06:30:29.126 INFO:tasks.workunit.client.1.smithi106.stdout:5/576: rmdir d8 39 2024-05-09T06:30:29.129 INFO:tasks.workunit.client.1.smithi106.stdout:3/490: readlink d5/d85/l54 0 2024-05-09T06:30:29.129 INFO:tasks.workunit.client.1.smithi106.stdout:3/491: readlink d5/d1c/d21/l46 0 2024-05-09T06:30:29.132 INFO:tasks.workunit.client.1.smithi106.stdout:9/581: rename d4/d54/d69/d95/d23/f4e to d4/d54/d69/d95/d23/d78/fa6 0 2024-05-09T06:30:29.135 INFO:tasks.workunit.client.1.smithi106.stdout:5/577: dread d8/d5a/d60/f75 [0,4194304] 0 2024-05-09T06:30:29.135 INFO:tasks.workunit.client.1.smithi106.stdout:6/586: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/fc9 x:0 0 0 2024-05-09T06:30:29.135 INFO:tasks.workunit.client.1.smithi106.stdout:6/587: write d0/d17/d76/f9b [265559,14517] 0 2024-05-09T06:30:29.137 INFO:tasks.workunit.client.1.smithi106.stdout:6/588: dread d0/d66/d7e/f2b [8388608,4194304] 0 2024-05-09T06:30:29.137 INFO:tasks.workunit.client.1.smithi106.stdout:6/589: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/fca x:0 0 0 2024-05-09T06:30:29.139 INFO:tasks.workunit.client.1.smithi106.stdout:8/502: unlink d3/d6b/lb1 0 2024-05-09T06:30:29.139 INFO:tasks.workunit.client.1.smithi106.stdout:8/503: readlink d3/l9c 0 2024-05-09T06:30:29.142 INFO:tasks.workunit.client.1.smithi106.stdout:5/578: write d8/d45/f55 [2250282,8608] 0 2024-05-09T06:30:29.142 INFO:tasks.workunit.client.1.smithi106.stdout:5/579: fsync d8/f37 0 2024-05-09T06:30:29.142 INFO:tasks.workunit.client.1.smithi106.stdout:5/580: chown d8/d45/d4c/d32/d5b/f52 248 1 2024-05-09T06:30:29.142 INFO:tasks.workunit.client.1.smithi106.stdout:5/581: write d8/f4e [79259,128106] 0 2024-05-09T06:30:29.143 INFO:tasks.workunit.client.1.smithi106.stdout:5/582: readlink d8/d5a/d60/l9b 0 2024-05-09T06:30:29.151 INFO:tasks.workunit.client.1.smithi106.stdout:2/667: creat d2/d7/d62/fe9 x:0 0 0 2024-05-09T06:30:29.151 INFO:tasks.workunit.client.1.smithi106.stdout:2/668: write d2/f8d [1613196,16609] 0 2024-05-09T06:30:29.151 INFO:tasks.workunit.client.1.smithi106.stdout:2/669: stat d2/d7/d2c/daf 0 2024-05-09T06:30:29.154 INFO:tasks.workunit.client.1.smithi106.stdout:3/492: mkdir d5/d1c/d21/d32/d96 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/590: dwrite d0/d66/d7e/f26 [0,4194304] 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/591: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fcb x:0 0 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/592: truncate d0/d17/d34/d4e/d98/da9/db1/d8/d50/f81 323599 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/593: write d0/d17/d34/f82 [815640,56610] 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/594: creat d0/d17/d76/fcc x:0 0 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/595: stat d0/d5c/l79 0 2024-05-09T06:30:29.155 INFO:tasks.workunit.client.1.smithi106.stdout:6/596: chown d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/la6 58227896 1 2024-05-09T06:30:29.157 INFO:tasks.workunit.client.1.smithi106.stdout:1/574: rename d4/d5/f58 to d4/d37/fd0 0 2024-05-09T06:30:29.161 INFO:tasks.workunit.client.1.smithi106.stdout:5/583: dwrite d8/d45/d4c/d32/d5b/f8c [0,4194304] 0 2024-05-09T06:30:29.161 INFO:tasks.workunit.client.1.smithi106.stdout:5/584: readlink d8/d5a/l86 0 2024-05-09T06:30:29.164 INFO:tasks.workunit.client.1.smithi106.stdout:8/504: unlink d3/d5/d7/d15/d3e/d7d/fa0 0 2024-05-09T06:30:29.164 INFO:tasks.workunit.client.1.smithi106.stdout:8/505: fdatasync d3/d5/d35/d4e/f67 0 2024-05-09T06:30:29.165 INFO:tasks.workunit.client.1.smithi106.stdout:8/506: readlink d3/d5/d35/d61/d6c/d83/d89/l8b 0 2024-05-09T06:30:29.167 INFO:tasks.workunit.client.1.smithi106.stdout:3/493: dwrite d5/d1c/f2b [4194304,4194304] 0 2024-05-09T06:30:29.173 INFO:tasks.workunit.client.1.smithi106.stdout:7/507: sync 2024-05-09T06:30:29.174 INFO:tasks.workunit.client.1.smithi106.stdout:2/670: mknod d2/d5/db/d1d/d90/cea 0 2024-05-09T06:30:29.174 INFO:tasks.workunit.client.1.smithi106.stdout:7/508: dread d0/f4a [0,4194304] 0 2024-05-09T06:30:29.176 INFO:tasks.workunit.client.1.smithi106.stdout:3/494: dread d5/d4d/f6c [0,4194304] 0 2024-05-09T06:30:29.179 INFO:tasks.workunit.client.1.smithi106.stdout:7/509: write d0/f29 [916964,8326] 0 2024-05-09T06:30:29.179 INFO:tasks.workunit.client.1.smithi106.stdout:7/510: truncate d0/dc/d1a/d36/d30/d44/f7f 1004552 0 2024-05-09T06:30:29.179 INFO:tasks.workunit.client.1.smithi106.stdout:7/511: truncate d0/dc/d1a/f83 548478 0 2024-05-09T06:30:29.182 INFO:tasks.workunit.client.1.smithi106.stdout:7/512: dread d0/f9 [0,4194304] 0 2024-05-09T06:30:29.182 INFO:tasks.workunit.client.1.smithi106.stdout:7/513: creat d0/dc/d1a/d5a/f9a x:0 0 0 2024-05-09T06:30:29.183 INFO:tasks.workunit.client.1.smithi106.stdout:6/597: rename d0/d66/d7e/l31 to d0/d66/lcd 0 2024-05-09T06:30:29.185 INFO:tasks.workunit.client.1.smithi106.stdout:1/575: symlink d4/d76/d13/ld1 0 2024-05-09T06:30:29.186 INFO:tasks.workunit.client.1.smithi106.stdout:1/576: fdatasync d4/f1a 0 2024-05-09T06:30:29.186 INFO:tasks.workunit.client.1.smithi106.stdout:1/577: creat d4/d76/fd2 x:0 0 0 2024-05-09T06:30:29.188 INFO:tasks.workunit.client.1.smithi106.stdout:1/578: dread d4/d76/f4b [0,4194304] 0 2024-05-09T06:30:29.188 INFO:tasks.workunit.client.1.smithi106.stdout:7/514: read d0/dc/d1a/d36/f3f [3588159,131018] 0 2024-05-09T06:30:29.188 INFO:tasks.workunit.client.1.smithi106.stdout:7/515: creat d0/dc/d1a/d36/d1e/f9b x:0 0 0 2024-05-09T06:30:29.189 INFO:tasks.workunit.client.1.smithi106.stdout:8/507: mknod d3/d5/d35/d61/d82/da1/cb3 0 2024-05-09T06:30:29.191 INFO:tasks.workunit.client.1.smithi106.stdout:2/671: mkdir d2/d5/db/d15/dd6/deb 0 2024-05-09T06:30:29.192 INFO:tasks.workunit.client.1.smithi106.stdout:1/579: write d4/d76/d13/f19 [603975,71522] 0 2024-05-09T06:30:29.193 INFO:tasks.workunit.client.1.smithi106.stdout:3/495: getdents d5/d1c/d24 0 2024-05-09T06:30:29.193 INFO:tasks.workunit.client.1.smithi106.stdout:3/496: truncate d5/d1c/d21/f7e 379446 0 2024-05-09T06:30:29.195 INFO:tasks.workunit.client.1.smithi106.stdout:5/585: rename d8/d7c to d8/d5a/d60/da8/daa/db4 0 2024-05-09T06:30:29.196 INFO:tasks.workunit.client.1.smithi106.stdout:6/598: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/lce 0 2024-05-09T06:30:29.200 INFO:tasks.workunit.client.1.smithi106.stdout:0/626: sync 2024-05-09T06:30:29.200 INFO:tasks.workunit.client.1.smithi106.stdout:7/516: truncate d0/dc/d1a/d36/d30/f32 1723028 0 2024-05-09T06:30:29.200 INFO:tasks.workunit.client.1.smithi106.stdout:7/517: creat d0/dc/d1a/d36/f9c x:0 0 0 2024-05-09T06:30:29.200 INFO:tasks.workunit.client.1.smithi106.stdout:7/518: creat d0/dc/d1a/d36/d1e/f9d x:0 0 0 2024-05-09T06:30:29.213 INFO:tasks.workunit.client.1.smithi106.stdout:8/508: symlink d3/d5/d35/lb4 0 2024-05-09T06:30:29.213 INFO:tasks.workunit.client.1.smithi106.stdout:8/509: creat d3/d5/d7/fb5 x:0 0 0 2024-05-09T06:30:29.216 INFO:tasks.workunit.client.1.smithi106.stdout:2/672: rmdir d2/d5/db/d1d/d23/d5e/dbe 0 2024-05-09T06:30:29.218 INFO:tasks.workunit.client.1.smithi106.stdout:1/580: symlink d4/d76/d13/d60/ld3 0 2024-05-09T06:30:29.221 INFO:tasks.workunit.client.1.smithi106.stdout:3/497: creat d5/d12/d26/d90/f97 x:0 0 0 2024-05-09T06:30:29.223 INFO:tasks.workunit.client.1.smithi106.stdout:5/586: creat d8/d5a/d60/fb5 x:0 0 0 2024-05-09T06:30:29.223 INFO:tasks.workunit.client.1.smithi106.stdout:5/587: fdatasync d8/f5f 0 2024-05-09T06:30:29.225 INFO:tasks.workunit.client.1.smithi106.stdout:8/510: dwrite d3/d5/d35/d61/d6c/fa6 [0,4194304] 0 2024-05-09T06:30:29.226 INFO:tasks.workunit.client.1.smithi106.stdout:6/599: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47/lcf 0 2024-05-09T06:30:29.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/600: dread d0/d17/d76/f9b [0,4194304] 0 2024-05-09T06:30:29.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/601: write d0/d17/d34/d4e/d98/da9/db1/fe [1107127,19097] 0 2024-05-09T06:30:29.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/602: write d0/d17/f63 [696370,15889] 0 2024-05-09T06:30:29.233 INFO:tasks.workunit.client.1.smithi106.stdout:7/519: rename d0/dc/d1a/d36/d30/d44/f7f to d0/dc/d1a/d36/d30/d44/d6a/f9e 0 2024-05-09T06:30:29.233 INFO:tasks.workunit.client.1.smithi106.stdout:7/520: chown d0/dc/d1a/d36/d30/l4b 931310633 1 2024-05-09T06:30:29.237 INFO:tasks.workunit.client.1.smithi106.stdout:2/673: link d2/d7/db7/f7c d2/d5/db/d1d/d23/d63/d7a/dda/fec 0 2024-05-09T06:30:29.239 INFO:tasks.workunit.client.1.smithi106.stdout:1/581: link d4/d76/d13/d60/c63 d4/d76/d13/d60/d9c/dbe/cd4 0 2024-05-09T06:30:29.239 INFO:tasks.workunit.client.1.smithi106.stdout:1/582: chown d4/d37/d3d/f44 26264189 1 2024-05-09T06:30:29.241 INFO:tasks.workunit.client.1.smithi106.stdout:3/498: mkdir d5/d1c/d24/d98 0 2024-05-09T06:30:29.242 INFO:tasks.workunit.client.1.smithi106.stdout:4/521: sync 2024-05-09T06:30:29.242 INFO:tasks.workunit.client.1.smithi106.stdout:5/588: truncate d8/d45/d4c/d32/d5b/f52 2940417 0 2024-05-09T06:30:29.242 INFO:tasks.workunit.client.1.smithi106.stdout:5/589: write d8/d45/f70 [1128915,75187] 0 2024-05-09T06:30:29.249 INFO:tasks.workunit.client.1.smithi106.stdout:0/627: truncate d1/d11/d23/d13/d2c/f2f 526142 0 2024-05-09T06:30:29.251 INFO:tasks.workunit.client.1.smithi106.stdout:6/603: mkdir d0/d17/d34/dd0 0 2024-05-09T06:30:29.251 INFO:tasks.workunit.client.1.smithi106.stdout:6/604: readlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47/l53 0 2024-05-09T06:30:29.258 INFO:tasks.workunit.client.1.smithi106.stdout:7/521: dwrite d0/dc/d1a/d36/d1e/f4c [0,4194304] 0 2024-05-09T06:30:29.258 INFO:tasks.workunit.client.1.smithi106.stdout:7/522: chown d0/dc/d1a/d36/d1e/d68 32152 1 2024-05-09T06:30:29.258 INFO:tasks.workunit.client.1.smithi106.stdout:7/523: chown d0/l7 5922487 1 2024-05-09T06:30:29.258 INFO:tasks.workunit.client.1.smithi106.stdout:1/583: creat d4/d76/d65/d8d/fd5 x:0 0 0 2024-05-09T06:30:29.259 INFO:tasks.workunit.client.1.smithi106.stdout:2/674: dwrite d2/d5/db/d68/f92 [0,4194304] 0 2024-05-09T06:30:29.260 INFO:tasks.workunit.client.1.smithi106.stdout:3/499: rename d5/d4d/d5f/l77 to d5/d4d/d5f/l99 0 2024-05-09T06:30:29.264 INFO:tasks.workunit.client.1.smithi106.stdout:4/522: getdents d7/d39 0 2024-05-09T06:30:29.266 INFO:tasks.workunit.client.1.smithi106.stdout:1/584: dread d4/d76/d13/dbb/f87 [0,4194304] 0 2024-05-09T06:30:29.267 INFO:tasks.workunit.client.1.smithi106.stdout:4/523: dread d7/d10/d1a/d5a/d1c/f72 [0,4194304] 0 2024-05-09T06:30:29.267 INFO:tasks.workunit.client.1.smithi106.stdout:4/524: chown d7/d10/d1a/d5a/d1c/f49 9125 1 2024-05-09T06:30:29.268 INFO:tasks.workunit.client.1.smithi106.stdout:5/590: creat d8/d33/d74/fb6 x:0 0 0 2024-05-09T06:30:29.268 INFO:tasks.workunit.client.1.smithi106.stdout:5/591: chown d8/d45/c62 1456288 1 2024-05-09T06:30:29.268 INFO:tasks.workunit.client.1.smithi106.stdout:5/592: chown d8/d45/d4c/d32/d5b/f2c 40146 1 2024-05-09T06:30:29.268 INFO:tasks.workunit.client.1.smithi106.stdout:5/593: read d8/d45/d4c/d32/d5b/f29 [1002193,96577] 0 2024-05-09T06:30:29.268 INFO:tasks.workunit.client.1.smithi106.stdout:5/594: readlink d8/d45/d4c/d32/d5b/l40 0 2024-05-09T06:30:29.274 INFO:tasks.workunit.client.1.smithi106.stdout:8/511: rmdir d3/d5/d7/d15/d3e 39 2024-05-09T06:30:29.276 INFO:tasks.workunit.client.1.smithi106.stdout:0/628: mkdir d1/da1/dd8 0 2024-05-09T06:30:29.276 INFO:tasks.workunit.client.1.smithi106.stdout:0/629: readlink d1/d11/d23/d13/d2c/d6d/d70/lb4 0 2024-05-09T06:30:29.278 INFO:tasks.workunit.client.1.smithi106.stdout:6/605: rmdir d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b 39 2024-05-09T06:30:29.279 INFO:tasks.workunit.client.1.smithi106.stdout:6/606: fdatasync d0/d17/d76/f9b 0 2024-05-09T06:30:29.281 INFO:tasks.workunit.client.1.smithi106.stdout:7/524: unlink d0/f29 0 2024-05-09T06:30:29.286 INFO:tasks.workunit.client.1.smithi106.stdout:6/607: dread d0/d17/f25 [0,4194304] 0 2024-05-09T06:30:29.287 INFO:tasks.workunit.client.1.smithi106.stdout:6/608: read d0/f19 [4251916,50615] 0 2024-05-09T06:30:29.287 INFO:tasks.workunit.client.1.smithi106.stdout:6/609: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fd1 x:0 0 0 2024-05-09T06:30:29.288 INFO:tasks.workunit.client.1.smithi106.stdout:2/675: creat d2/d5/db/d15/dc6/fed x:0 0 0 2024-05-09T06:30:29.288 INFO:tasks.workunit.client.1.smithi106.stdout:2/676: write d2/f2b [3371496,51885] 0 2024-05-09T06:30:29.288 INFO:tasks.workunit.client.1.smithi106.stdout:1/585: dwrite d4/f2d [0,4194304] 0 2024-05-09T06:30:29.288 INFO:tasks.workunit.client.1.smithi106.stdout:1/586: stat d4/d37/d74/f86 0 2024-05-09T06:30:29.288 INFO:tasks.workunit.client.1.smithi106.stdout:4/525: dwrite d7/d39/d47/d66/f87 [0,4194304] 0 2024-05-09T06:30:29.290 INFO:tasks.workunit.client.1.smithi106.stdout:3/500: link d5/d4d/c93 d5/d1c/d21/d32/d96/c9a 0 2024-05-09T06:30:29.290 INFO:tasks.workunit.client.1.smithi106.stdout:3/501: write d5/d3f/f4f [2074348,4636] 0 2024-05-09T06:30:29.290 INFO:tasks.workunit.client.1.smithi106.stdout:3/502: write d5/d12/d65/d81/f94 [63831,72586] 0 2024-05-09T06:30:29.290 INFO:tasks.workunit.client.1.smithi106.stdout:3/503: chown d5/d4d/d72/l73 225483354 1 2024-05-09T06:30:29.290 INFO:tasks.workunit.client.1.smithi106.stdout:3/504: chown d5/d1c/d24/d89/d8c 120103853 1 2024-05-09T06:30:29.291 INFO:tasks.workunit.client.1.smithi106.stdout:5/595: getdents d8/d5a/d60/d7e/dae 0 2024-05-09T06:30:29.291 INFO:tasks.workunit.client.1.smithi106.stdout:5/596: chown d8/d33/d3a/ca9 18146856 1 2024-05-09T06:30:29.291 INFO:tasks.workunit.client.1.smithi106.stdout:5/597: chown d8/d33/d3a/d59/c6b 5813803 1 2024-05-09T06:30:29.294 INFO:tasks.workunit.client.1.smithi106.stdout:8/512: unlink d3/d5/d7/d15/d47/d50/l88 0 2024-05-09T06:30:29.297 INFO:tasks.workunit.client.1.smithi106.stdout:2/677: dread d2/d7/d2c/f80 [0,4194304] 0 2024-05-09T06:30:29.297 INFO:tasks.workunit.client.1.smithi106.stdout:2/678: dread - d2/d5/db/d1d/fc5 zero size 2024-05-09T06:30:29.297 INFO:tasks.workunit.client.1.smithi106.stdout:2/679: chown d2/d7/d2c/daf 8765311 1 2024-05-09T06:30:29.297 INFO:tasks.workunit.client.1.smithi106.stdout:0/630: rename d1/d11/d23/d13/d2c/d6d/d70/fa9 to d1/fd9 0 2024-05-09T06:30:29.299 INFO:tasks.workunit.client.1.smithi106.stdout:7/525: link d0/dc/c4e d0/dc/d1a/d36/d30/d44/d58/d65/d84/c9f 0 2024-05-09T06:30:29.299 INFO:tasks.workunit.client.1.smithi106.stdout:5/598: dread d8/d5a/d60/f75 [0,4194304] 0 2024-05-09T06:30:29.299 INFO:tasks.workunit.client.1.smithi106.stdout:5/599: creat d8/d33/d74/fb7 x:0 0 0 2024-05-09T06:30:29.310 INFO:tasks.workunit.client.1.smithi106.stdout:1/587: creat d4/d76/d13/d2f/db4/fd6 x:0 0 0 2024-05-09T06:30:29.310 INFO:tasks.workunit.client.1.smithi106.stdout:1/588: fsync d4/d37/f43 0 2024-05-09T06:30:29.310 INFO:tasks.workunit.client.1.smithi106.stdout:1/589: dread - d4/d76/d13/f6b zero size 2024-05-09T06:30:29.310 INFO:tasks.workunit.client.1.smithi106.stdout:1/590: write d4/d76/d13/d2f/f42 [772700,110005] 0 2024-05-09T06:30:29.317 INFO:tasks.workunit.client.1.smithi106.stdout:4/526: creat d7/d39/d47/d66/fa9 x:0 0 0 2024-05-09T06:30:29.317 INFO:tasks.workunit.client.1.smithi106.stdout:9/582: sync 2024-05-09T06:30:29.317 INFO:tasks.workunit.client.1.smithi106.stdout:9/583: stat d4/d54/d69/d95/d23/l9e 0 2024-05-09T06:30:29.322 INFO:tasks.workunit.client.1.smithi106.stdout:5/600: dwrite d8/d33/d74/fb6 [0,4194304] 0 2024-05-09T06:30:29.325 INFO:tasks.workunit.client.1.smithi106.stdout:2/680: dwrite d2/d7/db7/f8f [0,4194304] 0 2024-05-09T06:30:29.326 INFO:tasks.workunit.client.1.smithi106.stdout:2/681: truncate d2/d5/db/d15/f18 4580429 0 2024-05-09T06:30:29.329 INFO:tasks.workunit.client.1.smithi106.stdout:0/631: mknod d1/da1/d83/cda 0 2024-05-09T06:30:29.331 INFO:tasks.workunit.client.1.smithi106.stdout:7/526: getdents d0/dc/d1a/d36/d30/d44/d6a/d72 0 2024-05-09T06:30:29.335 INFO:tasks.workunit.client.1.smithi106.stdout:1/591: dwrite d4/d76/d13/dbb/f61 [0,4194304] 0 2024-05-09T06:30:29.337 INFO:tasks.workunit.client.1.smithi106.stdout:6/610: getdents d0/d17/d76 0 2024-05-09T06:30:29.341 INFO:tasks.workunit.client.1.smithi106.stdout:4/527: dwrite d7/d10/f43 [0,4194304] 0 2024-05-09T06:30:29.341 INFO:tasks.workunit.client.1.smithi106.stdout:4/528: truncate d7/d39/d35/f9a 1045800 0 2024-05-09T06:30:29.346 INFO:tasks.workunit.client.1.smithi106.stdout:5/601: unlink d8/l11 0 2024-05-09T06:30:29.348 INFO:tasks.workunit.client.1.smithi106.stdout:3/505: dwrite d5/f3b [0,4194304] 0 2024-05-09T06:30:29.348 INFO:tasks.workunit.client.1.smithi106.stdout:3/506: chown d5/d1c/d24/d52/c88 1 1 2024-05-09T06:30:29.348 INFO:tasks.workunit.client.1.smithi106.stdout:2/682: dwrite d2/d5/db/d15/d41/d58/fc1 [0,4194304] 0 2024-05-09T06:30:29.354 INFO:tasks.workunit.client.1.smithi106.stdout:0/632: truncate d1/f1d 1489214 0 2024-05-09T06:30:29.356 INFO:tasks.workunit.client.1.smithi106.stdout:7/527: creat d0/dc/d1a/d36/d30/d44/d58/d65/d84/fa0 x:0 0 0 2024-05-09T06:30:29.361 INFO:tasks.workunit.client.1.smithi106.stdout:1/592: symlink d4/d76/d65/d8d/dad/ld7 0 2024-05-09T06:30:29.361 INFO:tasks.workunit.client.1.smithi106.stdout:1/593: stat d4/d5/ld 0 2024-05-09T06:30:29.361 INFO:tasks.workunit.client.1.smithi106.stdout:1/594: write d4/d76/f27 [2724955,85477] 0 2024-05-09T06:30:29.370 INFO:tasks.workunit.client.1.smithi106.stdout:4/529: creat d7/d28/faa x:0 0 0 2024-05-09T06:30:29.371 INFO:tasks.workunit.client.1.smithi106.stdout:4/530: write d7/d39/d35/d6f/fa4 [506067,41517] 0 2024-05-09T06:30:29.373 INFO:tasks.workunit.client.1.smithi106.stdout:5/602: mknod d8/d45/d4c/d32/d5b/d95/cb8 0 2024-05-09T06:30:29.373 INFO:tasks.workunit.client.1.smithi106.stdout:5/603: fdatasync d8/d33/f4f 0 2024-05-09T06:30:29.375 INFO:tasks.workunit.client.1.smithi106.stdout:3/507: creat d5/d4d/d7a/f9b x:0 0 0 2024-05-09T06:30:29.375 INFO:tasks.workunit.client.1.smithi106.stdout:3/508: chown d5/d1c/d21/d32/f49 7 1 2024-05-09T06:30:29.383 INFO:tasks.workunit.client.1.smithi106.stdout:2/683: creat d2/d5/db/d15/d41/d58/fee x:0 0 0 2024-05-09T06:30:29.383 INFO:tasks.workunit.client.1.smithi106.stdout:2/684: truncate d2/d5/db/d15/d41/fce 640413 0 2024-05-09T06:30:29.384 INFO:tasks.workunit.client.1.smithi106.stdout:2/685: dread - d2/d5/db/f87 zero size 2024-05-09T06:30:29.384 INFO:tasks.workunit.client.1.smithi106.stdout:2/686: fdatasync d2/d5/db/d1d/f9b 0 2024-05-09T06:30:29.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/513: dwrite d3/d5/d35/d61/f63 [0,4194304] 0 2024-05-09T06:30:29.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/514: readlink d3/l23 0 2024-05-09T06:30:29.389 INFO:tasks.workunit.client.1.smithi106.stdout:7/528: mknod d0/dc/d1a/d36/d30/d44/ca1 0 2024-05-09T06:30:29.393 INFO:tasks.workunit.client.1.smithi106.stdout:1/595: rmdir d4/d76/d65/dbc 0 2024-05-09T06:30:29.396 INFO:tasks.workunit.client.1.smithi106.stdout:6/611: symlink d0/d17/ld2 0 2024-05-09T06:30:29.399 INFO:tasks.workunit.client.1.smithi106.stdout:4/531: mknod d7/d39/d47/cab 0 2024-05-09T06:30:29.399 INFO:tasks.workunit.client.1.smithi106.stdout:4/532: write d7/d39/f3f [3653762,92660] 0 2024-05-09T06:30:29.403 INFO:tasks.workunit.client.1.smithi106.stdout:3/509: symlink d5/d1c/d21/l9c 0 2024-05-09T06:30:29.405 INFO:tasks.workunit.client.1.smithi106.stdout:6/612: read d0/d17/d34/d4e/d98/da9/db1/d8/d50/f7d [3452605,37342] 0 2024-05-09T06:30:29.407 INFO:tasks.workunit.client.1.smithi106.stdout:4/533: dread d7/d28/f73 [0,4194304] 0 2024-05-09T06:30:29.408 INFO:tasks.workunit.client.1.smithi106.stdout:4/534: chown d7/d28/d2a/f9f 1583527 1 2024-05-09T06:30:29.408 INFO:tasks.workunit.client.1.smithi106.stdout:4/535: write d7/d10/f65 [2536123,1505] 0 2024-05-09T06:30:29.408 INFO:tasks.workunit.client.1.smithi106.stdout:4/536: readlink d7/d28/d2a/l2d 0 2024-05-09T06:30:29.409 INFO:tasks.workunit.client.1.smithi106.stdout:8/515: creat d3/d5/d7/d58/fb6 x:0 0 0 2024-05-09T06:30:29.409 INFO:tasks.workunit.client.1.smithi106.stdout:8/516: fsync d3/d5/d35/d4e/d32/fac 0 2024-05-09T06:30:29.413 INFO:tasks.workunit.client.1.smithi106.stdout:1/596: symlink d4/d76/d13/d60/d9c/ld8 0 2024-05-09T06:30:29.423 INFO:tasks.workunit.client.1.smithi106.stdout:6/613: symlink d0/d17/d34/d4e/d98/da9/db1/d8/ld3 0 2024-05-09T06:30:29.423 INFO:tasks.workunit.client.1.smithi106.stdout:6/614: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/fd4 x:0 0 0 2024-05-09T06:30:29.423 INFO:tasks.workunit.client.1.smithi106.stdout:6/615: dread - d0/d17/d34/d4e/d98/da9/db1/d8/d27/fc9 zero size 2024-05-09T06:30:29.423 INFO:tasks.workunit.client.1.smithi106.stdout:6/616: chown d0/d66/fa0 247019 1 2024-05-09T06:30:29.424 INFO:tasks.workunit.client.1.smithi106.stdout:2/687: dwrite d2/d7/f27 [0,4194304] 0 2024-05-09T06:30:29.424 INFO:tasks.workunit.client.1.smithi106.stdout:2/688: chown d2/d7/db7/fa4 33 1 2024-05-09T06:30:29.424 INFO:tasks.workunit.client.1.smithi106.stdout:2/689: fdatasync d2/d7/fad 0 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:1/597: rename d4/d76/fe to d4/d5/fd9 0 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:1/598: fdatasync d4/d76/f53 0 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:1/599: dread - d4/d76/d13/dbb/f81 zero size 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:1/600: truncate d4/d5/ff 5140505 0 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:1/601: readlink d4/d76/d13/dbb/l52 0 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/529: dwrite d0/dc/d1a/d36/d1e/d68/f6b [0,4194304] 0 2024-05-09T06:30:29.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/530: dread - d0/dc/d1a/d36/d30/d44/d58/f66 zero size 2024-05-09T06:30:29.430 INFO:tasks.workunit.client.1.smithi106.stdout:4/537: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:29.432 INFO:tasks.workunit.client.1.smithi106.stdout:0/633: write d1/d11/d23/d13/d58/f60 [253385,58064] 0 2024-05-09T06:30:29.432 INFO:tasks.workunit.client.1.smithi106.stdout:0/634: fdatasync d1/d11/d23/d13/d2c/f2f 0 2024-05-09T06:30:29.437 INFO:tasks.workunit.client.1.smithi106.stdout:3/510: symlink d5/l9d 0 2024-05-09T06:30:29.437 INFO:tasks.workunit.client.1.smithi106.stdout:3/511: chown d5/d1c/d24/f28 9357707 1 2024-05-09T06:30:29.443 INFO:tasks.workunit.client.1.smithi106.stdout:8/517: dwrite d3/d5/d7/f60 [0,4194304] 0 2024-05-09T06:30:29.443 INFO:tasks.workunit.client.1.smithi106.stdout:6/617: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/faa [0,4194304] 0 2024-05-09T06:30:29.444 INFO:tasks.workunit.client.1.smithi106.stdout:1/602: truncate d4/d76/f5f 2862320 0 2024-05-09T06:30:29.444 INFO:tasks.workunit.client.1.smithi106.stdout:7/531: dwrite d0/dc/d1a/d36/d30/d44/d6a/d72/f88 [0,4194304] 0 2024-05-09T06:30:29.445 INFO:tasks.workunit.client.1.smithi106.stdout:7/532: truncate d0/f13 4573137 0 2024-05-09T06:30:29.451 INFO:tasks.workunit.client.1.smithi106.stdout:4/538: unlink d7/d39/d47/d66/fa9 0 2024-05-09T06:30:29.453 INFO:tasks.workunit.client.1.smithi106.stdout:0/635: symlink d1/d11/d23/da6/ldb 0 2024-05-09T06:30:29.456 INFO:tasks.workunit.client.1.smithi106.stdout:3/512: creat d5/d12/d26/f9e x:0 0 0 2024-05-09T06:30:29.457 INFO:tasks.workunit.client.1.smithi106.stdout:8/518: dwrite d3/d5/d7/d15/fa4 [0,4194304] 0 2024-05-09T06:30:29.458 INFO:tasks.workunit.client.1.smithi106.stdout:8/519: chown d3/d5/d7/d58/f6d 30391419 1 2024-05-09T06:30:29.462 INFO:tasks.workunit.client.1.smithi106.stdout:7/533: dwrite d0/f9 [0,4194304] 0 2024-05-09T06:30:29.475 INFO:tasks.workunit.client.1.smithi106.stdout:6/618: rmdir d0/d17 39 2024-05-09T06:30:29.475 INFO:tasks.workunit.client.1.smithi106.stdout:6/619: readlink d0/d17/d34/d4e/d98/da9/db1/l5b 0 2024-05-09T06:30:29.475 INFO:tasks.workunit.client.1.smithi106.stdout:6/620: chown d0/d17/f25 11 1 2024-05-09T06:30:29.475 INFO:tasks.workunit.client.1.smithi106.stdout:6/621: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fd5 x:0 0 0 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/622: fdatasync d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/fc8 0 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/623: stat d0/f6a 0 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/624: truncate d0/d66/d7e/f2b 9572509 0 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/625: dread - d0/d17/d34/d4e/d98/da9/db1/d8/d50/fb3 zero size 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/626: write d0/d66/d7e/f8c [760990,114024] 0 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:6/627: fdatasync d0/d17/d34/d4e/d98/da9/db1/d8/f1d 0 2024-05-09T06:30:29.476 INFO:tasks.workunit.client.1.smithi106.stdout:1/603: getdents d4/d76/d13/d60/d9c 0 2024-05-09T06:30:29.482 INFO:tasks.workunit.client.1.smithi106.stdout:4/539: mkdir d7/d39/d35/dac 0 2024-05-09T06:30:29.484 INFO:tasks.workunit.client.1.smithi106.stdout:0/636: creat d1/da1/dd8/fdc x:0 0 0 2024-05-09T06:30:29.484 INFO:tasks.workunit.client.1.smithi106.stdout:0/637: chown d1/d11/d23/f1a 44952671 1 2024-05-09T06:30:29.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/513: link d5/d1c/d24/f35 d5/d3f/f9f 0 2024-05-09T06:30:29.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/514: creat d5/d12/fa0 x:0 0 0 2024-05-09T06:30:29.490 INFO:tasks.workunit.client.1.smithi106.stdout:6/628: dwrite d0/d17/f29 [0,4194304] 0 2024-05-09T06:30:29.490 INFO:tasks.workunit.client.1.smithi106.stdout:6/629: fsync d0/d17/d34/d4e/d98/da9/db1/d8/d50/f81 0 2024-05-09T06:30:29.493 INFO:tasks.workunit.client.1.smithi106.stdout:0/638: write d1/d11/d23/da6/f7a [2208366,99669] 0 2024-05-09T06:30:29.493 INFO:tasks.workunit.client.1.smithi106.stdout:8/520: truncate d3/d5/d13/d3a/f77 340626 0 2024-05-09T06:30:29.497 INFO:tasks.workunit.client.1.smithi106.stdout:2/690: rename d2/d7/d2c/daf to d2/d7/d62/def 0 2024-05-09T06:30:29.497 INFO:tasks.workunit.client.1.smithi106.stdout:2/691: creat d2/d5/db/d15/d41/d58/ff0 x:0 0 0 2024-05-09T06:30:29.503 INFO:tasks.workunit.client.1.smithi106.stdout:7/534: symlink d0/dc/d1a/d36/d30/d44/d6a/d72/la2 0 2024-05-09T06:30:29.503 INFO:tasks.workunit.client.1.smithi106.stdout:7/535: chown d0/dc/d1a/d36/d30/d44/d6a/f8e 28869 1 2024-05-09T06:30:29.509 INFO:tasks.workunit.client.1.smithi106.stdout:3/515: dwrite d5/d12/d26/f9e [0,4194304] 0 2024-05-09T06:30:29.512 INFO:tasks.workunit.client.1.smithi106.stdout:4/540: rmdir d7/d39/d47/d89 39 2024-05-09T06:30:29.521 INFO:tasks.workunit.client.1.smithi106.stdout:6/630: rename d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fcb to d0/d66/d7e/d9f/fd6 0 2024-05-09T06:30:29.524 INFO:tasks.workunit.client.1.smithi106.stdout:2/692: truncate d2/d5/f54 3374724 0 2024-05-09T06:30:29.526 INFO:tasks.workunit.client.1.smithi106.stdout:9/584: sync 2024-05-09T06:30:29.526 INFO:tasks.workunit.client.1.smithi106.stdout:9/585: chown d4/d54/d69/d95/d23/d2f/d31/f44 248380 1 2024-05-09T06:30:29.527 INFO:tasks.workunit.client.1.smithi106.stdout:8/521: dread d3/d5/d13/d3a/f77 [0,4194304] 0 2024-05-09T06:30:29.527 INFO:tasks.workunit.client.1.smithi106.stdout:8/522: chown d3/d5/d7/d15/d3e/d7d 51962884 1 2024-05-09T06:30:29.527 INFO:tasks.workunit.client.1.smithi106.stdout:8/523: creat d3/d5/d7/fb7 x:0 0 0 2024-05-09T06:30:29.527 INFO:tasks.workunit.client.1.smithi106.stdout:8/524: chown d3/d5/f3c 915 1 2024-05-09T06:30:29.527 INFO:tasks.workunit.client.1.smithi106.stdout:7/536: unlink d0/fe 0 2024-05-09T06:30:29.528 INFO:tasks.workunit.client.1.smithi106.stdout:5/604: sync 2024-05-09T06:30:29.529 INFO:tasks.workunit.client.1.smithi106.stdout:6/631: dread d0/f19 [0,4194304] 0 2024-05-09T06:30:29.529 INFO:tasks.workunit.client.1.smithi106.stdout:6/632: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/fd7 x:0 0 0 2024-05-09T06:30:29.534 INFO:tasks.workunit.client.1.smithi106.stdout:3/516: symlink d5/d1c/d24/d89/la1 0 2024-05-09T06:30:29.535 INFO:tasks.workunit.client.1.smithi106.stdout:7/537: dread d0/f90 [0,4194304] 0 2024-05-09T06:30:29.535 INFO:tasks.workunit.client.1.smithi106.stdout:7/538: stat d0/d53/l59 0 2024-05-09T06:30:29.535 INFO:tasks.workunit.client.1.smithi106.stdout:7/539: chown d0/dc/d1a/d36/d30/d44/d6a 551619499 1 2024-05-09T06:30:29.536 INFO:tasks.workunit.client.1.smithi106.stdout:4/541: mknod d7/d39/d35/d6f/d9c/cad 0 2024-05-09T06:30:29.539 INFO:tasks.workunit.client.1.smithi106.stdout:6/633: dread d0/d17/d34/d4e/d98/da9/db1/d8/f70 [0,4194304] 0 2024-05-09T06:30:29.539 INFO:tasks.workunit.client.1.smithi106.stdout:6/634: stat d0/d17 0 2024-05-09T06:30:29.539 INFO:tasks.workunit.client.1.smithi106.stdout:6/635: readlink d0/d17/d34/d72/l9a 0 2024-05-09T06:30:29.541 INFO:tasks.workunit.client.1.smithi106.stdout:0/639: rename d1/d11/d23/d13/l37 to d1/d11/d7f/ldd 0 2024-05-09T06:30:29.541 INFO:tasks.workunit.client.1.smithi106.stdout:0/640: chown d1/d11/d23/f53 56088793 1 2024-05-09T06:30:29.542 INFO:tasks.workunit.client.1.smithi106.stdout:7/540: dread d0/dc/d1a/d36/d30/f26 [0,4194304] 0 2024-05-09T06:30:29.542 INFO:tasks.workunit.client.1.smithi106.stdout:7/541: truncate d0/dc/d1a/d5a/f94 371802 0 2024-05-09T06:30:29.542 INFO:tasks.workunit.client.1.smithi106.stdout:2/693: creat d2/d5/db/ff1 x:0 0 0 2024-05-09T06:30:29.544 INFO:tasks.workunit.client.1.smithi106.stdout:9/586: mknod d4/d54/d69/d95/d23/ca7 0 2024-05-09T06:30:29.545 INFO:tasks.workunit.client.1.smithi106.stdout:8/525: dwrite d3/d5/d13/d3a/f90 [0,4194304] 0 2024-05-09T06:30:29.545 INFO:tasks.workunit.client.1.smithi106.stdout:8/526: write d3/d5/d7/f60 [5017699,10296] 0 2024-05-09T06:30:29.547 INFO:tasks.workunit.client.1.smithi106.stdout:8/527: write d3/d5/d7/f44 [1132935,106928] 0 2024-05-09T06:30:29.548 INFO:tasks.workunit.client.1.smithi106.stdout:8/528: chown d3/d5/d7/c5c 104 1 2024-05-09T06:30:29.554 INFO:tasks.workunit.client.1.smithi106.stdout:4/542: link d7/d10/d1a/d5a/c6a d7/d10/d1a/cae 0 2024-05-09T06:30:29.558 INFO:tasks.workunit.client.1.smithi106.stdout:3/517: rename d5/d1c/d24/d52/f78 to d5/d1c/d21/fa2 0 2024-05-09T06:30:29.558 INFO:tasks.workunit.client.1.smithi106.stdout:2/694: dwrite d2/d7/d2c/f34 [0,4194304] 0 2024-05-09T06:30:29.558 INFO:tasks.workunit.client.1.smithi106.stdout:2/695: read d2/d5/f6 [3471458,110396] 0 2024-05-09T06:30:29.564 INFO:tasks.workunit.client.1.smithi106.stdout:7/542: creat d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/fa3 x:0 0 0 2024-05-09T06:30:29.566 INFO:tasks.workunit.client.1.smithi106.stdout:9/587: truncate d4/d54/d69/d95/d23/d2f/d31/f46 3339467 0 2024-05-09T06:30:29.573 INFO:tasks.workunit.client.1.smithi106.stdout:9/588: dread d4/d54/d69/d99/d2a/d42/f4f [0,4194304] 0 2024-05-09T06:30:29.577 INFO:tasks.workunit.client.1.smithi106.stdout:8/529: mknod d3/d5/d35/d61/d6c/d83/d89/cb8 0 2024-05-09T06:30:29.579 INFO:tasks.workunit.client.1.smithi106.stdout:5/605: rmdir d8/d45/d4c/d32 39 2024-05-09T06:30:29.582 INFO:tasks.workunit.client.1.smithi106.stdout:9/589: dread d4/d54/d69/d99/d2a/f26 [0,4194304] 0 2024-05-09T06:30:29.582 INFO:tasks.workunit.client.1.smithi106.stdout:4/543: unlink d7/d10/l4f 0 2024-05-09T06:30:29.584 INFO:tasks.workunit.client.1.smithi106.stdout:2/696: mknod d2/d5/db/d15/d41/d60/dcc/cf2 0 2024-05-09T06:30:29.588 INFO:tasks.workunit.client.1.smithi106.stdout:5/606: dread d8/fa [0,4194304] 0 2024-05-09T06:30:29.589 INFO:tasks.workunit.client.1.smithi106.stdout:0/641: rmdir d1/d11/d23/d13/d58 39 2024-05-09T06:30:29.589 INFO:tasks.workunit.client.1.smithi106.stdout:0/642: dread - d1/d11/d23/d22/fcf zero size 2024-05-09T06:30:29.591 INFO:tasks.workunit.client.1.smithi106.stdout:7/543: symlink d0/dc/d1a/d5a/la4 0 2024-05-09T06:30:29.593 INFO:tasks.workunit.client.1.smithi106.stdout:2/697: dread d2/fc [0,4194304] 0 2024-05-09T06:30:29.594 INFO:tasks.workunit.client.1.smithi106.stdout:8/530: rename d3/d5/d13/d3a/c48 to d3/d5/d7/d15/d47/cb9 0 2024-05-09T06:30:29.596 INFO:tasks.workunit.client.1.smithi106.stdout:0/643: dread d1/f4a [0,4194304] 0 2024-05-09T06:30:29.596 INFO:tasks.workunit.client.1.smithi106.stdout:0/644: readlink d1/l50 0 2024-05-09T06:30:29.596 INFO:tasks.workunit.client.1.smithi106.stdout:0/645: readlink d1/da1/d83/lbd 0 2024-05-09T06:30:29.596 INFO:tasks.workunit.client.1.smithi106.stdout:9/590: mknod d4/d54/ca8 0 2024-05-09T06:30:29.598 INFO:tasks.workunit.client.1.smithi106.stdout:0/646: dread d1/d11/f3c [4194304,4194304] 0 2024-05-09T06:30:29.598 INFO:tasks.workunit.client.1.smithi106.stdout:0/647: chown d1/da1/dd8/fdc 182246920 1 2024-05-09T06:30:29.598 INFO:tasks.workunit.client.1.smithi106.stdout:1/604: sync 2024-05-09T06:30:29.598 INFO:tasks.workunit.client.1.smithi106.stdout:1/605: dread - d4/d76/d13/f3e zero size 2024-05-09T06:30:29.598 INFO:tasks.workunit.client.1.smithi106.stdout:4/544: mknod d7/d39/caf 0 2024-05-09T06:30:29.601 INFO:tasks.workunit.client.1.smithi106.stdout:0/648: dread d1/f4a [0,4194304] 0 2024-05-09T06:30:29.601 INFO:tasks.workunit.client.1.smithi106.stdout:0/649: chown d1/f1d 19 1 2024-05-09T06:30:29.601 INFO:tasks.workunit.client.1.smithi106.stdout:0/650: dread - d1/d11/d23/d13/d8a/fc9 zero size 2024-05-09T06:30:29.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/607: unlink d8/d45/d4c/d32/ca3 0 2024-05-09T06:30:29.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/608: write d8/d5a/d60/d7e/f82 [1677720,111974] 0 2024-05-09T06:30:29.608 INFO:tasks.workunit.client.1.smithi106.stdout:2/698: creat d2/d5/db/d15/d41/d58/ddf/ff3 x:0 0 0 2024-05-09T06:30:29.609 INFO:tasks.workunit.client.1.smithi106.stdout:2/699: chown d2/d5/cbb 28236 1 2024-05-09T06:30:29.611 INFO:tasks.workunit.client.1.smithi106.stdout:9/591: rename d4/d54/d69/d95/d23/d2f/l6a to d4/d54/d69/d95/d23/d2f/la9 0 2024-05-09T06:30:29.611 INFO:tasks.workunit.client.1.smithi106.stdout:9/592: dread - d4/d54/d69/d99/d2a/d42/d6c/fa4 zero size 2024-05-09T06:30:29.611 INFO:tasks.workunit.client.1.smithi106.stdout:9/593: fdatasync d4/d54/d69/d99/d2a/f1e 0 2024-05-09T06:30:29.614 INFO:tasks.workunit.client.1.smithi106.stdout:4/545: symlink d7/d39/lb0 0 2024-05-09T06:30:29.616 INFO:tasks.workunit.client.1.smithi106.stdout:0/651: mkdir d1/d11/d23/d13/d2c/d3d/dbe/dde 0 2024-05-09T06:30:29.617 INFO:tasks.workunit.client.1.smithi106.stdout:1/606: dwrite d4/d37/d3d/f44 [0,4194304] 0 2024-05-09T06:30:29.617 INFO:tasks.workunit.client.1.smithi106.stdout:1/607: dread - d4/d5b/f8c zero size 2024-05-09T06:30:29.617 INFO:tasks.workunit.client.1.smithi106.stdout:8/531: dwrite d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:29.618 INFO:tasks.workunit.client.1.smithi106.stdout:2/700: read d2/d7/db7/fbf [4403601,37329] 0 2024-05-09T06:30:29.619 INFO:tasks.workunit.client.1.smithi106.stdout:1/608: dread d4/d5b/d75/fb9 [0,4194304] 0 2024-05-09T06:30:29.619 INFO:tasks.workunit.client.1.smithi106.stdout:1/609: truncate d4/d5b/f8c 902869 0 2024-05-09T06:30:29.619 INFO:tasks.workunit.client.1.smithi106.stdout:1/610: chown d4/d76/d65 2 1 2024-05-09T06:30:29.619 INFO:tasks.workunit.client.1.smithi106.stdout:1/611: creat d4/d5b/d75/fda x:0 0 0 2024-05-09T06:30:29.620 INFO:tasks.workunit.client.1.smithi106.stdout:5/609: mknod d8/d33/d3a/d59/d99/cb9 0 2024-05-09T06:30:29.621 INFO:tasks.workunit.client.1.smithi106.stdout:7/544: mkdir d0/da5 0 2024-05-09T06:30:29.623 INFO:tasks.workunit.client.1.smithi106.stdout:9/594: mknod d4/d54/d69/d95/d23/d2f/d31/d51/caa 0 2024-05-09T06:30:29.624 INFO:tasks.workunit.client.1.smithi106.stdout:9/595: write d4/d54/d69/d99/d2a/d42/d6c/d6d/f77 [1021805,100021] 0 2024-05-09T06:30:29.624 INFO:tasks.workunit.client.1.smithi106.stdout:9/596: write d4/d54/d69/d99/d2a/f20 [701749,2182] 0 2024-05-09T06:30:29.624 INFO:tasks.workunit.client.1.smithi106.stdout:9/597: write d4/d54/d91/f93 [504567,67841] 0 2024-05-09T06:30:29.626 INFO:tasks.workunit.client.1.smithi106.stdout:4/546: symlink d7/d39/d35/lb1 0 2024-05-09T06:30:29.629 INFO:tasks.workunit.client.1.smithi106.stdout:0/652: creat d1/d11/d7f/fdf x:0 0 0 2024-05-09T06:30:29.633 INFO:tasks.workunit.client.1.smithi106.stdout:1/612: dwrite d4/d76/d13/f1b [0,4194304] 0 2024-05-09T06:30:29.636 INFO:tasks.workunit.client.1.smithi106.stdout:8/532: symlink d3/d5/d35/d61/d6c/d83/d89/lba 0 2024-05-09T06:30:29.638 INFO:tasks.workunit.client.1.smithi106.stdout:2/701: creat d2/d5/db/d15/dd6/deb/ff4 x:0 0 0 2024-05-09T06:30:29.643 INFO:tasks.workunit.client.1.smithi106.stdout:7/545: rename d0/dc/d1a/d36/d30/d44/d6a/d72/d77 to d0/dc/d45/da6 0 2024-05-09T06:30:29.644 INFO:tasks.workunit.client.1.smithi106.stdout:7/546: fdatasync d0/dc/d1a/d36/d30/d44/d6a/f8e 0 2024-05-09T06:30:29.644 INFO:tasks.workunit.client.1.smithi106.stdout:7/547: chown d0/dc/d1a/d36/d1e/c56 588284 1 2024-05-09T06:30:29.645 INFO:tasks.workunit.client.1.smithi106.stdout:9/598: creat d4/d54/fab x:0 0 0 2024-05-09T06:30:29.645 INFO:tasks.workunit.client.1.smithi106.stdout:9/599: write d4/d54/d69/d99/d2a/d42/d6c/fa4 [789874,97228] 0 2024-05-09T06:30:29.645 INFO:tasks.workunit.client.1.smithi106.stdout:9/600: write d4/d54/d69/d95/d23/d2f/d38/d68/f6f [861949,121672] 0 2024-05-09T06:30:29.646 INFO:tasks.workunit.client.1.smithi106.stdout:5/610: getdents d8/d33/d3a/d59/d99 0 2024-05-09T06:30:29.647 INFO:tasks.workunit.client.1.smithi106.stdout:5/611: read d8/d5a/f73 [165883,113376] 0 2024-05-09T06:30:29.647 INFO:tasks.workunit.client.1.smithi106.stdout:5/612: chown d8/d45/d4c/d32 0 1 2024-05-09T06:30:29.648 INFO:tasks.workunit.client.1.smithi106.stdout:4/547: creat d7/fb2 x:0 0 0 2024-05-09T06:30:29.649 INFO:tasks.workunit.client.1.smithi106.stdout:7/548: dread d0/dc/d1a/d36/d30/f3b [0,4194304] 0 2024-05-09T06:30:29.649 INFO:tasks.workunit.client.1.smithi106.stdout:7/549: stat d0/dc/f43 0 2024-05-09T06:30:29.651 INFO:tasks.workunit.client.1.smithi106.stdout:5/613: dread d8/f1a [0,4194304] 0 2024-05-09T06:30:29.651 INFO:tasks.workunit.client.1.smithi106.stdout:5/614: chown d8/d45/c90 6780 1 2024-05-09T06:30:29.651 INFO:tasks.workunit.client.1.smithi106.stdout:5/615: stat d8/d45/d4c/f6e 0 2024-05-09T06:30:29.652 INFO:tasks.workunit.client.1.smithi106.stdout:5/616: fsync d8/d33/f96 0 2024-05-09T06:30:29.652 INFO:tasks.workunit.client.1.smithi106.stdout:0/653: getdents d1/d11/d23/d13/d2c/d57 0 2024-05-09T06:30:29.656 INFO:tasks.workunit.client.1.smithi106.stdout:7/550: dread d0/dc/f57 [0,4194304] 0 2024-05-09T06:30:29.656 INFO:tasks.workunit.client.1.smithi106.stdout:7/551: stat d0/fa 0 2024-05-09T06:30:29.668 INFO:tasks.workunit.client.1.smithi106.stdout:1/613: mknod d4/cdb 0 2024-05-09T06:30:29.668 INFO:tasks.workunit.client.1.smithi106.stdout:7/552: dread d0/dc/d1a/f3a [0,4194304] 0 2024-05-09T06:30:29.669 INFO:tasks.workunit.client.1.smithi106.stdout:6/636: sync 2024-05-09T06:30:29.669 INFO:tasks.workunit.client.1.smithi106.stdout:6/637: readlink d0/d17/d34/d95/la2 0 2024-05-09T06:30:29.669 INFO:tasks.workunit.client.1.smithi106.stdout:9/601: dwrite d4/d54/d69/d95/d23/d2f/d38/d86/f8c [0,4194304] 0 2024-05-09T06:30:29.669 INFO:tasks.workunit.client.1.smithi106.stdout:5/617: dwrite d8/f51 [4194304,4194304] 0 2024-05-09T06:30:29.672 INFO:tasks.workunit.client.1.smithi106.stdout:8/533: rename d3/d5/d7/d58/l5f to d3/d5/d35/d4e/lbb 0 2024-05-09T06:30:29.677 INFO:tasks.workunit.client.1.smithi106.stdout:1/614: mknod d4/d37/d3d/cdc 0 2024-05-09T06:30:29.679 INFO:tasks.workunit.client.1.smithi106.stdout:7/553: rmdir d0/dc/d45 39 2024-05-09T06:30:29.679 INFO:tasks.workunit.client.1.smithi106.stdout:1/615: dread d4/fa [0,4194304] 0 2024-05-09T06:30:29.681 INFO:tasks.workunit.client.1.smithi106.stdout:6/638: symlink d0/d17/d76/d8b/ld8 0 2024-05-09T06:30:29.687 INFO:tasks.workunit.client.1.smithi106.stdout:9/602: getdents d4/d54/d69/d95/d23/d78/d8f 0 2024-05-09T06:30:29.687 INFO:tasks.workunit.client.1.smithi106.stdout:3/518: sync 2024-05-09T06:30:29.688 INFO:tasks.workunit.client.1.smithi106.stdout:7/554: read d0/fa [7517273,4267] 0 2024-05-09T06:30:29.688 INFO:tasks.workunit.client.1.smithi106.stdout:7/555: stat d0/dc/f19 0 2024-05-09T06:30:29.688 INFO:tasks.workunit.client.1.smithi106.stdout:7/556: chown d0/dc/d1a/c3e 297 1 2024-05-09T06:30:29.697 INFO:tasks.workunit.client.1.smithi106.stdout:5/618: link d8/d5a/l97 d8/d5a/lba 0 2024-05-09T06:30:29.700 INFO:tasks.workunit.client.1.smithi106.stdout:2/702: rename d2/d5/c12 to d2/d5/db/d1d/d6a/cf5 0 2024-05-09T06:30:29.700 INFO:tasks.workunit.client.1.smithi106.stdout:2/703: chown d2/d5/db/d15/d41/fce 1195496340 1 2024-05-09T06:30:29.702 INFO:tasks.workunit.client.1.smithi106.stdout:8/534: mkdir d3/d5/dbc 0 2024-05-09T06:30:29.704 INFO:tasks.workunit.client.1.smithi106.stdout:1/616: creat d4/fdd x:0 0 0 2024-05-09T06:30:29.705 INFO:tasks.workunit.client.1.smithi106.stdout:6/639: rmdir d0/d17/d76/d8b 39 2024-05-09T06:30:29.706 INFO:tasks.workunit.client.1.smithi106.stdout:9/603: symlink d4/d54/d69/lac 0 2024-05-09T06:30:29.708 INFO:tasks.workunit.client.1.smithi106.stdout:5/619: getdents d8/d33/d3a 0 2024-05-09T06:30:29.709 INFO:tasks.workunit.client.1.smithi106.stdout:9/604: write d4/d54/d69/d95/d23/d2f/d38/d86/f8c [4773224,35974] 0 2024-05-09T06:30:29.710 INFO:tasks.workunit.client.1.smithi106.stdout:0/654: rename d1/d11/d23/d13/d58/da8/dd6/l87 to d1/le0 0 2024-05-09T06:30:29.711 INFO:tasks.workunit.client.1.smithi106.stdout:0/655: chown d1/d11/d7f 1968620407 1 2024-05-09T06:30:29.711 INFO:tasks.workunit.client.1.smithi106.stdout:7/557: dwrite d0/dc/d1a/d36/d30/f26 [0,4194304] 0 2024-05-09T06:30:29.712 INFO:tasks.workunit.client.1.smithi106.stdout:8/535: mkdir d3/d5/d35/d73/d9d/da9/dbd 0 2024-05-09T06:30:29.714 INFO:tasks.workunit.client.1.smithi106.stdout:7/558: write d0/dc/d1a/f3a [400033,808] 0 2024-05-09T06:30:29.714 INFO:tasks.workunit.client.1.smithi106.stdout:5/620: dread d8/d45/f55 [0,4194304] 0 2024-05-09T06:30:29.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/621: stat d8/d45/d4c/d32/l3c 0 2024-05-09T06:30:29.715 INFO:tasks.workunit.client.1.smithi106.stdout:5/622: truncate d8/d33/d3a/f88 89825 0 2024-05-09T06:30:29.715 INFO:tasks.workunit.client.1.smithi106.stdout:1/617: unlink d4/d76/d1d/f38 0 2024-05-09T06:30:29.717 INFO:tasks.workunit.client.1.smithi106.stdout:6/640: mknod d0/d17/d34/d4e/d98/da9/db1/d40/cd9 0 2024-05-09T06:30:29.722 INFO:tasks.workunit.client.1.smithi106.stdout:9/605: mknod d4/d54/d69/d95/d23/d16/d94/cad 0 2024-05-09T06:30:29.723 INFO:tasks.workunit.client.1.smithi106.stdout:8/536: mkdir d3/d5/d13/d3a/dbe 0 2024-05-09T06:30:29.723 INFO:tasks.workunit.client.1.smithi106.stdout:5/623: dread d8/d5a/d60/f75 [0,4194304] 0 2024-05-09T06:30:29.724 INFO:tasks.workunit.client.1.smithi106.stdout:7/559: mknod d0/dc/d1a/d5a/ca7 0 2024-05-09T06:30:29.726 INFO:tasks.workunit.client.1.smithi106.stdout:1/618: link d4/d5b/f9f d4/d76/d13/d60/d9c/dbe/fde 0 2024-05-09T06:30:29.726 INFO:tasks.workunit.client.1.smithi106.stdout:1/619: chown d4/d76/d1d/f41 177862167 1 2024-05-09T06:30:29.728 INFO:tasks.workunit.client.1.smithi106.stdout:6/641: creat d0/d17/d34/d4e/fda x:0 0 0 2024-05-09T06:30:29.731 INFO:tasks.workunit.client.1.smithi106.stdout:9/606: rename d4/d54/d69/d95/d23/d2f/d38/f3a to d4/d54/d69/d99/d2a/fae 0 2024-05-09T06:30:29.731 INFO:tasks.workunit.client.1.smithi106.stdout:9/607: chown d4/d54/d69/d99/d2a/d42/d6c/d6d/c9b 50 1 2024-05-09T06:30:29.731 INFO:tasks.workunit.client.1.smithi106.stdout:9/608: chown d4/d54/d69/d99/d2a/f20 5769086 1 2024-05-09T06:30:29.731 INFO:tasks.workunit.client.1.smithi106.stdout:9/609: dread - d4/d54/d69/d95/d23/d2f/d47/f9d zero size 2024-05-09T06:30:29.732 INFO:tasks.workunit.client.1.smithi106.stdout:0/656: dwrite d1/d11/d23/d13/f54 [4194304,4194304] 0 2024-05-09T06:30:29.732 INFO:tasks.workunit.client.1.smithi106.stdout:8/537: dread d3/d5/d35/d4e/d32/f7b [0,4194304] 0 2024-05-09T06:30:29.733 INFO:tasks.workunit.client.1.smithi106.stdout:5/624: creat d8/d45/d4c/d32/d5b/d69/fbb x:0 0 0 2024-05-09T06:30:29.735 INFO:tasks.workunit.client.1.smithi106.stdout:7/560: mkdir d0/da5/da8 0 2024-05-09T06:30:29.737 INFO:tasks.workunit.client.1.smithi106.stdout:1/620: dread d4/d37/d3d/f44 [0,4194304] 0 2024-05-09T06:30:29.740 INFO:tasks.workunit.client.1.smithi106.stdout:0/657: mkdir d1/d11/d23/d13/d2c/d57/de1 0 2024-05-09T06:30:29.743 INFO:tasks.workunit.client.1.smithi106.stdout:0/658: write d1/d11/d23/f64 [1645769,57416] 0 2024-05-09T06:30:29.743 INFO:tasks.workunit.client.1.smithi106.stdout:0/659: chown d1/d11/d23/d13/d2c/d6d/c78 2 1 2024-05-09T06:30:29.743 INFO:tasks.workunit.client.1.smithi106.stdout:0/660: write d1/d11/d23/d13/d8a/fc9 [135394,68552] 0 2024-05-09T06:30:29.744 INFO:tasks.workunit.client.1.smithi106.stdout:0/661: creat d1/d11/d23/da6/fe2 x:0 0 0 2024-05-09T06:30:29.744 INFO:tasks.workunit.client.1.smithi106.stdout:5/625: truncate d8/d45/d4c/d32/d5b/f2c 806628 0 2024-05-09T06:30:29.746 INFO:tasks.workunit.client.1.smithi106.stdout:5/626: dread d8/f5f [0,4194304] 0 2024-05-09T06:30:29.748 INFO:tasks.workunit.client.1.smithi106.stdout:6/642: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d50/f81 [0,4194304] 0 2024-05-09T06:30:29.754 INFO:tasks.workunit.client.1.smithi106.stdout:7/561: creat d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/fa9 x:0 0 0 2024-05-09T06:30:29.755 INFO:tasks.workunit.client.1.smithi106.stdout:1/621: dwrite d4/d37/d74/fa5 [0,4194304] 0 2024-05-09T06:30:29.756 INFO:tasks.workunit.client.1.smithi106.stdout:1/622: creat d4/d76/fdf x:0 0 0 2024-05-09T06:30:29.766 INFO:tasks.workunit.client.1.smithi106.stdout:5/627: mknod d8/d45/d4c/d32/d5b/d69/cbc 0 2024-05-09T06:30:29.768 INFO:tasks.workunit.client.1.smithi106.stdout:0/662: dwrite d1/d11/d23/d13/d58/da8/dd6/d7e/fa0 [0,4194304] 0 2024-05-09T06:30:29.772 INFO:tasks.workunit.client.1.smithi106.stdout:6/643: stat d0/d17/d34/d4e/d98/da9/db1/d8/d27/l5a 0 2024-05-09T06:30:29.777 INFO:tasks.workunit.client.1.smithi106.stdout:7/562: creat d0/dc/d45/da6/faa x:0 0 0 2024-05-09T06:30:29.777 INFO:tasks.workunit.client.1.smithi106.stdout:7/563: creat d0/dc/d1a/d5a/fab x:0 0 0 2024-05-09T06:30:29.777 INFO:tasks.workunit.client.1.smithi106.stdout:7/564: truncate d0/dc/f69 1119925 0 2024-05-09T06:30:29.788 INFO:tasks.workunit.client.1.smithi106.stdout:5/628: getdents d8/d5a 0 2024-05-09T06:30:29.794 INFO:tasks.workunit.client.1.smithi106.stdout:6/644: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d50/ldb 0 2024-05-09T06:30:29.794 INFO:tasks.workunit.client.1.smithi106.stdout:6/645: fsync d0/d17/d34/f82 0 2024-05-09T06:30:29.796 INFO:tasks.workunit.client.1.smithi106.stdout:1/623: write d4/d76/d13/dbb/f61 [749263,109886] 0 2024-05-09T06:30:29.799 INFO:tasks.workunit.client.1.smithi106.stdout:5/629: mknod d8/d33/cbd 0 2024-05-09T06:30:29.802 INFO:tasks.workunit.client.1.smithi106.stdout:6/646: rename d0/f19 to d0/d17/d34/d4e/d98/da9/db1/d8/d27/fdc 0 2024-05-09T06:30:29.802 INFO:tasks.workunit.client.1.smithi106.stdout:4/548: sync 2024-05-09T06:30:29.805 INFO:tasks.workunit.client.1.smithi106.stdout:1/624: dread - d4/d76/d13/dbb/f55 zero size 2024-05-09T06:30:29.807 INFO:tasks.workunit.client.1.smithi106.stdout:7/565: getdents d0/dc/d1a/d36/d30/d44/d80 0 2024-05-09T06:30:29.807 INFO:tasks.workunit.client.1.smithi106.stdout:7/566: chown d0/dc/d1a/d36/d30/d44/ca1 959 1 2024-05-09T06:30:29.808 INFO:tasks.workunit.client.1.smithi106.stdout:5/630: truncate d8/d5a/d60/da8/daa/db4/f9a 4046797 0 2024-05-09T06:30:29.810 INFO:tasks.workunit.client.1.smithi106.stdout:6/647: symlink d0/d17/d34/d72/ldd 0 2024-05-09T06:30:29.814 INFO:tasks.workunit.client.1.smithi106.stdout:7/567: symlink d0/dc/d1a/d36/lac 0 2024-05-09T06:30:29.817 INFO:tasks.workunit.client.1.smithi106.stdout:5/631: unlink d8/d5a/d60/d7e/dae/fb1 0 2024-05-09T06:30:29.819 INFO:tasks.workunit.client.1.smithi106.stdout:6/648: mknod d0/d66/d7e/cde 0 2024-05-09T06:30:29.820 INFO:tasks.workunit.client.1.smithi106.stdout:4/549: getdents d7/d28 0 2024-05-09T06:30:29.822 INFO:tasks.workunit.client.1.smithi106.stdout:4/550: read d7/d10/d1a/d5a/d7a/f83 [358497,32525] 0 2024-05-09T06:30:29.822 INFO:tasks.workunit.client.1.smithi106.stdout:4/551: fsync d7/d39/d35/d6f/fa4 0 2024-05-09T06:30:29.822 INFO:tasks.workunit.client.1.smithi106.stdout:7/568: symlink d0/dc/d1a/d36/d30/d44/d6a/d72/lad 0 2024-05-09T06:30:29.825 INFO:tasks.workunit.client.1.smithi106.stdout:5/632: unlink d8/d45/f55 0 2024-05-09T06:30:29.825 INFO:tasks.workunit.client.1.smithi106.stdout:5/633: truncate d8/d33/f76 592282 0 2024-05-09T06:30:29.826 INFO:tasks.workunit.client.1.smithi106.stdout:4/552: getdents d7/d28/d2a 0 2024-05-09T06:30:29.833 INFO:tasks.workunit.client.1.smithi106.stdout:5/634: rename d8/d45/d4c/f6e to d8/d5a/d60/da8/daa/db4/fbe 0 2024-05-09T06:30:29.835 INFO:tasks.workunit.client.1.smithi106.stdout:7/569: getdents d0/dc/d1a/d36/d30/d44/d6a 0 2024-05-09T06:30:29.838 INFO:tasks.workunit.client.1.smithi106.stdout:4/553: write d7/d10/f43 [3993072,113196] 0 2024-05-09T06:30:29.838 INFO:tasks.workunit.client.1.smithi106.stdout:7/570: rmdir d0/da5/da8 0 2024-05-09T06:30:29.839 INFO:tasks.workunit.client.1.smithi106.stdout:7/571: write d0/f5b [687918,94120] 0 2024-05-09T06:30:29.839 INFO:tasks.workunit.client.1.smithi106.stdout:6/649: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d27/fdc [0,4194304] 0 2024-05-09T06:30:29.843 INFO:tasks.workunit.client.1.smithi106.stdout:5/635: write d8/f7a [3204227,21141] 0 2024-05-09T06:30:29.843 INFO:tasks.workunit.client.1.smithi106.stdout:5/636: truncate d8/d45/d4c/d32/d5b/d69/fab 301490 0 2024-05-09T06:30:29.848 INFO:tasks.workunit.client.1.smithi106.stdout:6/650: creat d0/d17/d34/d4e/d98/fdf x:0 0 0 2024-05-09T06:30:29.852 INFO:tasks.workunit.client.1.smithi106.stdout:7/572: dwrite d0/dc/d1a/d5a/f70 [0,4194304] 0 2024-05-09T06:30:29.852 INFO:tasks.workunit.client.1.smithi106.stdout:7/573: chown d0/dc/f57 32287 1 2024-05-09T06:30:29.853 INFO:tasks.workunit.client.1.smithi106.stdout:4/554: rmdir d7 39 2024-05-09T06:30:29.858 INFO:tasks.workunit.client.1.smithi106.stdout:5/637: creat d8/d45/d4c/d85/fbf x:0 0 0 2024-05-09T06:30:29.860 INFO:tasks.workunit.client.1.smithi106.stdout:6/651: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/dad/le0 0 2024-05-09T06:30:29.860 INFO:tasks.workunit.client.1.smithi106.stdout:6/652: fsync d0/f8a 0 2024-05-09T06:30:29.874 INFO:tasks.workunit.client.1.smithi106.stdout:7/574: creat d0/dc/d45/fae x:0 0 0 2024-05-09T06:30:29.876 INFO:tasks.workunit.client.1.smithi106.stdout:4/555: truncate d7/f2e 2689458 0 2024-05-09T06:30:29.879 INFO:tasks.workunit.client.1.smithi106.stdout:5/638: creat d8/d45/d4c/fc0 x:0 0 0 2024-05-09T06:30:29.880 INFO:tasks.workunit.client.1.smithi106.stdout:6/653: mknod d0/d17/d34/d4e/d98/da9/db1/ce1 0 2024-05-09T06:30:29.881 INFO:tasks.workunit.client.1.smithi106.stdout:7/575: symlink d0/d53/laf 0 2024-05-09T06:30:29.883 INFO:tasks.workunit.client.1.smithi106.stdout:4/556: mknod d7/d39/d35/d4a/cb3 0 2024-05-09T06:30:29.885 INFO:tasks.workunit.client.1.smithi106.stdout:5/639: symlink d8/lc1 0 2024-05-09T06:30:29.886 INFO:tasks.workunit.client.1.smithi106.stdout:7/576: symlink d0/dc/d1a/d36/d1e/d68/lb0 0 2024-05-09T06:30:29.888 INFO:tasks.workunit.client.1.smithi106.stdout:4/557: creat d7/d39/d47/d89/fb4 x:0 0 0 2024-05-09T06:30:29.891 INFO:tasks.workunit.client.1.smithi106.stdout:7/577: truncate d0/f52 1512899 0 2024-05-09T06:30:29.892 INFO:tasks.workunit.client.1.smithi106.stdout:3/519: sync 2024-05-09T06:30:29.892 INFO:tasks.workunit.client.1.smithi106.stdout:2/704: sync 2024-05-09T06:30:29.894 INFO:tasks.workunit.client.1.smithi106.stdout:7/578: dread d0/dc/f57 [0,4194304] 0 2024-05-09T06:30:29.894 INFO:tasks.workunit.client.1.smithi106.stdout:7/579: write d0/dc/d1a/d36/f74 [4997974,115099] 0 2024-05-09T06:30:29.896 INFO:tasks.workunit.client.1.smithi106.stdout:2/705: symlink d2/d5/db/d15/lf6 0 2024-05-09T06:30:29.896 INFO:tasks.workunit.client.1.smithi106.stdout:2/706: chown d2/ca7 172718 1 2024-05-09T06:30:29.896 INFO:tasks.workunit.client.1.smithi106.stdout:2/707: read - d2/d5/db/f87 zero size 2024-05-09T06:30:29.897 INFO:tasks.workunit.client.1.smithi106.stdout:6/654: dwrite d0/d17/f57 [4194304,4194304] 0 2024-05-09T06:30:29.897 INFO:tasks.workunit.client.1.smithi106.stdout:6/655: chown d0/d17/d34/d4e/d98/da9/db1/d8/d27/fc9 1509 1 2024-05-09T06:30:29.898 INFO:tasks.workunit.client.1.smithi106.stdout:7/580: write d0/dc/d1a/d36/d1e/f21 [118698,98947] 0 2024-05-09T06:30:29.901 INFO:tasks.workunit.client.1.smithi106.stdout:2/708: creat d2/d5/db/d1d/d23/d63/d7a/ff7 x:0 0 0 2024-05-09T06:30:29.901 INFO:tasks.workunit.client.1.smithi106.stdout:2/709: write d2/d5/db/d1d/fc5 [397731,31329] 0 2024-05-09T06:30:29.901 INFO:tasks.workunit.client.1.smithi106.stdout:3/520: dread d5/f3b [0,4194304] 0 2024-05-09T06:30:29.901 INFO:tasks.workunit.client.1.smithi106.stdout:3/521: chown d5/d12/d26/d90/f97 126795026 1 2024-05-09T06:30:29.901 INFO:tasks.workunit.client.1.smithi106.stdout:3/522: chown d5/d3f/f4f 7377610 1 2024-05-09T06:30:29.909 INFO:tasks.workunit.client.1.smithi106.stdout:3/523: mkdir d5/d12/d65/da3 0 2024-05-09T06:30:29.910 INFO:tasks.workunit.client.1.smithi106.stdout:3/524: mkdir d5/d1c/d24/d5b/da4 0 2024-05-09T06:30:29.911 INFO:tasks.workunit.client.1.smithi106.stdout:2/710: dread d2/f2b [0,4194304] 0 2024-05-09T06:30:29.911 INFO:tasks.workunit.client.1.smithi106.stdout:2/711: stat d2/d5/db/d15/l49 0 2024-05-09T06:30:29.912 INFO:tasks.workunit.client.1.smithi106.stdout:5/640: dwrite d8/f4e [0,4194304] 0 2024-05-09T06:30:29.912 INFO:tasks.workunit.client.1.smithi106.stdout:5/641: write d8/d33/f3b [1833393,60218] 0 2024-05-09T06:30:29.913 INFO:tasks.workunit.client.1.smithi106.stdout:5/642: fsync d8/d33/d3a/fb3 0 2024-05-09T06:30:29.913 INFO:tasks.workunit.client.1.smithi106.stdout:5/643: write d8/d45/d4c/d32/d5b/d69/fab [1161805,7565] 0 2024-05-09T06:30:29.914 INFO:tasks.workunit.client.1.smithi106.stdout:2/712: unlink d2/d5/db/d1d/l77 0 2024-05-09T06:30:29.915 INFO:tasks.workunit.client.1.smithi106.stdout:4/558: dwrite d7/d10/d1a/fa2 [0,4194304] 0 2024-05-09T06:30:29.915 INFO:tasks.workunit.client.1.smithi106.stdout:6/656: dwrite d0/d17/f25 [0,4194304] 0 2024-05-09T06:30:29.916 INFO:tasks.workunit.client.1.smithi106.stdout:4/559: dread d7/d10/d1a/f5b [0,4194304] 0 2024-05-09T06:30:29.916 INFO:tasks.workunit.client.1.smithi106.stdout:4/560: dread - d7/d39/d47/d89/f90 zero size 2024-05-09T06:30:29.916 INFO:tasks.workunit.client.1.smithi106.stdout:4/561: dread - d7/d39/d35/f99 zero size 2024-05-09T06:30:29.921 INFO:tasks.workunit.client.1.smithi106.stdout:5/644: creat d8/d45/d4c/d32/fc2 x:0 0 0 2024-05-09T06:30:29.925 INFO:tasks.workunit.client.1.smithi106.stdout:3/525: unlink d5/ld 0 2024-05-09T06:30:29.926 INFO:tasks.workunit.client.1.smithi106.stdout:2/713: mkdir d2/d5/db/d15/d41/df8 0 2024-05-09T06:30:29.933 INFO:tasks.workunit.client.1.smithi106.stdout:6/657: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/de2 0 2024-05-09T06:30:29.935 INFO:tasks.workunit.client.1.smithi106.stdout:2/714: dread d2/d5/db/d1d/d23/f66 [0,4194304] 0 2024-05-09T06:30:29.935 INFO:tasks.workunit.client.1.smithi106.stdout:2/715: chown d2/d5/db/d15/d41/d58/f45 328 1 2024-05-09T06:30:29.944 INFO:tasks.workunit.client.1.smithi106.stdout:4/562: truncate d7/d39/f7b 1988975 0 2024-05-09T06:30:29.946 INFO:tasks.workunit.client.1.smithi106.stdout:5/645: mkdir d8/d45/d4c/d85/dc3 0 2024-05-09T06:30:29.948 INFO:tasks.workunit.client.1.smithi106.stdout:3/526: creat d5/d4d/d5f/fa5 x:0 0 0 2024-05-09T06:30:29.950 INFO:tasks.workunit.client.1.smithi106.stdout:6/658: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d6c/le3 0 2024-05-09T06:30:29.950 INFO:tasks.workunit.client.1.smithi106.stdout:6/659: write d0/d66/d7e/d9f/fd6 [87722,109405] 0 2024-05-09T06:30:29.954 INFO:tasks.workunit.client.1.smithi106.stdout:2/716: link d2/d5/db/d1d/f8a d2/d5/db/d15/d41/d60/dcc/ff9 0 2024-05-09T06:30:29.958 INFO:tasks.workunit.client.1.smithi106.stdout:8/538: sync 2024-05-09T06:30:29.958 INFO:tasks.workunit.client.1.smithi106.stdout:9/610: sync 2024-05-09T06:30:29.958 INFO:tasks.workunit.client.1.smithi106.stdout:4/563: link d7/fb2 d7/d10/d1a/d5a/d1c/da7/fb5 0 2024-05-09T06:30:29.959 INFO:tasks.workunit.client.1.smithi106.stdout:4/564: dread d7/d10/d1a/d5a/f63 [0,4194304] 0 2024-05-09T06:30:29.960 INFO:tasks.workunit.client.1.smithi106.stdout:6/660: dread d0/d17/d76/f71 [4194304,4194304] 0 2024-05-09T06:30:29.961 INFO:tasks.workunit.client.1.smithi106.stdout:3/527: truncate d5/d1c/d24/f35 2737841 0 2024-05-09T06:30:29.963 INFO:tasks.workunit.client.1.smithi106.stdout:5/646: dwrite d8/d45/d4c/d85/fbf [0,4194304] 0 2024-05-09T06:30:29.968 INFO:tasks.workunit.client.1.smithi106.stdout:8/539: truncate d3/d5/d13/f36 1414763 0 2024-05-09T06:30:29.971 INFO:tasks.workunit.client.1.smithi106.stdout:5/647: read d8/d45/d4c/d32/d5b/f1e [2449440,33287] 0 2024-05-09T06:30:29.972 INFO:tasks.workunit.client.1.smithi106.stdout:4/565: creat d7/d10/d1a/d5a/d1c/fb6 x:0 0 0 2024-05-09T06:30:29.972 INFO:tasks.workunit.client.1.smithi106.stdout:4/566: readlink d7/d10/d1a/d5a/d1c/l38 0 2024-05-09T06:30:29.974 INFO:tasks.workunit.client.1.smithi106.stdout:3/528: creat d5/d1c/d24/d89/d8e/fa6 x:0 0 0 2024-05-09T06:30:29.975 INFO:tasks.workunit.client.1.smithi106.stdout:2/717: dwrite d2/d5/db/d15/d41/d60/dcc/ff9 [0,4194304] 0 2024-05-09T06:30:29.975 INFO:tasks.workunit.client.1.smithi106.stdout:2/718: readlink d2/d5/db/d1d/d23/d63/l69 0 2024-05-09T06:30:29.975 INFO:tasks.workunit.client.1.smithi106.stdout:2/719: creat d2/d5/db/d15/d41/d60/dcc/ffa x:0 0 0 2024-05-09T06:30:29.977 INFO:tasks.workunit.client.1.smithi106.stdout:6/661: dwrite d0/d17/d34/d4e/d98/da9/db1/fe [4194304,4194304] 0 2024-05-09T06:30:29.977 INFO:tasks.workunit.client.1.smithi106.stdout:6/662: write d0/d17/d34/d4e/d98/da9/db1/fb [2482302,10098] 0 2024-05-09T06:30:29.977 INFO:tasks.workunit.client.1.smithi106.stdout:2/720: read d2/d7/db7/fa0 [165345,85839] 0 2024-05-09T06:30:29.984 INFO:tasks.workunit.client.1.smithi106.stdout:9/611: rename d4/d54/d69/d95/d23/d2f/d38/l7f to d4/d54/d91/laf 0 2024-05-09T06:30:29.985 INFO:tasks.workunit.client.1.smithi106.stdout:8/540: creat d3/d5/d35/d4e/d32/d92/fbf x:0 0 0 2024-05-09T06:30:29.988 INFO:tasks.workunit.client.1.smithi106.stdout:4/567: mknod d7/d39/d47/cb7 0 2024-05-09T06:30:29.995 INFO:tasks.workunit.client.1.smithi106.stdout:0/663: sync 2024-05-09T06:30:29.995 INFO:tasks.workunit.client.1.smithi106.stdout:1/625: sync 2024-05-09T06:30:29.995 INFO:tasks.workunit.client.1.smithi106.stdout:1/626: readlink d4/d5b/d75/l91 0 2024-05-09T06:30:29.995 INFO:tasks.workunit.client.1.smithi106.stdout:1/627: stat d4/d76/d13/d60/d9c/dbe/fde 0 2024-05-09T06:30:29.999 INFO:tasks.workunit.client.1.smithi106.stdout:3/529: dwrite d5/d4d/f6c [4194304,4194304] 0 2024-05-09T06:30:30.003 INFO:tasks.workunit.client.1.smithi106.stdout:5/648: dwrite d8/d33/f3b [0,4194304] 0 2024-05-09T06:30:30.006 INFO:tasks.workunit.client.1.smithi106.stdout:0/664: dread d1/d11/d23/d22/f84 [0,4194304] 0 2024-05-09T06:30:30.006 INFO:tasks.workunit.client.1.smithi106.stdout:0/665: fsync d1/d11/d23/d13/d2c/d6d/dce/fd4 0 2024-05-09T06:30:30.009 INFO:tasks.workunit.client.1.smithi106.stdout:4/568: creat d7/d10/d1a/d5a/d7a/fb8 x:0 0 0 2024-05-09T06:30:30.014 INFO:tasks.workunit.client.1.smithi106.stdout:0/666: dread d1/f1d [0,4194304] 0 2024-05-09T06:30:30.015 INFO:tasks.workunit.client.1.smithi106.stdout:0/667: read d1/d11/d23/f64 [338554,36142] 0 2024-05-09T06:30:30.016 INFO:tasks.workunit.client.1.smithi106.stdout:8/541: dwrite d3/d5/d7/f7f [0,4194304] 0 2024-05-09T06:30:30.018 INFO:tasks.workunit.client.1.smithi106.stdout:5/649: rename d8/d33/d74/c78 to d8/d45/cc4 0 2024-05-09T06:30:30.020 INFO:tasks.workunit.client.1.smithi106.stdout:4/569: symlink d7/d10/d1a/d5a/d1c/lb9 0 2024-05-09T06:30:30.023 INFO:tasks.workunit.client.1.smithi106.stdout:1/628: getdents d4/d37/d3d 0 2024-05-09T06:30:30.025 INFO:tasks.workunit.client.1.smithi106.stdout:0/668: chown d1/d11/d23/d13/d2c/f8b 338957329 1 2024-05-09T06:30:30.026 INFO:tasks.workunit.client.1.smithi106.stdout:5/650: dread d8/d33/f4a [0,4194304] 0 2024-05-09T06:30:30.026 INFO:tasks.workunit.client.1.smithi106.stdout:5/651: chown d8/f4e 8567 1 2024-05-09T06:30:30.031 INFO:tasks.workunit.client.1.smithi106.stdout:6/663: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/f70 [0,4194304] 0 2024-05-09T06:30:30.034 INFO:tasks.workunit.client.1.smithi106.stdout:3/530: dwrite d5/d1c/d24/f28 [0,4194304] 0 2024-05-09T06:30:30.034 INFO:tasks.workunit.client.1.smithi106.stdout:9/612: dwrite d4/d54/d69/d95/d23/d2f/d31/d51/d58/f7b [0,4194304] 0 2024-05-09T06:30:30.035 INFO:tasks.workunit.client.1.smithi106.stdout:2/721: dwrite d2/d5/db/d1d/d23/d63/d7a/dda/fec [0,4194304] 0 2024-05-09T06:30:30.035 INFO:tasks.workunit.client.1.smithi106.stdout:4/570: symlink d7/lba 0 2024-05-09T06:30:30.036 INFO:tasks.workunit.client.1.smithi106.stdout:1/629: mknod d4/da7/ce0 0 2024-05-09T06:30:30.038 INFO:tasks.workunit.client.1.smithi106.stdout:5/652: dread d8/fc [0,4194304] 0 2024-05-09T06:30:30.038 INFO:tasks.workunit.client.1.smithi106.stdout:0/669: creat d1/d11/d23/d22/dbc/fe3 x:0 0 0 2024-05-09T06:30:30.045 INFO:tasks.workunit.client.1.smithi106.stdout:3/531: dread d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:30.051 INFO:tasks.workunit.client.1.smithi106.stdout:9/613: mkdir d4/d54/d69/d95/d23/d2f/d31/db0 0 2024-05-09T06:30:30.055 INFO:tasks.workunit.client.1.smithi106.stdout:5/653: dwrite d8/d5a/d60/d7e/f82 [0,4194304] 0 2024-05-09T06:30:30.058 INFO:tasks.workunit.client.1.smithi106.stdout:9/614: dread d4/d54/d69/d95/d23/d16/f5b [0,4194304] 0 2024-05-09T06:30:30.060 INFO:tasks.workunit.client.1.smithi106.stdout:9/615: dread d4/d54/d69/d99/f65 [0,4194304] 0 2024-05-09T06:30:30.069 INFO:tasks.workunit.client.1.smithi106.stdout:9/616: write d4/d54/d69/d99/d2a/f26 [12998,84189] 0 2024-05-09T06:30:30.081 INFO:tasks.workunit.client.1.smithi106.stdout:4/571: mknod d7/d10/d1a/d5a/d1c/da7/cbb 0 2024-05-09T06:30:30.082 INFO:tasks.workunit.client.1.smithi106.stdout:2/722: dread d2/d5/db/d1d/f4a [0,4194304] 0 2024-05-09T06:30:30.083 INFO:tasks.workunit.client.1.smithi106.stdout:2/723: creat d2/d5/db/d15/ffb x:0 0 0 2024-05-09T06:30:30.083 INFO:tasks.workunit.client.1.smithi106.stdout:2/724: write d2/d5/db/d15/d41/f53 [458491,95892] 0 2024-05-09T06:30:30.083 INFO:tasks.workunit.client.1.smithi106.stdout:8/542: rename d3/d5/d7/d58 to d3/d5/d13/d3a/dbe/dc0 0 2024-05-09T06:30:30.083 INFO:tasks.workunit.client.1.smithi106.stdout:6/664: rename d0/d17 to d0/d17/d34/d4e/d98/de4 22 2024-05-09T06:30:30.084 INFO:tasks.workunit.client.1.smithi106.stdout:3/532: symlink d5/d1c/d24/d89/la7 0 2024-05-09T06:30:30.084 INFO:tasks.workunit.client.1.smithi106.stdout:3/533: write d5/d12/d65/d81/f94 [226608,110157] 0 2024-05-09T06:30:30.086 INFO:tasks.workunit.client.1.smithi106.stdout:5/654: mkdir d8/d45/d4c/d32/dc5 0 2024-05-09T06:30:30.090 INFO:tasks.workunit.client.1.smithi106.stdout:9/617: link d4/d54/ca8 d4/d54/d69/d95/d23/d16/cb1 0 2024-05-09T06:30:30.090 INFO:tasks.workunit.client.1.smithi106.stdout:9/618: fdatasync d4/d54/d69/d99/f3e 0 2024-05-09T06:30:30.092 INFO:tasks.workunit.client.1.smithi106.stdout:4/572: creat d7/d39/d35/d6f/d9c/fbc x:0 0 0 2024-05-09T06:30:30.097 INFO:tasks.workunit.client.1.smithi106.stdout:2/725: dwrite d2/d7/db7/f8f [0,4194304] 0 2024-05-09T06:30:30.099 INFO:tasks.workunit.client.1.smithi106.stdout:1/630: rename d4/d5/f3a to d4/d76/d65/d67/fe1 0 2024-05-09T06:30:30.099 INFO:tasks.workunit.client.1.smithi106.stdout:1/631: write d4/d37/d3d/f69 [387780,80556] 0 2024-05-09T06:30:30.103 INFO:tasks.workunit.client.1.smithi106.stdout:3/534: mkdir d5/d1c/d7d/da8 0 2024-05-09T06:30:30.105 INFO:tasks.workunit.client.1.smithi106.stdout:9/619: symlink d4/d54/d69/d95/d23/d2f/d31/d51/da2/lb2 0 2024-05-09T06:30:30.105 INFO:tasks.workunit.client.1.smithi106.stdout:9/620: chown d4/d54/d69/d95/d23/d2f/d47/f4d 81 1 2024-05-09T06:30:30.106 INFO:tasks.workunit.client.1.smithi106.stdout:9/621: chown d4/d54/d69/d95/f5e 14 1 2024-05-09T06:30:30.106 INFO:tasks.workunit.client.1.smithi106.stdout:9/622: write d4/d54/d69/d99/d2a/f1e [2164438,107718] 0 2024-05-09T06:30:30.108 INFO:tasks.workunit.client.1.smithi106.stdout:2/726: dread d2/d5/db/d68/f76 [0,4194304] 0 2024-05-09T06:30:30.111 INFO:tasks.workunit.client.1.smithi106.stdout:4/573: dwrite d7/d10/d1a/f5b [0,4194304] 0 2024-05-09T06:30:30.112 INFO:tasks.workunit.client.1.smithi106.stdout:5/655: dwrite d8/d45/f70 [0,4194304] 0 2024-05-09T06:30:30.112 INFO:tasks.workunit.client.1.smithi106.stdout:0/670: rename d1/d11/d23/da6/fe2 to d1/da1/d83/fe4 0 2024-05-09T06:30:30.114 INFO:tasks.workunit.client.1.smithi106.stdout:1/632: symlink d4/d76/d65/d67/le2 0 2024-05-09T06:30:30.114 INFO:tasks.workunit.client.1.smithi106.stdout:1/633: truncate d4/d76/d65/d67/fb2 617660 0 2024-05-09T06:30:30.114 INFO:tasks.workunit.client.1.smithi106.stdout:1/634: write d4/f8a [4722556,95888] 0 2024-05-09T06:30:30.117 INFO:tasks.workunit.client.1.smithi106.stdout:6/665: getdents d0/d17/d34/d4e/d98/da9/db1/d8/d27 0 2024-05-09T06:30:30.118 INFO:tasks.workunit.client.1.smithi106.stdout:5/656: write d8/d45/d4c/d32/d5b/f1e [3350466,68136] 0 2024-05-09T06:30:30.122 INFO:tasks.workunit.client.1.smithi106.stdout:7/581: sync 2024-05-09T06:30:30.122 INFO:tasks.workunit.client.1.smithi106.stdout:7/582: dread - d0/dc/d1a/d36/d1e/f9b zero size 2024-05-09T06:30:30.122 INFO:tasks.workunit.client.1.smithi106.stdout:7/583: write d0/dc/d1a/d36/d30/d44/d58/d65/f99 [836155,104175] 0 2024-05-09T06:30:30.130 INFO:tasks.workunit.client.1.smithi106.stdout:6/666: dread d0/d17/d34/d4e/d98/da9/db1/d8/faa [0,4194304] 0 2024-05-09T06:30:30.130 INFO:tasks.workunit.client.1.smithi106.stdout:8/543: rename d3/d5/d35/d4e/l1d to d3/d5/d35/d61/lc1 0 2024-05-09T06:30:30.132 INFO:tasks.workunit.client.1.smithi106.stdout:1/635: dwrite d4/d76/d13/f19 [0,4194304] 0 2024-05-09T06:30:30.132 INFO:tasks.workunit.client.1.smithi106.stdout:2/727: dwrite d2/d7/f25 [0,4194304] 0 2024-05-09T06:30:30.144 INFO:tasks.workunit.client.1.smithi106.stdout:5/657: unlink d8/d45/d4c/c8f 0 2024-05-09T06:30:30.147 INFO:tasks.workunit.client.1.smithi106.stdout:1/636: dwrite d4/d76/d13/d2f/fca [0,4194304] 0 2024-05-09T06:30:30.148 INFO:tasks.workunit.client.1.smithi106.stdout:1/637: truncate d4/d76/d65/d8d/fd5 821122 0 2024-05-09T06:30:30.148 INFO:tasks.workunit.client.1.smithi106.stdout:7/584: rename d0/d53/l76 to d0/d53/lb1 0 2024-05-09T06:30:30.150 INFO:tasks.workunit.client.1.smithi106.stdout:3/535: rename d5/d1c/d7d to d5/d4d/d7a/da9 0 2024-05-09T06:30:30.156 INFO:tasks.workunit.client.1.smithi106.stdout:2/728: symlink d2/d7/d62/lfc 0 2024-05-09T06:30:30.157 INFO:tasks.workunit.client.1.smithi106.stdout:2/729: readlink d2/d5/db/l3a 0 2024-05-09T06:30:30.157 INFO:tasks.workunit.client.1.smithi106.stdout:2/730: write d2/d5/db/d15/d41/fe0 [361364,16049] 0 2024-05-09T06:30:30.159 INFO:tasks.workunit.client.1.smithi106.stdout:1/638: link d4/d37/d3d/c6a d4/d76/d65/d8d/db5/ce3 0 2024-05-09T06:30:30.160 INFO:tasks.workunit.client.1.smithi106.stdout:7/585: mkdir d0/dc/d45/da6/db2 0 2024-05-09T06:30:30.160 INFO:tasks.workunit.client.1.smithi106.stdout:1/639: dread d4/d76/d13/d60/fc5 [0,4194304] 0 2024-05-09T06:30:30.169 INFO:tasks.workunit.client.1.smithi106.stdout:7/586: dread d0/f9 [0,4194304] 0 2024-05-09T06:30:30.170 INFO:tasks.workunit.client.1.smithi106.stdout:7/587: stat d0/c82 0 2024-05-09T06:30:30.170 INFO:tasks.workunit.client.1.smithi106.stdout:2/731: rmdir d2/d7/d62/d9a 39 2024-05-09T06:30:30.172 INFO:tasks.workunit.client.1.smithi106.stdout:7/588: mkdir d0/dc/d1a/d36/d30/d44/db3 0 2024-05-09T06:30:30.173 INFO:tasks.workunit.client.1.smithi106.stdout:3/536: dread d5/fb [0,4194304] 0 2024-05-09T06:30:30.173 INFO:tasks.workunit.client.1.smithi106.stdout:3/537: read - d5/d12/d26/d90/f97 zero size 2024-05-09T06:30:30.173 INFO:tasks.workunit.client.1.smithi106.stdout:2/732: mknod d2/d5/db/d15/dd6/cfd 0 2024-05-09T06:30:30.174 INFO:tasks.workunit.client.1.smithi106.stdout:2/733: dread d2/d7/d2c/f78 [0,4194304] 0 2024-05-09T06:30:30.175 INFO:tasks.workunit.client.1.smithi106.stdout:2/734: read d2/d7/db7/fa9 [95656,109316] 0 2024-05-09T06:30:30.175 INFO:tasks.workunit.client.1.smithi106.stdout:2/735: chown d2/d5/db/c21 341613 1 2024-05-09T06:30:30.175 INFO:tasks.workunit.client.1.smithi106.stdout:2/736: chown d2/d5/c2f 320922303 1 2024-05-09T06:30:30.176 INFO:tasks.workunit.client.1.smithi106.stdout:7/589: symlink d0/lb4 0 2024-05-09T06:30:30.177 INFO:tasks.workunit.client.1.smithi106.stdout:3/538: rename d5/d85/f60 to d5/d1c/d24/d98/faa 0 2024-05-09T06:30:30.178 INFO:tasks.workunit.client.1.smithi106.stdout:2/737: mknod d2/d5/db/d15/dc6/cfe 0 2024-05-09T06:30:30.179 INFO:tasks.workunit.client.1.smithi106.stdout:1/640: dwrite f2 [0,4194304] 0 2024-05-09T06:30:30.180 INFO:tasks.workunit.client.1.smithi106.stdout:1/641: write d4/d76/f4b [993762,130816] 0 2024-05-09T06:30:30.187 INFO:tasks.workunit.client.1.smithi106.stdout:2/738: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:30.188 INFO:tasks.workunit.client.1.smithi106.stdout:3/539: rename d5/c86 to d5/d12/d65/d81/cab 0 2024-05-09T06:30:30.193 INFO:tasks.workunit.client.1.smithi106.stdout:3/540: mknod d5/d3f/cac 0 2024-05-09T06:30:30.194 INFO:tasks.workunit.client.1.smithi106.stdout:2/739: rmdir d2/d5/db/d15/d41/d58 39 2024-05-09T06:30:30.196 INFO:tasks.workunit.client.1.smithi106.stdout:3/541: link d5/d1c/d24/c69 d5/d1c/d24/d89/cad 0 2024-05-09T06:30:30.196 INFO:tasks.workunit.client.1.smithi106.stdout:3/542: write d5/d1c/d21/f7e [664307,28044] 0 2024-05-09T06:30:30.198 INFO:tasks.workunit.client.1.smithi106.stdout:8/544: dwrite d3/d5/f8a [0,4194304] 0 2024-05-09T06:30:30.198 INFO:tasks.workunit.client.1.smithi106.stdout:8/545: dread - d3/d5/d7/d15/d3e/d7d/f84 zero size 2024-05-09T06:30:30.199 INFO:tasks.workunit.client.1.smithi106.stdout:8/546: chown d3/d5/d7/d15/l5d 25777881 1 2024-05-09T06:30:30.201 INFO:tasks.workunit.client.1.smithi106.stdout:8/547: dread d3/d5/f3c [0,4194304] 0 2024-05-09T06:30:30.202 INFO:tasks.workunit.client.1.smithi106.stdout:7/590: getdents d0/dc/d1a/d36/d30/d44 0 2024-05-09T06:30:30.204 INFO:tasks.workunit.client.1.smithi106.stdout:4/574: sync 2024-05-09T06:30:30.204 INFO:tasks.workunit.client.1.smithi106.stdout:9/623: sync 2024-05-09T06:30:30.206 INFO:tasks.workunit.client.1.smithi106.stdout:4/575: unlink d7/d10/l77 0 2024-05-09T06:30:30.206 INFO:tasks.workunit.client.1.smithi106.stdout:3/543: getdents d5/d12/d65/d81 0 2024-05-09T06:30:30.207 INFO:tasks.workunit.client.1.smithi106.stdout:4/576: dread d7/d10/d1a/d5a/f63 [0,4194304] 0 2024-05-09T06:30:30.208 INFO:tasks.workunit.client.1.smithi106.stdout:9/624: mkdir d4/d54/db3 0 2024-05-09T06:30:30.209 INFO:tasks.workunit.client.1.smithi106.stdout:3/544: symlink d5/d12/d65/d81/d92/lae 0 2024-05-09T06:30:30.209 INFO:tasks.workunit.client.1.smithi106.stdout:7/591: dread d0/f90 [0,4194304] 0 2024-05-09T06:30:30.210 INFO:tasks.workunit.client.1.smithi106.stdout:9/625: creat d4/d54/d69/d95/d23/d78/d8f/fb4 x:0 0 0 2024-05-09T06:30:30.211 INFO:tasks.workunit.client.1.smithi106.stdout:8/548: dread d3/d5/d13/d3a/f9e [0,4194304] 0 2024-05-09T06:30:30.212 INFO:tasks.workunit.client.1.smithi106.stdout:3/545: creat d5/d4d/faf x:0 0 0 2024-05-09T06:30:30.213 INFO:tasks.workunit.client.1.smithi106.stdout:2/740: dwrite d2/d5/d9c/fa6 [0,4194304] 0 2024-05-09T06:30:30.214 INFO:tasks.workunit.client.1.smithi106.stdout:9/626: link d4/d54/d69/d99/d2a/f26 d4/d54/d69/d99/d2a/d42/d6c/d6d/fb5 0 2024-05-09T06:30:30.214 INFO:tasks.workunit.client.1.smithi106.stdout:9/627: getdents d4/d54/db3 0 2024-05-09T06:30:30.214 INFO:tasks.workunit.client.1.smithi106.stdout:9/628: write d4/f25 [3190840,40074] 0 2024-05-09T06:30:30.215 INFO:tasks.workunit.client.1.smithi106.stdout:8/549: mknod d3/d5/d35/d61/d6c/d83/cc2 0 2024-05-09T06:30:30.215 INFO:tasks.workunit.client.1.smithi106.stdout:8/550: write d3/d5/d13/d3a/dbe/dc0/fb6 [567141,105456] 0 2024-05-09T06:30:30.217 INFO:tasks.workunit.client.1.smithi106.stdout:2/741: symlink d2/d5/db/d15/dd6/lff 0 2024-05-09T06:30:30.218 INFO:tasks.workunit.client.1.smithi106.stdout:9/629: truncate d4/d54/d69/d95/d23/f6e 273985 0 2024-05-09T06:30:30.220 INFO:tasks.workunit.client.1.smithi106.stdout:8/551: creat d3/d5/dbc/fc3 x:0 0 0 2024-05-09T06:30:30.221 INFO:tasks.workunit.client.1.smithi106.stdout:8/552: getdents d3/d5/d35/d61 0 2024-05-09T06:30:30.221 INFO:tasks.workunit.client.1.smithi106.stdout:3/546: dread d5/d3f/f4a [0,4194304] 0 2024-05-09T06:30:30.223 INFO:tasks.workunit.client.1.smithi106.stdout:8/553: link d3/d5/d7/f6a d3/d5/d35/d61/d6c/d83/d89/d9b/fc4 0 2024-05-09T06:30:30.224 INFO:tasks.workunit.client.1.smithi106.stdout:3/547: fsync d5/f3d 0 2024-05-09T06:30:30.225 INFO:tasks.workunit.client.1.smithi106.stdout:4/577: dwrite d7/d10/d1a/d5a/d46/f54 [4194304,4194304] 0 2024-05-09T06:30:30.225 INFO:tasks.workunit.client.1.smithi106.stdout:4/578: read - d7/d10/d1a/d5a/d7a/fb8 zero size 2024-05-09T06:30:30.234 INFO:tasks.workunit.client.1.smithi106.stdout:8/554: write d3/d5/d13/f40 [1449446,57145] 0 2024-05-09T06:30:30.234 INFO:tasks.workunit.client.1.smithi106.stdout:8/555: chown d3/d6b/f79 2611743 1 2024-05-09T06:30:30.234 INFO:tasks.workunit.client.1.smithi106.stdout:8/556: creat d3/d5/d35/d4e/d32/d92/fc5 x:0 0 0 2024-05-09T06:30:30.235 INFO:tasks.workunit.client.1.smithi106.stdout:4/579: write d7/d39/f44 [842813,58347] 0 2024-05-09T06:30:30.237 INFO:tasks.workunit.client.1.smithi106.stdout:8/557: symlink d3/d5/d35/d73/d9d/lc6 0 2024-05-09T06:30:30.237 INFO:tasks.workunit.client.1.smithi106.stdout:8/558: write d3/d5/d7/d15/d3e/f56 [1658714,32020] 0 2024-05-09T06:30:30.238 INFO:tasks.workunit.client.1.smithi106.stdout:4/580: getdents d7/d39/d47 0 2024-05-09T06:30:30.238 INFO:tasks.workunit.client.1.smithi106.stdout:4/581: fsync d7/d39/d47/d89/f90 0 2024-05-09T06:30:30.240 INFO:tasks.workunit.client.1.smithi106.stdout:4/582: getdents d7/d10/d1a/d5a/d1c 0 2024-05-09T06:30:30.240 INFO:tasks.workunit.client.1.smithi106.stdout:4/583: write d7/d10/d1a/d5a/d7a/d7f/f84 [1011781,27689] 0 2024-05-09T06:30:30.240 INFO:tasks.workunit.client.1.smithi106.stdout:4/584: chown d7/d39/d47/d89/fb4 13387 1 2024-05-09T06:30:30.241 INFO:tasks.workunit.client.1.smithi106.stdout:4/585: creat d7/d39/d8c/fbd x:0 0 0 2024-05-09T06:30:30.243 INFO:tasks.workunit.client.1.smithi106.stdout:4/586: creat d7/d10/d1a/d5a/fbe x:0 0 0 2024-05-09T06:30:30.243 INFO:tasks.workunit.client.1.smithi106.stdout:4/587: truncate d7/d10/d1a/d5a/d1c/da7/fb5 949971 0 2024-05-09T06:30:30.243 INFO:tasks.workunit.client.1.smithi106.stdout:4/588: getdents d7/d39/d47/d66 0 2024-05-09T06:30:30.244 INFO:tasks.workunit.client.1.smithi106.stdout:4/589: chown d7/d39/d35/d4a/l4b 0 1 2024-05-09T06:30:30.244 INFO:tasks.workunit.client.1.smithi106.stdout:4/590: fsync d7/f2e 0 2024-05-09T06:30:30.245 INFO:tasks.workunit.client.1.smithi106.stdout:3/548: dwrite d5/d1c/d24/d5b/f66 [0,4194304] 0 2024-05-09T06:30:30.246 INFO:tasks.workunit.client.1.smithi106.stdout:8/559: read d3/d5/d35/d4e/f67 [7800133,22180] 0 2024-05-09T06:30:30.247 INFO:tasks.workunit.client.1.smithi106.stdout:3/549: dread d5/d1c/f76 [0,4194304] 0 2024-05-09T06:30:30.247 INFO:tasks.workunit.client.1.smithi106.stdout:9/630: dwrite d4/d54/d69/d95/d23/d2f/d39/f88 [0,4194304] 0 2024-05-09T06:30:30.247 INFO:tasks.workunit.client.1.smithi106.stdout:9/631: stat d4/d54/d69/d95/l9 0 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/13: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/2: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:0/120: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/64: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:4/77: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:0/121: fdatasync d11/f22 0 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:0/122: chown l2 31 1 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/65: write d3/d7/dd/f15 [527365,52832] 0 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:3/19: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:6/187: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:6/188: chown db/fd 288 1 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/6: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/3: sync 2024-05-09T06:30:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/7: readlink - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/4: write - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/5: unlink - no file 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/6: dwrite - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/7: rename - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/8: dwrite - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/9: dread - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:5/8: stat d0 0 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:2/53: sync 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/10: getdents . 0 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/11: dread - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/12: truncate - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/13: dwrite - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/14: dread - no filename 2024-05-09T06:30:30.253 INFO:tasks.workunit.client.0.smithi046.stdout:5/9: creat d0/f2 x:0 0 0 2024-05-09T06:30:30.254 INFO:tasks.workunit.client.1.smithi106.stdout:4/591: dread d7/d10/d1a/f1e [4194304,4194304] 0 2024-05-09T06:30:30.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/14: mkdir d2/d6 0 2024-05-09T06:30:30.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/15: write f0 [1917973,6737] 0 2024-05-09T06:30:30.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/3: symlink l1 0 2024-05-09T06:30:30.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/4: dread - f0 zero size 2024-05-09T06:30:30.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/5: creat f2 x:0 0 0 2024-05-09T06:30:30.256 INFO:tasks.workunit.client.0.smithi046.stdout:9/16: dread d2/f5 [0,4194304] 0 2024-05-09T06:30:30.257 INFO:tasks.workunit.client.1.smithi106.stdout:3/550: creat d5/d1c/d24/d80/fb0 x:0 0 0 2024-05-09T06:30:30.260 INFO:tasks.workunit.client.0.smithi046.stdout:0/123: unlink d11/d18/f21 0 2024-05-09T06:30:30.262 INFO:tasks.workunit.client.0.smithi046.stdout:7/66: rename d3/d7/lb to d3/l17 0 2024-05-09T06:30:30.268 INFO:tasks.workunit.client.0.smithi046.stdout:4/78: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:30.268 INFO:tasks.workunit.client.0.smithi046.stdout:4/79: write d7/f1a [5197325,114160] 0 2024-05-09T06:30:30.276 INFO:tasks.workunit.client.0.smithi046.stdout:7/67: dwrite d3/f8 [0,4194304] 0 2024-05-09T06:30:30.309 INFO:tasks.workunit.client.1.smithi106.stdout:9/632: mkdir d4/d54/db3/db6 0 2024-05-09T06:30:30.309 INFO:tasks.workunit.client.1.smithi106.stdout:9/633: write d4/d54/d69/d95/d23/d2f/d47/f9d [833671,87507] 0 2024-05-09T06:30:30.312 INFO:tasks.workunit.client.0.smithi046.stdout:2/54: mkdir da/de 0 2024-05-09T06:30:30.312 INFO:tasks.workunit.client.0.smithi046.stdout:2/55: read f4 [177226,17427] 0 2024-05-09T06:30:30.312 INFO:tasks.workunit.client.1.smithi106.stdout:8/560: truncate d3/d5/d7/d15/d3e/f56 1116060 0 2024-05-09T06:30:30.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/15: creat f0 x:0 0 0 2024-05-09T06:30:30.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/16: chown f0 6144 1 2024-05-09T06:30:30.317 INFO:tasks.workunit.client.1.smithi106.stdout:4/592: symlink d7/d39/d47/d89/lbf 0 2024-05-09T06:30:30.317 INFO:tasks.workunit.client.1.smithi106.stdout:4/593: chown d7/d10/d1a/d5a/d7a/d7f/f84 1348 1 2024-05-09T06:30:30.319 INFO:tasks.workunit.client.0.smithi046.stdout:5/10: symlink d0/l3 0 2024-05-09T06:30:30.330 INFO:tasks.workunit.client.0.smithi046.stdout:9/17: mkdir d2/d6/d7 0 2024-05-09T06:30:30.334 INFO:tasks.workunit.client.1.smithi106.stdout:8/561: dwrite d3/d5/d13/f29 [0,4194304] 0 2024-05-09T06:30:30.334 INFO:tasks.workunit.client.0.smithi046.stdout:0/124: mknod d11/d18/c2a 0 2024-05-09T06:30:30.335 INFO:tasks.workunit.client.1.smithi106.stdout:4/594: dwrite d7/d39/f3f [0,4194304] 0 2024-05-09T06:30:30.335 INFO:tasks.workunit.client.1.smithi106.stdout:4/595: write d7/d10/d1a/d5a/d1c/fb6 [233355,64168] 0 2024-05-09T06:30:30.346 INFO:tasks.workunit.client.0.smithi046.stdout:6/189: rmdir db/d10/d19 39 2024-05-09T06:30:30.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/80: rmdir d7/d20 0 2024-05-09T06:30:30.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/81: readlink d7/l8 0 2024-05-09T06:30:30.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/82: fsync d7/fb 0 2024-05-09T06:30:30.361 INFO:tasks.workunit.client.1.smithi106.stdout:4/596: dwrite d7/d39/d35/f76 [4194304,4194304] 0 2024-05-09T06:30:30.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/68: mknod d3/d7/dd/c18 0 2024-05-09T06:30:30.362 INFO:tasks.workunit.client.0.smithi046.stdout:6/190: dwrite db/f2b [0,4194304] 0 2024-05-09T06:30:30.364 INFO:tasks.workunit.client.0.smithi046.stdout:4/83: dread d7/f15 [0,4194304] 0 2024-05-09T06:30:30.371 INFO:tasks.workunit.client.1.smithi106.stdout:4/597: read d7/d28/f91 [2245688,62843] 0 2024-05-09T06:30:30.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/56: mkdir da/df 0 2024-05-09T06:30:30.381 INFO:tasks.workunit.client.1.smithi106.stdout:4/598: write d7/d39/f94 [3169558,64621] 0 2024-05-09T06:30:30.381 INFO:tasks.workunit.client.1.smithi106.stdout:4/599: chown d7/d10/d1a/d5a/c1f 41525 1 2024-05-09T06:30:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/11: rename d0/f2 to d0/f4 0 2024-05-09T06:30:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/12: fsync d0/f1 0 2024-05-09T06:30:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/13: dread - d0/f4 zero size 2024-05-09T06:30:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/14: fsync d0/f1 0 2024-05-09T06:30:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/15: write d0/f1 [959087,95037] 0 2024-05-09T06:30:30.386 INFO:tasks.workunit.client.1.smithi106.stdout:9/634: unlink d4/d54/d69/d95/d23/d78/d8f/d9a/ca0 0 2024-05-09T06:30:30.386 INFO:tasks.workunit.client.1.smithi106.stdout:9/635: read - d4/d54/d69/d95/d23/d2f/d39/f89 zero size 2024-05-09T06:30:30.388 INFO:tasks.workunit.client.0.smithi046.stdout:1/6: unlink f2 0 2024-05-09T06:30:30.388 INFO:tasks.workunit.client.0.smithi046.stdout:1/7: dread - f0 zero size 2024-05-09T06:30:30.388 INFO:tasks.workunit.client.0.smithi046.stdout:1/8: truncate f0 747398 0 2024-05-09T06:30:30.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/551: getdents d5/d12/d26 0 2024-05-09T06:30:30.391 INFO:tasks.workunit.client.0.smithi046.stdout:9/18: creat d2/d6/d7/f8 x:0 0 0 2024-05-09T06:30:30.391 INFO:tasks.workunit.client.0.smithi046.stdout:9/19: fsync d2/f5 0 2024-05-09T06:30:30.393 INFO:tasks.workunit.client.1.smithi106.stdout:8/562: creat d3/d5/d35/d61/d6c/d83/d89/d9b/fc7 x:0 0 0 2024-05-09T06:30:30.394 INFO:tasks.workunit.client.0.smithi046.stdout:0/125: getdents d11 0 2024-05-09T06:30:30.396 INFO:tasks.workunit.client.0.smithi046.stdout:9/20: dread f0 [0,4194304] 0 2024-05-09T06:30:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:3/20: link l3 d4/d5/l7 0 2024-05-09T06:30:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:3/21: truncate - no filename 2024-05-09T06:30:30.398 INFO:tasks.workunit.client.0.smithi046.stdout:3/22: write - no filename 2024-05-09T06:30:30.400 INFO:tasks.workunit.client.1.smithi106.stdout:4/600: creat d7/d10/d1a/d5a/d7a/d7f/fc0 x:0 0 0 2024-05-09T06:30:30.400 INFO:tasks.workunit.client.1.smithi106.stdout:4/601: truncate d7/d10/d1a/d5a/d7a/f8e 659828 0 2024-05-09T06:30:30.402 INFO:tasks.workunit.client.1.smithi106.stdout:9/636: rename d4/d54/d69/d95/d23/d16/f5b to d4/d54/d69/d95/d23/d78/d8f/d9a/fb7 0 2024-05-09T06:30:30.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/9: dwrite f0 [0,4194304] 0 2024-05-09T06:30:30.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/10: chown f0 2 1 2024-05-09T06:30:30.409 INFO:tasks.workunit.client.1.smithi106.stdout:4/602: mkdir d7/d39/d47/d89/dc1 0 2024-05-09T06:30:30.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/191: rename f4 to db/f42 0 2024-05-09T06:30:30.414 INFO:tasks.workunit.client.0.smithi046.stdout:1/11: dread f0 [0,4194304] 0 2024-05-09T06:30:30.414 INFO:tasks.workunit.client.0.smithi046.stdout:4/84: symlink d7/df/d10/d1d/l21 0 2024-05-09T06:30:30.414 INFO:tasks.workunit.client.1.smithi106.stdout:3/552: rmdir d5/d1c/d24/d89 39 2024-05-09T06:30:30.416 INFO:tasks.workunit.client.1.smithi106.stdout:8/563: rename d3/d5/d13/d3a/f9e to d3/d5/d13/d3a/dbe/dc0/fc8 0 2024-05-09T06:30:30.417 INFO:tasks.workunit.client.0.smithi046.stdout:2/57: creat da/de/f10 x:0 0 0 2024-05-09T06:30:30.418 INFO:tasks.workunit.client.1.smithi106.stdout:9/637: dwrite d4/d54/d69/d99/f3e [0,4194304] 0 2024-05-09T06:30:30.421 INFO:tasks.workunit.client.0.smithi046.stdout:5/16: mknod d0/c5 0 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:5/658: sync 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:0/671: sync 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:6/667: sync 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:0/672: chown d1/d11/d23/cba 25632 1 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:0/673: stat d1/d11/c6b 0 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:0/674: getdents d1/d11/d23/d13/d2c/d57/de1 0 2024-05-09T06:30:30.422 INFO:tasks.workunit.client.1.smithi106.stdout:6/668: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/fca [484796,127204] 0 2024-05-09T06:30:30.423 INFO:tasks.workunit.client.0.smithi046.stdout:1/12: write f0 [1965187,77964] 0 2024-05-09T06:30:30.423 INFO:tasks.workunit.client.0.smithi046.stdout:1/13: chown f0 0 1 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:3/553: mkdir d5/d1c/d24/d5b/db1 0 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:3/554: readlink d5/d4d/d5f/l87 0 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:3/555: creat d5/d4d/d7a/fb2 x:0 0 0 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/592: sync 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:1/642: sync 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:2/742: sync 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:2/743: fsync d2/d5/db/d15/d41/fce 0 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:2/744: dread - d2/d5/db/ff1 zero size 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/593: read d0/dc/d1a/d36/d30/f3b [1269412,49976] 0 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/594: chown d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87 1797291 1 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/595: getdents d0/dc/d1a/d36/d30/d44/db3 0 2024-05-09T06:30:30.428 INFO:tasks.workunit.client.1.smithi106.stdout:7/596: stat d0/dc/f57 0 2024-05-09T06:30:30.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/21: symlink d2/d6/l9 0 2024-05-09T06:30:30.435 INFO:tasks.workunit.client.1.smithi106.stdout:8/564: dwrite d3/d5/d35/d61/d6c/d83/d89/d9b/fc7 [0,4194304] 0 2024-05-09T06:30:30.439 INFO:tasks.workunit.client.0.smithi046.stdout:7/69: getdents d3/d7 0 2024-05-09T06:30:30.443 INFO:tasks.workunit.client.0.smithi046.stdout:6/192: symlink db/d10/l43 0 2024-05-09T06:30:30.443 INFO:tasks.workunit.client.0.smithi046.stdout:5/17: dwrite d0/f4 [0,4194304] 0 2024-05-09T06:30:30.445 INFO:tasks.workunit.client.1.smithi106.stdout:9/638: dread d4/d54/d69/d95/d23/d2f/d38/f3c [0,4194304] 0 2024-05-09T06:30:30.445 INFO:tasks.workunit.client.1.smithi106.stdout:9/639: write d4/d54/d69/d95/d23/d2f/d47/f7c [412716,60840] 0 2024-05-09T06:30:30.446 INFO:tasks.workunit.client.0.smithi046.stdout:4/85: mkdir d7/df/d22 0 2024-05-09T06:30:30.449 INFO:tasks.workunit.client.1.smithi106.stdout:0/675: creat d1/d11/d23/d13/d2c/d6d/fe5 x:0 0 0 2024-05-09T06:30:30.452 INFO:tasks.workunit.client.0.smithi046.stdout:2/58: unlink c0 0 2024-05-09T06:30:30.454 INFO:tasks.workunit.client.1.smithi106.stdout:6/669: mkdir d0/d66/d7e/de5 0 2024-05-09T06:30:30.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/193: dwrite db/d10/d19/f20 [0,4194304] 0 2024-05-09T06:30:30.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/194: stat db/c11 0 2024-05-09T06:30:30.459 INFO:tasks.workunit.client.0.smithi046.stdout:1/14: rename l1 to l3 0 2024-05-09T06:30:30.459 INFO:tasks.workunit.client.0.smithi046.stdout:1/15: write f0 [3237559,123883] 0 2024-05-09T06:30:30.459 INFO:tasks.workunit.client.1.smithi106.stdout:8/565: dwrite d3/d5/d7/f60 [0,4194304] 0 2024-05-09T06:30:30.460 INFO:tasks.workunit.client.1.smithi106.stdout:6/670: dread d0/d17/d34/d4e/d98/da9/db1/d8/d50/fca [0,4194304] 0 2024-05-09T06:30:30.460 INFO:tasks.workunit.client.1.smithi106.stdout:6/671: fdatasync d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d6c/fc1 0 2024-05-09T06:30:30.462 INFO:tasks.workunit.client.0.smithi046.stdout:0/126: truncate f10 4404000 0 2024-05-09T06:30:30.465 INFO:tasks.workunit.client.1.smithi106.stdout:3/556: creat d5/d1c/d24/d5b/da4/fb3 x:0 0 0 2024-05-09T06:30:30.465 INFO:tasks.workunit.client.1.smithi106.stdout:3/557: dread - d5/d12/d26/d90/f97 zero size 2024-05-09T06:30:30.465 INFO:tasks.workunit.client.1.smithi106.stdout:3/558: dread - d5/d4d/d7a/fb2 zero size 2024-05-09T06:30:30.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/22: mknod d2/d6/ca 0 2024-05-09T06:30:30.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/23: stat d2/f4 0 2024-05-09T06:30:30.468 INFO:tasks.workunit.client.1.smithi106.stdout:1/643: mkdir d4/d76/d13/d60/d9c/de4 0 2024-05-09T06:30:30.468 INFO:tasks.workunit.client.1.smithi106.stdout:1/644: dread - d4/d76/d13/f72 zero size 2024-05-09T06:30:30.468 INFO:tasks.workunit.client.1.smithi106.stdout:1/645: fsync d4/d76/d65/d67/f68 0 2024-05-09T06:30:30.470 INFO:tasks.workunit.client.1.smithi106.stdout:2/745: mkdir d2/d5/db/d15/d41/d60/d100 0 2024-05-09T06:30:30.470 INFO:tasks.workunit.client.1.smithi106.stdout:2/746: fdatasync d2/d5/db/d1d/fc5 0 2024-05-09T06:30:30.471 INFO:tasks.workunit.client.1.smithi106.stdout:2/747: write d2/d5/fd8 [318057,14594] 0 2024-05-09T06:30:30.473 INFO:tasks.workunit.client.1.smithi106.stdout:7/597: symlink d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/lb5 0 2024-05-09T06:30:30.473 INFO:tasks.workunit.client.1.smithi106.stdout:7/598: read d0/dc/d1a/f3a [2555864,87679] 0 2024-05-09T06:30:30.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/18: mknod d0/c6 0 2024-05-09T06:30:30.478 INFO:tasks.workunit.client.0.smithi046.stdout:4/86: truncate f1 26089 0 2024-05-09T06:30:30.480 INFO:tasks.workunit.client.1.smithi106.stdout:0/676: link d1/d11/d23/d22/f31 d1/da1/d93/fe6 0 2024-05-09T06:30:30.480 INFO:tasks.workunit.client.1.smithi106.stdout:0/677: stat d1/d11/d23/cba 0 2024-05-09T06:30:30.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/59: dwrite f4 [0,4194304] 0 2024-05-09T06:30:30.483 INFO:tasks.workunit.client.1.smithi106.stdout:9/640: dwrite d4/d54/d69/d95/d23/d2f/d39/f4a [0,4194304] 0 2024-05-09T06:30:30.484 INFO:tasks.workunit.client.1.smithi106.stdout:8/566: dwrite d3/d5/d35/d61/d6c/d83/f8f [0,4194304] 0 2024-05-09T06:30:30.484 INFO:tasks.workunit.client.1.smithi106.stdout:8/567: fdatasync d3/d5/d13/f1b 0 2024-05-09T06:30:30.488 INFO:tasks.workunit.client.1.smithi106.stdout:6/672: symlink d0/d66/d7e/le6 0 2024-05-09T06:30:30.488 INFO:tasks.workunit.client.1.smithi106.stdout:6/673: fsync d0/d17/f89 0 2024-05-09T06:30:30.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/127: getdents d11/d18/d1c 0 2024-05-09T06:30:30.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/128: truncate d11/f24 350454 0 2024-05-09T06:30:30.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/129: chown d11/f12 2169903 1 2024-05-09T06:30:30.491 INFO:tasks.workunit.client.1.smithi106.stdout:3/559: getdents d5/d1c/d24/d89 0 2024-05-09T06:30:30.491 INFO:tasks.workunit.client.1.smithi106.stdout:3/560: write d5/d4d/d5f/fa5 [154043,25234] 0 2024-05-09T06:30:30.493 INFO:tasks.workunit.client.0.smithi046.stdout:9/24: creat d2/fb x:0 0 0 2024-05-09T06:30:30.495 INFO:tasks.workunit.client.1.smithi106.stdout:1/646: mknod d4/d76/d13/d60/d9c/dbe/ce5 0 2024-05-09T06:30:30.496 INFO:tasks.workunit.client.1.smithi106.stdout:6/674: write d0/d17/f1e [7917799,85637] 0 2024-05-09T06:30:30.496 INFO:tasks.workunit.client.1.smithi106.stdout:6/675: dread - d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d6c/fb2 zero size 2024-05-09T06:30:30.498 INFO:tasks.workunit.client.0.smithi046.stdout:5/19: link d0/l3 d0/l7 0 2024-05-09T06:30:30.500 INFO:tasks.workunit.client.1.smithi106.stdout:2/748: creat d2/d5/db/d1d/d23/d63/f101 x:0 0 0 2024-05-09T06:30:30.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/87: symlink d7/df/d10/d1d/l23 0 2024-05-09T06:30:30.505 INFO:tasks.workunit.client.1.smithi106.stdout:7/599: mknod d0/dc/d1a/d36/d30/d44/d58/d65/cb6 0 2024-05-09T06:30:30.505 INFO:tasks.workunit.client.1.smithi106.stdout:7/600: readlink d0/d53/l59 0 2024-05-09T06:30:30.507 INFO:tasks.workunit.client.1.smithi106.stdout:6/676: read d0/f6a [3405358,62550] 0 2024-05-09T06:30:30.507 INFO:tasks.workunit.client.1.smithi106.stdout:6/677: write d0/f30 [8555474,46650] 0 2024-05-09T06:30:30.507 INFO:tasks.workunit.client.1.smithi106.stdout:6/678: readlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/l5a 0 2024-05-09T06:30:30.508 INFO:tasks.workunit.client.0.smithi046.stdout:2/60: truncate f7 3934073 0 2024-05-09T06:30:30.511 INFO:tasks.workunit.client.1.smithi106.stdout:0/678: dwrite d1/f1d [0,4194304] 0 2024-05-09T06:30:30.511 INFO:tasks.workunit.client.1.smithi106.stdout:0/679: chown d1/d11/d23/d22/f4e 6 1 2024-05-09T06:30:30.512 INFO:tasks.workunit.client.0.smithi046.stdout:0/130: unlink d11/f26 0 2024-05-09T06:30:30.512 INFO:tasks.workunit.client.1.smithi106.stdout:8/568: dwrite d3/d5/d35/d4e/d32/fac [0,4194304] 0 2024-05-09T06:30:30.512 INFO:tasks.workunit.client.0.smithi046.stdout:4/88: dread d7/fa [0,4194304] 0 2024-05-09T06:30:30.513 INFO:tasks.workunit.client.1.smithi106.stdout:5/659: symlink d8/d45/d4c/d32/lc6 0 2024-05-09T06:30:30.513 INFO:tasks.workunit.client.1.smithi106.stdout:5/660: fsync d8/d5a/d60/d7e/f82 0 2024-05-09T06:30:30.513 INFO:tasks.workunit.client.1.smithi106.stdout:5/661: chown d8/l25 1435345036 1 2024-05-09T06:30:30.514 INFO:tasks.workunit.client.1.smithi106.stdout:5/662: chown d8/d45/d4c/d32/d5b/f41 3168 1 2024-05-09T06:30:30.514 INFO:tasks.workunit.client.1.smithi106.stdout:3/561: dwrite d5/d4d/d7a/fb2 [0,4194304] 0 2024-05-09T06:30:30.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/25: mkdir d2/dc 0 2024-05-09T06:30:30.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/26: creat d2/d6/d7/fd x:0 0 0 2024-05-09T06:30:30.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/27: stat d2/d6/ca 0 2024-05-09T06:30:30.519 INFO:tasks.workunit.client.1.smithi106.stdout:9/641: mknod d4/d54/d69/d95/d23/d2f/d39/cb8 0 2024-05-09T06:30:30.519 INFO:tasks.workunit.client.1.smithi106.stdout:9/642: dread - d4/f98 zero size 2024-05-09T06:30:30.520 INFO:tasks.workunit.client.1.smithi106.stdout:2/749: dwrite d2/d5/db/d1d/d23/d63/fae [0,4194304] 0 2024-05-09T06:30:30.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/20: mknod d0/c8 0 2024-05-09T06:30:30.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/21: chown d0/f4 12531478 1 2024-05-09T06:30:30.522 INFO:tasks.workunit.client.1.smithi106.stdout:3/562: write d5/d12/f23 [541535,123246] 0 2024-05-09T06:30:30.524 INFO:tasks.workunit.client.0.smithi046.stdout:0/131: creat d11/d18/d27/d28/f2b x:0 0 0 2024-05-09T06:30:30.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/89: creat d7/df/d10/f24 x:0 0 0 2024-05-09T06:30:30.527 INFO:tasks.workunit.client.1.smithi106.stdout:7/601: dwrite d0/dc/d1a/d36/f79 [4194304,4194304] 0 2024-05-09T06:30:30.530 INFO:tasks.workunit.client.0.smithi046.stdout:9/28: creat d2/dc/fe x:0 0 0 2024-05-09T06:30:30.538 INFO:tasks.workunit.client.0.smithi046.stdout:0/132: link l6 d11/d18/l2c 0 2024-05-09T06:30:30.539 INFO:tasks.workunit.client.1.smithi106.stdout:1/647: unlink d4/d76/fd2 0 2024-05-09T06:30:30.539 INFO:tasks.workunit.client.1.smithi106.stdout:1/648: fdatasync d4/d76/d13/d60/d9c/dbe/fc0 0 2024-05-09T06:30:30.539 INFO:tasks.workunit.client.1.smithi106.stdout:1/649: chown d4/d37/fd0 3095516 1 2024-05-09T06:30:30.539 INFO:tasks.workunit.client.1.smithi106.stdout:1/650: dread - d4/d5b/d75/fda zero size 2024-05-09T06:30:30.540 INFO:tasks.workunit.client.1.smithi106.stdout:1/651: truncate d4/f59 4356343 0 2024-05-09T06:30:30.540 INFO:tasks.workunit.client.1.smithi106.stdout:1/652: fdatasync d4/d76/d13/f20 0 2024-05-09T06:30:30.540 INFO:tasks.workunit.client.1.smithi106.stdout:1/653: dread - d4/d76/d13/f72 zero size 2024-05-09T06:30:30.541 INFO:tasks.workunit.client.1.smithi106.stdout:6/679: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/ce7 0 2024-05-09T06:30:30.541 INFO:tasks.workunit.client.1.smithi106.stdout:6/680: truncate d0/d17/d34/fbe 133691 0 2024-05-09T06:30:30.543 INFO:tasks.workunit.client.1.smithi106.stdout:0/680: unlink d1/d11/d23/d22/fab 0 2024-05-09T06:30:30.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/195: fsync db/f42 0 2024-05-09T06:30:30.547 INFO:tasks.workunit.client.1.smithi106.stdout:9/643: dwrite d4/d54/d69/d95/d23/d2f/d38/d68/f84 [0,4194304] 0 2024-05-09T06:30:30.548 INFO:tasks.workunit.client.1.smithi106.stdout:8/569: unlink d3/d5/d35/d61/d6c/c8c 0 2024-05-09T06:30:30.548 INFO:tasks.workunit.client.1.smithi106.stdout:1/654: dread d4/d76/d13/d2f/f42 [0,4194304] 0 2024-05-09T06:30:30.548 INFO:tasks.workunit.client.1.smithi106.stdout:3/563: dwrite d5/d1c/d24/d52/f71 [4194304,4194304] 0 2024-05-09T06:30:30.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/90: dwrite d7/df/f1b [0,4194304] 0 2024-05-09T06:30:30.551 INFO:tasks.workunit.client.1.smithi106.stdout:5/663: rename d8/d45/d4c/d32/dc5 to d8/d5a/dc7 0 2024-05-09T06:30:30.551 INFO:tasks.workunit.client.1.smithi106.stdout:5/664: fdatasync d8/d33/d3a/d59/faf 0 2024-05-09T06:30:30.554 INFO:tasks.workunit.client.0.smithi046.stdout:0/133: dread ff [0,4194304] 0 2024-05-09T06:30:30.561 INFO:tasks.workunit.client.0.smithi046.stdout:4/91: mkdir d7/df/d22/d25 0 2024-05-09T06:30:30.561 INFO:tasks.workunit.client.0.smithi046.stdout:4/92: chown d7/f1a 341 1 2024-05-09T06:30:30.563 INFO:tasks.workunit.client.0.smithi046.stdout:0/134: rmdir d11/d18/d1c 39 2024-05-09T06:30:30.564 INFO:tasks.workunit.client.0.smithi046.stdout:0/135: dread fc [0,4194304] 0 2024-05-09T06:30:30.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/750: symlink d2/d7/d2c/l102 0 2024-05-09T06:30:30.565 INFO:tasks.workunit.client.1.smithi106.stdout:2/751: chown d2/d5/db/c8e 59315 1 2024-05-09T06:30:30.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/93: symlink d7/df/d22/d25/l26 0 2024-05-09T06:30:30.566 INFO:tasks.workunit.client.1.smithi106.stdout:8/570: dread d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:30.568 INFO:tasks.workunit.client.1.smithi106.stdout:7/602: mkdir d0/dc/d1a/d36/d30/d44/d6a/db7 0 2024-05-09T06:30:30.569 INFO:tasks.workunit.client.0.smithi046.stdout:5/22: truncate d0/f1 555832 0 2024-05-09T06:30:30.569 INFO:tasks.workunit.client.0.smithi046.stdout:5/23: chown d0/l3 2 1 2024-05-09T06:30:30.573 INFO:tasks.workunit.client.1.smithi106.stdout:9/644: mkdir d4/d54/d69/d99/d2a/d42/db9 0 2024-05-09T06:30:30.574 INFO:tasks.workunit.client.0.smithi046.stdout:0/136: read f0 [243365,117713] 0 2024-05-09T06:30:30.575 INFO:tasks.workunit.client.1.smithi106.stdout:1/655: mkdir d4/dbd/de6 0 2024-05-09T06:30:30.575 INFO:tasks.workunit.client.1.smithi106.stdout:1/656: dread - d4/d76/d65/d8d/dad/fba zero size 2024-05-09T06:30:30.575 INFO:tasks.workunit.client.1.smithi106.stdout:1/657: stat d4/d37/d3d 0 2024-05-09T06:30:30.576 INFO:tasks.workunit.client.0.smithi046.stdout:6/196: dwrite db/f23 [4194304,4194304] 0 2024-05-09T06:30:30.577 INFO:tasks.workunit.client.1.smithi106.stdout:8/571: dread d3/d5/d35/d61/d6c/f70 [0,4194304] 0 2024-05-09T06:30:30.578 INFO:tasks.workunit.client.1.smithi106.stdout:0/681: rename d1/d11/d23/l2e to d1/d11/d23/d13/d2c/d57/le7 0 2024-05-09T06:30:30.579 INFO:tasks.workunit.client.1.smithi106.stdout:7/603: dread d0/dc/d1a/d36/f79 [0,4194304] 0 2024-05-09T06:30:30.579 INFO:tasks.workunit.client.1.smithi106.stdout:7/604: dread d0/dc/d1a/d5a/f94 [0,4194304] 0 2024-05-09T06:30:30.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/681: dwrite d0/f30 [8388608,4194304] 0 2024-05-09T06:30:30.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/682: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fe8 x:0 0 0 2024-05-09T06:30:30.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/683: write d0/d17/d34/d4e/d98/fdf [55880,7623] 0 2024-05-09T06:30:30.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/684: creat d0/d17/d34/d4e/d98/fe9 x:0 0 0 2024-05-09T06:30:30.584 INFO:tasks.workunit.client.0.smithi046.stdout:6/197: mkdir db/d10/d3f/d44 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/16: unlink l3 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/17: write f0 [4459241,59879] 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/18: creat f4 x:0 0 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/19: write f0 [3996319,121065] 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/20: creat f5 x:0 0 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/21: dread - f4 zero size 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/22: creat f6 x:0 0 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/23: write f5 [658175,37730] 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/24: dread - f4 zero size 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/25: truncate f4 717744 0 2024-05-09T06:30:30.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/137: dread d11/d18/f1b [0,4194304] 0 2024-05-09T06:30:30.590 INFO:tasks.workunit.client.1.smithi106.stdout:8/572: write d3/d5/d7/f60 [3995042,64353] 0 2024-05-09T06:30:30.590 INFO:tasks.workunit.client.1.smithi106.stdout:8/573: stat d3/d5/d7 0 2024-05-09T06:30:30.596 INFO:tasks.workunit.client.1.smithi106.stdout:9/645: dwrite d4/d54/f5f [0,4194304] 0 2024-05-09T06:30:30.605 INFO:tasks.workunit.client.1.smithi106.stdout:5/665: unlink d8/d45/l5d 0 2024-05-09T06:30:30.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/138: dwrite d11/d18/d27/d28/f2b [0,4194304] 0 2024-05-09T06:30:30.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/139: write fe [53426,88396] 0 2024-05-09T06:30:30.610 INFO:tasks.workunit.client.1.smithi106.stdout:1/658: mknod d4/d76/d65/d8d/ce7 0 2024-05-09T06:30:30.612 INFO:tasks.workunit.client.1.smithi106.stdout:2/752: rename d2/d7/d62/def to d2/d5/db/d1d/d90/d103 0 2024-05-09T06:30:30.612 INFO:tasks.workunit.client.1.smithi106.stdout:2/753: write d2/f2b [3399942,106071] 0 2024-05-09T06:30:30.614 INFO:tasks.workunit.client.1.smithi106.stdout:0/682: mkdir d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8 0 2024-05-09T06:30:30.616 INFO:tasks.workunit.client.1.smithi106.stdout:7/605: creat d0/dc/d1a/d36/d30/fb8 x:0 0 0 2024-05-09T06:30:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:0/140: mkdir d11/d18/d27/d28/d2d 0 2024-05-09T06:30:30.627 INFO:tasks.workunit.client.0.smithi046.stdout:0/141: rename f10 to d11/d18/d27/d28/f2e 0 2024-05-09T06:30:30.628 INFO:tasks.workunit.client.1.smithi106.stdout:6/685: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/fea x:0 0 0 2024-05-09T06:30:30.628 INFO:tasks.workunit.client.1.smithi106.stdout:2/754: dwrite d2/d5/db/d1d/d90/faa [0,4194304] 0 2024-05-09T06:30:30.629 INFO:tasks.workunit.client.1.smithi106.stdout:6/686: dread d0/d17/d76/f9b [0,4194304] 0 2024-05-09T06:30:30.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/142: truncate d11/f12 1445234 0 2024-05-09T06:30:30.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/143: write d11/d18/d1c/f1d [271658,87978] 0 2024-05-09T06:30:30.631 INFO:tasks.workunit.client.1.smithi106.stdout:8/574: rmdir d3/d5/d35/d73/d9d 39 2024-05-09T06:30:30.631 INFO:tasks.workunit.client.1.smithi106.stdout:8/575: write d3/d5/d35/d61/d6c/d83/d89/fb0 [1528531,73771] 0 2024-05-09T06:30:30.634 INFO:tasks.workunit.client.1.smithi106.stdout:9/646: creat d4/d54/d69/d95/d23/d2f/d31/d51/fba x:0 0 0 2024-05-09T06:30:30.635 INFO:tasks.workunit.client.1.smithi106.stdout:5/666: truncate d8/f5f 120049 0 2024-05-09T06:30:30.637 INFO:tasks.workunit.client.1.smithi106.stdout:1/659: creat d4/d5b/fe8 x:0 0 0 2024-05-09T06:30:30.638 INFO:tasks.workunit.client.1.smithi106.stdout:0/683: readlink d1/d11/d23/d13/d2c/l3b 0 2024-05-09T06:30:30.640 INFO:tasks.workunit.client.1.smithi106.stdout:7/606: rmdir d0/dc/d1a/d36/d30/d44 39 2024-05-09T06:30:30.640 INFO:tasks.workunit.client.1.smithi106.stdout:7/607: write d0/dc/d1a/d36/d30/d44/d6a/f6d [2244019,57157] 0 2024-05-09T06:30:30.640 INFO:tasks.workunit.client.1.smithi106.stdout:7/608: chown d0/dc/d1a/d36/d30/f64 2668719 1 2024-05-09T06:30:30.648 INFO:tasks.workunit.client.1.smithi106.stdout:2/755: mkdir d2/d7/d89/d104 0 2024-05-09T06:30:30.649 INFO:tasks.workunit.client.1.smithi106.stdout:6/687: mkdir d0/d17/d34/d4e/deb 0 2024-05-09T06:30:30.649 INFO:tasks.workunit.client.1.smithi106.stdout:6/688: creat d0/d66/d7e/fec x:0 0 0 2024-05-09T06:30:30.649 INFO:tasks.workunit.client.1.smithi106.stdout:6/689: chown d0/d17/d34/d4e/d98/da9/db1/f28 13085956 1 2024-05-09T06:30:30.649 INFO:tasks.workunit.client.1.smithi106.stdout:6/690: fdatasync d0/d66/d7e/f77 0 2024-05-09T06:30:30.652 INFO:tasks.workunit.client.1.smithi106.stdout:8/576: creat d3/d5/d35/d61/d6c/d83/fc9 x:0 0 0 2024-05-09T06:30:30.652 INFO:tasks.workunit.client.1.smithi106.stdout:5/667: truncate d8/d45/d4c/d32/d5b/f29 1018889 0 2024-05-09T06:30:30.654 INFO:tasks.workunit.client.1.smithi106.stdout:1/660: creat d4/d76/d65/d8d/db5/fe9 x:0 0 0 2024-05-09T06:30:30.654 INFO:tasks.workunit.client.1.smithi106.stdout:1/661: creat d4/d76/d65/d8d/db5/fea x:0 0 0 2024-05-09T06:30:30.655 INFO:tasks.workunit.client.1.smithi106.stdout:1/662: dread d4/d76/f7c [0,4194304] 0 2024-05-09T06:30:30.655 INFO:tasks.workunit.client.1.smithi106.stdout:0/684: creat d1/d11/d23/d13/d2c/fe9 x:0 0 0 2024-05-09T06:30:30.656 INFO:tasks.workunit.client.0.smithi046.stdout:0/144: dwrite d11/d18/f1a [0,4194304] 0 2024-05-09T06:30:30.656 INFO:tasks.workunit.client.0.smithi046.stdout:0/145: chown d11/f24 75585207 1 2024-05-09T06:30:30.657 INFO:tasks.workunit.client.1.smithi106.stdout:2/756: symlink d2/d5/d9c/dd3/l105 0 2024-05-09T06:30:30.658 INFO:tasks.workunit.client.1.smithi106.stdout:9/647: dwrite d4/d54/d69/d95/d23/d2f/d38/d86/f8c [0,4194304] 0 2024-05-09T06:30:30.658 INFO:tasks.workunit.client.0.smithi046.stdout:9/29: fsync d2/d6/d7/fd 0 2024-05-09T06:30:30.658 INFO:tasks.workunit.client.0.smithi046.stdout:9/30: readlink d2/d6/l9 0 2024-05-09T06:30:30.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/61: dwrite f6 [0,4194304] 0 2024-05-09T06:30:30.661 INFO:tasks.workunit.client.1.smithi106.stdout:8/577: creat d3/d5/d35/d4e/fca x:0 0 0 2024-05-09T06:30:30.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/603: sync 2024-05-09T06:30:30.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/604: stat d7/d28/c82 0 2024-05-09T06:30:30.665 INFO:tasks.workunit.client.1.smithi106.stdout:5/668: stat d8/d45/d4c/d32/d5b/l40 0 2024-05-09T06:30:30.667 INFO:tasks.workunit.client.0.smithi046.stdout:2/62: getdents da/dc 0 2024-05-09T06:30:30.668 INFO:tasks.workunit.client.1.smithi106.stdout:9/648: dread d4/d54/d69/d95/d23/d2f/d31/d51/d58/f7b [0,4194304] 0 2024-05-09T06:30:30.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/31: link d2/dc/fe d2/d6/d7/ff 0 2024-05-09T06:30:30.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/32: read d2/f4 [452679,23585] 0 2024-05-09T06:30:30.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/33: chown d2/f5 215380175 1 2024-05-09T06:30:30.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/34: chown d2/d6 31 1 2024-05-09T06:30:30.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/35: dread - d2/d6/d7/ff zero size 2024-05-09T06:30:30.671 INFO:tasks.workunit.client.1.smithi106.stdout:0/685: mknod d1/d11/d23/cea 0 2024-05-09T06:30:30.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/63: mkdir da/de/d11 0 2024-05-09T06:30:30.673 INFO:tasks.workunit.client.1.smithi106.stdout:1/663: dwrite d4/d37/d3d/fc3 [0,4194304] 0 2024-05-09T06:30:30.673 INFO:tasks.workunit.client.1.smithi106.stdout:1/664: write d4/d5b/d75/fda [908119,92797] 0 2024-05-09T06:30:30.673 INFO:tasks.workunit.client.1.smithi106.stdout:7/609: symlink d0/lb9 0 2024-05-09T06:30:30.676 INFO:tasks.workunit.client.1.smithi106.stdout:2/757: creat d2/d5/db/d15/d41/f106 x:0 0 0 2024-05-09T06:30:30.677 INFO:tasks.workunit.client.1.smithi106.stdout:2/758: chown d2/d5/db/d15/d41/d58/l8b 6 1 2024-05-09T06:30:30.678 INFO:tasks.workunit.client.1.smithi106.stdout:6/691: rmdir d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62 39 2024-05-09T06:30:30.680 INFO:tasks.workunit.client.1.smithi106.stdout:4/605: creat d7/d39/d35/fc2 x:0 0 0 2024-05-09T06:30:30.682 INFO:tasks.workunit.client.1.smithi106.stdout:9/649: dwrite d4/d54/d69/d95/f11 [0,4194304] 0 2024-05-09T06:30:30.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/64: dread f1 [0,4194304] 0 2024-05-09T06:30:30.685 INFO:tasks.workunit.client.1.smithi106.stdout:0/686: creat d1/d11/d23/d13/d2c/d57/de1/feb x:0 0 0 2024-05-09T06:30:30.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/65: symlink da/dc/l12 0 2024-05-09T06:30:30.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/66: link f7 da/dc/f13 0 2024-05-09T06:30:30.691 INFO:tasks.workunit.client.1.smithi106.stdout:7/610: creat d0/dc/d1a/fba x:0 0 0 2024-05-09T06:30:30.691 INFO:tasks.workunit.client.1.smithi106.stdout:7/611: write d0/dc/d1a/d5a/fab [568156,123052] 0 2024-05-09T06:30:30.694 INFO:tasks.workunit.client.1.smithi106.stdout:2/759: rename d2/d5/fd8 to d2/d5/db/d15/f107 0 2024-05-09T06:30:30.696 INFO:tasks.workunit.client.1.smithi106.stdout:6/692: link d0/d66/d7e/f77 d0/d17/d34/d4e/d98/fed 0 2024-05-09T06:30:30.696 INFO:tasks.workunit.client.1.smithi106.stdout:6/693: readlink d0/d17/d34/d4e/d98/da9/db1/d8/d50/ldb 0 2024-05-09T06:30:30.696 INFO:tasks.workunit.client.1.smithi106.stdout:6/694: stat d0/d17/d34/d72 0 2024-05-09T06:30:30.697 INFO:tasks.workunit.client.1.smithi106.stdout:4/606: mknod d7/d39/d35/d6f/d9d/cc3 0 2024-05-09T06:30:30.698 INFO:tasks.workunit.client.1.smithi106.stdout:5/669: getdents d8/d45/d4c/d32/d5b/d69 0 2024-05-09T06:30:30.700 INFO:tasks.workunit.client.1.smithi106.stdout:9/650: creat d4/d54/d69/d95/d23/d78/fbb x:0 0 0 2024-05-09T06:30:30.701 INFO:tasks.workunit.client.1.smithi106.stdout:0/687: symlink d1/d11/d23/d13/d2c/d57/lec 0 2024-05-09T06:30:30.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/198: rmdir db 39 2024-05-09T06:30:30.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/67: dwrite f6 [0,4194304] 0 2024-05-09T06:30:30.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/68: stat f4 0 2024-05-09T06:30:30.705 INFO:tasks.workunit.client.1.smithi106.stdout:7/612: creat d0/fbb x:0 0 0 2024-05-09T06:30:30.705 INFO:tasks.workunit.client.1.smithi106.stdout:7/613: write d0/dc/d1a/d36/d30/d44/d6a/f9e [1248764,85956] 0 2024-05-09T06:30:30.707 INFO:tasks.workunit.client.1.smithi106.stdout:2/760: rename d2/d5/db/d15/d41/fce to d2/d7/d62/f108 0 2024-05-09T06:30:30.707 INFO:tasks.workunit.client.1.smithi106.stdout:2/761: fsync d2/d5/db/d1d/f8a 0 2024-05-09T06:30:30.708 INFO:tasks.workunit.client.1.smithi106.stdout:5/670: write d8/d45/d4c/d32/d5b/d69/fab [1047904,25161] 0 2024-05-09T06:30:30.708 INFO:tasks.workunit.client.1.smithi106.stdout:6/695: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/lee 0 2024-05-09T06:30:30.710 INFO:tasks.workunit.client.1.smithi106.stdout:9/651: mkdir d4/d54/d69/d95/d23/d2f/dbc 0 2024-05-09T06:30:30.715 INFO:tasks.workunit.client.1.smithi106.stdout:7/614: rmdir d0/dc/d1a/d36/d30/d44/d6a/db7 0 2024-05-09T06:30:30.715 INFO:tasks.workunit.client.0.smithi046.stdout:2/69: dread da/dc/f13 [0,4194304] 0 2024-05-09T06:30:30.716 INFO:tasks.workunit.client.1.smithi106.stdout:2/762: mkdir d2/d5/db/d15/dd6/d109 0 2024-05-09T06:30:30.716 INFO:tasks.workunit.client.0.smithi046.stdout:6/199: write db/d10/f1e [651568,41022] 0 2024-05-09T06:30:30.716 INFO:tasks.workunit.client.0.smithi046.stdout:1/26: fsync f5 0 2024-05-09T06:30:30.716 INFO:tasks.workunit.client.0.smithi046.stdout:1/27: dread - f6 zero size 2024-05-09T06:30:30.717 INFO:tasks.workunit.client.1.smithi106.stdout:2/763: dread d2/d5/f5d [0,4194304] 0 2024-05-09T06:30:30.718 INFO:tasks.workunit.client.1.smithi106.stdout:5/671: rename d8/d33/f76 to d8/d45/fc8 0 2024-05-09T06:30:30.718 INFO:tasks.workunit.client.1.smithi106.stdout:5/672: fdatasync d8/d5a/d60/f75 0 2024-05-09T06:30:30.721 INFO:tasks.workunit.client.1.smithi106.stdout:4/607: dwrite d7/d39/d35/d6f/fa4 [0,4194304] 0 2024-05-09T06:30:30.721 INFO:tasks.workunit.client.1.smithi106.stdout:4/608: fdatasync d7/d39/d35/f9b 0 2024-05-09T06:30:30.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/696: truncate d0/d17/d34/d4e/d98/da9/db1/fe 4580008 0 2024-05-09T06:30:30.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/697: creat d0/d66/d7e/fef x:0 0 0 2024-05-09T06:30:30.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/698: write d0/d17/d76/f71 [984422,67626] 0 2024-05-09T06:30:30.725 INFO:tasks.workunit.client.0.smithi046.stdout:6/200: unlink db/f2f 0 2024-05-09T06:30:30.726 INFO:tasks.workunit.client.1.smithi106.stdout:9/652: mkdir d4/d54/d69/d95/d23/d2f/d31/dbd 0 2024-05-09T06:30:30.727 INFO:tasks.workunit.client.0.smithi046.stdout:6/201: read db/d10/f16 [574161,79023] 0 2024-05-09T06:30:30.727 INFO:tasks.workunit.client.1.smithi106.stdout:1/665: getdents d4/d76/d65/d8d 0 2024-05-09T06:30:30.727 INFO:tasks.workunit.client.1.smithi106.stdout:1/666: stat d4/d76/d1d/f3c 0 2024-05-09T06:30:30.727 INFO:tasks.workunit.client.1.smithi106.stdout:1/667: truncate d4/d76/d13/d2f/db4/fd6 210848 0 2024-05-09T06:30:30.728 INFO:tasks.workunit.client.1.smithi106.stdout:1/668: write d4/d76/d13/d2f/fce [145839,123476] 0 2024-05-09T06:30:30.740 INFO:tasks.workunit.client.1.smithi106.stdout:1/669: dread d4/d37/d3d/f6e [0,4194304] 0 2024-05-09T06:30:30.740 INFO:tasks.workunit.client.1.smithi106.stdout:1/670: readlink d4/d37/d74/l9d 0 2024-05-09T06:30:30.747 INFO:tasks.workunit.client.1.smithi106.stdout:5/673: dwrite d8/d33/d3a/fb3 [0,4194304] 0 2024-05-09T06:30:30.747 INFO:tasks.workunit.client.0.smithi046.stdout:1/28: dwrite f0 [0,4194304] 0 2024-05-09T06:30:30.747 INFO:tasks.workunit.client.0.smithi046.stdout:6/202: dwrite db/f25 [0,4194304] 0 2024-05-09T06:30:30.752 INFO:tasks.workunit.client.0.smithi046.stdout:0/146: dwrite d11/d18/d27/d28/f2b [4194304,4194304] 0 2024-05-09T06:30:30.752 INFO:tasks.workunit.client.0.smithi046.stdout:0/147: chown ff 1289653936 1 2024-05-09T06:30:30.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/29: mkdir d7 0 2024-05-09T06:30:30.758 INFO:tasks.workunit.client.0.smithi046.stdout:6/203: creat db/d10/d3c/f45 x:0 0 0 2024-05-09T06:30:30.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/148: rename d11/d18/l2c to d11/d18/l2f 0 2024-05-09T06:30:30.763 INFO:tasks.workunit.client.1.smithi106.stdout:3/564: sync 2024-05-09T06:30:30.764 INFO:tasks.workunit.client.0.smithi046.stdout:1/30: creat d7/f8 x:0 0 0 2024-05-09T06:30:30.764 INFO:tasks.workunit.client.1.smithi106.stdout:5/674: dwrite d8/d5a/d60/f75 [0,4194304] 0 2024-05-09T06:30:30.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/204: mkdir db/d10/d3f/d44/d46 0 2024-05-09T06:30:30.767 INFO:tasks.workunit.client.1.smithi106.stdout:7/615: symlink d0/dc/d1a/d36/d30/d44/lbc 0 2024-05-09T06:30:30.767 INFO:tasks.workunit.client.1.smithi106.stdout:7/616: fdatasync d0/dc/f2d 0 2024-05-09T06:30:30.767 INFO:tasks.workunit.client.1.smithi106.stdout:7/617: chown d0/dc/c4e 126430 1 2024-05-09T06:30:30.767 INFO:tasks.workunit.client.1.smithi106.stdout:7/618: chown d0/lb4 8 1 2024-05-09T06:30:30.767 INFO:tasks.workunit.client.0.smithi046.stdout:0/149: creat d11/d18/d27/d28/d2d/f30 x:0 0 0 2024-05-09T06:30:30.768 INFO:tasks.workunit.client.1.smithi106.stdout:2/764: mkdir d2/d7/d89/d104/d10a 0 2024-05-09T06:30:30.768 INFO:tasks.workunit.client.1.smithi106.stdout:2/765: fsync d2/d5/db/d15/ffb 0 2024-05-09T06:30:30.769 INFO:tasks.workunit.client.1.smithi106.stdout:2/766: chown d2/d7/d62/l82 5736 1 2024-05-09T06:30:30.770 INFO:tasks.workunit.client.0.smithi046.stdout:6/205: creat db/d10/d3f/d44/d46/f47 x:0 0 0 2024-05-09T06:30:30.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/150: truncate f0 4184607 0 2024-05-09T06:30:30.776 INFO:tasks.workunit.client.0.smithi046.stdout:6/206: creat db/d10/d3f/d44/f48 x:0 0 0 2024-05-09T06:30:30.778 INFO:tasks.workunit.client.1.smithi106.stdout:4/609: truncate d7/d10/d1a/f5b 3754229 0 2024-05-09T06:30:30.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/36: rmdir d2/dc 39 2024-05-09T06:30:30.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/37: dread - d2/d6/d7/f8 zero size 2024-05-09T06:30:30.785 INFO:tasks.workunit.client.1.smithi106.stdout:5/675: dwrite d8/f7a [0,4194304] 0 2024-05-09T06:30:30.786 INFO:tasks.workunit.client.1.smithi106.stdout:6/699: rename d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47/l53 to d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/de2/lf0 0 2024-05-09T06:30:30.786 INFO:tasks.workunit.client.1.smithi106.stdout:6/700: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/f7d [1520608,39519] 0 2024-05-09T06:30:30.786 INFO:tasks.workunit.client.1.smithi106.stdout:6/701: stat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/dad 0 2024-05-09T06:30:30.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/38: mknod d2/c10 0 2024-05-09T06:30:30.790 INFO:tasks.workunit.client.0.smithi046.stdout:1/31: dwrite f0 [0,4194304] 0 2024-05-09T06:30:30.791 INFO:tasks.workunit.client.0.smithi046.stdout:9/39: rmdir d2/dc 39 2024-05-09T06:30:30.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/40: truncate d2/d6/d7/f8 866584 0 2024-05-09T06:30:30.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/32: mknod d7/c9 0 2024-05-09T06:30:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/207: dwrite db/d10/d19/f29 [0,4194304] 0 2024-05-09T06:30:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/208: fdatasync db/f14 0 2024-05-09T06:30:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/209: dread - db/d10/d3c/f45 zero size 2024-05-09T06:30:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/210: fsync db/f42 0 2024-05-09T06:30:30.795 INFO:tasks.workunit.client.1.smithi106.stdout:1/671: creat d4/d76/d13/d60/d9c/feb x:0 0 0 2024-05-09T06:30:30.795 INFO:tasks.workunit.client.1.smithi106.stdout:1/672: chown d4/d76/db3 107102 1 2024-05-09T06:30:30.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/41: link f0 d2/dc/f11 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/42: write f0 [1187279,125453] 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/43: write d2/d6/d7/ff [514783,107783] 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/44: stat d2 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/45: write d2/fb [98892,69647] 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/46: write d2/dc/fe [321999,52455] 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/47: truncate d2/d6/d7/fd 717280 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/48: chown d2/d6/d7 1557 1 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/49: write d2/dc/f11 [894922,93059] 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:1/33: symlink d7/la 0 2024-05-09T06:30:30.798 INFO:tasks.workunit.client.0.smithi046.stdout:1/34: creat d7/fb x:0 0 0 2024-05-09T06:30:30.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/211: unlink db/d10/d19/f35 0 2024-05-09T06:30:30.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/50: rename d2/dc/fe to d2/d6/d7/f12 0 2024-05-09T06:30:30.804 INFO:tasks.workunit.client.1.smithi106.stdout:0/688: rmdir d1 39 2024-05-09T06:30:30.804 INFO:tasks.workunit.client.1.smithi106.stdout:0/689: stat d1/d11/d23/d22/f91 0 2024-05-09T06:30:30.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/35: link f4 d7/fc 0 2024-05-09T06:30:30.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/36: write d7/fb [709787,75865] 0 2024-05-09T06:30:30.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/37: creat d7/fd x:0 0 0 2024-05-09T06:30:30.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/38: dread - d7/fd zero size 2024-05-09T06:30:30.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/39: write d7/fc [115622,124205] 0 2024-05-09T06:30:30.811 INFO:tasks.workunit.client.0.smithi046.stdout:1/40: write d7/f8 [224774,115749] 0 2024-05-09T06:30:30.811 INFO:tasks.workunit.client.0.smithi046.stdout:6/212: symlink db/l49 0 2024-05-09T06:30:30.811 INFO:tasks.workunit.client.0.smithi046.stdout:6/213: truncate db/f18 5351541 0 2024-05-09T06:30:30.817 INFO:tasks.workunit.client.1.smithi106.stdout:3/565: mknod d5/d12/cb4 0 2024-05-09T06:30:30.817 INFO:tasks.workunit.client.1.smithi106.stdout:3/566: stat d5/d1c/d24/d98/faa 0 2024-05-09T06:30:30.818 INFO:tasks.workunit.client.1.smithi106.stdout:3/567: creat d5/d1c/d21/fb5 x:0 0 0 2024-05-09T06:30:30.818 INFO:tasks.workunit.client.1.smithi106.stdout:3/568: write d5/d1c/d24/d52/f71 [3678815,7066] 0 2024-05-09T06:30:30.818 INFO:tasks.workunit.client.1.smithi106.stdout:3/569: chown d5/d4d/f70 0 1 2024-05-09T06:30:30.818 INFO:tasks.workunit.client.1.smithi106.stdout:3/570: chown d5/d4d/d5f/c79 60 1 2024-05-09T06:30:30.819 INFO:tasks.workunit.client.0.smithi046.stdout:6/214: rename db/d10/d19/f29 to db/d10/d30/f4a 0 2024-05-09T06:30:30.822 INFO:tasks.workunit.client.1.smithi106.stdout:2/767: mkdir d2/d5/db/d15/d41/d58/ddf/d10b 0 2024-05-09T06:30:30.824 INFO:tasks.workunit.client.0.smithi046.stdout:2/70: truncate f4 3720836 0 2024-05-09T06:30:30.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/215: mknod db/c4b 0 2024-05-09T06:30:30.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/216: chown db/d10/d3f/d44/d46 24 1 2024-05-09T06:30:30.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/217: readlink db/d10/l3b 0 2024-05-09T06:30:30.826 INFO:tasks.workunit.client.1.smithi106.stdout:4/610: creat d7/fc4 x:0 0 0 2024-05-09T06:30:30.826 INFO:tasks.workunit.client.1.smithi106.stdout:4/611: stat d7/d39/l56 0 2024-05-09T06:30:30.827 INFO:tasks.workunit.client.1.smithi106.stdout:4/612: chown d7/d10/d1a/d5a/f97 165277287 1 2024-05-09T06:30:30.829 INFO:tasks.workunit.client.1.smithi106.stdout:0/690: dwrite d1/d11/d23/d13/d58/f98 [0,4194304] 0 2024-05-09T06:30:30.829 INFO:tasks.workunit.client.0.smithi046.stdout:2/71: rename da/df to da/de/d14 0 2024-05-09T06:30:30.829 INFO:tasks.workunit.client.0.smithi046.stdout:9/51: dwrite d2/f4 [0,4194304] 0 2024-05-09T06:30:30.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/218: rename db/d10/d3f/d44/d46/f47 to db/d10/d3f/f4c 0 2024-05-09T06:30:30.839 INFO:tasks.workunit.client.0.smithi046.stdout:2/72: creat da/db/f15 x:0 0 0 2024-05-09T06:30:30.842 INFO:tasks.workunit.client.1.smithi106.stdout:5/676: symlink d8/d5a/d60/lc9 0 2024-05-09T06:30:30.848 INFO:tasks.workunit.client.1.smithi106.stdout:0/691: dwrite d1/d11/d23/f64 [0,4194304] 0 2024-05-09T06:30:30.849 INFO:tasks.workunit.client.1.smithi106.stdout:6/702: unlink d0/d17/d76/f99 0 2024-05-09T06:30:30.851 INFO:tasks.workunit.client.1.smithi106.stdout:1/673: symlink d4/d76/d65/d8d/lec 0 2024-05-09T06:30:30.855 INFO:tasks.workunit.client.0.smithi046.stdout:1/41: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:30.855 INFO:tasks.workunit.client.0.smithi046.stdout:1/42: read - f6 zero size 2024-05-09T06:30:30.856 INFO:tasks.workunit.client.0.smithi046.stdout:6/219: dread f6 [0,4194304] 0 2024-05-09T06:30:30.856 INFO:tasks.workunit.client.0.smithi046.stdout:6/220: creat db/d10/d3f/d44/d46/f4d x:0 0 0 2024-05-09T06:30:30.856 INFO:tasks.workunit.client.1.smithi106.stdout:3/571: mknod d5/d1c/d21/d32/cb6 0 2024-05-09T06:30:30.860 INFO:tasks.workunit.client.1.smithi106.stdout:7/619: getdents d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87 0 2024-05-09T06:30:30.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/73: symlink da/l16 0 2024-05-09T06:30:30.869 INFO:tasks.workunit.client.1.smithi106.stdout:4/613: symlink d7/d39/d35/d7c/lc5 0 2024-05-09T06:30:30.872 INFO:tasks.workunit.client.0.smithi046.stdout:0/151: truncate d11/d18/f1a 1030395 0 2024-05-09T06:30:30.872 INFO:tasks.workunit.client.0.smithi046.stdout:0/152: creat d11/d18/d27/d28/f31 x:0 0 0 2024-05-09T06:30:30.872 INFO:tasks.workunit.client.0.smithi046.stdout:0/153: fdatasync d11/d18/d27/d28/f31 0 2024-05-09T06:30:30.878 INFO:tasks.workunit.client.1.smithi106.stdout:5/677: creat d8/d33/d3a/d59/fca x:0 0 0 2024-05-09T06:30:30.881 INFO:tasks.workunit.client.1.smithi106.stdout:5/678: dread d8/d5a/f73 [0,4194304] 0 2024-05-09T06:30:30.881 INFO:tasks.workunit.client.1.smithi106.stdout:5/679: creat d8/d5a/d60/fcb x:0 0 0 2024-05-09T06:30:30.886 INFO:tasks.workunit.client.1.smithi106.stdout:0/692: dwrite d1/d11/d23/f53 [0,4194304] 0 2024-05-09T06:30:30.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/43: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:30.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/44: write d7/fd [482902,46976] 0 2024-05-09T06:30:30.888 INFO:tasks.workunit.client.1.smithi106.stdout:3/572: dwrite d5/f3b [0,4194304] 0 2024-05-09T06:30:30.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/221: rename db/d10/l3b to db/d10/d3f/d44/l4e 0 2024-05-09T06:30:30.890 INFO:tasks.workunit.client.1.smithi106.stdout:6/703: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/ff1 x:0 0 0 2024-05-09T06:30:30.891 INFO:tasks.workunit.client.1.smithi106.stdout:6/704: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fe8 [258356,76298] 0 2024-05-09T06:30:30.893 INFO:tasks.workunit.client.1.smithi106.stdout:1/674: creat d4/d76/d65/d8d/fed x:0 0 0 2024-05-09T06:30:30.893 INFO:tasks.workunit.client.1.smithi106.stdout:1/675: chown d4/d76/d65/d8d/ce7 56612 1 2024-05-09T06:30:30.893 INFO:tasks.workunit.client.1.smithi106.stdout:7/620: dwrite d0/dc/d1a/d36/d30/d44/d6a/f9e [0,4194304] 0 2024-05-09T06:30:30.895 INFO:tasks.workunit.client.1.smithi106.stdout:8/578: sync 2024-05-09T06:30:30.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/45: dread f0 [0,4194304] 0 2024-05-09T06:30:30.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/154: getdents d11/d18 0 2024-05-09T06:30:30.900 INFO:tasks.workunit.client.0.smithi046.stdout:6/222: getdents db/d10/d3c 0 2024-05-09T06:30:30.906 INFO:tasks.workunit.client.0.smithi046.stdout:1/46: dread d7/fd [0,4194304] 0 2024-05-09T06:30:30.907 INFO:tasks.workunit.client.1.smithi106.stdout:1/676: dwrite d4/d37/d3d/f40 [0,4194304] 0 2024-05-09T06:30:30.908 INFO:tasks.workunit.client.0.smithi046.stdout:1/47: dread d7/fd [0,4194304] 0 2024-05-09T06:30:30.908 INFO:tasks.workunit.client.0.smithi046.stdout:1/48: chown d7/f8 488 1 2024-05-09T06:30:30.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/223: write db/f25 [3076622,53316] 0 2024-05-09T06:30:30.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/224: write f6 [939861,32064] 0 2024-05-09T06:30:30.916 INFO:tasks.workunit.client.1.smithi106.stdout:2/768: rmdir d2/d5/db 39 2024-05-09T06:30:30.916 INFO:tasks.workunit.client.1.smithi106.stdout:9/653: sync 2024-05-09T06:30:30.917 INFO:tasks.workunit.client.1.smithi106.stdout:4/614: mknod d7/d39/d35/d6f/d9d/cc6 0 2024-05-09T06:30:30.919 INFO:tasks.workunit.client.0.smithi046.stdout:6/225: unlink db/d10/d3f/f4c 0 2024-05-09T06:30:30.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/155: dwrite d11/d18/d27/d28/f2b [0,4194304] 0 2024-05-09T06:30:30.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/156: write d11/f24 [341955,1586] 0 2024-05-09T06:30:30.921 INFO:tasks.workunit.client.1.smithi106.stdout:5/680: mknod d8/d45/d4c/d32/d5b/d95/ccc 0 2024-05-09T06:30:30.922 INFO:tasks.workunit.client.0.smithi046.stdout:6/226: rmdir db/d10/d30 39 2024-05-09T06:30:30.925 INFO:tasks.workunit.client.1.smithi106.stdout:0/693: symlink d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/led 0 2024-05-09T06:30:30.925 INFO:tasks.workunit.client.1.smithi106.stdout:0/694: write d1/d11/d23/d22/f45 [143323,63198] 0 2024-05-09T06:30:30.936 INFO:tasks.workunit.client.1.smithi106.stdout:7/621: mknod d0/dc/d1a/d36/d30/d44/d6a/d72/cbd 0 2024-05-09T06:30:30.936 INFO:tasks.workunit.client.1.smithi106.stdout:7/622: chown d0/dc/d1a/d36/d30/d44/d58/d65 1259 1 2024-05-09T06:30:30.937 INFO:tasks.workunit.client.1.smithi106.stdout:8/579: rmdir d3/d5/d13 39 2024-05-09T06:30:30.937 INFO:tasks.workunit.client.1.smithi106.stdout:8/580: write d3/d5/d35/d4e/d32/d92/fbf [449931,37921] 0 2024-05-09T06:30:30.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/74: dwrite f4 [4194304,4194304] 0 2024-05-09T06:30:30.942 INFO:tasks.workunit.client.0.smithi046.stdout:1/49: dwrite f6 [0,4194304] 0 2024-05-09T06:30:30.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/227: dwrite db/d10/f16 [0,4194304] 0 2024-05-09T06:30:30.942 INFO:tasks.workunit.client.1.smithi106.stdout:5/681: dwrite d8/f5f [0,4194304] 0 2024-05-09T06:30:30.942 INFO:tasks.workunit.client.0.smithi046.stdout:1/50: write f0 [4324290,90799] 0 2024-05-09T06:30:30.946 INFO:tasks.workunit.client.1.smithi106.stdout:1/677: write d4/d76/d13/dbb/f81 [179471,123925] 0 2024-05-09T06:30:30.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/75: unlink f4 0 2024-05-09T06:30:30.948 INFO:tasks.workunit.client.1.smithi106.stdout:2/769: rmdir d2/d5/db/d1d/d6a 39 2024-05-09T06:30:30.951 INFO:tasks.workunit.client.1.smithi106.stdout:5/682: write d8/d33/d3a/d59/faf [4486204,68877] 0 2024-05-09T06:30:30.952 INFO:tasks.workunit.client.1.smithi106.stdout:9/654: mkdir d4/d54/d91/d9c/dbe 0 2024-05-09T06:30:30.952 INFO:tasks.workunit.client.1.smithi106.stdout:9/655: write d4/d54/d69/d99/d2a/d42/f4f [4276311,74591] 0 2024-05-09T06:30:30.953 INFO:tasks.workunit.client.1.smithi106.stdout:4/615: mkdir d7/d10/dc7 0 2024-05-09T06:30:30.953 INFO:tasks.workunit.client.1.smithi106.stdout:4/616: readlink d7/d39/d35/d7c/lc5 0 2024-05-09T06:30:30.953 INFO:tasks.workunit.client.1.smithi106.stdout:4/617: fdatasync d7/d28/d2a/d80/fa6 0 2024-05-09T06:30:30.957 INFO:tasks.workunit.client.1.smithi106.stdout:0/695: unlink d1/d11/d23/c25 0 2024-05-09T06:30:30.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/51: rename f0 to d7/fe 0 2024-05-09T06:30:30.962 INFO:tasks.workunit.client.1.smithi106.stdout:5/683: write d8/d45/d4c/d32/d5b/f1e [5439563,118218] 0 2024-05-09T06:30:30.962 INFO:tasks.workunit.client.1.smithi106.stdout:5/684: read d8/d45/d4c/d32/d5b/f2c [493521,97824] 0 2024-05-09T06:30:30.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/76: mknod da/c17 0 2024-05-09T06:30:30.965 INFO:tasks.workunit.client.1.smithi106.stdout:7/623: mkdir d0/da5/dbe 0 2024-05-09T06:30:30.968 INFO:tasks.workunit.client.1.smithi106.stdout:8/581: link d3/d5/d13/d3a/dbe/dc0/c64 d3/d5/d13/d3a/dbe/ccb 0 2024-05-09T06:30:30.970 INFO:tasks.workunit.client.0.smithi046.stdout:2/77: unlink da/c17 0 2024-05-09T06:30:30.970 INFO:tasks.workunit.client.0.smithi046.stdout:2/78: fdatasync f1 0 2024-05-09T06:30:30.974 INFO:tasks.workunit.client.1.smithi106.stdout:5/685: dread d8/d5a/d60/d7e/f82 [0,4194304] 0 2024-05-09T06:30:30.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/79: link l2 da/dc/l18 0 2024-05-09T06:30:30.976 INFO:tasks.workunit.client.1.smithi106.stdout:1/678: creat d4/d76/db3/fee x:0 0 0 2024-05-09T06:30:30.978 INFO:tasks.workunit.client.1.smithi106.stdout:7/624: write d0/dc/d1a/d5a/f6c [4123411,22062] 0 2024-05-09T06:30:30.979 INFO:tasks.workunit.client.1.smithi106.stdout:4/618: mkdir d7/d10/d1a/d5a/d7a/d7f/dc8 0 2024-05-09T06:30:30.979 INFO:tasks.workunit.client.1.smithi106.stdout:4/619: chown d7/d39/d35/d6f/d9d 1922 1 2024-05-09T06:30:30.979 INFO:tasks.workunit.client.0.smithi046.stdout:2/80: dread f1 [0,4194304] 0 2024-05-09T06:30:30.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/157: dwrite d11/d18/f1a [0,4194304] 0 2024-05-09T06:30:30.981 INFO:tasks.workunit.client.1.smithi106.stdout:0/696: creat d1/d11/d23/d13/d2c/d3d/dbe/fee x:0 0 0 2024-05-09T06:30:30.981 INFO:tasks.workunit.client.1.smithi106.stdout:2/770: dwrite d2/d7/db7/fa4 [0,4194304] 0 2024-05-09T06:30:30.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/656: dwrite d4/d54/d69/d95/d23/d16/f4c [0,4194304] 0 2024-05-09T06:30:30.982 INFO:tasks.workunit.client.1.smithi106.stdout:6/705: rename d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d6c to d0/d17/d34/dd0/df2 0 2024-05-09T06:30:30.982 INFO:tasks.workunit.client.1.smithi106.stdout:2/771: rename d2/d5/db/d15/d41 to d2/d5/db/d15/d41/d60/d10c 22 2024-05-09T06:30:30.982 INFO:tasks.workunit.client.1.smithi106.stdout:6/706: stat d0/d17/d34/d4e/d98/da9/db1/ce1 0 2024-05-09T06:30:30.983 INFO:tasks.workunit.client.1.smithi106.stdout:5/686: dread d8/d33/d3a/fb3 [0,4194304] 0 2024-05-09T06:30:30.985 INFO:tasks.workunit.client.1.smithi106.stdout:8/582: mkdir d3/d5/d35/d61/d6c/d83/dcc 0 2024-05-09T06:30:30.985 INFO:tasks.workunit.client.1.smithi106.stdout:8/583: creat d3/d5/d7/fcd x:0 0 0 2024-05-09T06:30:30.988 INFO:tasks.workunit.client.1.smithi106.stdout:1/679: link d4/d37/d74/l9d d4/lef 0 2024-05-09T06:30:30.988 INFO:tasks.workunit.client.1.smithi106.stdout:1/680: readlink d4/d76/d1d/l34 0 2024-05-09T06:30:30.989 INFO:tasks.workunit.client.0.smithi046.stdout:0/158: rename d11/d18/f23 to d11/d18/f32 0 2024-05-09T06:30:30.992 INFO:tasks.workunit.client.1.smithi106.stdout:6/707: read d0/d66/d7e/f2b [3737551,18491] 0 2024-05-09T06:30:30.992 INFO:tasks.workunit.client.1.smithi106.stdout:6/708: dread - d0/d17/d34/d4e/d98/fed zero size 2024-05-09T06:30:30.997 INFO:tasks.workunit.client.1.smithi106.stdout:7/625: symlink d0/dc/d1a/d36/d30/d44/lbf 0 2024-05-09T06:30:30.999 INFO:tasks.workunit.client.1.smithi106.stdout:4/620: mknod d7/d39/d35/d7c/da8/cc9 0 2024-05-09T06:30:31.000 INFO:tasks.workunit.client.1.smithi106.stdout:1/681: write d4/d37/d3d/f44 [2810924,67738] 0 2024-05-09T06:30:31.000 INFO:tasks.workunit.client.1.smithi106.stdout:1/682: write d4/d76/d65/d67/fb2 [1527304,31013] 0 2024-05-09T06:30:31.002 INFO:tasks.workunit.client.0.smithi046.stdout:2/81: rmdir da/de 39 2024-05-09T06:30:31.003 INFO:tasks.workunit.client.1.smithi106.stdout:0/697: dwrite d1/d11/d23/d13/f15 [0,4194304] 0 2024-05-09T06:30:31.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/159: rmdir d11/d18 39 2024-05-09T06:30:31.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/160: readlink d11/l17 0 2024-05-09T06:30:31.009 INFO:tasks.workunit.client.1.smithi106.stdout:1/683: dread d4/d37/d74/f86 [0,4194304] 0 2024-05-09T06:30:31.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/161: creat d11/d18/d27/f33 x:0 0 0 2024-05-09T06:30:31.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/162: truncate d11/f25 874084 0 2024-05-09T06:30:31.015 INFO:tasks.workunit.client.1.smithi106.stdout:8/584: dwrite d3/d5/d35/d4e/d32/d92/fbf [0,4194304] 0 2024-05-09T06:30:31.020 INFO:tasks.workunit.client.1.smithi106.stdout:9/657: mkdir d4/d54/d91/dbf 0 2024-05-09T06:30:31.021 INFO:tasks.workunit.client.1.smithi106.stdout:2/772: symlink d2/d5/db/d1d/d6a/l10d 0 2024-05-09T06:30:31.022 INFO:tasks.workunit.client.0.smithi046.stdout:2/82: dwrite da/dc/f13 [0,4194304] 0 2024-05-09T06:30:31.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/228: truncate db/d10/d19/f20 3087157 0 2024-05-09T06:30:31.024 INFO:tasks.workunit.client.1.smithi106.stdout:5/687: mknod d8/d33/d3a/d59/d99/ccd 0 2024-05-09T06:30:31.024 INFO:tasks.workunit.client.1.smithi106.stdout:5/688: chown d8/d33/d74/c7d 1713960 1 2024-05-09T06:30:31.028 INFO:tasks.workunit.client.1.smithi106.stdout:8/585: read d3/d5/d35/d4e/d32/d92/fbf [1016655,7751] 0 2024-05-09T06:30:31.030 INFO:tasks.workunit.client.1.smithi106.stdout:6/709: creat d0/d17/d34/d95/ff3 x:0 0 0 2024-05-09T06:30:31.030 INFO:tasks.workunit.client.0.smithi046.stdout:0/163: dwrite d11/d18/d1c/f1d [0,4194304] 0 2024-05-09T06:30:31.031 INFO:tasks.workunit.client.0.smithi046.stdout:6/229: mkdir db/d10/d3f/d4f 0 2024-05-09T06:30:31.035 INFO:tasks.workunit.client.1.smithi106.stdout:7/626: link d0/dc/d1a/d36/d1e/d68/f92 d0/dc/d1a/d36/d30/d44/d6a/d72/fc0 0 2024-05-09T06:30:31.035 INFO:tasks.workunit.client.1.smithi106.stdout:7/627: dread - d0/dc/d45/da6/faa zero size 2024-05-09T06:30:31.035 INFO:tasks.workunit.client.1.smithi106.stdout:2/773: dread d2/d5/db/d1d/d23/d63/fae [0,4194304] 0 2024-05-09T06:30:31.037 INFO:tasks.workunit.client.1.smithi106.stdout:4/621: mknod d7/d10/d1a/d5a/d7a/d7f/dc8/cca 0 2024-05-09T06:30:31.041 INFO:tasks.workunit.client.0.smithi046.stdout:0/164: symlink d11/d18/d27/d28/l34 0 2024-05-09T06:30:31.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/230: mknod db/d10/d3f/d44/c50 0 2024-05-09T06:30:31.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/231: truncate db/d10/d3c/f45 1015403 0 2024-05-09T06:30:31.049 INFO:tasks.workunit.client.1.smithi106.stdout:9/658: link d4/d54/d69/d95/d23/d2f/d31/d51/fba d4/d54/db3/db6/fc0 0 2024-05-09T06:30:31.051 INFO:tasks.workunit.client.1.smithi106.stdout:7/628: rmdir d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87 39 2024-05-09T06:30:31.053 INFO:tasks.workunit.client.1.smithi106.stdout:2/774: link d2/d5/db/d68/fc8 d2/d5/db/d15/d41/d58/f10e 0 2024-05-09T06:30:31.053 INFO:tasks.workunit.client.1.smithi106.stdout:5/689: dwrite d8/d45/d4c/f2e [0,4194304] 0 2024-05-09T06:30:31.054 INFO:tasks.workunit.client.1.smithi106.stdout:4/622: mkdir d7/dcb 0 2024-05-09T06:30:31.056 INFO:tasks.workunit.client.1.smithi106.stdout:1/684: rename d4/d76/d13/dbb/l52 to d4/d5b/lf0 0 2024-05-09T06:30:31.059 INFO:tasks.workunit.client.1.smithi106.stdout:8/586: rmdir d3/d5/d35/d61/d6c/d83/d89/d9b 39 2024-05-09T06:30:31.059 INFO:tasks.workunit.client.1.smithi106.stdout:8/587: fsync d3/d5/d7/f7f 0 2024-05-09T06:30:31.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/232: dread db/f23 [0,4194304] 0 2024-05-09T06:30:31.060 INFO:tasks.workunit.client.1.smithi106.stdout:7/629: truncate d0/f9 3510697 0 2024-05-09T06:30:31.061 INFO:tasks.workunit.client.1.smithi106.stdout:6/710: dwrite d0/d17/d76/f71 [0,4194304] 0 2024-05-09T06:30:31.062 INFO:tasks.workunit.client.1.smithi106.stdout:2/775: unlink d2/d5/db/d1d/d23/d63/ccd 0 2024-05-09T06:30:31.064 INFO:tasks.workunit.client.1.smithi106.stdout:5/690: creat d8/d5a/d60/d7e/fce x:0 0 0 2024-05-09T06:30:31.064 INFO:tasks.workunit.client.1.smithi106.stdout:3/573: sync 2024-05-09T06:30:31.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/83: dwrite da/dc/f13 [0,4194304] 0 2024-05-09T06:30:31.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/84: chown da/de/d14 107429596 1 2024-05-09T06:30:31.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/85: stat da/de 0 2024-05-09T06:30:31.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/165: dwrite d11/d18/d27/d28/f31 [0,4194304] 0 2024-05-09T06:30:31.067 INFO:tasks.workunit.client.1.smithi106.stdout:4/623: rename d7/d10/f51 to d7/d10/d1a/d5a/d1c/fcc 0 2024-05-09T06:30:31.067 INFO:tasks.workunit.client.0.smithi046.stdout:0/166: dread d11/f25 [0,4194304] 0 2024-05-09T06:30:31.068 INFO:tasks.workunit.client.1.smithi106.stdout:9/659: dwrite d4/d54/d69/d99/d2a/d42/d6c/d6d/fb5 [0,4194304] 0 2024-05-09T06:30:31.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/233: mknod db/d10/d30/c51 0 2024-05-09T06:30:31.071 INFO:tasks.workunit.client.1.smithi106.stdout:8/588: mknod d3/d5/d35/d73/cce 0 2024-05-09T06:30:31.071 INFO:tasks.workunit.client.1.smithi106.stdout:8/589: write d3/d5/d35/d4e/d32/f4a [2813182,32032] 0 2024-05-09T06:30:31.071 INFO:tasks.workunit.client.1.smithi106.stdout:8/590: chown d3/d6b/c91 319 1 2024-05-09T06:30:31.071 INFO:tasks.workunit.client.1.smithi106.stdout:8/591: write d3/d5/d35/d4e/d32/f7b [4024511,126975] 0 2024-05-09T06:30:31.071 INFO:tasks.workunit.client.1.smithi106.stdout:8/592: chown d3/d5/d35/d73/fa5 61256 1 2024-05-09T06:30:31.071 INFO:tasks.workunit.client.1.smithi106.stdout:8/593: fsync d3/d5/d7/fb5 0 2024-05-09T06:30:31.074 INFO:tasks.workunit.client.0.smithi046.stdout:2/86: write f6 [611682,111150] 0 2024-05-09T06:30:31.074 INFO:tasks.workunit.client.0.smithi046.stdout:2/87: write f6 [4754794,75859] 0 2024-05-09T06:30:31.075 INFO:tasks.workunit.client.1.smithi106.stdout:7/630: unlink d0/dc/d1a/d5a/f75 0 2024-05-09T06:30:31.078 INFO:tasks.workunit.client.1.smithi106.stdout:6/711: link d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fd5 d0/d5c/ff4 0 2024-05-09T06:30:31.078 INFO:tasks.workunit.client.1.smithi106.stdout:6/712: chown d0/d5c/f96 3932 1 2024-05-09T06:30:31.079 INFO:tasks.workunit.client.1.smithi106.stdout:4/624: dread d7/f9 [0,4194304] 0 2024-05-09T06:30:31.079 INFO:tasks.workunit.client.1.smithi106.stdout:4/625: stat d7/d10/d1a/fa2 0 2024-05-09T06:30:31.079 INFO:tasks.workunit.client.1.smithi106.stdout:4/626: write d7/d39/d35/d4a/f93 [811956,122388] 0 2024-05-09T06:30:31.079 INFO:tasks.workunit.client.1.smithi106.stdout:4/627: write d7/d39/d35/f99 [82588,97011] 0 2024-05-09T06:30:31.080 INFO:tasks.workunit.client.0.smithi046.stdout:0/167: creat d11/f35 x:0 0 0 2024-05-09T06:30:31.080 INFO:tasks.workunit.client.0.smithi046.stdout:2/88: fsync da/dc/f13 0 2024-05-09T06:30:31.080 INFO:tasks.workunit.client.0.smithi046.stdout:2/89: stat f3 0 2024-05-09T06:30:31.082 INFO:tasks.workunit.client.1.smithi106.stdout:5/691: dwrite d8/d45/f70 [0,4194304] 0 2024-05-09T06:30:31.083 INFO:tasks.workunit.client.1.smithi106.stdout:5/692: chown d8/f50 23 1 2024-05-09T06:30:31.083 INFO:tasks.workunit.client.0.smithi046.stdout:6/234: creat db/d10/d30/f52 x:0 0 0 2024-05-09T06:30:31.085 INFO:tasks.workunit.client.1.smithi106.stdout:3/574: link d5/d1c/d24/c31 d5/d4d/d7a/da9/da8/cb7 0 2024-05-09T06:30:31.085 INFO:tasks.workunit.client.1.smithi106.stdout:3/575: chown d5/d1c/l44 4 1 2024-05-09T06:30:31.086 INFO:tasks.workunit.client.0.smithi046.stdout:0/168: mkdir d11/d18/d27/d28/d36 0 2024-05-09T06:30:31.087 INFO:tasks.workunit.client.1.smithi106.stdout:1/685: rename d4/d76/d13/f3e to d4/d76/d65/ff1 0 2024-05-09T06:30:31.089 INFO:tasks.workunit.client.1.smithi106.stdout:9/660: rmdir d4/d54/db3 39 2024-05-09T06:30:31.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/90: mknod da/dc/c19 0 2024-05-09T06:30:31.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/91: readlink da/dc/l12 0 2024-05-09T06:30:31.091 INFO:tasks.workunit.client.0.smithi046.stdout:6/235: mkdir db/d10/d30/d53 0 2024-05-09T06:30:31.095 INFO:tasks.workunit.client.1.smithi106.stdout:7/631: mkdir d0/dc/d1a/d36/d30/d44/dc1 0 2024-05-09T06:30:31.095 INFO:tasks.workunit.client.1.smithi106.stdout:7/632: chown d0/dc/d1a/d36/d30/d44/d6a/d72 69547169 1 2024-05-09T06:30:31.095 INFO:tasks.workunit.client.1.smithi106.stdout:7/633: creat d0/dc/d1a/d36/fc2 x:0 0 0 2024-05-09T06:30:31.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/92: mknod da/de/d14/c1a 0 2024-05-09T06:30:31.097 INFO:tasks.workunit.client.1.smithi106.stdout:6/713: truncate d0/d17/d34/d4e/d98/da9/db1/d8/d27/f3a 789366 0 2024-05-09T06:30:31.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/236: creat db/d10/d19/f54 x:0 0 0 2024-05-09T06:30:31.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/237: write db/fd [4801273,117655] 0 2024-05-09T06:30:31.101 INFO:tasks.workunit.client.1.smithi106.stdout:2/776: getdents d2/d5 0 2024-05-09T06:30:31.101 INFO:tasks.workunit.client.1.smithi106.stdout:2/777: readlink d2/d5/db/d1d/lc9 0 2024-05-09T06:30:31.101 INFO:tasks.workunit.client.1.smithi106.stdout:2/778: write d2/d5/db/d68/fc8 [2774325,79058] 0 2024-05-09T06:30:31.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/169: getdents d11/d18/d27/d28/d2d 0 2024-05-09T06:30:31.105 INFO:tasks.workunit.client.1.smithi106.stdout:6/714: dread d0/d17/d34/d4e/d98/da9/db1/f5d [0,4194304] 0 2024-05-09T06:30:31.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/93: creat da/de/d14/f1b x:0 0 0 2024-05-09T06:30:31.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/94: dread - da/db/f15 zero size 2024-05-09T06:30:31.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/95: dread - da/db/f15 zero size 2024-05-09T06:30:31.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/96: mkdir da/de/d1c 0 2024-05-09T06:30:31.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/97: read f1 [1533596,91864] 0 2024-05-09T06:30:31.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/98: write da/dc/f13 [5204081,94732] 0 2024-05-09T06:30:31.114 INFO:tasks.workunit.client.0.smithi046.stdout:6/238: dread db/f28 [0,4194304] 0 2024-05-09T06:30:31.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/779: write d2/d5/db/d1d/d90/faa [3432482,106082] 0 2024-05-09T06:30:31.117 INFO:tasks.workunit.client.1.smithi106.stdout:7/634: dwrite d0/f13 [0,4194304] 0 2024-05-09T06:30:31.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/780: getdents d2/d5 0 2024-05-09T06:30:31.117 INFO:tasks.workunit.client.1.smithi106.stdout:7/635: stat d0/da5/dbe 0 2024-05-09T06:30:31.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/781: chown d2/f8d 75 1 2024-05-09T06:30:31.121 INFO:tasks.workunit.client.0.smithi046.stdout:2/99: rmdir da/db 39 2024-05-09T06:30:31.121 INFO:tasks.workunit.client.0.smithi046.stdout:2/100: write da/db/f15 [298042,16178] 0 2024-05-09T06:30:31.122 INFO:tasks.workunit.client.1.smithi106.stdout:5/693: truncate d8/f51 7459922 0 2024-05-09T06:30:31.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/239: dread db/d10/f1e [0,4194304] 0 2024-05-09T06:30:31.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/101: mknod da/de/d1c/c1d 0 2024-05-09T06:30:31.126 INFO:tasks.workunit.client.1.smithi106.stdout:3/576: getdents d5/d12/d65/d81/d92 0 2024-05-09T06:30:31.126 INFO:tasks.workunit.client.1.smithi106.stdout:3/577: stat d5/d1c/d24/d98/faa 0 2024-05-09T06:30:31.127 INFO:tasks.workunit.client.0.smithi046.stdout:0/170: dwrite fc [0,4194304] 0 2024-05-09T06:30:31.128 INFO:tasks.workunit.client.1.smithi106.stdout:8/594: rename d3/d5/d35/d4e/d32/f7b to d3/d5/d7/d15/d47/fcf 0 2024-05-09T06:30:31.128 INFO:tasks.workunit.client.1.smithi106.stdout:8/595: chown d3/d5/d35/d61/d6c/d83/f8f 107362987 1 2024-05-09T06:30:31.129 INFO:tasks.workunit.client.0.smithi046.stdout:2/102: dread f1 [0,4194304] 0 2024-05-09T06:30:31.130 INFO:tasks.workunit.client.1.smithi106.stdout:9/661: creat d4/d54/d69/d99/fc1 x:0 0 0 2024-05-09T06:30:31.130 INFO:tasks.workunit.client.1.smithi106.stdout:9/662: truncate d4/d54/d69/d95/d23/d2f/d31/f33 4455153 0 2024-05-09T06:30:31.130 INFO:tasks.workunit.client.1.smithi106.stdout:9/663: creat d4/d54/d69/d99/d2a/d42/d6c/fc2 x:0 0 0 2024-05-09T06:30:31.136 INFO:tasks.workunit.client.1.smithi106.stdout:8/596: read d3/d5/d7/f7f [2543307,32777] 0 2024-05-09T06:30:31.136 INFO:tasks.workunit.client.1.smithi106.stdout:8/597: write d3/d5/d7/f44 [2197106,18297] 0 2024-05-09T06:30:31.136 INFO:tasks.workunit.client.1.smithi106.stdout:8/598: chown d3/l71 502391169 1 2024-05-09T06:30:31.136 INFO:tasks.workunit.client.1.smithi106.stdout:8/599: chown d3/d5/d35/d61/d6c/d83/d89/cb8 0 1 2024-05-09T06:30:31.136 INFO:tasks.workunit.client.1.smithi106.stdout:8/600: readlink d3/d5/d35/d4e/lab 0 2024-05-09T06:30:31.136 INFO:tasks.workunit.client.1.smithi106.stdout:8/601: write d3/d5/d7/fb7 [387921,708] 0 2024-05-09T06:30:31.137 INFO:tasks.workunit.client.1.smithi106.stdout:9/664: dread d4/d54/d69/d95/d23/d2f/d39/f60 [0,4194304] 0 2024-05-09T06:30:31.138 INFO:tasks.workunit.client.0.smithi046.stdout:6/240: dread db/fd [0,4194304] 0 2024-05-09T06:30:31.139 INFO:tasks.workunit.client.0.smithi046.stdout:2/103: creat da/de/f1e x:0 0 0 2024-05-09T06:30:31.143 INFO:tasks.workunit.client.1.smithi106.stdout:7/636: creat d0/d53/fc3 x:0 0 0 2024-05-09T06:30:31.143 INFO:tasks.workunit.client.1.smithi106.stdout:7/637: write d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/fa9 [1005893,117789] 0 2024-05-09T06:30:31.145 INFO:tasks.workunit.client.0.smithi046.stdout:0/171: rmdir d11 39 2024-05-09T06:30:31.145 INFO:tasks.workunit.client.1.smithi106.stdout:0/698: sync 2024-05-09T06:30:31.147 INFO:tasks.workunit.client.1.smithi106.stdout:3/578: mknod d5/d4d/d7a/da9/cb8 0 2024-05-09T06:30:31.150 INFO:tasks.workunit.client.0.smithi046.stdout:2/104: mkdir da/de/d14/d1f 0 2024-05-09T06:30:31.150 INFO:tasks.workunit.client.1.smithi106.stdout:1/686: rename d4/dbd/ccf to d4/d76/d13/d60/d9c/de4/cf2 0 2024-05-09T06:30:31.153 INFO:tasks.workunit.client.1.smithi106.stdout:8/602: mknod d3/d5/d35/d73/cd0 0 2024-05-09T06:30:31.157 INFO:tasks.workunit.client.1.smithi106.stdout:9/665: link d4/d54/d69/d95/f15 d4/d54/d69/d99/d2a/d42/fc3 0 2024-05-09T06:30:31.158 INFO:tasks.workunit.client.1.smithi106.stdout:7/638: mkdir d0/dc/d1a/d36/d30/d44/d6a/d72/dc4 0 2024-05-09T06:30:31.159 INFO:tasks.workunit.client.1.smithi106.stdout:0/699: symlink d1/d11/d23/d13/d58/lef 0 2024-05-09T06:30:31.160 INFO:tasks.workunit.client.1.smithi106.stdout:3/579: truncate d5/d1c/f1e 1262658 0 2024-05-09T06:30:31.163 INFO:tasks.workunit.client.1.smithi106.stdout:2/782: rename d2/d5/db/d1d/d23/d63/d7a/cd4 to d2/d5/d9c/dd3/c10f 0 2024-05-09T06:30:31.163 INFO:tasks.workunit.client.1.smithi106.stdout:2/783: truncate d2/f8d 2146443 0 2024-05-09T06:30:31.164 INFO:tasks.workunit.client.1.smithi106.stdout:1/687: symlink d4/dbd/lf3 0 2024-05-09T06:30:31.164 INFO:tasks.workunit.client.0.smithi046.stdout:6/241: dwrite db/d10/d3f/d44/f48 [0,4194304] 0 2024-05-09T06:30:31.165 INFO:tasks.workunit.client.0.smithi046.stdout:0/172: dwrite d11/d18/f32 [0,4194304] 0 2024-05-09T06:30:31.165 INFO:tasks.workunit.client.0.smithi046.stdout:0/173: stat fe 0 2024-05-09T06:30:31.166 INFO:tasks.workunit.client.1.smithi106.stdout:8/603: creat d3/d5/d35/d73/d9d/da9/dbd/fd1 x:0 0 0 2024-05-09T06:30:31.166 INFO:tasks.workunit.client.1.smithi106.stdout:8/604: write d3/d5/d35/d61/d6c/fa6 [5064624,82919] 0 2024-05-09T06:30:31.168 INFO:tasks.workunit.client.1.smithi106.stdout:9/666: creat d4/d54/db3/fc4 x:0 0 0 2024-05-09T06:30:31.168 INFO:tasks.workunit.client.1.smithi106.stdout:0/700: dread d1/d11/d23/d13/d2c/d3d/f82 [0,4194304] 0 2024-05-09T06:30:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/242: dread db/d10/d19/f20 [0,4194304] 0 2024-05-09T06:30:31.173 INFO:tasks.workunit.client.1.smithi106.stdout:7/639: mkdir d0/dc/d45/da6/dc5 0 2024-05-09T06:30:31.173 INFO:tasks.workunit.client.1.smithi106.stdout:7/640: truncate d0/fbb 998708 0 2024-05-09T06:30:31.173 INFO:tasks.workunit.client.1.smithi106.stdout:7/641: chown d0/dc/d1a/d36/d30/f64 60876 1 2024-05-09T06:30:31.173 INFO:tasks.workunit.client.1.smithi106.stdout:7/642: readlink d0/dc/d1a/d36/d30/l4b 0 2024-05-09T06:30:31.175 INFO:tasks.workunit.client.1.smithi106.stdout:1/688: dread d4/d76/d13/f25 [0,4194304] 0 2024-05-09T06:30:31.175 INFO:tasks.workunit.client.1.smithi106.stdout:3/580: rename d5/d1c/l44 to d5/d1c/lb9 0 2024-05-09T06:30:31.177 INFO:tasks.workunit.client.1.smithi106.stdout:2/784: truncate d2/d7/db7/f8f 247954 0 2024-05-09T06:30:31.182 INFO:tasks.workunit.client.0.smithi046.stdout:0/174: creat d11/d18/d27/d28/d36/f37 x:0 0 0 2024-05-09T06:30:31.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/243: unlink db/d10/d19/f2a 0 2024-05-09T06:30:31.187 INFO:tasks.workunit.client.1.smithi106.stdout:1/689: write d4/f1f [3925305,121682] 0 2024-05-09T06:30:31.187 INFO:tasks.workunit.client.1.smithi106.stdout:1/690: chown d4/d5b/f8c 1 1 2024-05-09T06:30:31.188 INFO:tasks.workunit.client.0.smithi046.stdout:0/175: symlink d11/d18/d1c/l38 0 2024-05-09T06:30:31.189 INFO:tasks.workunit.client.1.smithi106.stdout:8/605: dwrite d3/d5/d35/d73/d9d/da9/dbd/fd1 [0,4194304] 0 2024-05-09T06:30:31.189 INFO:tasks.workunit.client.1.smithi106.stdout:8/606: creat d3/d5/d35/d61/d6c/d83/d89/fd2 x:0 0 0 2024-05-09T06:30:31.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/105: dwrite da/dc/f13 [0,4194304] 0 2024-05-09T06:30:31.190 INFO:tasks.workunit.client.0.smithi046.stdout:2/106: write da/db/f15 [69508,49588] 0 2024-05-09T06:30:31.191 INFO:tasks.workunit.client.0.smithi046.stdout:6/244: mknod db/c55 0 2024-05-09T06:30:31.191 INFO:tasks.workunit.client.0.smithi046.stdout:6/245: chown db/d10/d3c 0 1 2024-05-09T06:30:31.191 INFO:tasks.workunit.client.1.smithi106.stdout:8/607: write d3/d5/d35/d61/d6c/d83/d89/fb0 [1127588,61973] 0 2024-05-09T06:30:31.191 INFO:tasks.workunit.client.1.smithi106.stdout:8/608: stat d3/d5/d7/d98/fae 0 2024-05-09T06:30:31.194 INFO:tasks.workunit.client.0.smithi046.stdout:0/176: rename d11/d18/d27/d28/f2b to d11/d18/f39 0 2024-05-09T06:30:31.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/107: mkdir da/de/d14/d1f/d20 0 2024-05-09T06:30:31.198 INFO:tasks.workunit.client.1.smithi106.stdout:9/667: link d4/d54/d69/d99/d2a/f20 d4/d54/db3/fc5 0 2024-05-09T06:30:31.199 INFO:tasks.workunit.client.0.smithi046.stdout:6/246: creat db/d10/d3f/f56 x:0 0 0 2024-05-09T06:30:31.201 INFO:tasks.workunit.client.1.smithi106.stdout:0/701: creat d1/d11/d23/d13/d58/da8/ff0 x:0 0 0 2024-05-09T06:30:31.202 INFO:tasks.workunit.client.1.smithi106.stdout:1/691: dwrite d4/d5b/f9f [0,4194304] 0 2024-05-09T06:30:31.202 INFO:tasks.workunit.client.1.smithi106.stdout:1/692: creat d4/d76/d13/d2f/db4/ff4 x:0 0 0 2024-05-09T06:30:31.202 INFO:tasks.workunit.client.1.smithi106.stdout:1/693: write d4/d5b/f9f [4948207,13760] 0 2024-05-09T06:30:31.202 INFO:tasks.workunit.client.1.smithi106.stdout:1/694: readlink d4/d76/d65/d67/le2 0 2024-05-09T06:30:31.202 INFO:tasks.workunit.client.1.smithi106.stdout:1/695: truncate d4/d5b/d75/fb9 810606 0 2024-05-09T06:30:31.203 INFO:tasks.workunit.client.0.smithi046.stdout:0/177: creat d11/d18/f3a x:0 0 0 2024-05-09T06:30:31.203 INFO:tasks.workunit.client.0.smithi046.stdout:0/178: creat d11/d18/f3b x:0 0 0 2024-05-09T06:30:31.203 INFO:tasks.workunit.client.1.smithi106.stdout:7/643: mknod d0/dc/cc6 0 2024-05-09T06:30:31.204 INFO:tasks.workunit.client.0.smithi046.stdout:2/108: getdents da/de/d14 0 2024-05-09T06:30:31.204 INFO:tasks.workunit.client.0.smithi046.stdout:2/109: truncate f6 5751010 0 2024-05-09T06:30:31.206 INFO:tasks.workunit.client.1.smithi106.stdout:3/581: creat d5/d4d/d72/fba x:0 0 0 2024-05-09T06:30:31.207 INFO:tasks.workunit.client.1.smithi106.stdout:3/582: chown d5/d3f/cac 1633005 1 2024-05-09T06:30:31.209 INFO:tasks.workunit.client.1.smithi106.stdout:2/785: symlink d2/d5/db/d1d/d23/d5e/de8/l110 0 2024-05-09T06:30:31.212 INFO:tasks.workunit.client.0.smithi046.stdout:0/179: creat d11/d18/d27/f3c x:0 0 0 2024-05-09T06:30:31.214 INFO:tasks.workunit.client.1.smithi106.stdout:3/583: dread d5/d1c/d24/f28 [4194304,4194304] 0 2024-05-09T06:30:31.215 INFO:tasks.workunit.client.0.smithi046.stdout:2/110: mknod da/de/d14/d1f/c21 0 2024-05-09T06:30:31.216 INFO:tasks.workunit.client.1.smithi106.stdout:7/644: dread d0/dc/d1a/d36/d30/d44/d6a/f6d [0,4194304] 0 2024-05-09T06:30:31.224 INFO:tasks.workunit.client.1.smithi106.stdout:8/609: rename d3/d5/d35/d61/d82/da1 to d3/d5/d35/d4e/d32/dd3 0 2024-05-09T06:30:31.228 INFO:tasks.workunit.client.1.smithi106.stdout:5/694: truncate d8/d33/d3a/d59/faf 2530987 0 2024-05-09T06:30:31.229 INFO:tasks.workunit.client.0.smithi046.stdout:6/247: rmdir db 39 2024-05-09T06:30:31.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/180: symlink d11/d18/d27/l3d 0 2024-05-09T06:30:31.232 INFO:tasks.workunit.client.1.smithi106.stdout:1/696: mkdir d4/d76/d13/d2f/df5 0 2024-05-09T06:30:31.232 INFO:tasks.workunit.client.1.smithi106.stdout:1/697: fsync d4/d5/f50 0 2024-05-09T06:30:31.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/111: link da/dc/c19 da/db/c22 0 2024-05-09T06:30:31.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/248: mkdir db/d10/d57 0 2024-05-09T06:30:31.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/181: creat d11/d18/d27/d28/d2d/f3e x:0 0 0 2024-05-09T06:30:31.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/182: fsync d11/f12 0 2024-05-09T06:30:31.241 INFO:tasks.workunit.client.0.smithi046.stdout:2/112: mknod da/de/d14/d1f/c23 0 2024-05-09T06:30:31.241 INFO:tasks.workunit.client.0.smithi046.stdout:2/113: truncate da/de/d14/f1b 160447 0 2024-05-09T06:30:31.241 INFO:tasks.workunit.client.1.smithi106.stdout:4/628: sync 2024-05-09T06:30:31.242 INFO:tasks.workunit.client.1.smithi106.stdout:2/786: getdents d2/d5/db/d15/dd6/deb 0 2024-05-09T06:30:31.242 INFO:tasks.workunit.client.1.smithi106.stdout:8/610: dwrite d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:31.244 INFO:tasks.workunit.client.0.smithi046.stdout:6/249: truncate db/f1f 2283965 0 2024-05-09T06:30:31.248 INFO:tasks.workunit.client.1.smithi106.stdout:3/584: mkdir d5/d1c/d24/d89/d8c/dbb 0 2024-05-09T06:30:31.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/183: mkdir d11/d3f 0 2024-05-09T06:30:31.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/184: fdatasync d11/d18/d27/d28/d36/f37 0 2024-05-09T06:30:31.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/185: fdatasync d11/d18/f1e 0 2024-05-09T06:30:31.250 INFO:tasks.workunit.client.1.smithi106.stdout:7/645: rmdir d0/dc/d1a/d36/d30/d44/d6a 39 2024-05-09T06:30:31.251 INFO:tasks.workunit.client.1.smithi106.stdout:6/715: sync 2024-05-09T06:30:31.251 INFO:tasks.workunit.client.1.smithi106.stdout:5/695: dread d8/d33/d3a/d59/faf [0,4194304] 0 2024-05-09T06:30:31.251 INFO:tasks.workunit.client.1.smithi106.stdout:6/716: write d0/d66/d7e/f77 [492468,38066] 0 2024-05-09T06:30:31.251 INFO:tasks.workunit.client.1.smithi106.stdout:5/696: truncate d8/d33/d3a/fb3 4520959 0 2024-05-09T06:30:31.251 INFO:tasks.workunit.client.1.smithi106.stdout:6/717: truncate d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/fc8 990776 0 2024-05-09T06:30:31.252 INFO:tasks.workunit.client.1.smithi106.stdout:9/668: rename d4/d54/d69/d95/d23/d2f/d38/d86 to d4/d54/d69/d95/d23/dc6 0 2024-05-09T06:30:31.252 INFO:tasks.workunit.client.1.smithi106.stdout:9/669: chown d4/d54/d69/d99/d2a/f7d 2164005 1 2024-05-09T06:30:31.253 INFO:tasks.workunit.client.1.smithi106.stdout:2/787: write d2/d5/db/d15/d41/d58/f45 [7850187,36174] 0 2024-05-09T06:30:31.253 INFO:tasks.workunit.client.1.smithi106.stdout:3/585: dread d5/d4d/d5f/fa5 [0,4194304] 0 2024-05-09T06:30:31.254 INFO:tasks.workunit.client.1.smithi106.stdout:3/586: truncate d5/d1c/d24/d5b/f61 629179 0 2024-05-09T06:30:31.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/186: unlink d11/d18/d27/l3d 0 2024-05-09T06:30:31.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/187: creat d11/d18/d27/d28/d2d/f40 x:0 0 0 2024-05-09T06:30:31.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/188: chown d11/d18/d27/d28/d2d/f30 381 1 2024-05-09T06:30:31.256 INFO:tasks.workunit.client.0.smithi046.stdout:2/114: dwrite da/de/f1e [0,4194304] 0 2024-05-09T06:30:31.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/250: dread db/f23 [0,4194304] 0 2024-05-09T06:30:31.259 INFO:tasks.workunit.client.1.smithi106.stdout:4/629: creat d7/d39/d35/d6f/d9d/fcd x:0 0 0 2024-05-09T06:30:31.259 INFO:tasks.workunit.client.1.smithi106.stdout:4/630: readlink d7/l3d 0 2024-05-09T06:30:31.264 INFO:tasks.workunit.client.0.smithi046.stdout:0/189: symlink d11/d18/d27/d28/d36/l41 0 2024-05-09T06:30:31.266 INFO:tasks.workunit.client.1.smithi106.stdout:8/611: creat d3/d5/d13/d3a/dbe/dc0/fd4 x:0 0 0 2024-05-09T06:30:31.267 INFO:tasks.workunit.client.1.smithi106.stdout:8/612: read d3/d5/d13/d3a/f77 [108708,117777] 0 2024-05-09T06:30:31.267 INFO:tasks.workunit.client.1.smithi106.stdout:8/613: creat d3/d5/d35/d73/fd5 x:0 0 0 2024-05-09T06:30:31.269 INFO:tasks.workunit.client.1.smithi106.stdout:8/614: read d3/d5/d13/d3a/dbe/dc0/fb6 [420256,47493] 0 2024-05-09T06:30:31.269 INFO:tasks.workunit.client.1.smithi106.stdout:6/718: mknod d0/d17/d34/d4e/deb/cf5 0 2024-05-09T06:30:31.269 INFO:tasks.workunit.client.1.smithi106.stdout:5/697: dwrite d8/d45/d4c/f5c [0,4194304] 0 2024-05-09T06:30:31.271 INFO:tasks.workunit.client.1.smithi106.stdout:0/702: rename d1/d11/d23/d13/d2c/d6d/d70/f9d to d1/d11/d23/d13/d58/da8/ff1 0 2024-05-09T06:30:31.271 INFO:tasks.workunit.client.1.smithi106.stdout:0/703: truncate d1/d11/d23/d13/d2c/f2f 621095 0 2024-05-09T06:30:31.273 INFO:tasks.workunit.client.0.smithi046.stdout:2/115: rename f9 to da/dc/f24 0 2024-05-09T06:30:31.274 INFO:tasks.workunit.client.0.smithi046.stdout:2/116: read da/de/d14/f1b [125447,37544] 0 2024-05-09T06:30:31.277 INFO:tasks.workunit.client.1.smithi106.stdout:2/788: unlink d2/d5/db/d15/d41/d58/fee 0 2024-05-09T06:30:31.278 INFO:tasks.workunit.client.0.smithi046.stdout:6/251: mknod db/d10/d3f/c58 0 2024-05-09T06:30:31.280 INFO:tasks.workunit.client.1.smithi106.stdout:3/587: link d5/d1c/d24/l36 d5/d1c/d21/lbc 0 2024-05-09T06:30:31.281 INFO:tasks.workunit.client.0.smithi046.stdout:0/190: mknod d11/d18/d1c/c42 0 2024-05-09T06:30:31.281 INFO:tasks.workunit.client.0.smithi046.stdout:0/191: dread - d11/f22 zero size 2024-05-09T06:30:31.281 INFO:tasks.workunit.client.1.smithi106.stdout:1/698: truncate d4/d76/d13/dbb/f87 2084470 0 2024-05-09T06:30:31.283 INFO:tasks.workunit.client.1.smithi106.stdout:4/631: mknod d7/dcb/cce 0 2024-05-09T06:30:31.285 INFO:tasks.workunit.client.1.smithi106.stdout:6/719: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/f70 [0,4194304] 0 2024-05-09T06:30:31.285 INFO:tasks.workunit.client.0.smithi046.stdout:2/117: creat da/de/d14/d1f/f25 x:0 0 0 2024-05-09T06:30:31.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/118: chown da/dc/f24 625 1 2024-05-09T06:30:31.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/119: read f1 [763078,31877] 0 2024-05-09T06:30:31.287 INFO:tasks.workunit.client.1.smithi106.stdout:6/720: dread d0/d17/d34/d4e/d98/fdf [0,4194304] 0 2024-05-09T06:30:31.290 INFO:tasks.workunit.client.0.smithi046.stdout:6/252: unlink db/d10/d3f/l31 0 2024-05-09T06:30:31.293 INFO:tasks.workunit.client.1.smithi106.stdout:8/615: creat d3/d5/d35/d73/d9d/da9/fd6 x:0 0 0 2024-05-09T06:30:31.294 INFO:tasks.workunit.client.1.smithi106.stdout:4/632: write d7/d39/d47/d66/f87 [1419033,104003] 0 2024-05-09T06:30:31.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/192: rename d11/d18/d27/d28/l34 to d11/d18/d27/d28/l43 0 2024-05-09T06:30:31.296 INFO:tasks.workunit.client.0.smithi046.stdout:2/120: mkdir da/de/d14/d1f/d20/d26 0 2024-05-09T06:30:31.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/121: dread da/db/f15 [0,4194304] 0 2024-05-09T06:30:31.298 INFO:tasks.workunit.client.1.smithi106.stdout:5/698: creat d8/d5a/d60/da8/fcf x:0 0 0 2024-05-09T06:30:31.298 INFO:tasks.workunit.client.1.smithi106.stdout:5/699: readlink d8/d45/d4c/l31 0 2024-05-09T06:30:31.299 INFO:tasks.workunit.client.1.smithi106.stdout:1/699: dwrite d4/d76/d13/d2f/db4/ff4 [0,4194304] 0 2024-05-09T06:30:31.300 INFO:tasks.workunit.client.1.smithi106.stdout:7/646: rename d0/dc/d1a/d36/d30/d44/d58/d65/f99 to d0/dc/d1a/fc7 0 2024-05-09T06:30:31.301 INFO:tasks.workunit.client.1.smithi106.stdout:7/647: readlink d0/dc/d1a/d36/d30/d44/d58/l60 0 2024-05-09T06:30:31.301 INFO:tasks.workunit.client.1.smithi106.stdout:0/704: rmdir d1/d11/d23/d13/d58 39 2024-05-09T06:30:31.302 INFO:tasks.workunit.client.0.smithi046.stdout:0/193: getdents d11/d18/d27/d28/d36 0 2024-05-09T06:30:31.303 INFO:tasks.workunit.client.1.smithi106.stdout:2/789: symlink d2/d5/db/d15/dd6/d109/l111 0 2024-05-09T06:30:31.303 INFO:tasks.workunit.client.0.smithi046.stdout:0/194: creat d11/d18/d1c/f44 x:0 0 0 2024-05-09T06:30:31.304 INFO:tasks.workunit.client.1.smithi106.stdout:3/588: symlink d5/d1c/d24/d89/d8e/lbd 0 2024-05-09T06:30:31.304 INFO:tasks.workunit.client.1.smithi106.stdout:3/589: fsync d5/d12/f23 0 2024-05-09T06:30:31.304 INFO:tasks.workunit.client.1.smithi106.stdout:3/590: fsync d5/d4d/faf 0 2024-05-09T06:30:31.304 INFO:tasks.workunit.client.1.smithi106.stdout:3/591: stat d5/d1c/d24/d89/la7 0 2024-05-09T06:30:31.305 INFO:tasks.workunit.client.1.smithi106.stdout:6/721: unlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/fc9 0 2024-05-09T06:30:31.306 INFO:tasks.workunit.client.0.smithi046.stdout:0/195: symlink d11/d3f/l45 0 2024-05-09T06:30:31.306 INFO:tasks.workunit.client.0.smithi046.stdout:0/196: chown d11/d18/d1c/l38 21471776 1 2024-05-09T06:30:31.306 INFO:tasks.workunit.client.1.smithi106.stdout:8/616: mkdir d3/d5/d35/d73/d9d/da9/dbd/dd7 0 2024-05-09T06:30:31.308 INFO:tasks.workunit.client.1.smithi106.stdout:5/700: unlink d8/d33/d3a/f65 0 2024-05-09T06:30:31.309 INFO:tasks.workunit.client.1.smithi106.stdout:7/648: write d0/dc/d1a/d36/d1e/f4c [453024,110845] 0 2024-05-09T06:30:31.311 INFO:tasks.workunit.client.1.smithi106.stdout:0/705: unlink d1/d11/d23/d13/d8a/lae 0 2024-05-09T06:30:31.311 INFO:tasks.workunit.client.1.smithi106.stdout:0/706: readlink d1/d11/l16 0 2024-05-09T06:30:31.311 INFO:tasks.workunit.client.1.smithi106.stdout:2/790: creat d2/d5/db/d15/d41/d58/ddf/f112 x:0 0 0 2024-05-09T06:30:31.312 INFO:tasks.workunit.client.1.smithi106.stdout:6/722: truncate d0/f30 11900264 0 2024-05-09T06:30:31.313 INFO:tasks.workunit.client.1.smithi106.stdout:7/649: creat d0/dc/d1a/d36/d30/d44/d6a/d72/dc4/fc8 x:0 0 0 2024-05-09T06:30:31.313 INFO:tasks.workunit.client.1.smithi106.stdout:7/650: truncate d0/dc/d1a/d36/d30/fb8 271196 0 2024-05-09T06:30:31.314 INFO:tasks.workunit.client.1.smithi106.stdout:0/707: mkdir d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/df2 0 2024-05-09T06:30:31.315 INFO:tasks.workunit.client.1.smithi106.stdout:7/651: mkdir d0/dc/d1a/d36/d1e/d68/dc9 0 2024-05-09T06:30:31.316 INFO:tasks.workunit.client.1.smithi106.stdout:9/670: rename d4/d54/d69/d95/d23/d2f/d31/d51 to d4/d54/d91/dc7 0 2024-05-09T06:30:31.316 INFO:tasks.workunit.client.1.smithi106.stdout:7/652: dread d0/dc/d1a/d5a/f94 [0,4194304] 0 2024-05-09T06:30:31.316 INFO:tasks.workunit.client.1.smithi106.stdout:8/617: write d3/d5/d13/f36 [135852,5633] 0 2024-05-09T06:30:31.317 INFO:tasks.workunit.client.1.smithi106.stdout:4/633: rename d7/d10/dc7 to d7/d28/d2a/d80/dcf 0 2024-05-09T06:30:31.318 INFO:tasks.workunit.client.1.smithi106.stdout:9/671: mkdir d4/d54/d69/d99/d2a/d42/dc8 0 2024-05-09T06:30:31.318 INFO:tasks.workunit.client.1.smithi106.stdout:9/672: dread - d4/f98 zero size 2024-05-09T06:30:31.320 INFO:tasks.workunit.client.1.smithi106.stdout:1/700: rename d4/lef to d4/d76/d13/d2f/df5/lf6 0 2024-05-09T06:30:31.320 INFO:tasks.workunit.client.1.smithi106.stdout:9/673: mknod d4/d54/d69/d99/d2a/d61/cc9 0 2024-05-09T06:30:31.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/197: dread d11/d18/f1b [0,4194304] 0 2024-05-09T06:30:31.321 INFO:tasks.workunit.client.1.smithi106.stdout:1/701: creat d4/d5/ff7 x:0 0 0 2024-05-09T06:30:31.323 INFO:tasks.workunit.client.0.smithi046.stdout:0/198: mknod d11/d18/d27/d28/c46 0 2024-05-09T06:30:31.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:31 smithi106 ceph-mon[34679]: pgmap v22: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 156 MiB/s rd, 209 MiB/s wr, 616 op/s 2024-05-09T06:30:31.325 INFO:tasks.workunit.client.1.smithi106.stdout:5/701: rename d8/d33/d6c to d8/d33/d3a/d59/dd0 0 2024-05-09T06:30:31.325 INFO:tasks.workunit.client.1.smithi106.stdout:9/674: rmdir d4/d54/d69/d95/d23/d2f/d47 39 2024-05-09T06:30:31.326 INFO:tasks.workunit.client.1.smithi106.stdout:2/791: write d2/d5/db/d1d/d6a/f99 [601294,89355] 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:6/723: read d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/f84 [2425475,59078] 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:0/708: rename d1/f4a to d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/ff3 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:6/724: readlink d0/d17/d34/d72/l9a 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:5/702: mkdir d8/d33/d3a/d59/dd1 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:0/709: fdatasync d1/d11/d23/d13/d58/f80 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:6/725: fsync d0/f8a 0 2024-05-09T06:30:31.328 INFO:tasks.workunit.client.1.smithi106.stdout:5/703: write d8/d5a/d60/da8/fcf [74325,54854] 0 2024-05-09T06:30:31.329 INFO:tasks.workunit.client.1.smithi106.stdout:9/675: mknod d4/d54/cca 0 2024-05-09T06:30:31.329 INFO:tasks.workunit.client.1.smithi106.stdout:2/792: creat d2/d7/d89/d104/f113 x:0 0 0 2024-05-09T06:30:31.330 INFO:tasks.workunit.client.1.smithi106.stdout:2/793: write d2/d5/db/d15/d41/f53 [63063,72304] 0 2024-05-09T06:30:31.331 INFO:tasks.workunit.client.1.smithi106.stdout:0/710: rename d1/d11/d23/d13/d2c/d57/le7 to d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/df2/lf4 0 2024-05-09T06:30:31.331 INFO:tasks.workunit.client.1.smithi106.stdout:0/711: write d1/d11/d23/d13/d2c/d57/de1/feb [153668,27867] 0 2024-05-09T06:30:31.332 INFO:tasks.workunit.client.1.smithi106.stdout:5/704: mkdir d8/d5a/d60/da8/daa/dd2 0 2024-05-09T06:30:31.333 INFO:tasks.workunit.client.1.smithi106.stdout:9/676: symlink d4/d54/d91/dc7/d58/lcb 0 2024-05-09T06:30:31.334 INFO:tasks.workunit.client.1.smithi106.stdout:5/705: link d8/d5a/d60/lc9 d8/d45/d4c/d32/ld3 0 2024-05-09T06:30:31.334 INFO:tasks.workunit.client.1.smithi106.stdout:5/706: chown d8/d45/d4c/f7b 29769283 1 2024-05-09T06:30:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:31 smithi046 ceph-mon[26924]: pgmap v22: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 156 MiB/s rd, 209 MiB/s wr, 616 op/s 2024-05-09T06:30:31.338 INFO:tasks.workunit.client.1.smithi106.stdout:6/726: write d0/d17/d34/d4e/d98/da9/db1/d8/d27/fdc [1127684,77206] 0 2024-05-09T06:30:31.338 INFO:tasks.workunit.client.1.smithi106.stdout:6/727: truncate d0/d66/d7e/fec 398096 0 2024-05-09T06:30:31.338 INFO:tasks.workunit.client.1.smithi106.stdout:6/728: readlink d0/d66/l9e 0 2024-05-09T06:30:31.339 INFO:tasks.workunit.client.1.smithi106.stdout:6/729: chown d0/d17/d34/fbe 2 1 2024-05-09T06:30:31.339 INFO:tasks.workunit.client.1.smithi106.stdout:6/730: stat d0/d17/d76/d8b/ld8 0 2024-05-09T06:30:31.339 INFO:tasks.workunit.client.1.smithi106.stdout:6/731: dread - d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f87 zero size 2024-05-09T06:30:31.348 INFO:tasks.workunit.client.1.smithi106.stdout:9/677: dread d4/d54/d69/d95/f11 [0,4194304] 0 2024-05-09T06:30:31.466 INFO:tasks.workunit.client.1.smithi106.stdout:0/712: rename d1/da1/d83/cda to d1/d11/d23/d13/d2c/cf5 0 2024-05-09T06:30:31.472 INFO:tasks.workunit.client.1.smithi106.stdout:6/732: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/dad/ff6 x:0 0 0 2024-05-09T06:30:31.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/199: dwrite f9 [0,4194304] 0 2024-05-09T06:30:31.477 INFO:tasks.workunit.client.1.smithi106.stdout:9/678: rename d4/d54/d69/d99/fc1 to d4/d54/d69/d99/d2a/d42/fcc 0 2024-05-09T06:30:31.479 INFO:tasks.workunit.client.1.smithi106.stdout:5/707: dread d8/d33/d3a/d59/faf [0,4194304] 0 2024-05-09T06:30:31.484 INFO:tasks.workunit.client.1.smithi106.stdout:6/733: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d50/df7 0 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:5/708: dread d8/f51 [0,4194304] 0 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/618: dwrite d3/d5/d35/d4e/d32/f97 [0,4194304] 0 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/619: chown d3/d5/d13/d3a/f90 2131235 1 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/620: fdatasync d3/d5/d7/fb5 0 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/621: creat d3/d5/d13/d3a/dbe/dc0/fd8 x:0 0 0 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/622: chown d3/d5/d13/d3a/dbe/dc0/l99 468 1 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:8/623: fsync d3/d5/f12 0 2024-05-09T06:30:31.488 INFO:tasks.workunit.client.1.smithi106.stdout:5/709: dread d8/d45/fc8 [0,4194304] 0 2024-05-09T06:30:31.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/200: rename d11/f24 to d11/d3f/f47 0 2024-05-09T06:30:31.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/201: read - d11/f22 zero size 2024-05-09T06:30:31.490 INFO:tasks.workunit.client.1.smithi106.stdout:6/734: mknod d0/d17/d34/dd0/df2/cf8 0 2024-05-09T06:30:31.491 INFO:tasks.workunit.client.1.smithi106.stdout:8/624: dread d3/d5/d7/fb7 [0,4194304] 0 2024-05-09T06:30:31.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/202: rmdir d11/d18/d27/d28 39 2024-05-09T06:30:31.493 INFO:tasks.workunit.client.0.smithi046.stdout:2/122: dwrite da/de/f10 [0,4194304] 0 2024-05-09T06:30:31.493 INFO:tasks.workunit.client.0.smithi046.stdout:2/123: chown da/de/d14/d1f/d20/d26 41 1 2024-05-09T06:30:31.494 INFO:tasks.workunit.client.1.smithi106.stdout:0/713: dwrite d1/d11/d23/d22/f31 [0,4194304] 0 2024-05-09T06:30:31.495 INFO:tasks.workunit.client.1.smithi106.stdout:4/634: dwrite d7/d28/d2a/f9f [0,4194304] 0 2024-05-09T06:30:31.495 INFO:tasks.workunit.client.1.smithi106.stdout:1/702: dwrite d4/f8a [4194304,4194304] 0 2024-05-09T06:30:31.495 INFO:tasks.workunit.client.1.smithi106.stdout:1/703: chown d4/d76/d13/d60/d9c/dbe/fde 37339255 1 2024-05-09T06:30:31.496 INFO:tasks.workunit.client.1.smithi106.stdout:0/714: dread d1/d11/d23/d13/d2c/d3d/f55 [4194304,4194304] 0 2024-05-09T06:30:31.501 INFO:tasks.workunit.client.1.smithi106.stdout:7/653: dwrite d0/dc/d1a/d36/d1e/f9d [0,4194304] 0 2024-05-09T06:30:31.501 INFO:tasks.workunit.client.1.smithi106.stdout:9/679: dwrite d4/d54/d69/d95/d23/d78/d8f/fb4 [0,4194304] 0 2024-05-09T06:30:31.502 INFO:tasks.workunit.client.1.smithi106.stdout:5/710: creat d8/d33/d3a/d59/dd1/fd4 x:0 0 0 2024-05-09T06:30:31.502 INFO:tasks.workunit.client.1.smithi106.stdout:5/711: dread - d8/d5a/d60/da8/daa/fb0 zero size 2024-05-09T06:30:31.509 INFO:tasks.workunit.client.1.smithi106.stdout:6/735: rename d0/d17/d34/d4e/d98/da9/lc3 to d0/d66/d7e/d9f/lf9 0 2024-05-09T06:30:31.510 INFO:tasks.workunit.client.1.smithi106.stdout:6/736: fsync d0/d17/d34/d4e/d98/da9/db1/d8/d27/fd7 0 2024-05-09T06:30:31.515 INFO:tasks.workunit.client.1.smithi106.stdout:0/715: dwrite d1/d11/d23/d22/fcb [0,4194304] 0 2024-05-09T06:30:31.520 INFO:tasks.workunit.client.1.smithi106.stdout:8/625: creat d3/d5/d7/d15/d47/fd9 x:0 0 0 2024-05-09T06:30:31.522 INFO:tasks.workunit.client.1.smithi106.stdout:6/737: dwrite d0/d17/d34/fae [0,4194304] 0 2024-05-09T06:30:31.525 INFO:tasks.workunit.client.1.smithi106.stdout:4/635: creat d7/d10/d1a/d5a/d1c/da7/fd0 x:0 0 0 2024-05-09T06:30:31.525 INFO:tasks.workunit.client.1.smithi106.stdout:4/636: read d7/d10/d1a/d5a/f63 [14416,54570] 0 2024-05-09T06:30:31.526 INFO:tasks.workunit.client.1.smithi106.stdout:1/704: symlink d4/d37/lf8 0 2024-05-09T06:30:31.534 INFO:tasks.workunit.client.1.smithi106.stdout:7/654: unlink d0/dc/d1a/d36/c7b 0 2024-05-09T06:30:31.535 INFO:tasks.workunit.client.1.smithi106.stdout:7/655: dread - d0/dc/d1a/d36/d30/d44/d6a/f8e zero size 2024-05-09T06:30:31.535 INFO:tasks.workunit.client.1.smithi106.stdout:7/656: creat d0/dc/d1a/d5a/fca x:0 0 0 2024-05-09T06:30:31.539 INFO:tasks.workunit.client.1.smithi106.stdout:5/712: creat d8/d5a/d60/d7e/dae/fd5 x:0 0 0 2024-05-09T06:30:31.547 INFO:tasks.workunit.client.1.smithi106.stdout:6/738: dwrite d0/d17/d34/d4e/d98/da9/db1/f28 [0,4194304] 0 2024-05-09T06:30:31.547 INFO:tasks.workunit.client.1.smithi106.stdout:6/739: dread - d0/d5c/fb9 zero size 2024-05-09T06:30:31.547 INFO:tasks.workunit.client.1.smithi106.stdout:1/705: dwrite d4/d5/f5e [0,4194304] 0 2024-05-09T06:30:31.547 INFO:tasks.workunit.client.1.smithi106.stdout:1/706: readlink d4/d76/d13/d60/d9c/ld8 0 2024-05-09T06:30:31.547 INFO:tasks.workunit.client.1.smithi106.stdout:1/707: readlink d4/d76/d1d/l34 0 2024-05-09T06:30:31.547 INFO:tasks.workunit.client.1.smithi106.stdout:0/716: symlink d1/da1/d83/lf6 0 2024-05-09T06:30:31.548 INFO:tasks.workunit.client.1.smithi106.stdout:8/626: mkdir d3/d5/d35/d61/dda 0 2024-05-09T06:30:31.552 INFO:tasks.workunit.client.1.smithi106.stdout:4/637: mkdir d7/d39/d35/d7c/dd1 0 2024-05-09T06:30:31.552 INFO:tasks.workunit.client.1.smithi106.stdout:4/638: fsync d7/d10/d1a/d5a/d7a/d7f/f84 0 2024-05-09T06:30:31.555 INFO:tasks.workunit.client.1.smithi106.stdout:7/657: unlink d0/dc/d1a/l1d 0 2024-05-09T06:30:31.555 INFO:tasks.workunit.client.1.smithi106.stdout:7/658: creat d0/dc/d1a/d36/d30/d44/d6a/d72/dc4/fcb x:0 0 0 2024-05-09T06:30:31.558 INFO:tasks.workunit.client.1.smithi106.stdout:8/627: dread d3/d5/d35/d61/d6c/fa6 [0,4194304] 0 2024-05-09T06:30:31.560 INFO:tasks.workunit.client.1.smithi106.stdout:6/740: mkdir d0/d17/d34/d4e/d98/dfa 0 2024-05-09T06:30:31.560 INFO:tasks.workunit.client.1.smithi106.stdout:4/639: dread d7/d39/d35/f76 [4194304,4194304] 0 2024-05-09T06:30:31.560 INFO:tasks.workunit.client.1.smithi106.stdout:4/640: creat d7/d10/d1a/d5a/d1c/da7/fd2 x:0 0 0 2024-05-09T06:30:31.564 INFO:tasks.workunit.client.1.smithi106.stdout:1/708: mknod d4/d76/db3/cf9 0 2024-05-09T06:30:31.565 INFO:tasks.workunit.client.1.smithi106.stdout:0/717: creat d1/ff7 x:0 0 0 2024-05-09T06:30:31.569 INFO:tasks.workunit.client.1.smithi106.stdout:7/659: mknod d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/ccc 0 2024-05-09T06:30:31.569 INFO:tasks.workunit.client.1.smithi106.stdout:4/641: dread d7/d28/f91 [0,4194304] 0 2024-05-09T06:30:31.571 INFO:tasks.workunit.client.1.smithi106.stdout:8/628: creat d3/d5/d7/d15/d47/d50/fdb x:0 0 0 2024-05-09T06:30:31.574 INFO:tasks.workunit.client.1.smithi106.stdout:6/741: rename d0/d17/cbd to d0/d17/d34/d4e/d98/da9/cfb 0 2024-05-09T06:30:31.576 INFO:tasks.workunit.client.1.smithi106.stdout:1/709: symlink d4/d76/db3/lfa 0 2024-05-09T06:30:31.576 INFO:tasks.workunit.client.1.smithi106.stdout:1/710: creat d4/d37/ffb x:0 0 0 2024-05-09T06:30:31.577 INFO:tasks.workunit.client.1.smithi106.stdout:4/642: symlink d7/d39/d47/d66/ld3 0 2024-05-09T06:30:31.577 INFO:tasks.workunit.client.1.smithi106.stdout:4/643: truncate d7/d10/d1a/d5a/d1c/da7/fd2 124860 0 2024-05-09T06:30:31.577 INFO:tasks.workunit.client.1.smithi106.stdout:4/644: read - d7/d10/d1a/d5a/d7a/d7f/fc0 zero size 2024-05-09T06:30:31.578 INFO:tasks.workunit.client.1.smithi106.stdout:4/645: dread - d7/fc4 zero size 2024-05-09T06:30:31.579 INFO:tasks.workunit.client.1.smithi106.stdout:8/629: mknod d3/d5/dbc/cdc 0 2024-05-09T06:30:31.579 INFO:tasks.workunit.client.1.smithi106.stdout:8/630: chown d3/d5/d7/d15 7 1 2024-05-09T06:30:31.579 INFO:tasks.workunit.client.1.smithi106.stdout:8/631: write d3/d5/d7/d98/faa [954838,10550] 0 2024-05-09T06:30:31.579 INFO:tasks.workunit.client.1.smithi106.stdout:6/742: unlink d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/ce7 0 2024-05-09T06:30:31.581 INFO:tasks.workunit.client.1.smithi106.stdout:0/718: rename d1/d11/d23/d13/d58/fbf to d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/df2/ff8 0 2024-05-09T06:30:31.584 INFO:tasks.workunit.client.1.smithi106.stdout:1/711: symlink d4/d76/daa/lfc 0 2024-05-09T06:30:31.586 INFO:tasks.workunit.client.1.smithi106.stdout:6/743: truncate d0/d17/d34/f65 1224630 0 2024-05-09T06:30:31.586 INFO:tasks.workunit.client.1.smithi106.stdout:6/744: creat d0/d17/d34/d4e/d98/ffc x:0 0 0 2024-05-09T06:30:31.586 INFO:tasks.workunit.client.1.smithi106.stdout:4/646: dread d7/d39/d35/f76 [0,4194304] 0 2024-05-09T06:30:31.587 INFO:tasks.workunit.client.1.smithi106.stdout:0/719: mknod d1/d11/d23/d13/d2c/d6d/dce/cf9 0 2024-05-09T06:30:31.587 INFO:tasks.workunit.client.1.smithi106.stdout:0/720: stat d1/d11/d23/d22/dbc/fe3 0 2024-05-09T06:30:31.587 INFO:tasks.workunit.client.1.smithi106.stdout:0/721: readlink d1/d11/l33 0 2024-05-09T06:30:31.590 INFO:tasks.workunit.client.1.smithi106.stdout:8/632: dread d3/d5/f8a [0,4194304] 0 2024-05-09T06:30:31.590 INFO:tasks.workunit.client.1.smithi106.stdout:8/633: chown d3/d5/d7/d98 924 1 2024-05-09T06:30:31.591 INFO:tasks.workunit.client.1.smithi106.stdout:4/647: mknod d7/d39/d47/d89/cd4 0 2024-05-09T06:30:31.594 INFO:tasks.workunit.client.1.smithi106.stdout:4/648: mkdir d7/d39/d35/dac/dd5 0 2024-05-09T06:30:31.594 INFO:tasks.workunit.client.1.smithi106.stdout:8/634: dread d3/d5/d35/d61/d6c/fa6 [0,4194304] 0 2024-05-09T06:30:31.594 INFO:tasks.workunit.client.1.smithi106.stdout:8/635: write d3/d5/d35/d4e/d32/f9a [248273,94336] 0 2024-05-09T06:30:31.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/713: rmdir d8/d5a/d60/d7e/dae 39 2024-05-09T06:30:31.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/714: fdatasync d8/d33/d74/fb6 0 2024-05-09T06:30:31.601 INFO:tasks.workunit.client.1.smithi106.stdout:5/715: write d8/d33/d74/f84 [1585846,127326] 0 2024-05-09T06:30:31.602 INFO:tasks.workunit.client.1.smithi106.stdout:3/592: sync 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/593: dread d5/d12/d65/d81/f94 [0,4194304] 0 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/594: chown d5/d4d/d7a/da9/da8 15464 1 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/595: write d5/d12/fa0 [262618,81603] 0 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/596: creat d5/d4d/d5f/fbe x:0 0 0 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/597: read - d5/d1c/d24/f59 zero size 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/598: read - d5/d1c/d24/f55 zero size 2024-05-09T06:30:31.605 INFO:tasks.workunit.client.1.smithi106.stdout:3/599: chown d5/d4d 157881 1 2024-05-09T06:30:31.606 INFO:tasks.workunit.client.1.smithi106.stdout:5/716: unlink d8/d45/d4c/d32/d5b/d69/cbc 0 2024-05-09T06:30:31.609 INFO:tasks.workunit.client.1.smithi106.stdout:5/717: mkdir d8/d5a/d60/dd6 0 2024-05-09T06:30:31.611 INFO:tasks.workunit.client.1.smithi106.stdout:5/718: link d8/l66 d8/d5a/d60/d7e/dae/ld7 0 2024-05-09T06:30:31.611 INFO:tasks.workunit.client.1.smithi106.stdout:5/719: chown d8/d5a/d60/dd6 383693 1 2024-05-09T06:30:31.613 INFO:tasks.workunit.client.1.smithi106.stdout:5/720: mknod d8/d5a/d60/da8/daa/db4/cd8 0 2024-05-09T06:30:31.620 INFO:tasks.workunit.client.1.smithi106.stdout:2/794: sync 2024-05-09T06:30:31.620 INFO:tasks.workunit.client.1.smithi106.stdout:9/680: sync 2024-05-09T06:30:31.620 INFO:tasks.workunit.client.1.smithi106.stdout:2/795: readlink d2/d5/db/d15/d41/d60/l96 0 2024-05-09T06:30:31.620 INFO:tasks.workunit.client.1.smithi106.stdout:9/681: fdatasync d4/d54/db3/db6/fc0 0 2024-05-09T06:30:31.620 INFO:tasks.workunit.client.1.smithi106.stdout:9/682: fdatasync d4/d54/fab 0 2024-05-09T06:30:31.620 INFO:tasks.workunit.client.1.smithi106.stdout:9/683: fsync d4/d54/d69/d95/f5e 0 2024-05-09T06:30:31.622 INFO:tasks.workunit.client.1.smithi106.stdout:9/684: link d4/d54/d69/d95/c66 d4/d54/d91/dc7/ccd 0 2024-05-09T06:30:31.624 INFO:tasks.workunit.client.1.smithi106.stdout:9/685: unlink d4/l1d 0 2024-05-09T06:30:31.624 INFO:tasks.workunit.client.1.smithi106.stdout:5/721: write d8/d33/d3a/d59/d99/f80 [1349383,56903] 0 2024-05-09T06:30:31.624 INFO:tasks.workunit.client.1.smithi106.stdout:5/722: chown d8/d45/d4c/d32/lc6 0 1 2024-05-09T06:30:31.625 INFO:tasks.workunit.client.1.smithi106.stdout:5/723: mkdir d8/d5a/d60/d7e/dae/dd9 0 2024-05-09T06:30:31.631 INFO:tasks.workunit.client.1.smithi106.stdout:4/649: dwrite d7/f29 [0,4194304] 0 2024-05-09T06:30:31.632 INFO:tasks.workunit.client.1.smithi106.stdout:0/722: dwrite d1/f1d [0,4194304] 0 2024-05-09T06:30:31.632 INFO:tasks.workunit.client.1.smithi106.stdout:3/600: dwrite d5/d1c/d21/fb5 [0,4194304] 0 2024-05-09T06:30:31.632 INFO:tasks.workunit.client.1.smithi106.stdout:3/601: dread - d5/d1c/d24/d80/fb0 zero size 2024-05-09T06:30:31.632 INFO:tasks.workunit.client.1.smithi106.stdout:3/602: write d5/d1c/f33 [2196294,113742] 0 2024-05-09T06:30:31.636 INFO:tasks.workunit.client.1.smithi106.stdout:9/686: write d4/f3d [2317371,12403] 0 2024-05-09T06:30:31.637 INFO:tasks.workunit.client.1.smithi106.stdout:9/687: write d4/d54/d69/d95/d23/d16/f24 [888693,66723] 0 2024-05-09T06:30:31.637 INFO:tasks.workunit.client.1.smithi106.stdout:6/745: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fd1 [0,4194304] 0 2024-05-09T06:30:31.637 INFO:tasks.workunit.client.1.smithi106.stdout:6/746: stat d0/d17/d34/d4e/d98/da9/db1/d8/f3c 0 2024-05-09T06:30:31.637 INFO:tasks.workunit.client.1.smithi106.stdout:3/603: mknod d5/d12/d26/cbf 0 2024-05-09T06:30:31.637 INFO:tasks.workunit.client.1.smithi106.stdout:3/604: readlink d5/d1c/l37 0 2024-05-09T06:30:31.638 INFO:tasks.workunit.client.1.smithi106.stdout:3/605: fdatasync d5/d12/d26/f9e 0 2024-05-09T06:30:31.639 INFO:tasks.workunit.client.1.smithi106.stdout:4/650: dread d7/d10/d1a/d5a/d1c/f49 [0,4194304] 0 2024-05-09T06:30:31.639 INFO:tasks.workunit.client.1.smithi106.stdout:4/651: stat d7/d10/d1a/d5a/d1c/da7 0 2024-05-09T06:30:31.639 INFO:tasks.workunit.client.1.smithi106.stdout:9/688: symlink d4/d54/db3/lce 0 2024-05-09T06:30:31.647 INFO:tasks.workunit.client.1.smithi106.stdout:5/724: dwrite d8/d33/d3a/d59/f68 [0,4194304] 0 2024-05-09T06:30:31.648 INFO:tasks.workunit.client.1.smithi106.stdout:6/747: dread d0/d17/d34/d4e/d98/da9/db1/d8/d50/f81 [0,4194304] 0 2024-05-09T06:30:31.651 INFO:tasks.workunit.client.1.smithi106.stdout:9/689: symlink d4/d54/d69/d99/d2a/d42/lcf 0 2024-05-09T06:30:31.652 INFO:tasks.workunit.client.1.smithi106.stdout:3/606: rmdir d5/d1c/d24/d5b/da4 39 2024-05-09T06:30:31.652 INFO:tasks.workunit.client.1.smithi106.stdout:3/607: readlink d5/d3f/l67 0 2024-05-09T06:30:31.656 INFO:tasks.workunit.client.1.smithi106.stdout:9/690: truncate d4/d54/db3/fc5 4628404 0 2024-05-09T06:30:31.657 INFO:tasks.workunit.client.1.smithi106.stdout:4/652: dwrite d7/d10/d1a/fa2 [4194304,4194304] 0 2024-05-09T06:30:31.657 INFO:tasks.workunit.client.1.smithi106.stdout:4/653: write d7/d10/d1a/d5a/f63 [474261,30215] 0 2024-05-09T06:30:31.657 INFO:tasks.workunit.client.1.smithi106.stdout:0/723: dwrite d1/d11/d23/f64 [0,4194304] 0 2024-05-09T06:30:31.658 INFO:tasks.workunit.client.1.smithi106.stdout:9/691: mkdir d4/d54/d69/d99/d2a/d42/d6c/dd0 0 2024-05-09T06:30:31.661 INFO:tasks.workunit.client.1.smithi106.stdout:3/608: dread d5/d12/f19 [4194304,4194304] 0 2024-05-09T06:30:31.664 INFO:tasks.workunit.client.1.smithi106.stdout:3/609: truncate d5/d1c/f47 787419 0 2024-05-09T06:30:31.667 INFO:tasks.workunit.client.1.smithi106.stdout:4/654: write d7/d10/d1a/d5a/d46/f54 [5940632,43989] 0 2024-05-09T06:30:31.667 INFO:tasks.workunit.client.1.smithi106.stdout:9/692: dread d4/d54/d69/d95/d23/d16/f4c [0,4194304] 0 2024-05-09T06:30:31.668 INFO:tasks.workunit.client.1.smithi106.stdout:4/655: read d7/d10/d1a/d5a/d1c/da7/fb5 [469215,83693] 0 2024-05-09T06:30:31.670 INFO:tasks.workunit.client.1.smithi106.stdout:9/693: rename d4/d54/d69/d95/d23/d2f to d4/d54/d69/d95/d23/d16/dd1 0 2024-05-09T06:30:31.670 INFO:tasks.workunit.client.1.smithi106.stdout:9/694: readlink d4/d54/d69/d95/d23/d78/d8f/l96 0 2024-05-09T06:30:31.670 INFO:tasks.workunit.client.1.smithi106.stdout:9/695: write d4/d54/d69/d95/f2b [726133,84922] 0 2024-05-09T06:30:31.670 INFO:tasks.workunit.client.1.smithi106.stdout:9/696: truncate d4/d54/d69/d95/d23/d16/f35 631776 0 2024-05-09T06:30:31.672 INFO:tasks.workunit.client.1.smithi106.stdout:0/724: dwrite d1/d11/d23/d13/d58/fb2 [0,4194304] 0 2024-05-09T06:30:31.672 INFO:tasks.workunit.client.1.smithi106.stdout:4/656: rename d7/d28/d2a/f50 to d7/d39/d35/d7c/fd6 0 2024-05-09T06:30:31.673 INFO:tasks.workunit.client.1.smithi106.stdout:9/697: symlink d4/d54/d69/d95/d23/d16/dd1/d39/ld2 0 2024-05-09T06:30:31.673 INFO:tasks.workunit.client.1.smithi106.stdout:7/660: sync 2024-05-09T06:30:31.676 INFO:tasks.workunit.client.1.smithi106.stdout:0/725: symlink d1/d11/d23/d13/d58/da8/dd6/lfa 0 2024-05-09T06:30:31.678 INFO:tasks.workunit.client.1.smithi106.stdout:4/657: mkdir d7/d39/d35/d7c/da8/dd7 0 2024-05-09T06:30:31.678 INFO:tasks.workunit.client.1.smithi106.stdout:4/658: chown d7/d28/f27 97603250 1 2024-05-09T06:30:31.678 INFO:tasks.workunit.client.1.smithi106.stdout:4/659: write d7/d10/f8f [6863169,128804] 0 2024-05-09T06:30:31.678 INFO:tasks.workunit.client.1.smithi106.stdout:4/660: write d7/d10/d1a/d5a/fbe [765024,85606] 0 2024-05-09T06:30:31.678 INFO:tasks.workunit.client.1.smithi106.stdout:4/661: write d7/d39/d8c/fbd [465941,42341] 0 2024-05-09T06:30:31.680 INFO:tasks.workunit.client.1.smithi106.stdout:9/698: mknod d4/d54/d69/d95/d23/d16/dd1/d31/cd3 0 2024-05-09T06:30:31.680 INFO:tasks.workunit.client.1.smithi106.stdout:9/699: chown d4/d54/d69/d99/d2a/l17 222 1 2024-05-09T06:30:31.682 INFO:tasks.workunit.client.1.smithi106.stdout:0/726: creat d1/d11/d23/d13/d2c/d6d/dce/ffb x:0 0 0 2024-05-09T06:30:31.684 INFO:tasks.workunit.client.1.smithi106.stdout:4/662: creat d7/d39/d35/dac/dd5/fd8 x:0 0 0 2024-05-09T06:30:31.689 INFO:tasks.workunit.client.1.smithi106.stdout:9/700: write d4/d54/d69/d95/d23/d78/d8f/d9a/fa5 [2603937,46251] 0 2024-05-09T06:30:31.693 INFO:tasks.workunit.client.1.smithi106.stdout:0/727: write d1/d11/d23/f64 [1615287,45269] 0 2024-05-09T06:30:31.696 INFO:tasks.workunit.client.1.smithi106.stdout:9/701: write d4/d54/d69/d95/d23/d16/dd1/d31/f50 [2513892,36038] 0 2024-05-09T06:30:31.696 INFO:tasks.workunit.client.1.smithi106.stdout:7/661: getdents d0 0 2024-05-09T06:30:31.696 INFO:tasks.workunit.client.1.smithi106.stdout:7/662: dread - d0/d53/fc3 zero size 2024-05-09T06:30:31.698 INFO:tasks.workunit.client.1.smithi106.stdout:9/702: symlink d4/d54/ld4 0 2024-05-09T06:30:31.698 INFO:tasks.workunit.client.1.smithi106.stdout:9/703: fsync d4/d54/d69/d99/d2a/f56 0 2024-05-09T06:30:31.698 INFO:tasks.workunit.client.1.smithi106.stdout:9/704: write d4/d54/d69/d95/d23/d16/dd1/d39/f89 [711634,57332] 0 2024-05-09T06:30:31.698 INFO:tasks.workunit.client.1.smithi106.stdout:9/705: chown d4/d54/d69/d99/d2a/d42/c43 128774 1 2024-05-09T06:30:31.698 INFO:tasks.workunit.client.1.smithi106.stdout:9/706: readlink d4/d54/d69/d99/d2a/d42/d6c/l80 0 2024-05-09T06:30:31.698 INFO:tasks.workunit.client.1.smithi106.stdout:9/707: fsync d4/d54/d69/d95/d23/d16/dd1/d31/f92 0 2024-05-09T06:30:31.699 INFO:tasks.workunit.client.1.smithi106.stdout:7/663: rename d0/dc/d1a/d36/d30/l3c to d0/dc/d1a/d36/d30/d44/d6a/d72/dc4/lcd 0 2024-05-09T06:30:31.700 INFO:tasks.workunit.client.1.smithi106.stdout:9/708: unlink d4/d54/d91/dc7/fba 0 2024-05-09T06:30:31.702 INFO:tasks.workunit.client.1.smithi106.stdout:7/664: rename d0/da5/dbe to d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/dce 0 2024-05-09T06:30:31.702 INFO:tasks.workunit.client.1.smithi106.stdout:7/665: creat d0/dc/d1a/d36/d30/fcf x:0 0 0 2024-05-09T06:30:31.702 INFO:tasks.workunit.client.1.smithi106.stdout:9/709: dread d4/d54/d69/d95/d23/d16/dd1/d38/f3c [0,4194304] 0 2024-05-09T06:30:31.703 INFO:tasks.workunit.client.1.smithi106.stdout:7/666: truncate d0/f52 1446235 0 2024-05-09T06:30:31.704 INFO:tasks.workunit.client.1.smithi106.stdout:7/667: truncate d0/dc/d1a/d36/d1e/f21 304974 0 2024-05-09T06:30:31.704 INFO:tasks.workunit.client.1.smithi106.stdout:9/710: creat d4/d54/d91/fd5 x:0 0 0 2024-05-09T06:30:31.704 INFO:tasks.workunit.client.1.smithi106.stdout:9/711: truncate d4/d54/d69/d99/d2a/d42/fcc 73930 0 2024-05-09T06:30:31.705 INFO:tasks.workunit.client.1.smithi106.stdout:7/668: unlink d0/dc/d1a/d36/d30/f3b 0 2024-05-09T06:30:31.710 INFO:tasks.workunit.client.1.smithi106.stdout:9/712: dread d4/d54/d69/d95/d23/d16/dd1/d31/f50 [0,4194304] 0 2024-05-09T06:30:31.712 INFO:tasks.workunit.client.1.smithi106.stdout:9/713: creat d4/d54/d69/d99/d2a/d42/d6c/d6d/fd6 x:0 0 0 2024-05-09T06:30:31.712 INFO:tasks.workunit.client.1.smithi106.stdout:9/714: chown d4/d54/d69/d95/l9 6655824 1 2024-05-09T06:30:31.712 INFO:tasks.workunit.client.1.smithi106.stdout:9/715: chown d4/d54/d69/d99/c7a 0 1 2024-05-09T06:30:31.712 INFO:tasks.workunit.client.1.smithi106.stdout:9/716: readlink d4/d54/d69/d95/d23/d16/l2c 0 2024-05-09T06:30:31.714 INFO:tasks.workunit.client.1.smithi106.stdout:9/717: symlink d4/d54/d69/d95/d23/d16/ld7 0 2024-05-09T06:30:31.714 INFO:tasks.workunit.client.1.smithi106.stdout:9/718: chown d4/d54/d69/d95/d23 0 1 2024-05-09T06:30:31.723 INFO:tasks.workunit.client.1.smithi106.stdout:7/669: dwrite d0/fa [4194304,4194304] 0 2024-05-09T06:30:31.723 INFO:tasks.workunit.client.1.smithi106.stdout:7/670: chown d0/dc/d1a/d36/d1e/f9d 24 1 2024-05-09T06:30:31.723 INFO:tasks.workunit.client.1.smithi106.stdout:7/671: creat d0/dc/d1a/d36/d1e/fd0 x:0 0 0 2024-05-09T06:30:31.728 INFO:tasks.workunit.client.1.smithi106.stdout:7/672: rename d0/dc/d1a/d36/l8c to d0/dc/d1a/d36/d30/d44/d58/d65/ld1 0 2024-05-09T06:30:31.731 INFO:tasks.workunit.client.1.smithi106.stdout:8/636: sync 2024-05-09T06:30:31.731 INFO:tasks.workunit.client.1.smithi106.stdout:1/712: sync 2024-05-09T06:30:31.732 INFO:tasks.workunit.client.1.smithi106.stdout:2/796: sync 2024-05-09T06:30:31.732 INFO:tasks.workunit.client.1.smithi106.stdout:9/719: dwrite d4/d54/d69/d95/d23/d16/dd1/d38/f3c [0,4194304] 0 2024-05-09T06:30:31.734 INFO:tasks.workunit.client.1.smithi106.stdout:2/797: dread d2/d5/f91 [0,4194304] 0 2024-05-09T06:30:31.734 INFO:tasks.workunit.client.1.smithi106.stdout:2/798: stat d2/d7/d2c/f34 0 2024-05-09T06:30:31.734 INFO:tasks.workunit.client.1.smithi106.stdout:2/799: write d2/d7/fd5 [1029037,101683] 0 2024-05-09T06:30:31.735 INFO:tasks.workunit.client.1.smithi106.stdout:2/800: chown d2/d5/db/d1d/d90/d103/fe1 21034241 1 2024-05-09T06:30:31.736 INFO:tasks.workunit.client.1.smithi106.stdout:8/637: rename d3/d5/d35/f68 to d3/d5/d35/d61/d6c/d83/d89/fdd 0 2024-05-09T06:30:31.737 INFO:tasks.workunit.client.1.smithi106.stdout:8/638: fdatasync d3/d5/d35/d4e/d32/f9a 0 2024-05-09T06:30:31.741 INFO:tasks.workunit.client.1.smithi106.stdout:2/801: stat d2/d5/db/d1d/d90/lab 0 2024-05-09T06:30:31.742 INFO:tasks.workunit.client.1.smithi106.stdout:8/639: mkdir d3/d5/d35/dde 0 2024-05-09T06:30:31.742 INFO:tasks.workunit.client.1.smithi106.stdout:8/640: truncate d3/d5/d13/f14 9287548 0 2024-05-09T06:30:31.742 INFO:tasks.workunit.client.1.smithi106.stdout:8/641: creat d3/d6b/fdf x:0 0 0 2024-05-09T06:30:31.742 INFO:tasks.workunit.client.1.smithi106.stdout:8/642: write d3/d5/d35/d73/fa5 [849139,128270] 0 2024-05-09T06:30:31.742 INFO:tasks.workunit.client.1.smithi106.stdout:8/643: write d3/d5/d35/d4e/fca [616859,72577] 0 2024-05-09T06:30:31.742 INFO:tasks.workunit.client.1.smithi106.stdout:8/644: write d3/d5/d13/f40 [887851,38948] 0 2024-05-09T06:30:31.743 INFO:tasks.workunit.client.1.smithi106.stdout:2/802: symlink d2/d5/db/l114 0 2024-05-09T06:30:31.746 INFO:tasks.workunit.client.1.smithi106.stdout:7/673: dwrite d0/dc/d1a/d36/d30/d44/d58/f66 [0,4194304] 0 2024-05-09T06:30:31.749 INFO:tasks.workunit.client.1.smithi106.stdout:8/645: rmdir d3/d5/d7/d15/d3e 39 2024-05-09T06:30:31.750 INFO:tasks.workunit.client.1.smithi106.stdout:2/803: mknod d2/d5/db/d1d/d23/d63/d7a/dda/c115 0 2024-05-09T06:30:31.773 INFO:tasks.workunit.client.1.smithi106.stdout:8/646: dwrite d3/d5/d35/d61/f80 [0,4194304] 0 2024-05-09T06:30:31.773 INFO:tasks.workunit.client.1.smithi106.stdout:1/713: dwrite d4/d76/d13/d2f/f7f [0,4194304] 0 2024-05-09T06:30:31.773 INFO:tasks.workunit.client.1.smithi106.stdout:1/714: chown d4/d37/d3d 3410382 1 2024-05-09T06:30:31.773 INFO:tasks.workunit.client.1.smithi106.stdout:1/715: fsync d4/d5/f50 0 2024-05-09T06:30:31.773 INFO:tasks.workunit.client.1.smithi106.stdout:9/720: dwrite d4/d54/d69/d95/d23/d78/d8f/d9a/fa5 [0,4194304] 0 2024-05-09T06:30:31.774 INFO:tasks.workunit.client.1.smithi106.stdout:8/647: rmdir d3/d5/d35/d73/d9d 39 2024-05-09T06:30:31.774 INFO:tasks.workunit.client.1.smithi106.stdout:8/648: fsync d3/d5/d35/d73/f54 0 2024-05-09T06:30:31.774 INFO:tasks.workunit.client.1.smithi106.stdout:8/649: fdatasync d3/d5/f12 0 2024-05-09T06:30:31.774 INFO:tasks.workunit.client.1.smithi106.stdout:8/650: chown d3/d5/d13/l21 158270399 1 2024-05-09T06:30:31.774 INFO:tasks.workunit.client.1.smithi106.stdout:8/651: chown d3/d5/d7/ld 111 1 2024-05-09T06:30:31.775 INFO:tasks.workunit.client.1.smithi106.stdout:8/652: read d3/d5/d7/f7f [461426,125730] 0 2024-05-09T06:30:31.775 INFO:tasks.workunit.client.1.smithi106.stdout:7/674: dwrite d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/fa3 [0,4194304] 0 2024-05-09T06:30:31.778 INFO:tasks.workunit.client.1.smithi106.stdout:9/721: truncate d4/d54/d69/d95/d23/d16/dd1/d39/f88 2904051 0 2024-05-09T06:30:31.781 INFO:tasks.workunit.client.1.smithi106.stdout:8/653: creat d3/d5/d35/d73/d9d/da9/dbd/dd7/fe0 x:0 0 0 2024-05-09T06:30:31.782 INFO:tasks.workunit.client.1.smithi106.stdout:7/675: symlink d0/dc/d1a/d36/d30/d44/d80/ld2 0 2024-05-09T06:30:31.783 INFO:tasks.workunit.client.1.smithi106.stdout:9/722: truncate d4/d54/d69/d95/d23/d78/d8f/d9a/fb7 568035 0 2024-05-09T06:30:31.783 INFO:tasks.workunit.client.1.smithi106.stdout:8/654: write d3/d5/d35/d73/fa5 [320667,74463] 0 2024-05-09T06:30:31.785 INFO:tasks.workunit.client.1.smithi106.stdout:7/676: rename d0/dc/d1a/d5a/f9a to d0/dc/d1a/d36/d30/fd3 0 2024-05-09T06:30:31.786 INFO:tasks.workunit.client.1.smithi106.stdout:9/723: mkdir d4/d54/d69/d95/d23/d78/dd8 0 2024-05-09T06:30:31.788 INFO:tasks.workunit.client.1.smithi106.stdout:1/716: dwrite d4/d76/fb8 [0,4194304] 0 2024-05-09T06:30:31.788 INFO:tasks.workunit.client.1.smithi106.stdout:1/717: write d4/d37/f93 [998116,9459] 0 2024-05-09T06:30:31.791 INFO:tasks.workunit.client.1.smithi106.stdout:7/677: mkdir d0/dc/d1a/d36/d30/d44/d6a/dd4 0 2024-05-09T06:30:31.793 INFO:tasks.workunit.client.1.smithi106.stdout:8/655: dread d3/d6b/f79 [0,4194304] 0 2024-05-09T06:30:31.793 INFO:tasks.workunit.client.1.smithi106.stdout:8/656: read - d3/d5/d35/d4e/d32/d92/fc5 zero size 2024-05-09T06:30:31.798 INFO:tasks.workunit.client.1.smithi106.stdout:1/718: mkdir d4/d76/d13/d2f/df5/dfd 0 2024-05-09T06:30:31.800 INFO:tasks.workunit.client.1.smithi106.stdout:9/724: dwrite d4/d54/d69/d95/d23/dc6/f8c [0,4194304] 0 2024-05-09T06:30:31.800 INFO:tasks.workunit.client.1.smithi106.stdout:7/678: link d0/dc/d1a/d36/d1e/f46 d0/dc/d1a/d36/d30/d44/fd5 0 2024-05-09T06:30:31.800 INFO:tasks.workunit.client.1.smithi106.stdout:7/679: stat d0/f9 0 2024-05-09T06:30:31.802 INFO:tasks.workunit.client.1.smithi106.stdout:8/657: symlink d3/d5/d35/d4e/d32/dd3/le1 0 2024-05-09T06:30:31.803 INFO:tasks.workunit.client.1.smithi106.stdout:1/719: link d4/d37/f43 d4/d76/d65/d8d/dad/ffe 0 2024-05-09T06:30:31.803 INFO:tasks.workunit.client.1.smithi106.stdout:1/720: dread - d4/d76/d13/dbb/f55 zero size 2024-05-09T06:30:31.805 INFO:tasks.workunit.client.1.smithi106.stdout:9/725: unlink d4/d54/d69/d99/d2a/d42/d6c/fa4 0 2024-05-09T06:30:31.806 INFO:tasks.workunit.client.1.smithi106.stdout:7/680: creat d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/fd6 x:0 0 0 2024-05-09T06:30:31.808 INFO:tasks.workunit.client.1.smithi106.stdout:8/658: creat d3/d5/d35/d4e/d32/dd3/fe2 x:0 0 0 2024-05-09T06:30:31.809 INFO:tasks.workunit.client.1.smithi106.stdout:9/726: link d4/d54/d91/dc7/ccd d4/d54/d69/d99/d2a/d61/cd9 0 2024-05-09T06:30:31.810 INFO:tasks.workunit.client.1.smithi106.stdout:7/681: creat d0/d53/d7a/fd7 x:0 0 0 2024-05-09T06:30:31.811 INFO:tasks.workunit.client.1.smithi106.stdout:8/659: truncate d3/d5/d35/d61/d6c/d83/f8f 859322 0 2024-05-09T06:30:31.813 INFO:tasks.workunit.client.1.smithi106.stdout:5/725: sync 2024-05-09T06:30:31.813 INFO:tasks.workunit.client.1.smithi106.stdout:6/748: sync 2024-05-09T06:30:31.813 INFO:tasks.workunit.client.1.smithi106.stdout:9/727: creat d4/d54/d91/dc7/da2/fda x:0 0 0 2024-05-09T06:30:31.814 INFO:tasks.workunit.client.1.smithi106.stdout:7/682: creat d0/dc/d1a/d36/d30/d44/fd8 x:0 0 0 2024-05-09T06:30:31.814 INFO:tasks.workunit.client.1.smithi106.stdout:7/683: readlink d0/dc/d1a/d36/d30/d44/l85 0 2024-05-09T06:30:31.814 INFO:tasks.workunit.client.1.smithi106.stdout:7/684: truncate d0/dc/d1a/d36/d30/d44/d6a/d72/dc4/fc8 796610 0 2024-05-09T06:30:31.816 INFO:tasks.workunit.client.1.smithi106.stdout:8/660: rmdir d3/d5/d35/dde 0 2024-05-09T06:30:31.817 INFO:tasks.workunit.client.1.smithi106.stdout:1/721: dwrite d4/d37/d3d/f6e [4194304,4194304] 0 2024-05-09T06:30:31.817 INFO:tasks.workunit.client.1.smithi106.stdout:1/722: stat d4/d76/d13/d60 0 2024-05-09T06:30:31.818 INFO:tasks.workunit.client.1.smithi106.stdout:5/726: rename d8/d33/d3a/d59/dd0 to d8/d45/d4c/d32/d5b/dda 0 2024-05-09T06:30:31.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/727: truncate d8/d5a/f73 319941 0 2024-05-09T06:30:31.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/728: chown d8/f12 768642 1 2024-05-09T06:30:31.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/729: write d8/d5a/d60/d7e/f82 [867403,53089] 0 2024-05-09T06:30:31.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/730: creat d8/d45/d4c/fdb x:0 0 0 2024-05-09T06:30:31.828 INFO:tasks.workunit.client.1.smithi106.stdout:8/661: write d3/d5/d35/d61/d6c/f70 [2472230,63544] 0 2024-05-09T06:30:31.841 INFO:tasks.workunit.client.1.smithi106.stdout:9/728: dwrite d4/d54/d69/d99/d2a/f73 [0,4194304] 0 2024-05-09T06:30:31.842 INFO:tasks.workunit.client.1.smithi106.stdout:9/729: read d4/d54/d69/d99/d2a/d42/f4f [4231539,38393] 0 2024-05-09T06:30:31.844 INFO:tasks.workunit.client.1.smithi106.stdout:8/662: dread d3/d5/d13/f29 [4194304,4194304] 0 2024-05-09T06:30:31.844 INFO:tasks.workunit.client.1.smithi106.stdout:1/723: dwrite d4/d76/d13/d2f/db4/fd6 [0,4194304] 0 2024-05-09T06:30:31.844 INFO:tasks.workunit.client.1.smithi106.stdout:7/685: dwrite d0/dc/d1a/f81 [0,4194304] 0 2024-05-09T06:30:31.846 INFO:tasks.workunit.client.1.smithi106.stdout:5/731: dread d8/d5a/d60/d7e/f82 [0,4194304] 0 2024-05-09T06:30:31.853 INFO:tasks.workunit.client.1.smithi106.stdout:8/663: symlink d3/d5/d35/d4e/d32/d92/le3 0 2024-05-09T06:30:31.853 INFO:tasks.workunit.client.1.smithi106.stdout:8/664: chown d3/d5/d35/d4e/l57 84 1 2024-05-09T06:30:31.854 INFO:tasks.workunit.client.1.smithi106.stdout:1/724: symlink d4/d76/d13/d2f/df5/lff 0 2024-05-09T06:30:31.854 INFO:tasks.workunit.client.1.smithi106.stdout:1/725: write d4/d76/d13/d2f/fce [987876,52409] 0 2024-05-09T06:30:31.855 INFO:tasks.workunit.client.1.smithi106.stdout:7/686: symlink d0/dc/d1a/d36/d30/d44/dc1/ld9 0 2024-05-09T06:30:31.855 INFO:tasks.workunit.client.1.smithi106.stdout:9/730: dwrite d4/d54/d69/d99/d2a/d42/d6c/fc2 [0,4194304] 0 2024-05-09T06:30:31.855 INFO:tasks.workunit.client.1.smithi106.stdout:9/731: fdatasync d4/d54/d69/d99/d2a/d42/d6c/d6d/f77 0 2024-05-09T06:30:31.855 INFO:tasks.workunit.client.1.smithi106.stdout:7/687: write d0/f40 [4551743,25561] 0 2024-05-09T06:30:31.857 INFO:tasks.workunit.client.1.smithi106.stdout:5/732: link d8/d45/c90 d8/d5a/dc7/cdc 0 2024-05-09T06:30:31.858 INFO:tasks.workunit.client.1.smithi106.stdout:4/663: sync 2024-05-09T06:30:31.858 INFO:tasks.workunit.client.1.smithi106.stdout:0/728: sync 2024-05-09T06:30:31.858 INFO:tasks.workunit.client.1.smithi106.stdout:0/729: chown d1/d11/d7f 4 1 2024-05-09T06:30:31.859 INFO:tasks.workunit.client.1.smithi106.stdout:3/610: sync 2024-05-09T06:30:31.860 INFO:tasks.workunit.client.1.smithi106.stdout:5/733: dread d8/d5a/d60/da8/daa/db4/fbe [0,4194304] 0 2024-05-09T06:30:31.860 INFO:tasks.workunit.client.1.smithi106.stdout:1/726: link d4/f1f d4/dbd/de6/f100 0 2024-05-09T06:30:31.863 INFO:tasks.workunit.client.1.smithi106.stdout:9/732: write d4/d54/d69/d95/d23/d16/dd1/d38/f40 [5977092,19973] 0 2024-05-09T06:30:31.863 INFO:tasks.workunit.client.1.smithi106.stdout:9/733: write d4/d54/d69/d95/d23/d16/dd1/d47/f9d [1428230,52314] 0 2024-05-09T06:30:31.863 INFO:tasks.workunit.client.1.smithi106.stdout:9/734: chown d4/d54/d69/d95/d23/d16/dd1/f90 0 1 2024-05-09T06:30:31.868 INFO:tasks.workunit.client.1.smithi106.stdout:3/611: rename d5/d1c/d21 to d5/d1c/d24/d98/dc0 0 2024-05-09T06:30:31.868 INFO:tasks.workunit.client.1.smithi106.stdout:3/612: write d5/d1c/d24/d98/dc0/f7e [1123303,71574] 0 2024-05-09T06:30:31.871 INFO:tasks.workunit.client.1.smithi106.stdout:9/735: rename d4/d54/d69/d95/d23/d16/dd1/d31/f32 to d4/d54/d69/d95/d23/fdb 0 2024-05-09T06:30:31.872 INFO:tasks.workunit.client.1.smithi106.stdout:2/804: sync 2024-05-09T06:30:31.872 INFO:tasks.workunit.client.1.smithi106.stdout:2/805: readlink d2/d5/db/l3a 0 2024-05-09T06:30:31.872 INFO:tasks.workunit.client.1.smithi106.stdout:2/806: chown d2/d5/db/d1d/d23/d5e/de8 4018529 1 2024-05-09T06:30:31.872 INFO:tasks.workunit.client.1.smithi106.stdout:6/749: sync 2024-05-09T06:30:31.873 INFO:tasks.workunit.client.1.smithi106.stdout:2/807: creat d2/d5/db/d15/dc6/f116 x:0 0 0 2024-05-09T06:30:31.874 INFO:tasks.workunit.client.1.smithi106.stdout:2/808: chown d2/d5/db/c8e 103 1 2024-05-09T06:30:31.874 INFO:tasks.workunit.client.1.smithi106.stdout:2/809: dread - d2/d7/d62/d9a/fcb zero size 2024-05-09T06:30:31.876 INFO:tasks.workunit.client.1.smithi106.stdout:6/750: rename d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/fc8 to d0/d17/d34/d4e/d98/da9/db1/d40/ffd 0 2024-05-09T06:30:31.880 INFO:tasks.workunit.client.1.smithi106.stdout:2/810: rename d2/d5/d9c/cbc to d2/d5/d9c/dd3/c117 0 2024-05-09T06:30:31.881 INFO:tasks.workunit.client.1.smithi106.stdout:6/751: symlink d0/lfe 0 2024-05-09T06:30:31.883 INFO:tasks.workunit.client.1.smithi106.stdout:2/811: rmdir d2/d5/d9c/dd3 39 2024-05-09T06:30:31.883 INFO:tasks.workunit.client.1.smithi106.stdout:3/613: dread d5/d12/f23 [0,4194304] 0 2024-05-09T06:30:31.885 INFO:tasks.workunit.client.1.smithi106.stdout:2/812: creat d2/d5/db/d15/dd6/deb/f118 x:0 0 0 2024-05-09T06:30:31.885 INFO:tasks.workunit.client.1.smithi106.stdout:2/813: chown d2/d5/db/d1d/d6a/f99 213 1 2024-05-09T06:30:31.887 INFO:tasks.workunit.client.1.smithi106.stdout:3/614: creat d5/d1c/d24/d89/fc1 x:0 0 0 2024-05-09T06:30:31.889 INFO:tasks.workunit.client.1.smithi106.stdout:2/814: symlink d2/d5/l119 0 2024-05-09T06:30:31.890 INFO:tasks.workunit.client.1.smithi106.stdout:2/815: mknod d2/d5/d9c/c11a 0 2024-05-09T06:30:31.892 INFO:tasks.workunit.client.1.smithi106.stdout:2/816: mkdir d2/d5/db/d15/d41/d60/d11b 0 2024-05-09T06:30:31.893 INFO:tasks.workunit.client.1.smithi106.stdout:2/817: rmdir d2/d5/db/d1d/d90/d103 39 2024-05-09T06:30:31.893 INFO:tasks.workunit.client.1.smithi106.stdout:2/818: truncate d2/d5/db/d1d/fc5 857121 0 2024-05-09T06:30:31.894 INFO:tasks.workunit.client.1.smithi106.stdout:2/819: creat d2/d5/db/d15/dd6/f11c x:0 0 0 2024-05-09T06:30:31.894 INFO:tasks.workunit.client.1.smithi106.stdout:2/820: dread - d2/d5/db/d15/dd6/deb/ff4 zero size 2024-05-09T06:30:31.895 INFO:tasks.workunit.client.1.smithi106.stdout:2/821: mknod d2/d5/db/d1d/d23/d5e/c11d 0 2024-05-09T06:30:31.898 INFO:tasks.workunit.client.1.smithi106.stdout:2/822: rename d2/d5/db/d15/dd6/deb/f118 to d2/d5/db/d15/dc6/f11e 0 2024-05-09T06:30:31.929 INFO:tasks.workunit.client.1.smithi106.stdout:1/727: dwrite d4/fdd [0,4194304] 0 2024-05-09T06:30:31.929 INFO:tasks.workunit.client.1.smithi106.stdout:7/688: dwrite d0/dc/d1a/d36/d30/d44/d6a/f6d [0,4194304] 0 2024-05-09T06:30:31.929 INFO:tasks.workunit.client.1.smithi106.stdout:1/728: creat d4/d76/d13/d2f/db4/f101 x:0 0 0 2024-05-09T06:30:31.931 INFO:tasks.workunit.client.1.smithi106.stdout:0/730: dwrite d1/f7 [0,4194304] 0 2024-05-09T06:30:31.931 INFO:tasks.workunit.client.1.smithi106.stdout:5/734: dwrite d8/d5a/d60/fcb [0,4194304] 0 2024-05-09T06:30:31.931 INFO:tasks.workunit.client.1.smithi106.stdout:6/752: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d50/fb3 [0,4194304] 0 2024-05-09T06:30:31.931 INFO:tasks.workunit.client.1.smithi106.stdout:9/736: dwrite d4/d54/d69/d99/d2a/d42/fcc [0,4194304] 0 2024-05-09T06:30:31.931 INFO:tasks.workunit.client.1.smithi106.stdout:3/615: dwrite d5/d12/d26/d90/f97 [0,4194304] 0 2024-05-09T06:30:31.931 INFO:tasks.workunit.client.1.smithi106.stdout:3/616: chown d5/d1c/d24/d98/dc0 66547 1 2024-05-09T06:30:31.932 INFO:tasks.workunit.client.1.smithi106.stdout:1/729: creat d4/d76/daa/f102 x:0 0 0 2024-05-09T06:30:31.932 INFO:tasks.workunit.client.1.smithi106.stdout:2/823: dwrite f1 [0,4194304] 0 2024-05-09T06:30:31.933 INFO:tasks.workunit.client.1.smithi106.stdout:2/824: readlink d2/d5/db/d1d/d23/d63/d7a/lde 0 2024-05-09T06:30:31.933 INFO:tasks.workunit.client.1.smithi106.stdout:7/689: dread d0/dc/d1a/d5a/fab [0,4194304] 0 2024-05-09T06:30:31.936 INFO:tasks.workunit.client.1.smithi106.stdout:5/735: mkdir d8/d45/d4c/ddd 0 2024-05-09T06:30:31.938 INFO:tasks.workunit.client.1.smithi106.stdout:9/737: dread d4/d54/d69/d95/d23/d16/dd1/d38/f40 [4194304,4194304] 0 2024-05-09T06:30:31.945 INFO:tasks.workunit.client.1.smithi106.stdout:0/731: read d1/d11/d23/d13/d2c/d3d/f55 [451242,12605] 0 2024-05-09T06:30:31.949 INFO:tasks.workunit.client.1.smithi106.stdout:1/730: mknod d4/d76/d13/d2f/c103 0 2024-05-09T06:30:31.949 INFO:tasks.workunit.client.1.smithi106.stdout:1/731: creat d4/d5/f104 x:0 0 0 2024-05-09T06:30:31.950 INFO:tasks.workunit.client.1.smithi106.stdout:2/825: truncate d2/d5/db/d15/d41/d58/f45 218423 0 2024-05-09T06:30:31.951 INFO:tasks.workunit.client.1.smithi106.stdout:7/690: mknod d0/dc/d1a/d36/d30/d44/cda 0 2024-05-09T06:30:31.951 INFO:tasks.workunit.client.1.smithi106.stdout:7/691: readlink d0/dc/d1a/d36/l38 0 2024-05-09T06:30:31.952 INFO:tasks.workunit.client.1.smithi106.stdout:9/738: mkdir d4/d54/d69/d95/d23/d16/dd1/d47/ddc 0 2024-05-09T06:30:31.954 INFO:tasks.workunit.client.1.smithi106.stdout:0/732: mkdir d1/d11/d23/d13/d58/da8/dd6/dfc 0 2024-05-09T06:30:31.955 INFO:tasks.workunit.client.1.smithi106.stdout:6/753: dwrite d0/d17/d34/d72/f93 [0,4194304] 0 2024-05-09T06:30:31.957 INFO:tasks.workunit.client.1.smithi106.stdout:1/732: creat d4/d76/d13/f105 x:0 0 0 2024-05-09T06:30:31.959 INFO:tasks.workunit.client.1.smithi106.stdout:2/826: truncate d2/d5/d9c/fa6 110578 0 2024-05-09T06:30:31.959 INFO:tasks.workunit.client.1.smithi106.stdout:2/827: dread - d2/d5/db/d15/dc6/f116 zero size 2024-05-09T06:30:31.959 INFO:tasks.workunit.client.1.smithi106.stdout:0/733: dread d1/d11/d23/d13/d58/fc8 [0,4194304] 0 2024-05-09T06:30:31.959 INFO:tasks.workunit.client.1.smithi106.stdout:0/734: readlink d1/d11/d23/d13/d2c/d57/l6a 0 2024-05-09T06:30:31.961 INFO:tasks.workunit.client.1.smithi106.stdout:7/692: link d0/dc/d1a/d5a/la4 d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/ldb 0 2024-05-09T06:30:31.961 INFO:tasks.workunit.client.1.smithi106.stdout:7/693: fsync d0/dc/d1a/d36/d30/d44/d6a/f6d 0 2024-05-09T06:30:31.962 INFO:tasks.workunit.client.1.smithi106.stdout:7/694: dread d0/dc/d1a/d36/d30/f91 [0,4194304] 0 2024-05-09T06:30:31.963 INFO:tasks.workunit.client.1.smithi106.stdout:3/617: dwrite d5/d1c/d24/d98/dc0/d32/f6e [0,4194304] 0 2024-05-09T06:30:31.963 INFO:tasks.workunit.client.1.smithi106.stdout:5/736: dwrite d8/d33/d3a/f63 [0,4194304] 0 2024-05-09T06:30:31.965 INFO:tasks.workunit.client.1.smithi106.stdout:4/664: sync 2024-05-09T06:30:31.965 INFO:tasks.workunit.client.1.smithi106.stdout:8/665: sync 2024-05-09T06:30:31.965 INFO:tasks.workunit.client.1.smithi106.stdout:8/666: chown d3/d5/d7/f7f 0 1 2024-05-09T06:30:31.966 INFO:tasks.workunit.client.1.smithi106.stdout:7/695: symlink d0/d53/d7a/ldc 0 2024-05-09T06:30:31.971 INFO:tasks.workunit.client.1.smithi106.stdout:0/735: dread d1/da1/fb3 [0,4194304] 0 2024-05-09T06:30:31.972 INFO:tasks.workunit.client.1.smithi106.stdout:5/737: mkdir d8/d45/d4c/d32/d5b/d69/dde 0 2024-05-09T06:30:31.972 INFO:tasks.workunit.client.1.smithi106.stdout:1/733: write d4/d76/d13/f19 [2484145,36950] 0 2024-05-09T06:30:31.978 INFO:tasks.workunit.client.1.smithi106.stdout:5/738: dread d8/d45/d4c/d32/d5b/f29 [0,4194304] 0 2024-05-09T06:30:31.981 INFO:tasks.workunit.client.1.smithi106.stdout:2/828: dwrite d2/d5/f91 [0,4194304] 0 2024-05-09T06:30:31.985 INFO:tasks.workunit.client.1.smithi106.stdout:3/618: dwrite d5/d1c/d24/d52/f71 [0,4194304] 0 2024-05-09T06:30:31.985 INFO:tasks.workunit.client.1.smithi106.stdout:3/619: chown d5/d1c/d24/c2c 5238597 1 2024-05-09T06:30:31.985 INFO:tasks.workunit.client.1.smithi106.stdout:3/620: write d5/d4d/d5f/fbe [988964,26051] 0 2024-05-09T06:30:31.985 INFO:tasks.workunit.client.1.smithi106.stdout:3/621: readlink d5/d1c/d24/d89/la7 0 2024-05-09T06:30:31.985 INFO:tasks.workunit.client.1.smithi106.stdout:6/754: rmdir d0/d17/d34/d4e/d98 39 2024-05-09T06:30:31.985 INFO:tasks.workunit.client.1.smithi106.stdout:6/755: dread - d0/d17/d34/dd0/df2/fb2 zero size 2024-05-09T06:30:31.986 INFO:tasks.workunit.client.1.smithi106.stdout:4/665: symlink d7/d39/d35/d7c/da8/ld9 0 2024-05-09T06:30:31.987 INFO:tasks.workunit.client.1.smithi106.stdout:7/696: mkdir d0/dc/d1a/d36/d30/d44/d6a/d72/ddd 0 2024-05-09T06:30:31.988 INFO:tasks.workunit.client.1.smithi106.stdout:7/697: fsync d0/dc/d1a/d5a/fca 0 2024-05-09T06:30:31.990 INFO:tasks.workunit.client.1.smithi106.stdout:0/736: mknod d1/d11/d7f/cfd 0 2024-05-09T06:30:31.991 INFO:tasks.workunit.client.1.smithi106.stdout:1/734: rename d4/d76/d13/c36 to d4/d76/d13/d2f/df5/dfd/c106 0 2024-05-09T06:30:31.994 INFO:tasks.workunit.client.1.smithi106.stdout:3/622: dread d5/d12/f19 [4194304,4194304] 0 2024-05-09T06:30:32.000 INFO:tasks.workunit.client.1.smithi106.stdout:8/667: dwrite d3/d5/d7/d15/d3e/d7d/f84 [0,4194304] 0 2024-05-09T06:30:32.000 INFO:tasks.workunit.client.1.smithi106.stdout:8/668: write d3/d5/d35/d61/d6c/d83/d89/fb0 [1684185,69761] 0 2024-05-09T06:30:32.000 INFO:tasks.workunit.client.1.smithi106.stdout:7/698: read d0/dc/d1a/d36/d30/d44/d58/d65/f8f [2474921,75230] 0 2024-05-09T06:30:32.000 INFO:tasks.workunit.client.1.smithi106.stdout:8/669: write d3/d5/d13/f14 [5946889,44061] 0 2024-05-09T06:30:32.000 INFO:tasks.workunit.client.1.smithi106.stdout:8/670: fsync d3/d5/d35/d4e/d32/d92/fbf 0 2024-05-09T06:30:32.001 INFO:tasks.workunit.client.1.smithi106.stdout:7/699: chown d0/f5b 0 1 2024-05-09T06:30:32.001 INFO:tasks.workunit.client.1.smithi106.stdout:5/739: mknod d8/d5a/cdf 0 2024-05-09T06:30:32.001 INFO:tasks.workunit.client.1.smithi106.stdout:5/740: write d8/f1a [1259811,3291] 0 2024-05-09T06:30:32.004 INFO:tasks.workunit.client.1.smithi106.stdout:4/666: unlink d7/l88 0 2024-05-09T06:30:32.005 INFO:tasks.workunit.client.1.smithi106.stdout:4/667: read d7/d10/f1d [67443,128743] 0 2024-05-09T06:30:32.006 INFO:tasks.workunit.client.1.smithi106.stdout:0/737: mknod d1/d11/d23/d13/cfe 0 2024-05-09T06:30:32.006 INFO:tasks.workunit.client.1.smithi106.stdout:4/668: creat d7/fda x:0 0 0 2024-05-09T06:30:32.006 INFO:tasks.workunit.client.1.smithi106.stdout:4/669: creat d7/d39/d35/dac/dd5/fdb x:0 0 0 2024-05-09T06:30:32.006 INFO:tasks.workunit.client.1.smithi106.stdout:4/670: chown d7/d10/d1a/f85 137 1 2024-05-09T06:30:32.006 INFO:tasks.workunit.client.1.smithi106.stdout:4/671: stat d7/d10/d1a/d5a/d1c/c74 0 2024-05-09T06:30:32.009 INFO:tasks.workunit.client.1.smithi106.stdout:8/671: rename d3/d5/d35/d73/l87 to d3/d6b/le4 0 2024-05-09T06:30:32.009 INFO:tasks.workunit.client.1.smithi106.stdout:8/672: fsync d3/d5/f12 0 2024-05-09T06:30:32.011 INFO:tasks.workunit.client.1.smithi106.stdout:5/741: creat d8/d45/d4c/d32/d5b/d69/fe0 x:0 0 0 2024-05-09T06:30:32.011 INFO:tasks.workunit.client.1.smithi106.stdout:5/742: creat d8/d45/d4c/d85/fe1 x:0 0 0 2024-05-09T06:30:32.013 INFO:tasks.workunit.client.1.smithi106.stdout:0/738: readlink d1/d11/d23/d13/d2c/l72 0 2024-05-09T06:30:32.015 INFO:tasks.workunit.client.1.smithi106.stdout:6/756: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fc7 [0,4194304] 0 2024-05-09T06:30:32.015 INFO:tasks.workunit.client.1.smithi106.stdout:6/757: readlink d0/d17/d34/d4e/d98/da9/db1/lba 0 2024-05-09T06:30:32.016 INFO:tasks.workunit.client.1.smithi106.stdout:4/672: link d7/d39/d47/d89/cd4 d7/d39/d35/cdc 0 2024-05-09T06:30:32.016 INFO:tasks.workunit.client.1.smithi106.stdout:7/700: dread d0/dc/d1a/d36/d30/d44/d58/f66 [0,4194304] 0 2024-05-09T06:30:32.018 INFO:tasks.workunit.client.1.smithi106.stdout:2/829: dwrite d2/d5/db/d1d/d23/d63/fb5 [0,4194304] 0 2024-05-09T06:30:32.018 INFO:tasks.workunit.client.1.smithi106.stdout:3/623: unlink d5/c9 0 2024-05-09T06:30:32.022 INFO:tasks.workunit.client.1.smithi106.stdout:5/743: mkdir d8/d45/d4c/d32/d5b/dda/de2 0 2024-05-09T06:30:32.022 INFO:tasks.workunit.client.1.smithi106.stdout:3/624: dread d5/d1c/f33 [0,4194304] 0 2024-05-09T06:30:32.022 INFO:tasks.workunit.client.1.smithi106.stdout:0/739: symlink d1/d11/d23/d13/d2c/d6d/d70/lff 0 2024-05-09T06:30:32.025 INFO:tasks.workunit.client.1.smithi106.stdout:7/701: rename d0/dc/d1a/d36/d30/d44/d58/f66 to d0/dc/d1a/d36/d30/d44/dc1/fde 0 2024-05-09T06:30:32.026 INFO:tasks.workunit.client.1.smithi106.stdout:1/735: dwrite d4/d76/d65/f66 [0,4194304] 0 2024-05-09T06:30:32.028 INFO:tasks.workunit.client.1.smithi106.stdout:2/830: mkdir d2/d5/d11f 0 2024-05-09T06:30:32.029 INFO:tasks.workunit.client.1.smithi106.stdout:4/673: dread d7/d10/f43 [0,4194304] 0 2024-05-09T06:30:32.029 INFO:tasks.workunit.client.1.smithi106.stdout:5/744: creat d8/d33/d3a/fe3 x:0 0 0 2024-05-09T06:30:32.030 INFO:tasks.workunit.client.1.smithi106.stdout:5/745: creat d8/d45/d4c/fe4 x:0 0 0 2024-05-09T06:30:32.030 INFO:tasks.workunit.client.1.smithi106.stdout:5/746: truncate d8/d45/d4c/d32/fc2 61677 0 2024-05-09T06:30:32.030 INFO:tasks.workunit.client.1.smithi106.stdout:0/740: chown d1/d11/d23/d13/d2c/f88 51078 1 2024-05-09T06:30:32.030 INFO:tasks.workunit.client.1.smithi106.stdout:0/741: chown d1/d11/d23/d13/d2c/fe9 2 1 2024-05-09T06:30:32.031 INFO:tasks.workunit.client.1.smithi106.stdout:0/742: dread - d1/d11/f8c zero size 2024-05-09T06:30:32.031 INFO:tasks.workunit.client.1.smithi106.stdout:8/673: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:32.035 INFO:tasks.workunit.client.1.smithi106.stdout:2/831: stat d2/d5/db/d1d/d23/d63/d7a/ccf 0 2024-05-09T06:30:32.036 INFO:tasks.workunit.client.1.smithi106.stdout:1/736: write d4/d76/d1d/f41 [2398101,75404] 0 2024-05-09T06:30:32.036 INFO:tasks.workunit.client.1.smithi106.stdout:1/737: write d4/d76/d13/f82 [660961,118410] 0 2024-05-09T06:30:32.036 INFO:tasks.workunit.client.1.smithi106.stdout:1/738: stat d4/d76/d1d/l1e 0 2024-05-09T06:30:32.038 INFO:tasks.workunit.client.1.smithi106.stdout:4/674: dread d7/d10/d1a/d5a/f55 [4194304,4194304] 0 2024-05-09T06:30:32.038 INFO:tasks.workunit.client.1.smithi106.stdout:4/675: fsync d7/d39/d47/d89/fb4 0 2024-05-09T06:30:32.038 INFO:tasks.workunit.client.1.smithi106.stdout:5/747: symlink d8/d5a/d60/le5 0 2024-05-09T06:30:32.038 INFO:tasks.workunit.client.1.smithi106.stdout:5/748: write d8/d5a/d60/da8/daa/fb2 [224646,56337] 0 2024-05-09T06:30:32.040 INFO:tasks.workunit.client.1.smithi106.stdout:8/674: dread d3/d5/d13/f29 [0,4194304] 0 2024-05-09T06:30:32.042 INFO:tasks.workunit.client.1.smithi106.stdout:0/743: unlink d1/d11/d23/d13/d2c/d3d/ca3 0 2024-05-09T06:30:32.042 INFO:tasks.workunit.client.1.smithi106.stdout:0/744: write d1/d11/d23/da6/f7b [2789092,11854] 0 2024-05-09T06:30:32.042 INFO:tasks.workunit.client.1.smithi106.stdout:0/745: write d1/d11/d23/d13/d58/da8/dd6/d7e/fa5 [2951931,80913] 0 2024-05-09T06:30:32.043 INFO:tasks.workunit.client.1.smithi106.stdout:7/702: truncate d0/dc/d1a/d36/d30/d44/f7e 1173923 0 2024-05-09T06:30:32.046 INFO:tasks.workunit.client.1.smithi106.stdout:4/676: creat d7/dcb/fdd x:0 0 0 2024-05-09T06:30:32.047 INFO:tasks.workunit.client.1.smithi106.stdout:5/749: write d8/d45/d4c/d32/d5b/f8c [2630017,108086] 0 2024-05-09T06:30:32.048 INFO:tasks.workunit.client.1.smithi106.stdout:5/750: write d8/d33/d3a/f88 [1121471,104772] 0 2024-05-09T06:30:32.048 INFO:tasks.workunit.client.1.smithi106.stdout:0/746: getdents d1/d11/d23/da6 0 2024-05-09T06:30:32.050 INFO:tasks.workunit.client.1.smithi106.stdout:4/677: write d7/d10/d1a/fa2 [4444827,14446] 0 2024-05-09T06:30:32.052 INFO:tasks.workunit.client.1.smithi106.stdout:7/703: creat d0/dc/d1a/d36/d30/d44/d80/fdf x:0 0 0 2024-05-09T06:30:32.052 INFO:tasks.workunit.client.1.smithi106.stdout:7/704: stat d0/dc/d1a/d36/d1e/f46 0 2024-05-09T06:30:32.054 INFO:tasks.workunit.client.1.smithi106.stdout:0/747: creat d1/d11/d23/f100 x:0 0 0 2024-05-09T06:30:32.054 INFO:tasks.workunit.client.1.smithi106.stdout:1/739: write d4/fdd [2881220,118041] 0 2024-05-09T06:30:32.054 INFO:tasks.workunit.client.1.smithi106.stdout:1/740: write d4/d76/d13/d60/fc5 [896552,78815] 0 2024-05-09T06:30:32.055 INFO:tasks.workunit.client.1.smithi106.stdout:1/741: fsync d4/d5/f89 0 2024-05-09T06:30:32.055 INFO:tasks.workunit.client.1.smithi106.stdout:7/705: creat d0/dc/d45/da6/fe0 x:0 0 0 2024-05-09T06:30:32.066 INFO:tasks.workunit.client.1.smithi106.stdout:1/742: write d4/d5/ff [2639933,97006] 0 2024-05-09T06:30:32.067 INFO:tasks.workunit.client.1.smithi106.stdout:1/743: write d4/d76/d1d/f4e [870371,12011] 0 2024-05-09T06:30:32.067 INFO:tasks.workunit.client.1.smithi106.stdout:7/706: unlink d0/f52 0 2024-05-09T06:30:32.067 INFO:tasks.workunit.client.1.smithi106.stdout:7/707: write d0/dc/d1a/f3a [1882960,69493] 0 2024-05-09T06:30:32.069 INFO:tasks.workunit.client.1.smithi106.stdout:1/744: truncate d4/dbd/de6/f100 983469 0 2024-05-09T06:30:32.069 INFO:tasks.workunit.client.1.smithi106.stdout:1/745: creat d4/dbd/f107 x:0 0 0 2024-05-09T06:30:32.069 INFO:tasks.workunit.client.1.smithi106.stdout:1/746: creat d4/d76/d65/d67/f108 x:0 0 0 2024-05-09T06:30:32.070 INFO:tasks.workunit.client.1.smithi106.stdout:7/708: truncate d0/dc/d1a/d36/d1e/d68/f6b 1189201 0 2024-05-09T06:30:32.072 INFO:tasks.workunit.client.1.smithi106.stdout:8/675: dwrite d3/d5/d35/d61/d6c/d83/d89/d9b/fc4 [0,4194304] 0 2024-05-09T06:30:32.072 INFO:tasks.workunit.client.1.smithi106.stdout:8/676: write d3/d5/dbc/fc3 [5926,80580] 0 2024-05-09T06:30:32.078 INFO:tasks.workunit.client.1.smithi106.stdout:5/751: dwrite d8/d5a/d60/d7e/dae/fd5 [0,4194304] 0 2024-05-09T06:30:32.078 INFO:tasks.workunit.client.1.smithi106.stdout:5/752: chown d8/d33/d3a/d59/dd1 6632658 1 2024-05-09T06:30:32.078 INFO:tasks.workunit.client.1.smithi106.stdout:5/753: chown d8/d45/d4c/d32/d5b/dda/l81 4754 1 2024-05-09T06:30:32.078 INFO:tasks.workunit.client.1.smithi106.stdout:0/748: dwrite d1/da1/d93/fe6 [4194304,4194304] 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:8/677: unlink d3/d5/d35/d4e/l53 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:8/678: read d3/d5/d13/d3a/dbe/dc0/fb6 [291640,98604] 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:1/747: dread d4/f14 [0,4194304] 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:1/748: write d4/d76/d65/f88 [188660,12157] 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:1/749: creat d4/d76/d13/d2f/f109 x:0 0 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:1/750: creat d4/d76/db3/f10a x:0 0 0 2024-05-09T06:30:32.084 INFO:tasks.workunit.client.1.smithi106.stdout:1/751: write d4/d37/f93 [1519338,105327] 0 2024-05-09T06:30:32.085 INFO:tasks.workunit.client.1.smithi106.stdout:4/678: dwrite d7/d39/d35/d6f/fa4 [0,4194304] 0 2024-05-09T06:30:32.086 INFO:tasks.workunit.client.1.smithi106.stdout:4/679: chown d7/d28/f73 1759 1 2024-05-09T06:30:32.092 INFO:tasks.workunit.client.1.smithi106.stdout:8/679: write d3/d5/d35/d73/f4f [5107825,31527] 0 2024-05-09T06:30:32.094 INFO:tasks.workunit.client.1.smithi106.stdout:5/754: rmdir d8/d45/d4c/d32/d5b/dda/de2 0 2024-05-09T06:30:32.095 INFO:tasks.workunit.client.1.smithi106.stdout:7/709: dwrite d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/fa3 [4194304,4194304] 0 2024-05-09T06:30:32.095 INFO:tasks.workunit.client.1.smithi106.stdout:0/749: dwrite d1/d11/d23/d22/f99 [0,4194304] 0 2024-05-09T06:30:32.099 INFO:tasks.workunit.client.1.smithi106.stdout:1/752: symlink d4/d76/d65/d8d/dad/l10b 0 2024-05-09T06:30:32.101 INFO:tasks.workunit.client.1.smithi106.stdout:8/680: dread d3/d5/d35/d4e/d32/fac [0,4194304] 0 2024-05-09T06:30:32.104 INFO:tasks.workunit.client.1.smithi106.stdout:4/680: creat d7/d39/d35/d4a/fde x:0 0 0 2024-05-09T06:30:32.106 INFO:tasks.workunit.client.1.smithi106.stdout:5/755: rename d8/d45/d4c/d32/d5b/f29 to d8/d33/d3a/fe6 0 2024-05-09T06:30:32.106 INFO:tasks.workunit.client.1.smithi106.stdout:5/756: write d8/d5a/d60/da8/daa/fb0 [773938,122452] 0 2024-05-09T06:30:32.106 INFO:tasks.workunit.client.1.smithi106.stdout:5/757: chown d8/d45/c61 9 1 2024-05-09T06:30:32.106 INFO:tasks.workunit.client.1.smithi106.stdout:5/758: fsync d8/d5a/d60/d7e/dae/fd5 0 2024-05-09T06:30:32.106 INFO:tasks.workunit.client.1.smithi106.stdout:5/759: chown d8/d45/d4c/d85/dc3 0 1 2024-05-09T06:30:32.107 INFO:tasks.workunit.client.1.smithi106.stdout:5/760: dread d8/d45/d4c/d32/fc2 [0,4194304] 0 2024-05-09T06:30:32.107 INFO:tasks.workunit.client.1.smithi106.stdout:5/761: truncate d8/d33/d3a/d59/dd1/fd4 397110 0 2024-05-09T06:30:32.107 INFO:tasks.workunit.client.1.smithi106.stdout:5/762: stat d8/f50 0 2024-05-09T06:30:32.108 INFO:tasks.workunit.client.1.smithi106.stdout:7/710: getdents d0/da5 0 2024-05-09T06:30:32.108 INFO:tasks.workunit.client.1.smithi106.stdout:7/711: write d0/dc/d1a/d36/d30/d44/d58/f5f [5199461,12178] 0 2024-05-09T06:30:32.114 INFO:tasks.workunit.client.1.smithi106.stdout:1/753: symlink d4/d76/db3/l10c 0 2024-05-09T06:30:32.115 INFO:tasks.workunit.client.1.smithi106.stdout:8/681: symlink d3/d5/d35/d73/le5 0 2024-05-09T06:30:32.115 INFO:tasks.workunit.client.1.smithi106.stdout:8/682: stat d3/d5/d35/d4e/d32/dd3/fe2 0 2024-05-09T06:30:32.116 INFO:tasks.workunit.client.1.smithi106.stdout:8/683: creat d3/d5/d7/fe6 x:0 0 0 2024-05-09T06:30:32.116 INFO:tasks.workunit.client.1.smithi106.stdout:5/763: dread d8/f4e [0,4194304] 0 2024-05-09T06:30:32.120 INFO:tasks.workunit.client.1.smithi106.stdout:0/750: mknod d1/d11/d23/d13/d2c/c101 0 2024-05-09T06:30:32.124 INFO:tasks.workunit.client.1.smithi106.stdout:8/684: creat d3/d5/d7/d15/d3e/d7d/fe7 x:0 0 0 2024-05-09T06:30:32.124 INFO:tasks.workunit.client.1.smithi106.stdout:8/685: truncate d3/d5/d7/fcd 742583 0 2024-05-09T06:30:32.124 INFO:tasks.workunit.client.1.smithi106.stdout:9/739: sync 2024-05-09T06:30:32.125 INFO:tasks.workunit.client.1.smithi106.stdout:9/740: write d4/d54/d69/d99/d2a/f75 [1396280,22303] 0 2024-05-09T06:30:32.125 INFO:tasks.workunit.client.1.smithi106.stdout:5/764: rename d8/l25 to d8/d33/d3a/d59/le7 0 2024-05-09T06:30:32.128 INFO:tasks.workunit.client.1.smithi106.stdout:4/681: dwrite d7/d28/d2a/f9f [0,4194304] 0 2024-05-09T06:30:32.128 INFO:tasks.workunit.client.1.smithi106.stdout:4/682: dread - d7/d39/d35/fc2 zero size 2024-05-09T06:30:32.128 INFO:tasks.workunit.client.1.smithi106.stdout:7/712: dwrite d0/dc/d1a/fc7 [0,4194304] 0 2024-05-09T06:30:32.128 INFO:tasks.workunit.client.1.smithi106.stdout:7/713: chown d0/dc/d45/da6/fe0 62592170 1 2024-05-09T06:30:32.128 INFO:tasks.workunit.client.1.smithi106.stdout:0/751: link d1/da1/d83/fe4 d1/da1/f102 0 2024-05-09T06:30:32.129 INFO:tasks.workunit.client.1.smithi106.stdout:7/714: dread - d0/d53/d7a/fd7 zero size 2024-05-09T06:30:32.129 INFO:tasks.workunit.client.1.smithi106.stdout:0/752: chown d1/d11/d23/d13/d2c/cf5 5 1 2024-05-09T06:30:32.130 INFO:tasks.workunit.client.1.smithi106.stdout:1/754: getdents d4/d76/d65/d8d/db5 0 2024-05-09T06:30:32.134 INFO:tasks.workunit.client.1.smithi106.stdout:8/686: unlink d3/d5/d35/d4e/f67 0 2024-05-09T06:30:32.134 INFO:tasks.workunit.client.1.smithi106.stdout:8/687: write d3/d5/d7/d15/d47/fcf [3960354,128780] 0 2024-05-09T06:30:32.134 INFO:tasks.workunit.client.1.smithi106.stdout:8/688: dread - d3/d5/d7/fb5 zero size 2024-05-09T06:30:32.137 INFO:tasks.workunit.client.1.smithi106.stdout:9/741: creat d4/d54/d91/dbf/fdd x:0 0 0 2024-05-09T06:30:32.139 INFO:tasks.workunit.client.1.smithi106.stdout:4/683: dread d7/d10/f16 [0,4194304] 0 2024-05-09T06:30:32.140 INFO:tasks.workunit.client.1.smithi106.stdout:8/689: dread d3/d5/d35/d4e/d32/f9a [0,4194304] 0 2024-05-09T06:30:32.140 INFO:tasks.workunit.client.1.smithi106.stdout:8/690: creat d3/d5/dbc/fe8 x:0 0 0 2024-05-09T06:30:32.142 INFO:tasks.workunit.client.1.smithi106.stdout:7/715: write d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/fa3 [4278878,18301] 0 2024-05-09T06:30:32.142 INFO:tasks.workunit.client.1.smithi106.stdout:5/765: dwrite d8/d33/d74/f84 [0,4194304] 0 2024-05-09T06:30:32.143 INFO:tasks.workunit.client.1.smithi106.stdout:0/753: mknod d1/d11/d23/da6/c103 0 2024-05-09T06:30:32.144 INFO:tasks.workunit.client.1.smithi106.stdout:0/754: write d1/d11/d23/d13/d2c/d6d/f6f [771838,67824] 0 2024-05-09T06:30:32.145 INFO:tasks.workunit.client.1.smithi106.stdout:0/755: dread - d1/da1/d83/f89 zero size 2024-05-09T06:30:32.145 INFO:tasks.workunit.client.1.smithi106.stdout:0/756: fdatasync d1/d11/d23/d13/d58/fc8 0 2024-05-09T06:30:32.145 INFO:tasks.workunit.client.1.smithi106.stdout:1/755: rename d4/d37/fd0 to d4/d76/d65/d67/f10d 0 2024-05-09T06:30:32.149 INFO:tasks.workunit.client.1.smithi106.stdout:9/742: link d4/d54/d69/d99/d2a/d61/l76 d4/d54/lde 0 2024-05-09T06:30:32.154 INFO:tasks.workunit.client.1.smithi106.stdout:5/766: symlink d8/d5a/d60/dd6/le8 0 2024-05-09T06:30:32.157 INFO:tasks.workunit.client.1.smithi106.stdout:0/757: creat d1/d11/d7f/f104 x:0 0 0 2024-05-09T06:30:32.157 INFO:tasks.workunit.client.1.smithi106.stdout:0/758: dread - d1/d11/d23/d13/d2c/d6d/dce/fd4 zero size 2024-05-09T06:30:32.157 INFO:tasks.workunit.client.1.smithi106.stdout:0/759: chown d1/d11/d23/d13/d58/da8/dd6 3193740 1 2024-05-09T06:30:32.157 INFO:tasks.workunit.client.1.smithi106.stdout:0/760: readlink d1/d11/d23/d13/d2c/d6d/d70/ld7 0 2024-05-09T06:30:32.159 INFO:tasks.workunit.client.1.smithi106.stdout:5/767: mkdir d8/d45/d4c/d32/d5b/d69/dde/de9 0 2024-05-09T06:30:32.159 INFO:tasks.workunit.client.1.smithi106.stdout:5/768: chown d8/d33/d3a/d59/d99/cb9 1 1 2024-05-09T06:30:32.160 INFO:tasks.workunit.client.1.smithi106.stdout:9/743: dread d4/d54/d69/d99/d2a/d42/d6c/d6d/f81 [0,4194304] 0 2024-05-09T06:30:32.162 INFO:tasks.workunit.client.1.smithi106.stdout:5/769: creat d8/d45/d4c/d32/d5b/dda/fea x:0 0 0 2024-05-09T06:30:32.162 INFO:tasks.workunit.client.1.smithi106.stdout:5/770: read d8/fa [3663727,93482] 0 2024-05-09T06:30:32.162 INFO:tasks.workunit.client.1.smithi106.stdout:5/771: write d8/d45/d4c/d32/d5b/f8c [4341011,118184] 0 2024-05-09T06:30:32.162 INFO:tasks.workunit.client.1.smithi106.stdout:6/758: sync 2024-05-09T06:30:32.164 INFO:tasks.workunit.client.1.smithi106.stdout:8/691: rename d3/d5/d13/d3a/dbe/dc0 to d3/d5/d35/d61/d6c/d83/dcc/de9 0 2024-05-09T06:30:32.166 INFO:tasks.workunit.client.1.smithi106.stdout:6/759: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/cff 0 2024-05-09T06:30:32.166 INFO:tasks.workunit.client.1.smithi106.stdout:6/760: fsync d0/d17/d34/d4e/d98/da9/db1/d8/d50/fd4 0 2024-05-09T06:30:32.167 INFO:tasks.workunit.client.1.smithi106.stdout:6/761: read d0/d17/d76/d8b/f91 [7357834,21296] 0 2024-05-09T06:30:32.167 INFO:tasks.workunit.client.1.smithi106.stdout:6/762: truncate d0/d17/d34/d4e/d98/da9/db1/d8/d27/fea 485867 0 2024-05-09T06:30:32.167 INFO:tasks.workunit.client.1.smithi106.stdout:0/761: read d1/d11/d23/d22/f4e [1404005,3183] 0 2024-05-09T06:30:32.169 INFO:tasks.workunit.client.1.smithi106.stdout:7/716: dwrite d0/dc/d1a/d36/d30/d44/d58/d65/f8f [0,4194304] 0 2024-05-09T06:30:32.170 INFO:tasks.workunit.client.1.smithi106.stdout:9/744: rename d4/d54/d91/laf to d4/d54/d69/d95/d23/d16/dd1/d47/ldf 0 2024-05-09T06:30:32.170 INFO:tasks.workunit.client.1.smithi106.stdout:4/684: dwrite d7/d10/d1a/d5a/d1c/f72 [0,4194304] 0 2024-05-09T06:30:32.170 INFO:tasks.workunit.client.1.smithi106.stdout:4/685: fdatasync d7/d10/d1a/d5a/d46/f54 0 2024-05-09T06:30:32.171 INFO:tasks.workunit.client.1.smithi106.stdout:4/686: creat d7/d10/d1a/d5a/d1c/da7/fdf x:0 0 0 2024-05-09T06:30:32.171 INFO:tasks.workunit.client.1.smithi106.stdout:1/756: dwrite d4/da7/fae [0,4194304] 0 2024-05-09T06:30:32.171 INFO:tasks.workunit.client.1.smithi106.stdout:8/692: creat d3/d5/d35/fea x:0 0 0 2024-05-09T06:30:32.173 INFO:tasks.workunit.client.1.smithi106.stdout:6/763: link d0/d17/d34/d4e/d98/da9/db1/la5 d0/d17/d76/l100 0 2024-05-09T06:30:32.174 INFO:tasks.workunit.client.1.smithi106.stdout:0/762: symlink d1/d11/l105 0 2024-05-09T06:30:32.177 INFO:tasks.workunit.client.1.smithi106.stdout:7/717: creat d0/dc/d1a/d36/d30/d44/d6a/fe1 x:0 0 0 2024-05-09T06:30:32.177 INFO:tasks.workunit.client.1.smithi106.stdout:7/718: fdatasync d0/dc/d1a/d36/d1e/f21 0 2024-05-09T06:30:32.178 INFO:tasks.workunit.client.1.smithi106.stdout:7/719: write d0/dc/d1a/d36/d30/f26 [5223064,13285] 0 2024-05-09T06:30:32.178 INFO:tasks.workunit.client.1.smithi106.stdout:9/745: mknod d4/d54/d69/d95/d23/d78/dd8/ce0 0 2024-05-09T06:30:32.178 INFO:tasks.workunit.client.1.smithi106.stdout:8/693: write d3/d5/d35/d4e/d32/fac [1128623,18799] 0 2024-05-09T06:30:32.179 INFO:tasks.workunit.client.1.smithi106.stdout:5/772: dwrite d8/d45/f70 [0,4194304] 0 2024-05-09T06:30:32.179 INFO:tasks.workunit.client.1.smithi106.stdout:5/773: chown d8/d33 82487 1 2024-05-09T06:30:32.181 INFO:tasks.workunit.client.1.smithi106.stdout:4/687: symlink d7/d10/d1a/d5a/d7a/d7f/dc8/le0 0 2024-05-09T06:30:32.185 INFO:tasks.workunit.client.1.smithi106.stdout:0/763: dread d1/d11/d23/d13/f15 [0,4194304] 0 2024-05-09T06:30:32.193 INFO:tasks.workunit.client.1.smithi106.stdout:1/757: rename d4/d76/d1d/c31 to d4/d76/d13/d2f/df5/c10e 0 2024-05-09T06:30:32.193 INFO:tasks.workunit.client.1.smithi106.stdout:1/758: write d4/d5/ff [3410159,121301] 0 2024-05-09T06:30:32.193 INFO:tasks.workunit.client.1.smithi106.stdout:1/759: write d4/d37/f92 [415227,4231] 0 2024-05-09T06:30:32.194 INFO:tasks.workunit.client.1.smithi106.stdout:6/764: symlink d0/d17/d34/d95/l101 0 2024-05-09T06:30:32.196 INFO:tasks.workunit.client.1.smithi106.stdout:7/720: truncate d0/dc/d1a/d36/d30/d44/d6a/d72/f88 53300 0 2024-05-09T06:30:32.196 INFO:tasks.workunit.client.1.smithi106.stdout:7/721: stat d0/dc/d1a/d36/d30/d44/d58 0 2024-05-09T06:30:32.196 INFO:tasks.workunit.client.1.smithi106.stdout:7/722: dread - d0/dc/d1a/d36/d30/fcf zero size 2024-05-09T06:30:32.196 INFO:tasks.workunit.client.1.smithi106.stdout:7/723: fdatasync d0/dc/d1a/d36/f9c 0 2024-05-09T06:30:32.196 INFO:tasks.workunit.client.1.smithi106.stdout:4/688: dwrite d7/d39/d35/dac/dd5/fdb [0,4194304] 0 2024-05-09T06:30:32.197 INFO:tasks.workunit.client.1.smithi106.stdout:9/746: mknod d4/d54/d69/d95/d23/d78/d8f/ce1 0 2024-05-09T06:30:32.201 INFO:tasks.workunit.client.1.smithi106.stdout:8/694: mkdir d3/d5/d35/d61/d6c/d83/d89/deb 0 2024-05-09T06:30:32.203 INFO:tasks.workunit.client.1.smithi106.stdout:5/774: creat d8/feb x:0 0 0 2024-05-09T06:30:32.204 INFO:tasks.workunit.client.1.smithi106.stdout:0/764: mkdir d1/da1/dd8/d106 0 2024-05-09T06:30:32.204 INFO:tasks.workunit.client.1.smithi106.stdout:0/765: chown d1/d11/d23/da6/c103 17059 1 2024-05-09T06:30:32.206 INFO:tasks.workunit.client.1.smithi106.stdout:2/832: sync 2024-05-09T06:30:32.206 INFO:tasks.workunit.client.1.smithi106.stdout:3/625: sync 2024-05-09T06:30:32.206 INFO:tasks.workunit.client.1.smithi106.stdout:3/626: fsync d5/d1c/f33 0 2024-05-09T06:30:32.206 INFO:tasks.workunit.client.1.smithi106.stdout:2/833: readlink d2/d5/db/d1d/d23/d63/d7a/lde 0 2024-05-09T06:30:32.207 INFO:tasks.workunit.client.1.smithi106.stdout:6/765: creat d0/d17/d34/d4e/d98/da9/db1/d8/d9c/f102 x:0 0 0 2024-05-09T06:30:32.207 INFO:tasks.workunit.client.1.smithi106.stdout:3/627: dread d5/d1c/d24/f28 [8388608,4194304] 0 2024-05-09T06:30:32.208 INFO:tasks.workunit.client.1.smithi106.stdout:7/724: truncate d0/dc/d1a/fc7 3082106 0 2024-05-09T06:30:32.213 INFO:tasks.workunit.client.1.smithi106.stdout:1/760: dwrite d4/d37/d3d/f73 [0,4194304] 0 2024-05-09T06:30:32.213 INFO:tasks.workunit.client.1.smithi106.stdout:5/775: write d8/d33/f3b [2326753,88295] 0 2024-05-09T06:30:32.213 INFO:tasks.workunit.client.1.smithi106.stdout:5/776: write d8/f10 [5443375,61783] 0 2024-05-09T06:30:32.213 INFO:tasks.workunit.client.1.smithi106.stdout:9/747: link d4/d54/d69/d95/f5e d4/d54/d69/d95/d23/d16/dd1/d31/fe2 0 2024-05-09T06:30:32.217 INFO:tasks.workunit.client.1.smithi106.stdout:8/695: truncate d3/d5/d7/d98/faa 239799 0 2024-05-09T06:30:32.223 INFO:tasks.workunit.client.1.smithi106.stdout:0/766: mknod d1/d11/d23/d13/d2c/d3d/dbe/c107 0 2024-05-09T06:30:32.224 INFO:tasks.workunit.client.1.smithi106.stdout:8/696: dread d3/d5/d7/d98/fae [0,4194304] 0 2024-05-09T06:30:32.225 INFO:tasks.workunit.client.1.smithi106.stdout:2/834: rename d2/d5/db/d15/f47 to d2/d5/db/d15/dd6/deb/f120 0 2024-05-09T06:30:32.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/766: creat d0/d66/d7e/de5/f103 x:0 0 0 2024-05-09T06:30:32.228 INFO:tasks.workunit.client.1.smithi106.stdout:3/628: mknod d5/d12/cc2 0 2024-05-09T06:30:32.229 INFO:tasks.workunit.client.1.smithi106.stdout:7/725: mknod d0/dc/d1a/d36/d30/d44/d6a/d72/ce2 0 2024-05-09T06:30:32.229 INFO:tasks.workunit.client.1.smithi106.stdout:7/726: write d0/dc/d1a/f83 [505365,113660] 0 2024-05-09T06:30:32.230 INFO:tasks.workunit.client.1.smithi106.stdout:1/761: mkdir d4/d76/d65/d8d/db5/d10f 0 2024-05-09T06:30:32.231 INFO:tasks.workunit.client.1.smithi106.stdout:1/762: write d4/d37/f92 [365618,126126] 0 2024-05-09T06:30:32.231 INFO:tasks.workunit.client.1.smithi106.stdout:1/763: read - d4/d76/db3/f10a zero size 2024-05-09T06:30:32.232 INFO:tasks.workunit.client.1.smithi106.stdout:5/777: mkdir d8/d45/d4c/d32/d5b/dec 0 2024-05-09T06:30:32.233 INFO:tasks.workunit.client.1.smithi106.stdout:5/778: chown d8/d33/d74/fb7 6732 1 2024-05-09T06:30:32.235 INFO:tasks.workunit.client.1.smithi106.stdout:2/835: dread d2/d5/db/d1d/d90/faa [0,4194304] 0 2024-05-09T06:30:32.237 INFO:tasks.workunit.client.1.smithi106.stdout:9/748: dwrite d4/d54/d69/d99/d2a/d42/d6c/d6d/fd6 [0,4194304] 0 2024-05-09T06:30:32.237 INFO:tasks.workunit.client.1.smithi106.stdout:9/749: fdatasync d4/d54/d69/d95/d23/d16/dd1/d47/f7c 0 2024-05-09T06:30:32.237 INFO:tasks.workunit.client.1.smithi106.stdout:6/767: read d0/d17/d34/d95/fa4 [2775199,14354] 0 2024-05-09T06:30:32.239 INFO:tasks.workunit.client.1.smithi106.stdout:7/727: symlink d0/dc/le3 0 2024-05-09T06:30:32.239 INFO:tasks.workunit.client.1.smithi106.stdout:7/728: write d0/dc/d1a/d36/f3f [3459153,42307] 0 2024-05-09T06:30:32.240 INFO:tasks.workunit.client.1.smithi106.stdout:5/779: mkdir d8/d45/d4c/d32/ded 0 2024-05-09T06:30:32.240 INFO:tasks.workunit.client.1.smithi106.stdout:5/780: write d8/d45/d4c/d32/fc2 [826163,69265] 0 2024-05-09T06:30:32.241 INFO:tasks.workunit.client.1.smithi106.stdout:2/836: rmdir d2/d5/db/d1d/d23/d5e 39 2024-05-09T06:30:32.241 INFO:tasks.workunit.client.1.smithi106.stdout:2/837: write d2/d5/db/d15/d41/f74 [3210645,48338] 0 2024-05-09T06:30:32.241 INFO:tasks.workunit.client.1.smithi106.stdout:5/781: dread d8/d33/d3a/fe6 [0,4194304] 0 2024-05-09T06:30:32.243 INFO:tasks.workunit.client.1.smithi106.stdout:0/767: link d1/d11/d23/c6c d1/d11/d23/d13/d2c/c108 0 2024-05-09T06:30:32.251 INFO:tasks.workunit.client.1.smithi106.stdout:9/750: mkdir d4/d54/d69/d99/d2a/d42/dc8/de3 0 2024-05-09T06:30:32.253 INFO:tasks.workunit.client.1.smithi106.stdout:6/768: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f104 x:0 0 0 2024-05-09T06:30:32.257 INFO:tasks.workunit.client.1.smithi106.stdout:2/838: dwrite d2/d5/db/d15/dd6/f11c [0,4194304] 0 2024-05-09T06:30:32.257 INFO:tasks.workunit.client.1.smithi106.stdout:2/839: truncate d2/d5/db/d1d/d6a/f86 908095 0 2024-05-09T06:30:32.258 INFO:tasks.workunit.client.1.smithi106.stdout:9/751: truncate d4/d54/d69/d99/d2a/d42/f4f 101919 0 2024-05-09T06:30:32.258 INFO:tasks.workunit.client.1.smithi106.stdout:9/752: getdents d4/d54/d69/d95/d23/d16/dd1/d31/dbd 0 2024-05-09T06:30:32.261 INFO:tasks.workunit.client.1.smithi106.stdout:6/769: symlink d0/d17/d76/d8b/l105 0 2024-05-09T06:30:32.262 INFO:tasks.workunit.client.1.smithi106.stdout:7/729: rmdir d0/dc/d1a/d36/d1e/d68 39 2024-05-09T06:30:32.267 INFO:tasks.workunit.client.1.smithi106.stdout:9/753: mkdir d4/d54/d69/d95/d23/d78/d8f/de4 0 2024-05-09T06:30:32.269 INFO:tasks.workunit.client.1.smithi106.stdout:3/629: rename d5/d12 to d5/d85/dc3 0 2024-05-09T06:30:32.271 INFO:tasks.workunit.client.1.smithi106.stdout:6/770: unlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/c7a 0 2024-05-09T06:30:32.271 INFO:tasks.workunit.client.1.smithi106.stdout:6/771: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f106 x:0 0 0 2024-05-09T06:30:32.272 INFO:tasks.workunit.client.1.smithi106.stdout:9/754: mkdir d4/d54/d69/d95/d23/d16/dd1/d47/de5 0 2024-05-09T06:30:32.272 INFO:tasks.workunit.client.1.smithi106.stdout:9/755: creat d4/d54/d69/d95/d23/d78/fe6 x:0 0 0 2024-05-09T06:30:32.274 INFO:tasks.workunit.client.1.smithi106.stdout:1/764: rename d4/fb to d4/d76/d65/d8d/db5/f110 0 2024-05-09T06:30:32.276 INFO:tasks.workunit.client.1.smithi106.stdout:6/772: mkdir d0/d66/d107 0 2024-05-09T06:30:32.277 INFO:tasks.workunit.client.1.smithi106.stdout:9/756: unlink d4/d54/d69/d95/d23/d16/dd1/d39/f88 0 2024-05-09T06:30:32.279 INFO:tasks.workunit.client.1.smithi106.stdout:5/782: rename d8/d33/f4f to d8/d5a/d60/fee 0 2024-05-09T06:30:32.281 INFO:tasks.workunit.client.1.smithi106.stdout:1/765: link d4/d76/d13/d2f/c6c d4/d37/c111 0 2024-05-09T06:30:32.281 INFO:tasks.workunit.client.1.smithi106.stdout:1/766: fdatasync d4/d5b/fe8 0 2024-05-09T06:30:32.281 INFO:tasks.workunit.client.1.smithi106.stdout:9/757: creat d4/d54/d69/d95/d23/d16/fe7 x:0 0 0 2024-05-09T06:30:32.282 INFO:tasks.workunit.client.1.smithi106.stdout:2/840: rename d2/d7/d2c/l102 to d2/d7/l121 0 2024-05-09T06:30:32.283 INFO:tasks.workunit.client.1.smithi106.stdout:6/773: rename d0/d17/d34/d95/l101 to d0/d66/d7e/l108 0 2024-05-09T06:30:32.284 INFO:tasks.workunit.client.1.smithi106.stdout:2/841: getdents d2/d7/d89 0 2024-05-09T06:30:32.284 INFO:tasks.workunit.client.1.smithi106.stdout:2/842: fdatasync d2/d7/db7/fa0 0 2024-05-09T06:30:32.285 INFO:tasks.workunit.client.1.smithi106.stdout:6/774: rename d0/d17/d76/d8b to d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/d109 0 2024-05-09T06:30:32.286 INFO:tasks.workunit.client.1.smithi106.stdout:2/843: unlink d2/d5/f5d 0 2024-05-09T06:30:32.287 INFO:tasks.workunit.client.1.smithi106.stdout:2/844: chown d2/d5/db/l114 4029807 1 2024-05-09T06:30:32.287 INFO:tasks.workunit.client.1.smithi106.stdout:1/767: dread d4/fdd [0,4194304] 0 2024-05-09T06:30:32.287 INFO:tasks.workunit.client.1.smithi106.stdout:1/768: symlink d4/d76/db3/l112 0 2024-05-09T06:30:32.289 INFO:tasks.workunit.client.1.smithi106.stdout:2/845: dread d2/d5/db/d1d/f3d [0,4194304] 0 2024-05-09T06:30:32.289 INFO:tasks.workunit.client.1.smithi106.stdout:2/846: dread - d2/d5/db/d15/dd6/deb/ff4 zero size 2024-05-09T06:30:32.292 INFO:tasks.workunit.client.1.smithi106.stdout:2/847: dread d2/d5/db/d1d/f4a [0,4194304] 0 2024-05-09T06:30:32.292 INFO:tasks.workunit.client.1.smithi106.stdout:2/848: write d2/d5/db/d15/d41/d58/f10e [3611290,42136] 0 2024-05-09T06:30:32.308 INFO:tasks.workunit.client.1.smithi106.stdout:7/730: dwrite d0/dc/d45/da6/fe0 [0,4194304] 0 2024-05-09T06:30:32.308 INFO:tasks.workunit.client.1.smithi106.stdout:7/731: write d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/fa9 [2170520,39586] 0 2024-05-09T06:30:32.308 INFO:tasks.workunit.client.1.smithi106.stdout:3/630: dwrite d5/d1c/d24/d89/fc1 [0,4194304] 0 2024-05-09T06:30:32.311 INFO:tasks.workunit.client.1.smithi106.stdout:9/758: write d4/d54/d69/f85 [2851317,45017] 0 2024-05-09T06:30:32.316 INFO:tasks.workunit.client.1.smithi106.stdout:2/849: dwrite d2/d5/db/d15/dd6/deb/f120 [0,4194304] 0 2024-05-09T06:30:32.316 INFO:tasks.workunit.client.1.smithi106.stdout:2/850: readlink d2/d5/db/d15/d41/d58/l7e 0 2024-05-09T06:30:32.316 INFO:tasks.workunit.client.1.smithi106.stdout:5/783: dwrite d8/d5a/d60/da8/fcf [0,4194304] 0 2024-05-09T06:30:32.316 INFO:tasks.workunit.client.1.smithi106.stdout:5/784: fsync d8/d33/d3a/fe3 0 2024-05-09T06:30:32.316 INFO:tasks.workunit.client.1.smithi106.stdout:5/785: write d8/d5a/f73 [651823,115810] 0 2024-05-09T06:30:32.316 INFO:tasks.workunit.client.1.smithi106.stdout:5/786: dread - d8/d45/d4c/fc0 zero size 2024-05-09T06:30:32.317 INFO:tasks.workunit.client.1.smithi106.stdout:3/631: mknod d5/d1c/d24/d98/dc0/d32/d96/cc4 0 2024-05-09T06:30:32.318 INFO:tasks.workunit.client.1.smithi106.stdout:9/759: mknod d4/d54/d69/d99/ce8 0 2024-05-09T06:30:32.321 INFO:tasks.workunit.client.1.smithi106.stdout:2/851: creat d2/d5/db/d15/d41/f122 x:0 0 0 2024-05-09T06:30:32.321 INFO:tasks.workunit.client.1.smithi106.stdout:2/852: creat d2/d7/d89/d104/f123 x:0 0 0 2024-05-09T06:30:32.321 INFO:tasks.workunit.client.1.smithi106.stdout:2/853: creat d2/d5/db/d15/d41/d58/ddf/f124 x:0 0 0 2024-05-09T06:30:32.321 INFO:tasks.workunit.client.1.smithi106.stdout:2/854: write d2/d5/db/d15/d41/d58/ff0 [277552,43711] 0 2024-05-09T06:30:32.324 INFO:tasks.workunit.client.1.smithi106.stdout:4/689: sync 2024-05-09T06:30:32.324 INFO:tasks.workunit.client.1.smithi106.stdout:4/690: creat d7/d10/d1a/d5a/d7a/d7f/fe1 x:0 0 0 2024-05-09T06:30:32.327 INFO:tasks.workunit.client.1.smithi106.stdout:3/632: creat d5/d85/dc3/d65/fc5 x:0 0 0 2024-05-09T06:30:32.328 INFO:tasks.workunit.client.1.smithi106.stdout:9/760: mkdir d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9 0 2024-05-09T06:30:32.328 INFO:tasks.workunit.client.1.smithi106.stdout:7/732: dwrite d0/f5b [0,4194304] 0 2024-05-09T06:30:32.330 INFO:tasks.workunit.client.1.smithi106.stdout:2/855: dread d2/d7/d2c/f34 [0,4194304] 0 2024-05-09T06:30:32.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/775: dwrite d0/d66/d7e/f26 [0,4194304] 0 2024-05-09T06:30:32.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/776: truncate d0/d66/d7e/fec 1093862 0 2024-05-09T06:30:32.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/777: truncate d0/d17/d34/d4e/d98/da9/db1/d8/f70 4621601 0 2024-05-09T06:30:32.330 INFO:tasks.workunit.client.1.smithi106.stdout:6/778: read - d0/d17/d34/d4e/d98/da9/db1/d8/d50/fd4 zero size 2024-05-09T06:30:32.331 INFO:tasks.workunit.client.1.smithi106.stdout:1/769: rmdir d4/d76 39 2024-05-09T06:30:32.332 INFO:tasks.workunit.client.1.smithi106.stdout:1/770: creat d4/f113 x:0 0 0 2024-05-09T06:30:32.332 INFO:tasks.workunit.client.1.smithi106.stdout:1/771: fdatasync d4/d76/d13/d2f/db4/ff4 0 2024-05-09T06:30:32.334 INFO:tasks.workunit.client.1.smithi106.stdout:4/691: symlink d7/d28/d2a/le2 0 2024-05-09T06:30:32.335 INFO:tasks.workunit.client.1.smithi106.stdout:1/772: dread d4/dbd/de6/f100 [0,4194304] 0 2024-05-09T06:30:32.337 INFO:tasks.workunit.client.1.smithi106.stdout:9/761: mknod d4/d54/d91/d9c/dbe/cea 0 2024-05-09T06:30:32.337 INFO:tasks.workunit.client.1.smithi106.stdout:9/762: creat d4/d54/d91/feb x:0 0 0 2024-05-09T06:30:32.347 INFO:tasks.workunit.client.1.smithi106.stdout:2/856: creat d2/d7/d62/d9a/f125 x:0 0 0 2024-05-09T06:30:32.348 INFO:tasks.workunit.client.1.smithi106.stdout:6/779: truncate d0/d17/d34/d4e/d98/da9/db1/fb 2041184 0 2024-05-09T06:30:32.348 INFO:tasks.workunit.client.1.smithi106.stdout:6/780: write d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/f84 [2067161,77152] 0 2024-05-09T06:30:32.352 INFO:tasks.workunit.client.1.smithi106.stdout:5/787: rename d8/d33/d3a/d59 to d8/d5a/d60/d7e/dae/dd9/def 0 2024-05-09T06:30:32.352 INFO:tasks.workunit.client.1.smithi106.stdout:5/788: chown d8/d33/d3a/f88 5796 1 2024-05-09T06:30:32.352 INFO:tasks.workunit.client.1.smithi106.stdout:5/789: chown d8/d45/c61 823 1 2024-05-09T06:30:32.354 INFO:tasks.workunit.client.1.smithi106.stdout:2/857: symlink d2/d5/db/d15/d41/d58/ddf/l126 0 2024-05-09T06:30:32.354 INFO:tasks.workunit.client.1.smithi106.stdout:2/858: chown d2/d5/cbb 260380 1 2024-05-09T06:30:32.356 INFO:tasks.workunit.client.1.smithi106.stdout:6/781: creat d0/d17/d34/d4e/d98/da9/db1/d40/f10a x:0 0 0 2024-05-09T06:30:32.357 INFO:tasks.workunit.client.1.smithi106.stdout:4/692: rmdir d7/d10/d1a/d5a/d7a/d7f 39 2024-05-09T06:30:32.359 INFO:tasks.workunit.client.1.smithi106.stdout:3/633: rename d5/d85/dc3/d65/da3 to d5/d1c/d24/d52/dc6 0 2024-05-09T06:30:32.359 INFO:tasks.workunit.client.1.smithi106.stdout:5/790: mkdir d8/d5a/d60/d7e/dae/dd9/def/d99/df0 0 2024-05-09T06:30:32.360 INFO:tasks.workunit.client.1.smithi106.stdout:2/859: creat d2/d5/d9c/dd3/f127 x:0 0 0 2024-05-09T06:30:32.361 INFO:tasks.workunit.client.1.smithi106.stdout:6/782: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/c10b 0 2024-05-09T06:30:32.365 INFO:tasks.workunit.client.1.smithi106.stdout:4/693: rename d7/d39/d47/d66/ld3 to d7/d39/d35/d7c/le3 0 2024-05-09T06:30:32.369 INFO:tasks.workunit.client.1.smithi106.stdout:2/860: creat d2/d5/db/d15/d41/df8/f128 x:0 0 0 2024-05-09T06:30:32.369 INFO:tasks.workunit.client.1.smithi106.stdout:2/861: chown d2/d7/fad 800 1 2024-05-09T06:30:32.369 INFO:tasks.workunit.client.1.smithi106.stdout:2/862: getdents d2/d5/db/d15/d41/d60/d100 0 2024-05-09T06:30:32.369 INFO:tasks.workunit.client.1.smithi106.stdout:2/863: chown d2/d5/db/d1d/d90/lab 25 1 2024-05-09T06:30:32.369 INFO:tasks.workunit.client.1.smithi106.stdout:2/864: readlink d2/d5/db/d15/d41/d58/ddf/l126 0 2024-05-09T06:30:32.369 INFO:tasks.workunit.client.1.smithi106.stdout:7/733: dwrite d0/dc/f8b [0,4194304] 0 2024-05-09T06:30:32.372 INFO:tasks.workunit.client.1.smithi106.stdout:4/694: creat d7/d10/d1a/d5a/d1c/fe4 x:0 0 0 2024-05-09T06:30:32.372 INFO:tasks.workunit.client.1.smithi106.stdout:9/763: dwrite d4/d54/d69/d99/d2a/f74 [0,4194304] 0 2024-05-09T06:30:32.372 INFO:tasks.workunit.client.1.smithi106.stdout:9/764: chown d4/d54/d69/d95/d23/f21 8896 1 2024-05-09T06:30:32.372 INFO:tasks.workunit.client.1.smithi106.stdout:9/765: creat d4/d54/d69/d99/fec x:0 0 0 2024-05-09T06:30:32.372 INFO:tasks.workunit.client.1.smithi106.stdout:3/634: mknod d5/cc7 0 2024-05-09T06:30:32.372 INFO:tasks.workunit.client.1.smithi106.stdout:2/865: mknod d2/d5/db/d15/dd6/deb/c129 0 2024-05-09T06:30:32.373 INFO:tasks.workunit.client.1.smithi106.stdout:5/791: dread d8/d5a/d60/fcb [0,4194304] 0 2024-05-09T06:30:32.373 INFO:tasks.workunit.client.1.smithi106.stdout:1/773: dwrite d4/d76/d1d/f41 [0,4194304] 0 2024-05-09T06:30:32.375 INFO:tasks.workunit.client.1.smithi106.stdout:3/635: getdents d5/d4d/d7a/da9/da8 0 2024-05-09T06:30:32.381 INFO:tasks.workunit.client.1.smithi106.stdout:4/695: write d7/f18 [2938152,130858] 0 2024-05-09T06:30:32.382 INFO:tasks.workunit.client.1.smithi106.stdout:2/866: rename d2/d5/db/d1d/d23/d5e/l7b to d2/d5/db/d15/d41/d60/d100/l12a 0 2024-05-09T06:30:32.382 INFO:tasks.workunit.client.1.smithi106.stdout:2/867: fsync d2/d7/fad 0 2024-05-09T06:30:32.382 INFO:tasks.workunit.client.1.smithi106.stdout:2/868: chown d2/d5/db/f33 14623012 1 2024-05-09T06:30:32.382 INFO:tasks.workunit.client.1.smithi106.stdout:2/869: write d2/d5/db/d15/fca [257366,86804] 0 2024-05-09T06:30:32.385 INFO:tasks.workunit.client.1.smithi106.stdout:5/792: mknod d8/d5a/d60/cf1 0 2024-05-09T06:30:32.385 INFO:tasks.workunit.client.1.smithi106.stdout:5/793: write d8/d45/d4c/fc0 [141881,34551] 0 2024-05-09T06:30:32.385 INFO:tasks.workunit.client.1.smithi106.stdout:5/794: read d8/d33/f3b [1310639,58531] 0 2024-05-09T06:30:32.386 INFO:tasks.workunit.client.1.smithi106.stdout:1/774: truncate d4/d76/d65/d67/f10d 1463973 0 2024-05-09T06:30:32.386 INFO:tasks.workunit.client.1.smithi106.stdout:1/775: chown d4/d76/d13/f20 3596024 1 2024-05-09T06:30:32.386 INFO:tasks.workunit.client.1.smithi106.stdout:1/776: readlink d4/d76/d13/ld1 0 2024-05-09T06:30:32.387 INFO:tasks.workunit.client.1.smithi106.stdout:9/766: symlink d4/d54/d69/d95/d23/d16/dd1/d38/led 0 2024-05-09T06:30:32.389 INFO:tasks.workunit.client.1.smithi106.stdout:7/734: dwrite d0/dc/d1a/d36/d1e/f5d [0,4194304] 0 2024-05-09T06:30:32.392 INFO:tasks.workunit.client.1.smithi106.stdout:4/696: mknod d7/d10/d1a/d5a/d7a/d7f/ce5 0 2024-05-09T06:30:32.392 INFO:tasks.workunit.client.1.smithi106.stdout:4/697: chown d7/d10/c98 2 1 2024-05-09T06:30:32.392 INFO:tasks.workunit.client.1.smithi106.stdout:4/698: chown d7/d39/d35/d6f/fa4 11 1 2024-05-09T06:30:32.393 INFO:tasks.workunit.client.1.smithi106.stdout:2/870: mkdir d2/d7/d89/d104/d12b 0 2024-05-09T06:30:32.394 INFO:tasks.workunit.client.1.smithi106.stdout:5/795: mknod d8/d45/d4c/d32/ded/cf2 0 2024-05-09T06:30:32.396 INFO:tasks.workunit.client.1.smithi106.stdout:1/777: symlink d4/d37/d3d/l114 0 2024-05-09T06:30:32.398 INFO:tasks.workunit.client.1.smithi106.stdout:9/767: rename d4/d54/d69/d95/d23/d16/dd1/d39/ld2 to d4/lee 0 2024-05-09T06:30:32.398 INFO:tasks.workunit.client.1.smithi106.stdout:9/768: chown d4/d54/d69/d99/d2a/d42/fc3 4 1 2024-05-09T06:30:32.398 INFO:tasks.workunit.client.1.smithi106.stdout:9/769: fdatasync d4/d54/db3/fc5 0 2024-05-09T06:30:32.398 INFO:tasks.workunit.client.1.smithi106.stdout:3/636: write d5/f64 [186490,96098] 0 2024-05-09T06:30:32.401 INFO:tasks.workunit.client.1.smithi106.stdout:4/699: truncate d7/d10/d1a/d5a/d1c/da7/fb5 360082 0 2024-05-09T06:30:32.401 INFO:tasks.workunit.client.1.smithi106.stdout:4/700: write d7/d10/f65 [3493847,28338] 0 2024-05-09T06:30:32.402 INFO:tasks.workunit.client.1.smithi106.stdout:2/871: symlink d2/d5/l12c 0 2024-05-09T06:30:32.403 INFO:tasks.workunit.client.1.smithi106.stdout:4/701: dread d7/d10/d1a/f71 [0,4194304] 0 2024-05-09T06:30:32.403 INFO:tasks.workunit.client.1.smithi106.stdout:4/702: chown d7/d10/d1a/d5a/c1f 17174166 1 2024-05-09T06:30:32.403 INFO:tasks.workunit.client.1.smithi106.stdout:8/697: sync 2024-05-09T06:30:32.403 INFO:tasks.workunit.client.1.smithi106.stdout:0/768: sync 2024-05-09T06:30:32.405 INFO:tasks.workunit.client.1.smithi106.stdout:1/778: symlink d4/d76/d13/d60/d9c/de4/l115 0 2024-05-09T06:30:32.406 INFO:tasks.workunit.client.1.smithi106.stdout:3/637: getdents d5/d4d/d7a/da9 0 2024-05-09T06:30:32.408 INFO:tasks.workunit.client.1.smithi106.stdout:9/770: write d4/f3d [6716927,130155] 0 2024-05-09T06:30:32.408 INFO:tasks.workunit.client.1.smithi106.stdout:9/771: stat d4/d54/d69/d95/d23/d16/dd1/d38/d68/f6f 0 2024-05-09T06:30:32.411 INFO:tasks.workunit.client.1.smithi106.stdout:2/872: rmdir d2/d7/d89/d104/d10a 0 2024-05-09T06:30:32.412 INFO:tasks.workunit.client.1.smithi106.stdout:5/796: dwrite d8/d5a/d60/d7e/dae/dd9/def/f68 [0,4194304] 0 2024-05-09T06:30:32.412 INFO:tasks.workunit.client.1.smithi106.stdout:5/797: dread - d8/d5a/d60/d7e/dae/dd9/def/fca zero size 2024-05-09T06:30:32.414 INFO:tasks.workunit.client.1.smithi106.stdout:3/638: write d5/d3f/f9f [2070,94348] 0 2024-05-09T06:30:32.415 INFO:tasks.workunit.client.1.smithi106.stdout:1/779: symlink d4/d76/d65/d8d/db5/d10f/l116 0 2024-05-09T06:30:32.415 INFO:tasks.workunit.client.1.smithi106.stdout:1/780: creat d4/f117 x:0 0 0 2024-05-09T06:30:32.418 INFO:tasks.workunit.client.1.smithi106.stdout:9/772: symlink d4/d54/d69/d99/d2a/d42/d6c/dd0/lef 0 2024-05-09T06:30:32.423 INFO:tasks.workunit.client.1.smithi106.stdout:5/798: creat d8/d45/d4c/ddd/ff3 x:0 0 0 2024-05-09T06:30:32.423 INFO:tasks.workunit.client.1.smithi106.stdout:7/735: write d0/dc/d1a/d36/d30/d44/f7e [1398926,55689] 0 2024-05-09T06:30:32.426 INFO:tasks.workunit.client.1.smithi106.stdout:8/698: dwrite d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:32.427 INFO:tasks.workunit.client.1.smithi106.stdout:3/639: unlink d5/d3f/f4a 0 2024-05-09T06:30:32.427 INFO:tasks.workunit.client.1.smithi106.stdout:4/703: fsync d7/fb2 0 2024-05-09T06:30:32.427 INFO:tasks.workunit.client.1.smithi106.stdout:3/640: write d5/d1c/f6d [196236,87262] 0 2024-05-09T06:30:32.427 INFO:tasks.workunit.client.1.smithi106.stdout:0/769: dwrite d1/d11/d23/d13/d2c/d6d/f73 [0,4194304] 0 2024-05-09T06:30:32.430 INFO:tasks.workunit.client.1.smithi106.stdout:9/773: mkdir d4/d54/d91/d9c/df0 0 2024-05-09T06:30:32.432 INFO:tasks.workunit.client.1.smithi106.stdout:4/704: symlink d7/d10/d1a/d5a/d1c/le6 0 2024-05-09T06:30:32.432 INFO:tasks.workunit.client.1.smithi106.stdout:0/770: dread d1/fd9 [0,4194304] 0 2024-05-09T06:30:32.432 INFO:tasks.workunit.client.1.smithi106.stdout:0/771: write d1/d11/d23/d22/fd1 [493531,32298] 0 2024-05-09T06:30:32.432 INFO:tasks.workunit.client.1.smithi106.stdout:0/772: chown d1/d11/d23/d13/d58/da8 9816 1 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:0/773: write d1/d11/d23/d13/d2c/f2f [33878,112310] 0 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:3/641: mkdir d5/d85/dc3/dc8 0 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:0/774: stat d1/d11/d23/d13/d2c/d6d/d70/lb4 0 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:3/642: write d5/d1c/d24/f59 [411495,11083] 0 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:8/699: read d3/d5/d35/d73/d9d/da9/dbd/fd1 [2769277,119441] 0 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:8/700: write d3/d5/d35/d61/d6c/d83/f8f [1664404,105336] 0 2024-05-09T06:30:32.435 INFO:tasks.workunit.client.1.smithi106.stdout:8/701: fsync d3/d6b/f79 0 2024-05-09T06:30:32.439 INFO:tasks.workunit.client.1.smithi106.stdout:4/705: truncate d7/d10/d1a/d5a/d1c/f2c 12334 0 2024-05-09T06:30:32.440 INFO:tasks.workunit.client.1.smithi106.stdout:4/706: dread d7/d39/d35/f9a [0,4194304] 0 2024-05-09T06:30:32.442 INFO:tasks.workunit.client.1.smithi106.stdout:8/702: rename d3/d5/d7/d15/d3e/d7d/c7e to d3/d5/d7/d98/cec 0 2024-05-09T06:30:32.444 INFO:tasks.workunit.client.1.smithi106.stdout:9/774: rmdir d4/d54/d69/d95/d23/d16/dd1/d39 39 2024-05-09T06:30:32.444 INFO:tasks.workunit.client.1.smithi106.stdout:2/873: dwrite d2/d5/db/d15/f107 [0,4194304] 0 2024-05-09T06:30:32.447 INFO:tasks.workunit.client.1.smithi106.stdout:4/707: mkdir d7/d28/de7 0 2024-05-09T06:30:32.447 INFO:tasks.workunit.client.1.smithi106.stdout:4/708: write d7/d10/d1a/d5a/d7a/d7f/f84 [1097443,52633] 0 2024-05-09T06:30:32.450 INFO:tasks.workunit.client.1.smithi106.stdout:9/775: getdents d4/d54/d69/d99/d2a/d42 0 2024-05-09T06:30:32.455 INFO:tasks.workunit.client.1.smithi106.stdout:3/643: dwrite d5/d85/dc3/d26/f9e [4194304,4194304] 0 2024-05-09T06:30:32.455 INFO:tasks.workunit.client.1.smithi106.stdout:7/736: dwrite d0/fbb [0,4194304] 0 2024-05-09T06:30:32.456 INFO:tasks.workunit.client.1.smithi106.stdout:5/799: dwrite d8/d45/d4c/f7b [0,4194304] 0 2024-05-09T06:30:32.458 INFO:tasks.workunit.client.1.smithi106.stdout:1/781: write d4/d76/d13/dbb/fc9 [580388,64752] 0 2024-05-09T06:30:32.459 INFO:tasks.workunit.client.1.smithi106.stdout:1/782: write d4/d5/ff [940110,102908] 0 2024-05-09T06:30:32.459 INFO:tasks.workunit.client.1.smithi106.stdout:8/703: dread d3/d5/d13/f14 [0,4194304] 0 2024-05-09T06:30:32.459 INFO:tasks.workunit.client.1.smithi106.stdout:8/704: chown d3/d5/d7/d15/d47 55 1 2024-05-09T06:30:32.459 INFO:tasks.workunit.client.1.smithi106.stdout:0/775: dwrite d1/da1/d83/f89 [0,4194304] 0 2024-05-09T06:30:32.459 INFO:tasks.workunit.client.1.smithi106.stdout:0/776: fdatasync d1/d11/d23/d13/d2c/d6d/dce/ffb 0 2024-05-09T06:30:32.464 INFO:tasks.workunit.client.1.smithi106.stdout:4/709: rename d7/d10/d1a/d5a/d46/l64 to d7/d28/le8 0 2024-05-09T06:30:32.465 INFO:tasks.workunit.client.1.smithi106.stdout:4/710: read d7/f9 [4270212,74551] 0 2024-05-09T06:30:32.465 INFO:tasks.workunit.client.1.smithi106.stdout:9/776: mkdir d4/d54/d69/d95/d23/d16/dd1/d38/d68/df1 0 2024-05-09T06:30:32.465 INFO:tasks.workunit.client.1.smithi106.stdout:9/777: dread - d4/d54/d69/d95/d23/d78/f82 zero size 2024-05-09T06:30:32.467 INFO:tasks.workunit.client.1.smithi106.stdout:3/644: symlink d5/d4d/d5f/lc9 0 2024-05-09T06:30:32.471 INFO:tasks.workunit.client.1.smithi106.stdout:7/737: creat d0/dc/d1a/d36/d1e/d68/dc9/fe4 x:0 0 0 2024-05-09T06:30:32.474 INFO:tasks.workunit.client.1.smithi106.stdout:5/800: symlink d8/d33/d74/lf4 0 2024-05-09T06:30:32.476 INFO:tasks.workunit.client.1.smithi106.stdout:1/783: mkdir d4/d76/d1d/d118 0 2024-05-09T06:30:32.478 INFO:tasks.workunit.client.1.smithi106.stdout:2/874: dwrite d2/d5/db/d15/d41/f74 [0,4194304] 0 2024-05-09T06:30:32.479 INFO:tasks.workunit.client.1.smithi106.stdout:6/783: sync 2024-05-09T06:30:32.480 INFO:tasks.workunit.client.1.smithi106.stdout:1/784: dread d4/d76/fa3 [0,4194304] 0 2024-05-09T06:30:32.480 INFO:tasks.workunit.client.1.smithi106.stdout:1/785: fdatasync d4/d76/d13/d2f/fca 0 2024-05-09T06:30:32.481 INFO:tasks.workunit.client.1.smithi106.stdout:0/777: creat d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/f109 x:0 0 0 2024-05-09T06:30:32.481 INFO:tasks.workunit.client.1.smithi106.stdout:0/778: write d1/d11/d23/d13/f3f [1741357,112768] 0 2024-05-09T06:30:32.481 INFO:tasks.workunit.client.1.smithi106.stdout:8/705: dwrite d3/d5/d7/d15/fa7 [0,4194304] 0 2024-05-09T06:30:32.481 INFO:tasks.workunit.client.1.smithi106.stdout:8/706: creat d3/d6b/fed x:0 0 0 2024-05-09T06:30:32.482 INFO:tasks.workunit.client.1.smithi106.stdout:4/711: symlink d7/d39/d35/dac/le9 0 2024-05-09T06:30:32.486 INFO:tasks.workunit.client.1.smithi106.stdout:8/707: dread d3/d5/d35/d73/f54 [0,4194304] 0 2024-05-09T06:30:32.487 INFO:tasks.workunit.client.1.smithi106.stdout:3/645: unlink d5/d1c/d24/l7f 0 2024-05-09T06:30:32.487 INFO:tasks.workunit.client.1.smithi106.stdout:3/646: chown d5/d4d/d5f/lc9 62253 1 2024-05-09T06:30:32.489 INFO:tasks.workunit.client.1.smithi106.stdout:7/738: creat d0/dc/d45/da6/dc5/fe5 x:0 0 0 2024-05-09T06:30:32.489 INFO:tasks.workunit.client.1.smithi106.stdout:7/739: write d0/dc/d1a/d36/d30/d44/fd8 [148379,107734] 0 2024-05-09T06:30:32.489 INFO:tasks.workunit.client.1.smithi106.stdout:1/786: write d4/d76/d65/d8d/dad/ffe [1868649,95284] 0 2024-05-09T06:30:32.490 INFO:tasks.workunit.client.1.smithi106.stdout:2/875: symlink d2/d7/d89/l12d 0 2024-05-09T06:30:32.490 INFO:tasks.workunit.client.1.smithi106.stdout:2/876: dread - d2/d5/db/ff1 zero size 2024-05-09T06:30:32.493 INFO:tasks.workunit.client.1.smithi106.stdout:6/784: write d0/d17/d34/d72/f93 [2103051,38991] 0 2024-05-09T06:30:32.493 INFO:tasks.workunit.client.1.smithi106.stdout:5/801: dwrite d8/d45/d4c/d32/d5b/f2c [4194304,4194304] 0 2024-05-09T06:30:32.493 INFO:tasks.workunit.client.1.smithi106.stdout:5/802: write d8/d45/d4c/d32/d5b/d69/fe0 [61942,68234] 0 2024-05-09T06:30:32.493 INFO:tasks.workunit.client.1.smithi106.stdout:0/779: unlink d1/d11/d23/d13/d58/da8/dd6/cbb 0 2024-05-09T06:30:32.495 INFO:tasks.workunit.client.1.smithi106.stdout:4/712: unlink d7/d10/d1a/d5a/d1c/c74 0 2024-05-09T06:30:32.497 INFO:tasks.workunit.client.1.smithi106.stdout:9/778: mknod d4/d54/d69/d95/d23/d16/dd1/d38/cf2 0 2024-05-09T06:30:32.497 INFO:tasks.workunit.client.1.smithi106.stdout:9/779: write d4/d54/d69/d99/d2a/d42/d6c/d6d/f77 [1784506,48646] 0 2024-05-09T06:30:32.498 INFO:tasks.workunit.client.1.smithi106.stdout:8/708: truncate d3/d5/d13/f29 7756820 0 2024-05-09T06:30:32.498 INFO:tasks.workunit.client.1.smithi106.stdout:8/709: read - d3/d5/d7/fe6 zero size 2024-05-09T06:30:32.501 INFO:tasks.workunit.client.1.smithi106.stdout:3/647: symlink d5/d1c/d24/d89/d8c/dbb/lca 0 2024-05-09T06:30:32.501 INFO:tasks.workunit.client.1.smithi106.stdout:5/803: dread d8/d45/d4c/f5c [0,4194304] 0 2024-05-09T06:30:32.501 INFO:tasks.workunit.client.1.smithi106.stdout:5/804: write d8/d5a/d60/da8/daa/db4/fbe [1711749,106093] 0 2024-05-09T06:30:32.501 INFO:tasks.workunit.client.1.smithi106.stdout:7/740: link d0/dc/d1a/d36/d30/d44/c93 d0/dc/d1a/d5a/ce6 0 2024-05-09T06:30:32.501 INFO:tasks.workunit.client.1.smithi106.stdout:7/741: write d0/dc/d1a/d36/d30/d44/d58/d65/d84/fa0 [904999,130517] 0 2024-05-09T06:30:32.505 INFO:tasks.workunit.client.1.smithi106.stdout:1/787: symlink d4/d76/d65/d8d/l119 0 2024-05-09T06:30:32.505 INFO:tasks.workunit.client.1.smithi106.stdout:1/788: write d4/d37/ffb [873339,119596] 0 2024-05-09T06:30:32.505 INFO:tasks.workunit.client.1.smithi106.stdout:1/789: write d4/d37/d74/fc6 [723504,92317] 0 2024-05-09T06:30:32.506 INFO:tasks.workunit.client.1.smithi106.stdout:1/790: read - d4/dbd/fcd zero size 2024-05-09T06:30:32.506 INFO:tasks.workunit.client.1.smithi106.stdout:2/877: symlink d2/d5/db/l12e 0 2024-05-09T06:30:32.510 INFO:tasks.workunit.client.1.smithi106.stdout:8/710: dwrite d3/d5/d35/d4e/d32/dd3/fe2 [0,4194304] 0 2024-05-09T06:30:32.510 INFO:tasks.workunit.client.1.smithi106.stdout:0/780: mkdir d1/d11/d23/d13/d2c/d6d/d10a 0 2024-05-09T06:30:32.511 INFO:tasks.workunit.client.1.smithi106.stdout:4/713: mknod d7/d10/d1a/d5a/d7a/d7f/cea 0 2024-05-09T06:30:32.514 INFO:tasks.workunit.client.1.smithi106.stdout:9/780: link d4/d54/d69/d95/d23/d16/f35 d4/d54/d91/dbf/ff3 0 2024-05-09T06:30:32.514 INFO:tasks.workunit.client.1.smithi106.stdout:9/781: write d4/d54/d69/d95/f2e [4337978,46640] 0 2024-05-09T06:30:32.515 INFO:tasks.workunit.client.1.smithi106.stdout:3/648: rename d5/f3d to d5/d4d/d5f/fcb 0 2024-05-09T06:30:32.515 INFO:tasks.workunit.client.1.smithi106.stdout:3/649: read d5/d1c/f6d [101069,13976] 0 2024-05-09T06:30:32.518 INFO:tasks.workunit.client.1.smithi106.stdout:1/791: creat d4/d76/d65/d67/f11a x:0 0 0 2024-05-09T06:30:32.518 INFO:tasks.workunit.client.1.smithi106.stdout:1/792: creat d4/d5b/d75/f11b x:0 0 0 2024-05-09T06:30:32.520 INFO:tasks.workunit.client.1.smithi106.stdout:8/711: dread d3/d5/d35/d61/d6c/d83/d89/fdd [0,4194304] 0 2024-05-09T06:30:32.521 INFO:tasks.workunit.client.1.smithi106.stdout:6/785: rmdir d0/d17/d34/d4e 39 2024-05-09T06:30:32.525 INFO:tasks.workunit.client.1.smithi106.stdout:2/878: dwrite d2/d5/db/d15/d41/df8/f128 [0,4194304] 0 2024-05-09T06:30:32.525 INFO:tasks.workunit.client.1.smithi106.stdout:4/714: link d7/d39/d35/d4a/f93 d7/d39/d47/d66/feb 0 2024-05-09T06:30:32.525 INFO:tasks.workunit.client.1.smithi106.stdout:4/715: chown d7/d10/d1a/f85 7491178 1 2024-05-09T06:30:32.527 INFO:tasks.workunit.client.1.smithi106.stdout:9/782: creat d4/d54/d69/d95/ff4 x:0 0 0 2024-05-09T06:30:32.529 INFO:tasks.workunit.client.1.smithi106.stdout:0/781: write d1/d11/d23/d22/f59 [456214,15216] 0 2024-05-09T06:30:32.529 INFO:tasks.workunit.client.1.smithi106.stdout:0/782: fdatasync d1/f43 0 2024-05-09T06:30:32.529 INFO:tasks.workunit.client.1.smithi106.stdout:2/879: dread d2/d5/d9c/fa6 [0,4194304] 0 2024-05-09T06:30:32.529 INFO:tasks.workunit.client.1.smithi106.stdout:2/880: dread - d2/d5/db/d15/d41/d58/ddf/f112 zero size 2024-05-09T06:30:32.529 INFO:tasks.workunit.client.1.smithi106.stdout:7/742: rename d0/dc/d1a/d36/d1e/l4f to d0/dc/d1a/d36/d30/d44/d58/le7 0 2024-05-09T06:30:32.530 INFO:tasks.workunit.client.1.smithi106.stdout:3/650: creat d5/d1c/d24/d98/dc0/d32/fcc x:0 0 0 2024-05-09T06:30:32.530 INFO:tasks.workunit.client.1.smithi106.stdout:3/651: truncate d5/d4d/f70 179368 0 2024-05-09T06:30:32.531 INFO:tasks.workunit.client.1.smithi106.stdout:5/805: rmdir d8/d45/d4c/d32/d5b/d69 39 2024-05-09T06:30:32.531 INFO:tasks.workunit.client.1.smithi106.stdout:6/786: dread d0/d17/f1e [0,4194304] 0 2024-05-09T06:30:32.531 INFO:tasks.workunit.client.1.smithi106.stdout:6/787: write d0/d17/d34/d4e/d98/da9/db1/d8/d27/fdc [1539497,119319] 0 2024-05-09T06:30:32.531 INFO:tasks.workunit.client.1.smithi106.stdout:6/788: read d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/f83 [793278,101800] 0 2024-05-09T06:30:32.531 INFO:tasks.workunit.client.1.smithi106.stdout:6/789: chown d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/d109/f91 418429703 1 2024-05-09T06:30:32.533 INFO:tasks.workunit.client.1.smithi106.stdout:1/793: symlink d4/d76/d13/d2f/df5/dfd/l11c 0 2024-05-09T06:30:32.533 INFO:tasks.workunit.client.1.smithi106.stdout:1/794: creat d4/d5b/d75/f11d x:0 0 0 2024-05-09T06:30:32.533 INFO:tasks.workunit.client.1.smithi106.stdout:1/795: fsync d4/d76/d1d/f3c 0 2024-05-09T06:30:32.533 INFO:tasks.workunit.client.1.smithi106.stdout:1/796: truncate d4/d76/f7c 393108 0 2024-05-09T06:30:32.534 INFO:tasks.workunit.client.1.smithi106.stdout:8/712: mkdir d3/d5/d35/d4e/dee 0 2024-05-09T06:30:32.537 INFO:tasks.workunit.client.1.smithi106.stdout:0/783: dread d1/d11/d23/da6/f7b [0,4194304] 0 2024-05-09T06:30:32.537 INFO:tasks.workunit.client.1.smithi106.stdout:0/784: creat d1/d11/d7f/f10b x:0 0 0 2024-05-09T06:30:32.537 INFO:tasks.workunit.client.1.smithi106.stdout:0/785: stat d1/da1/fad 0 2024-05-09T06:30:32.538 INFO:tasks.workunit.client.1.smithi106.stdout:4/716: truncate d7/d10/d1a/d5a/d1c/f72 2188587 0 2024-05-09T06:30:32.538 INFO:tasks.workunit.client.1.smithi106.stdout:4/717: creat d7/d39/d35/d6f/d9d/fec x:0 0 0 2024-05-09T06:30:32.544 INFO:tasks.workunit.client.1.smithi106.stdout:9/783: mknod d4/d54/d69/d95/d23/d16/dd1/d31/db0/cf5 0 2024-05-09T06:30:32.544 INFO:tasks.workunit.client.1.smithi106.stdout:2/881: rename d2/d5/db/d15/dd6/deb/ff4 to d2/d7/d62/f12f 0 2024-05-09T06:30:32.545 INFO:tasks.workunit.client.1.smithi106.stdout:9/784: chown d4/d54/d69/d95/d23/d16/d94 2797 1 2024-05-09T06:30:32.546 INFO:tasks.workunit.client.1.smithi106.stdout:7/743: symlink d0/dc/d1a/d36/d30/d44/d58/d65/le8 0 2024-05-09T06:30:32.546 INFO:tasks.workunit.client.1.smithi106.stdout:7/744: truncate d0/dc/d1a/d36/d30/d44/d58/d65/d84/fa0 1368909 0 2024-05-09T06:30:32.548 INFO:tasks.workunit.client.1.smithi106.stdout:3/652: mkdir d5/d1c/d24/d89/d8e/dcd 0 2024-05-09T06:30:32.549 INFO:tasks.workunit.client.1.smithi106.stdout:5/806: mknod d8/d5a/cf5 0 2024-05-09T06:30:32.552 INFO:tasks.workunit.client.1.smithi106.stdout:6/790: truncate d0/d17/d34/d4e/d98/da9/db1/d8/d50/f7d 4132875 0 2024-05-09T06:30:32.554 INFO:tasks.workunit.client.1.smithi106.stdout:1/797: rmdir d4/d76/d65/d8d 39 2024-05-09T06:30:32.554 INFO:tasks.workunit.client.1.smithi106.stdout:1/798: write d4/d5b/d75/f97 [5851894,97014] 0 2024-05-09T06:30:32.555 INFO:tasks.workunit.client.1.smithi106.stdout:9/785: write d4/d54/d69/d95/d23/d16/dd1/d38/d68/f84 [231808,16556] 0 2024-05-09T06:30:32.555 INFO:tasks.workunit.client.1.smithi106.stdout:8/713: creat d3/d5/d35/d61/d6c/d83/dcc/de9/fef x:0 0 0 2024-05-09T06:30:32.556 INFO:tasks.workunit.client.1.smithi106.stdout:2/882: write d2/d7/f27 [643737,109909] 0 2024-05-09T06:30:32.556 INFO:tasks.workunit.client.1.smithi106.stdout:1/799: dread d4/d5b/f8c [0,4194304] 0 2024-05-09T06:30:32.557 INFO:tasks.workunit.client.1.smithi106.stdout:0/786: write d1/d11/d23/d13/d2c/fb1 [550988,111056] 0 2024-05-09T06:30:32.558 INFO:tasks.workunit.client.1.smithi106.stdout:8/714: read d3/d5/d35/d61/d6c/d83/d89/d9b/fc7 [767962,60233] 0 2024-05-09T06:30:32.558 INFO:tasks.workunit.client.1.smithi106.stdout:0/787: write d1/d11/d23/d13/d58/f98 [4769453,37016] 0 2024-05-09T06:30:32.562 INFO:tasks.workunit.client.1.smithi106.stdout:7/745: mknod d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/ce9 0 2024-05-09T06:30:32.565 INFO:tasks.workunit.client.1.smithi106.stdout:3/653: mkdir d5/d4d/d7a/dce 0 2024-05-09T06:30:32.566 INFO:tasks.workunit.client.1.smithi106.stdout:8/715: read d3/d5/d35/d61/f63 [4001747,99202] 0 2024-05-09T06:30:32.571 INFO:tasks.workunit.client.1.smithi106.stdout:5/807: mkdir d8/d5a/d60/df6 0 2024-05-09T06:30:32.571 INFO:tasks.workunit.client.1.smithi106.stdout:5/808: write d8/d33/d74/fb7 [343509,49328] 0 2024-05-09T06:30:32.571 INFO:tasks.workunit.client.1.smithi106.stdout:5/809: write d8/f1a [1892312,102053] 0 2024-05-09T06:30:32.571 INFO:tasks.workunit.client.1.smithi106.stdout:5/810: fsync d8/d45/d4c/d85/fbf 0 2024-05-09T06:30:32.578 INFO:tasks.workunit.client.1.smithi106.stdout:8/716: read d3/d5/d7/d15/fa7 [2788670,67861] 0 2024-05-09T06:30:32.578 INFO:tasks.workunit.client.1.smithi106.stdout:8/717: fdatasync d3/d5/d7/d15/fa4 0 2024-05-09T06:30:32.579 INFO:tasks.workunit.client.1.smithi106.stdout:6/791: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d9c/c10c 0 2024-05-09T06:30:32.580 INFO:tasks.workunit.client.1.smithi106.stdout:6/792: dread d0/d17/d34/d4e/d98/da9/db1/d40/ffd [0,4194304] 0 2024-05-09T06:30:32.583 INFO:tasks.workunit.client.1.smithi106.stdout:9/786: link d4/d54/d69/d95/c66 d4/d54/d69/d95/d23/d16/dd1/d31/db0/cf6 0 2024-05-09T06:30:32.583 INFO:tasks.workunit.client.1.smithi106.stdout:9/787: chown d4/d54/d69/d99/d2a/d42/f97 1812 1 2024-05-09T06:30:32.585 INFO:tasks.workunit.client.1.smithi106.stdout:2/883: creat d2/d5/db/d1d/d90/f130 x:0 0 0 2024-05-09T06:30:32.588 INFO:tasks.workunit.client.1.smithi106.stdout:0/788: rename d1/d11/d23/d13/d2c/d6d/fe5 to d1/d11/d23/d22/f10c 0 2024-05-09T06:30:32.590 INFO:tasks.workunit.client.1.smithi106.stdout:7/746: unlink d0/dc/d1a/d36/d30/d44/d80/fdf 0 2024-05-09T06:30:32.590 INFO:tasks.workunit.client.1.smithi106.stdout:7/747: dread - d0/dc/d1a/d36/d30/d44/d6a/d72/dc4/fcb zero size 2024-05-09T06:30:32.590 INFO:tasks.workunit.client.1.smithi106.stdout:9/788: dread d4/f25 [0,4194304] 0 2024-05-09T06:30:32.590 INFO:tasks.workunit.client.1.smithi106.stdout:7/748: fsync d0/dc/d1a/d36/d30/fb8 0 2024-05-09T06:30:32.590 INFO:tasks.workunit.client.1.smithi106.stdout:7/749: stat d0/dc/d1a/d36/d30/d44/d6a/d72/dc4 0 2024-05-09T06:30:32.592 INFO:tasks.workunit.client.1.smithi106.stdout:7/750: dread d0/dc/f69 [0,4194304] 0 2024-05-09T06:30:32.592 INFO:tasks.workunit.client.1.smithi106.stdout:7/751: chown d0/dc/d1a/d36/d1e/f4c 767056 1 2024-05-09T06:30:32.592 INFO:tasks.workunit.client.1.smithi106.stdout:7/752: creat d0/dc/fea x:0 0 0 2024-05-09T06:30:32.593 INFO:tasks.workunit.client.1.smithi106.stdout:5/811: creat d8/d5a/d60/df6/ff7 x:0 0 0 2024-05-09T06:30:32.593 INFO:tasks.workunit.client.1.smithi106.stdout:2/884: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:32.594 INFO:tasks.workunit.client.1.smithi106.stdout:2/885: write d2/d7/d2c/fdd [195281,44435] 0 2024-05-09T06:30:32.596 INFO:tasks.workunit.client.1.smithi106.stdout:8/718: rmdir d3/d5/d35/d61/dda 0 2024-05-09T06:30:32.598 INFO:tasks.workunit.client.1.smithi106.stdout:6/793: symlink d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/l10d 0 2024-05-09T06:30:32.600 INFO:tasks.workunit.client.1.smithi106.stdout:1/800: getdents d4/d5b/d75 0 2024-05-09T06:30:32.602 INFO:tasks.workunit.client.1.smithi106.stdout:0/789: creat d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/f10d x:0 0 0 2024-05-09T06:30:32.602 INFO:tasks.workunit.client.1.smithi106.stdout:0/790: chown d1/d11/d23/d13/d2c/d6d/dce 1 1 2024-05-09T06:30:32.607 INFO:tasks.workunit.client.1.smithi106.stdout:5/812: rename d8/d45/d4c/f2e to d8/d5a/d60/ff8 0 2024-05-09T06:30:32.607 INFO:tasks.workunit.client.1.smithi106.stdout:5/813: creat d8/d33/d74/ff9 x:0 0 0 2024-05-09T06:30:32.607 INFO:tasks.workunit.client.1.smithi106.stdout:5/814: creat d8/d5a/d60/ffa x:0 0 0 2024-05-09T06:30:32.607 INFO:tasks.workunit.client.1.smithi106.stdout:5/815: readlink d8/l21 0 2024-05-09T06:30:32.608 INFO:tasks.workunit.client.1.smithi106.stdout:1/801: mknod d4/d76/d13/d60/d9c/de4/c11e 0 2024-05-09T06:30:32.608 INFO:tasks.workunit.client.1.smithi106.stdout:1/802: chown d4/f14 238309803 1 2024-05-09T06:30:32.609 INFO:tasks.workunit.client.1.smithi106.stdout:0/791: symlink d1/d11/d23/d22/dbc/l10e 0 2024-05-09T06:30:32.611 INFO:tasks.workunit.client.1.smithi106.stdout:6/794: write d0/d66/fbc [1807084,122225] 0 2024-05-09T06:30:32.613 INFO:tasks.workunit.client.1.smithi106.stdout:5/816: creat d8/d5a/d60/da8/daa/ffb x:0 0 0 2024-05-09T06:30:32.614 INFO:tasks.workunit.client.1.smithi106.stdout:1/803: mknod d4/d76/d65/d8d/dad/c11f 0 2024-05-09T06:30:32.614 INFO:tasks.workunit.client.1.smithi106.stdout:1/804: dread - d4/d76/d13/f105 zero size 2024-05-09T06:30:32.615 INFO:tasks.workunit.client.1.smithi106.stdout:0/792: symlink d1/d11/d23/l10f 0 2024-05-09T06:30:32.618 INFO:tasks.workunit.client.1.smithi106.stdout:5/817: truncate d8/f51 1105404 0 2024-05-09T06:30:32.620 INFO:tasks.workunit.client.1.smithi106.stdout:1/805: link d4/cdb d4/dbd/de6/c120 0 2024-05-09T06:30:32.621 INFO:tasks.workunit.client.1.smithi106.stdout:0/793: mknod d1/d11/d23/c110 0 2024-05-09T06:30:32.623 INFO:tasks.workunit.client.1.smithi106.stdout:6/795: rename d0/d17/d34/d4e/d98/da9/db1/d8/d50/fb3 to d0/d17/f10e 0 2024-05-09T06:30:32.624 INFO:tasks.workunit.client.1.smithi106.stdout:5/818: unlink d8/d33/d3a/f88 0 2024-05-09T06:30:32.628 INFO:tasks.workunit.client.1.smithi106.stdout:5/819: mknod d8/d45/cfc 0 2024-05-09T06:30:32.628 INFO:tasks.workunit.client.1.smithi106.stdout:5/820: dread - d8/d33/f96 zero size 2024-05-09T06:30:32.629 INFO:tasks.workunit.client.1.smithi106.stdout:5/821: chown d8/d45/d4c/c4d 70285 1 2024-05-09T06:30:32.630 INFO:tasks.workunit.client.1.smithi106.stdout:5/822: creat d8/d5a/d60/d7e/dae/dd9/def/d99/ffd x:0 0 0 2024-05-09T06:30:32.631 INFO:tasks.workunit.client.1.smithi106.stdout:7/753: dwrite d0/dc/d1a/f83 [0,4194304] 0 2024-05-09T06:30:32.634 INFO:tasks.workunit.client.1.smithi106.stdout:0/794: write d1/d11/d23/d13/f5c [1015033,98427] 0 2024-05-09T06:30:32.634 INFO:tasks.workunit.client.1.smithi106.stdout:0/795: creat d1/d11/d23/d13/d2c/d3d/dbe/f111 x:0 0 0 2024-05-09T06:30:32.634 INFO:tasks.workunit.client.1.smithi106.stdout:0/796: write d1/d11/d23/d13/d58/f60 [1038400,126282] 0 2024-05-09T06:30:32.637 INFO:tasks.workunit.client.1.smithi106.stdout:9/789: dwrite d4/d54/d69/d95/d23/d16/dd1/f64 [0,4194304] 0 2024-05-09T06:30:32.640 INFO:tasks.workunit.client.1.smithi106.stdout:8/719: dwrite d3/d5/d35/d73/fd5 [0,4194304] 0 2024-05-09T06:30:32.642 INFO:tasks.workunit.client.1.smithi106.stdout:7/754: mkdir d0/d53/deb 0 2024-05-09T06:30:32.642 INFO:tasks.workunit.client.1.smithi106.stdout:7/755: creat d0/dc/d1a/d36/d30/d44/d58/d65/fec x:0 0 0 2024-05-09T06:30:32.642 INFO:tasks.workunit.client.1.smithi106.stdout:7/756: read - d0/d53/d7a/fd7 zero size 2024-05-09T06:30:32.644 INFO:tasks.workunit.client.1.smithi106.stdout:2/886: dwrite d2/d5/db/d15/d41/d60/dcc/fd0 [0,4194304] 0 2024-05-09T06:30:32.644 INFO:tasks.workunit.client.1.smithi106.stdout:1/806: dwrite d4/d5b/d75/f11d [0,4194304] 0 2024-05-09T06:30:32.648 INFO:tasks.workunit.client.1.smithi106.stdout:0/797: rename d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/df2/lf4 to d1/da1/dd8/l112 0 2024-05-09T06:30:32.648 INFO:tasks.workunit.client.1.smithi106.stdout:0/798: chown d1/d11/d23/d13/d2c/d6d/d10a 31 1 2024-05-09T06:30:32.650 INFO:tasks.workunit.client.1.smithi106.stdout:0/799: dread d1/f4b [0,4194304] 0 2024-05-09T06:30:32.655 INFO:tasks.workunit.client.1.smithi106.stdout:8/720: symlink d3/d5/lf0 0 2024-05-09T06:30:32.655 INFO:tasks.workunit.client.1.smithi106.stdout:8/721: chown d3/d5/d13/d3a/dbe 3 1 2024-05-09T06:30:32.656 INFO:tasks.workunit.client.1.smithi106.stdout:8/722: dread - d3/d6b/fed zero size 2024-05-09T06:30:32.657 INFO:tasks.workunit.client.1.smithi106.stdout:5/823: dwrite d8/f7a [0,4194304] 0 2024-05-09T06:30:32.657 INFO:tasks.workunit.client.1.smithi106.stdout:5/824: fsync d8/d45/d4c/d32/d5b/f1e 0 2024-05-09T06:30:32.657 INFO:tasks.workunit.client.1.smithi106.stdout:7/757: truncate d0/dc/d1a/d36/d30/f64 648935 0 2024-05-09T06:30:32.657 INFO:tasks.workunit.client.1.smithi106.stdout:6/796: dwrite d0/d66/d7e/f8c [0,4194304] 0 2024-05-09T06:30:32.657 INFO:tasks.workunit.client.1.smithi106.stdout:7/758: write d0/dc/d1a/f81 [4835609,13047] 0 2024-05-09T06:30:32.658 INFO:tasks.workunit.client.1.smithi106.stdout:3/654: dwrite d5/d1c/d24/d5b/f61 [0,4194304] 0 2024-05-09T06:30:32.665 INFO:tasks.workunit.client.1.smithi106.stdout:2/887: mkdir d2/d5/db/d15/d41/d60/d100/d131 0 2024-05-09T06:30:32.668 INFO:tasks.workunit.client.1.smithi106.stdout:0/800: creat d1/da1/f113 x:0 0 0 2024-05-09T06:30:32.669 INFO:tasks.workunit.client.1.smithi106.stdout:0/801: write d1/fa7 [212875,78625] 0 2024-05-09T06:30:32.670 INFO:tasks.workunit.client.1.smithi106.stdout:8/723: symlink d3/d5/d13/d3a/lf1 0 2024-05-09T06:30:32.670 INFO:tasks.workunit.client.1.smithi106.stdout:9/790: dwrite d4/d54/d69/d99/d2a/f7d [0,4194304] 0 2024-05-09T06:30:32.670 INFO:tasks.workunit.client.1.smithi106.stdout:9/791: dread - d4/d54/d69/d99/fec zero size 2024-05-09T06:30:32.671 INFO:tasks.workunit.client.1.smithi106.stdout:1/807: dwrite d4/d76/d13/d2f/db4/fd6 [0,4194304] 0 2024-05-09T06:30:32.671 INFO:tasks.workunit.client.1.smithi106.stdout:5/825: link d8/d5a/d60/da8/daa/fb2 d8/d5a/d60/d7e/dae/dd9/def/d99/df0/ffe 0 2024-05-09T06:30:32.676 INFO:tasks.workunit.client.1.smithi106.stdout:6/797: link d0/d66/d7e/l75 d0/d17/d34/d72/l10f 0 2024-05-09T06:30:32.680 INFO:tasks.workunit.client.1.smithi106.stdout:5/826: dread d8/d33/d3a/f63 [0,4194304] 0 2024-05-09T06:30:32.680 INFO:tasks.workunit.client.1.smithi106.stdout:5/827: chown d8/d33/d3a/c5e 0 1 2024-05-09T06:30:32.683 INFO:tasks.workunit.client.1.smithi106.stdout:3/655: creat d5/d1c/d24/d89/d8c/fcf x:0 0 0 2024-05-09T06:30:32.683 INFO:tasks.workunit.client.1.smithi106.stdout:3/656: creat d5/d4d/d72/fd0 x:0 0 0 2024-05-09T06:30:32.683 INFO:tasks.workunit.client.1.smithi106.stdout:3/657: stat d5/d1c/d24/d98/dc0/d32/l62 0 2024-05-09T06:30:32.683 INFO:tasks.workunit.client.1.smithi106.stdout:8/724: dwrite d3/d5/d35/d61/d6c/d83/dcc/de9/fef [0,4194304] 0 2024-05-09T06:30:32.683 INFO:tasks.workunit.client.1.smithi106.stdout:3/658: readlink d5/d1c/d24/d98/dc0/l5d 0 2024-05-09T06:30:32.684 INFO:tasks.workunit.client.1.smithi106.stdout:8/725: creat d3/d5/d35/d73/ff2 x:0 0 0 2024-05-09T06:30:32.685 INFO:tasks.workunit.client.1.smithi106.stdout:2/888: creat d2/d5/db/d1d/d90/d103/f132 x:0 0 0 2024-05-09T06:30:32.686 INFO:tasks.workunit.client.1.smithi106.stdout:0/802: mkdir d1/da1/d93/d114 0 2024-05-09T06:30:32.688 INFO:tasks.workunit.client.1.smithi106.stdout:4/718: sync 2024-05-09T06:30:32.691 INFO:tasks.workunit.client.1.smithi106.stdout:9/792: mknod d4/d54/d69/d95/d23/d16/cf7 0 2024-05-09T06:30:32.695 INFO:tasks.workunit.client.1.smithi106.stdout:1/808: symlink d4/d76/d13/d60/d9c/de4/l121 0 2024-05-09T06:30:32.698 INFO:tasks.workunit.client.1.smithi106.stdout:6/798: rmdir d0/d66/d7e/d9f 39 2024-05-09T06:30:32.698 INFO:tasks.workunit.client.1.smithi106.stdout:6/799: write d0/d17/d34/d4e/d98/da9/db1/d40/f10a [891996,90403] 0 2024-05-09T06:30:32.698 INFO:tasks.workunit.client.1.smithi106.stdout:6/800: creat d0/d66/f110 x:0 0 0 2024-05-09T06:30:32.705 INFO:tasks.workunit.client.1.smithi106.stdout:9/793: write d4/d54/d69/d99/d2a/d61/fa3 [453089,82694] 0 2024-05-09T06:30:32.705 INFO:tasks.workunit.client.1.smithi106.stdout:9/794: chown d4/d54/d69/d95/f2e 460000403 1 2024-05-09T06:30:32.709 INFO:tasks.workunit.client.1.smithi106.stdout:5/828: dwrite d8/d5a/d60/da8/daa/ffb [0,4194304] 0 2024-05-09T06:30:32.713 INFO:tasks.workunit.client.1.smithi106.stdout:0/803: symlink d1/d11/d23/d13/d2c/d6d/l115 0 2024-05-09T06:30:32.714 INFO:tasks.workunit.client.1.smithi106.stdout:0/804: write d1/d11/d23/d13/d2c/fe9 [854026,113277] 0 2024-05-09T06:30:32.714 INFO:tasks.workunit.client.1.smithi106.stdout:0/805: dread - d1/d11/d23/da6/fac zero size 2024-05-09T06:30:32.714 INFO:tasks.workunit.client.1.smithi106.stdout:1/809: mkdir d4/d37/d74/d122 0 2024-05-09T06:30:32.714 INFO:tasks.workunit.client.1.smithi106.stdout:1/810: readlink d4/d76/d65/d8d/lec 0 2024-05-09T06:30:32.715 INFO:tasks.workunit.client.1.smithi106.stdout:8/726: dwrite d3/d5/d7/d15/d47/fcf [0,4194304] 0 2024-05-09T06:30:32.715 INFO:tasks.workunit.client.1.smithi106.stdout:3/659: dwrite d5/d1c/d24/d98/dc0/f7e [0,4194304] 0 2024-05-09T06:30:32.715 INFO:tasks.workunit.client.1.smithi106.stdout:3/660: chown d5/f3b 998 1 2024-05-09T06:30:32.717 INFO:tasks.workunit.client.1.smithi106.stdout:7/759: rename d0/dc/d1a/d36/d1e/d68/dc9 to d0/dc/d1a/d36/d30/d44/ded 0 2024-05-09T06:30:32.717 INFO:tasks.workunit.client.1.smithi106.stdout:7/760: fdatasync d0/dc/d1a/d36/d30/d44/d58/d65/d84/fa0 0 2024-05-09T06:30:32.718 INFO:tasks.workunit.client.1.smithi106.stdout:9/795: truncate d4/d54/d69/d95/d23/d16/dd1/d39/f60 622999 0 2024-05-09T06:30:32.720 INFO:tasks.workunit.client.1.smithi106.stdout:2/889: rmdir d2/d5/db/d15/d41/df8 39 2024-05-09T06:30:32.720 INFO:tasks.workunit.client.1.smithi106.stdout:2/890: read - d2/d7/fd7 zero size 2024-05-09T06:30:32.721 INFO:tasks.workunit.client.1.smithi106.stdout:4/719: dwrite d7/d39/f44 [0,4194304] 0 2024-05-09T06:30:32.721 INFO:tasks.workunit.client.1.smithi106.stdout:0/806: getdents d1/d11/d23/d13/d2c/d57/de1 0 2024-05-09T06:30:32.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/801: dwrite d0/d17/d34/f82 [0,4194304] 0 2024-05-09T06:30:32.729 INFO:tasks.workunit.client.1.smithi106.stdout:8/727: creat d3/d5/d13/d3a/dbe/ff3 x:0 0 0 2024-05-09T06:30:32.729 INFO:tasks.workunit.client.1.smithi106.stdout:8/728: dread - d3/d6b/fed zero size 2024-05-09T06:30:32.733 INFO:tasks.workunit.client.1.smithi106.stdout:7/761: mknod d0/dc/d1a/d36/d30/d44/dc1/cee 0 2024-05-09T06:30:32.733 INFO:tasks.workunit.client.1.smithi106.stdout:7/762: creat d0/dc/d45/da6/dc5/fef x:0 0 0 2024-05-09T06:30:32.733 INFO:tasks.workunit.client.1.smithi106.stdout:8/729: dread d3/d5/d7/f44 [0,4194304] 0 2024-05-09T06:30:32.736 INFO:tasks.workunit.client.1.smithi106.stdout:9/796: dwrite d4/d54/d69/d95/d23/d16/dd1/d31/f44 [0,4194304] 0 2024-05-09T06:30:32.736 INFO:tasks.workunit.client.1.smithi106.stdout:6/802: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/c111 0 2024-05-09T06:30:32.741 INFO:tasks.workunit.client.1.smithi106.stdout:5/829: rename d8/d45/d4c/d32/d5b to d8/d5a/d60/d7e/dae/dd9/def/dd1/dff 0 2024-05-09T06:30:32.743 INFO:tasks.workunit.client.1.smithi106.stdout:8/730: mkdir d3/d5/d7/d15/df4 0 2024-05-09T06:30:32.747 INFO:tasks.workunit.client.1.smithi106.stdout:9/797: mknod d4/d54/cf8 0 2024-05-09T06:30:32.749 INFO:tasks.workunit.client.1.smithi106.stdout:6/803: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/f112 x:0 0 0 2024-05-09T06:30:32.752 INFO:tasks.workunit.client.1.smithi106.stdout:1/811: rename d4/d76/d1d/l1e to d4/d5/l123 0 2024-05-09T06:30:32.752 INFO:tasks.workunit.client.1.smithi106.stdout:1/812: fsync d4/d76/d65/d8d/db5/fe9 0 2024-05-09T06:30:32.754 INFO:tasks.workunit.client.1.smithi106.stdout:5/830: mkdir d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/d100 0 2024-05-09T06:30:32.755 INFO:tasks.workunit.client.1.smithi106.stdout:9/798: truncate d4/d54/d69/d95/d23/d78/fa6 2656990 0 2024-05-09T06:30:32.755 INFO:tasks.workunit.client.1.smithi106.stdout:9/799: write d4/d54/d69/d95/f2b [3196297,68444] 0 2024-05-09T06:30:32.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/891: rename d2/d5/db/d1d/d23/d63/d7a/dda to d2/d5/db/d1d/d133 0 2024-05-09T06:30:32.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/892: fdatasync d2/d5/db/f87 0 2024-05-09T06:30:32.757 INFO:tasks.workunit.client.1.smithi106.stdout:2/893: stat d2/d7/c1a 0 2024-05-09T06:30:32.757 INFO:tasks.workunit.client.0.smithi046.stdout:8/17: sync 2024-05-09T06:30:32.758 INFO:tasks.workunit.client.0.smithi046.stdout:8/18: readlink - no filename 2024-05-09T06:30:32.758 INFO:tasks.workunit.client.0.smithi046.stdout:8/19: fsync f0 0 2024-05-09T06:30:32.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/813: mkdir d4/d76/d13/d60/d124 0 2024-05-09T06:30:32.758 INFO:tasks.workunit.client.1.smithi106.stdout:1/814: dread - d4/da7/fb1 zero size 2024-05-09T06:30:32.760 INFO:tasks.workunit.client.1.smithi106.stdout:2/894: write d2/f8d [1483808,110032] 0 2024-05-09T06:30:32.760 INFO:tasks.workunit.client.1.smithi106.stdout:2/895: read d2/d5/db/d15/d41/d58/f50 [184895,29578] 0 2024-05-09T06:30:32.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/20: unlink f0 0 2024-05-09T06:30:32.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/21: rename - no filename 2024-05-09T06:30:32.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/22: dread - no filename 2024-05-09T06:30:32.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/23: dread - no filename 2024-05-09T06:30:32.761 INFO:tasks.workunit.client.1.smithi106.stdout:8/731: dwrite d3/d5/d13/f29 [4194304,4194304] 0 2024-05-09T06:30:32.761 INFO:tasks.workunit.client.1.smithi106.stdout:5/831: write d8/d5a/d60/fcb [2648373,112595] 0 2024-05-09T06:30:32.761 INFO:tasks.workunit.client.1.smithi106.stdout:5/832: readlink d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/l40 0 2024-05-09T06:30:32.764 INFO:tasks.workunit.client.1.smithi106.stdout:3/661: rename d5/d1c/d24/d98/dc0/fb5 to d5/d8f/fd1 0 2024-05-09T06:30:32.765 INFO:tasks.workunit.client.1.smithi106.stdout:2/896: truncate d2/d5/db/d68/fc8 4032090 0 2024-05-09T06:30:32.766 INFO:tasks.workunit.client.1.smithi106.stdout:9/800: write d4/d54/d69/d95/d23/d16/dd1/d39/f4a [534040,127773] 0 2024-05-09T06:30:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:8/24: mkdir d1 0 2024-05-09T06:30:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:8/25: rename d1 to d1/d2 22 2024-05-09T06:30:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:8/26: dread - no filename 2024-05-09T06:30:32.767 INFO:tasks.workunit.client.0.smithi046.stdout:8/27: readlink - no filename 2024-05-09T06:30:32.767 INFO:tasks.workunit.client.0.smithi046.stdout:8/28: link - no file 2024-05-09T06:30:32.767 INFO:tasks.workunit.client.0.smithi046.stdout:8/29: dwrite - no filename 2024-05-09T06:30:32.769 INFO:tasks.workunit.client.1.smithi106.stdout:8/732: symlink d3/d5/d35/d73/d9d/da9/dbd/lf5 0 2024-05-09T06:30:32.770 INFO:tasks.workunit.client.1.smithi106.stdout:8/733: creat d3/d5/d7/d98/ff6 x:0 0 0 2024-05-09T06:30:32.770 INFO:tasks.workunit.client.1.smithi106.stdout:8/734: write d3/d6b/fed [165602,99998] 0 2024-05-09T06:30:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/30: creat d1/f3 x:0 0 0 2024-05-09T06:30:32.773 INFO:tasks.workunit.client.1.smithi106.stdout:7/763: rename d0/dc/d1a/d36/d1e/d68 to d0/dc/d1a/d36/d30/d44/df0 0 2024-05-09T06:30:32.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/662: creat d5/d85/fd2 x:0 0 0 2024-05-09T06:30:32.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/663: readlink d5/d1c/d24/d98/dc0/lbc 0 2024-05-09T06:30:32.775 INFO:tasks.workunit.client.1.smithi106.stdout:2/897: dread d2/d5/db/d1d/d23/f66 [0,4194304] 0 2024-05-09T06:30:32.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/664: creat d5/d1c/d24/d89/d8c/fd3 x:0 0 0 2024-05-09T06:30:32.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/665: dread - d5/d85/dc3/d65/fc5 zero size 2024-05-09T06:30:32.776 INFO:tasks.workunit.client.1.smithi106.stdout:3/666: write d5/d4d/d72/fd0 [756241,111047] 0 2024-05-09T06:30:32.776 INFO:tasks.workunit.client.1.smithi106.stdout:3/667: readlink d5/d1c/d24/d89/la1 0 2024-05-09T06:30:32.776 INFO:tasks.workunit.client.1.smithi106.stdout:3/668: creat d5/d1c/d24/d98/dc0/d32/fd4 x:0 0 0 2024-05-09T06:30:32.776 INFO:tasks.workunit.client.1.smithi106.stdout:3/669: fdatasync d5/d4d/d7a/fb2 0 2024-05-09T06:30:32.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/31: rename d1/f3 to d1/f4 0 2024-05-09T06:30:32.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/32: rename d1 to d1/d5 22 2024-05-09T06:30:32.778 INFO:tasks.workunit.client.0.smithi046.stdout:8/33: symlink d1/l6 0 2024-05-09T06:30:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:8/735: symlink d3/d5/d35/d4e/d32/lf7 0 2024-05-09T06:30:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:8/736: write d3/d5/d35/d73/d9d/da9/dbd/dd7/fe0 [979714,119577] 0 2024-05-09T06:30:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:8/737: write d3/d5/d35/d4e/d32/f75 [293739,93075] 0 2024-05-09T06:30:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:8/738: chown d3/d5/d35/d61/d6c/d83/dcc/de9/laf 53269754 1 2024-05-09T06:30:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:8/739: creat d3/d5/d35/d73/d9d/da9/ff8 x:0 0 0 2024-05-09T06:30:32.782 INFO:tasks.workunit.client.1.smithi106.stdout:8/740: read - d3/d5/d7/d15/d47/fd9 zero size 2024-05-09T06:30:32.783 INFO:tasks.workunit.client.1.smithi106.stdout:6/804: rename d0/d17/d34/d4e/d98/da9/db1/d8/cb8 to d0/c113 0 2024-05-09T06:30:32.783 INFO:tasks.workunit.client.1.smithi106.stdout:6/805: write d0/d17/d34/d4e/d98/da9/db1/d8/d27/fd7 [780260,86545] 0 2024-05-09T06:30:32.783 INFO:tasks.workunit.client.1.smithi106.stdout:6/806: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/f7d [3568644,25534] 0 2024-05-09T06:30:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/34: mkdir d1/d7 0 2024-05-09T06:30:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/35: chown d1/d7 619163247 1 2024-05-09T06:30:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/36: read - d1/f4 zero size 2024-05-09T06:30:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/37: readlink d1/l6 0 2024-05-09T06:30:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/38: fdatasync d1/f4 0 2024-05-09T06:30:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/39: dread - d1/f4 zero size 2024-05-09T06:30:32.787 INFO:tasks.workunit.client.1.smithi106.stdout:5/833: dwrite d8/fa [4194304,4194304] 0 2024-05-09T06:30:32.787 INFO:tasks.workunit.client.1.smithi106.stdout:5/834: stat d8/c15 0 2024-05-09T06:30:32.787 INFO:tasks.workunit.client.1.smithi106.stdout:3/670: dread d5/d1c/d24/d52/f71 [0,4194304] 0 2024-05-09T06:30:32.791 INFO:tasks.workunit.client.1.smithi106.stdout:7/764: dwrite d0/d53/d7a/fd7 [0,4194304] 0 2024-05-09T06:30:32.795 INFO:tasks.workunit.client.1.smithi106.stdout:8/741: link d3/d5/d35/d4e/l39 d3/d5/d35/d73/d9d/da9/dbd/dd7/lf9 0 2024-05-09T06:30:32.804 INFO:tasks.workunit.client.1.smithi106.stdout:7/765: dread d0/d53/d7a/fd7 [0,4194304] 0 2024-05-09T06:30:32.807 INFO:tasks.workunit.client.1.smithi106.stdout:1/815: rename d4/d76/d13/d60/d9c/de4/l115 to d4/d76/d13/dbb/l125 0 2024-05-09T06:30:32.809 INFO:tasks.workunit.client.1.smithi106.stdout:9/801: rename d4/d54/d69/d95/d23/d78/d8f/l9f to d4/d54/d91/lf9 0 2024-05-09T06:30:32.810 INFO:tasks.workunit.client.1.smithi106.stdout:1/816: symlink d4/d76/d13/d2f/df5/l126 0 2024-05-09T06:30:32.811 INFO:tasks.workunit.client.1.smithi106.stdout:2/898: rename d2/d5/db/d15/d41/d58/l7e to d2/d7/d62/l134 0 2024-05-09T06:30:32.812 INFO:tasks.workunit.client.1.smithi106.stdout:5/835: dwrite d8/f10 [0,4194304] 0 2024-05-09T06:30:32.813 INFO:tasks.workunit.client.1.smithi106.stdout:9/802: link d4/d54/d69/d99/d2a/d42/f57 d4/d54/d91/dc7/d58/ffa 0 2024-05-09T06:30:32.818 INFO:tasks.workunit.client.1.smithi106.stdout:5/836: mkdir d8/d5a/d60/df6/d101 0 2024-05-09T06:30:32.820 INFO:tasks.workunit.client.1.smithi106.stdout:5/837: rmdir d8/d5a/d60/d7e/dae/dd9 39 2024-05-09T06:30:32.820 INFO:tasks.workunit.client.1.smithi106.stdout:2/899: dread d2/d5/db/d15/f107 [0,4194304] 0 2024-05-09T06:30:32.822 INFO:tasks.workunit.client.1.smithi106.stdout:5/838: mknod d8/d45/d4c/d32/c102 0 2024-05-09T06:30:32.824 INFO:tasks.workunit.client.1.smithi106.stdout:5/839: unlink d8/d33/l94 0 2024-05-09T06:30:32.825 INFO:tasks.workunit.client.1.smithi106.stdout:7/766: dread d0/dc/d1a/d36/d30/d44/d6a/f7c [0,4194304] 0 2024-05-09T06:30:32.827 INFO:tasks.workunit.client.1.smithi106.stdout:1/817: dread d4/d76/f53 [0,4194304] 0 2024-05-09T06:30:32.827 INFO:tasks.workunit.client.1.smithi106.stdout:1/818: dread - d4/d76/d13/f105 zero size 2024-05-09T06:30:32.827 INFO:tasks.workunit.client.1.smithi106.stdout:1/819: truncate d4/d76/d65/d67/fe1 116694 0 2024-05-09T06:30:32.827 INFO:tasks.workunit.client.1.smithi106.stdout:6/807: dwrite d0/d17/d34/d4e/fda [0,4194304] 0 2024-05-09T06:30:32.828 INFO:tasks.workunit.client.1.smithi106.stdout:6/808: truncate d0/d17/d34/dd0/df2/fb2 656259 0 2024-05-09T06:30:32.828 INFO:tasks.workunit.client.1.smithi106.stdout:5/840: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/f103 x:0 0 0 2024-05-09T06:30:32.828 INFO:tasks.workunit.client.1.smithi106.stdout:8/742: dwrite d3/d5/d13/f40 [0,4194304] 0 2024-05-09T06:30:32.828 INFO:tasks.workunit.client.0.smithi046.stdout:8/40: dwrite d1/f4 [0,4194304] 0 2024-05-09T06:30:32.830 INFO:tasks.workunit.client.1.smithi106.stdout:7/767: rmdir d0/dc/d1a/d36/d30/d44/d6a 39 2024-05-09T06:30:32.830 INFO:tasks.workunit.client.1.smithi106.stdout:7/768: stat d0/d53/l59 0 2024-05-09T06:30:32.830 INFO:tasks.workunit.client.1.smithi106.stdout:7/769: truncate d0/dc/d1a/d5a/f94 1177535 0 2024-05-09T06:30:32.836 INFO:tasks.workunit.client.1.smithi106.stdout:9/803: dwrite d4/d54/f5f [0,4194304] 0 2024-05-09T06:30:32.839 INFO:tasks.workunit.client.1.smithi106.stdout:9/804: dread d4/f25 [0,4194304] 0 2024-05-09T06:30:32.840 INFO:tasks.workunit.client.1.smithi106.stdout:6/809: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47/c114 0 2024-05-09T06:30:32.843 INFO:tasks.workunit.client.1.smithi106.stdout:7/770: unlink d0/dc/cc6 0 2024-05-09T06:30:32.843 INFO:tasks.workunit.client.1.smithi106.stdout:7/771: chown d0/dc/d1a/d36/d30/d44/d6a/f9e 1404619 1 2024-05-09T06:30:32.843 INFO:tasks.workunit.client.1.smithi106.stdout:7/772: fsync d0/dc/d45/da6/fe0 0 2024-05-09T06:30:32.844 INFO:tasks.workunit.client.1.smithi106.stdout:6/810: dread d0/d17/d34/d72/f93 [0,4194304] 0 2024-05-09T06:30:32.845 INFO:tasks.workunit.client.1.smithi106.stdout:9/805: rename d4/d54/d69/d95/d23/l9e to d4/d54/d69/d95/d23/d16/dd1/d47/ddc/lfb 0 2024-05-09T06:30:32.847 INFO:tasks.workunit.client.1.smithi106.stdout:5/841: getdents d8/d5a/d60 0 2024-05-09T06:30:32.849 INFO:tasks.workunit.client.1.smithi106.stdout:7/773: symlink d0/dc/d1a/d36/d30/d44/d58/d65/d84/d86/lf1 0 2024-05-09T06:30:32.850 INFO:tasks.workunit.client.1.smithi106.stdout:9/806: creat d4/ffc x:0 0 0 2024-05-09T06:30:32.852 INFO:tasks.workunit.client.1.smithi106.stdout:7/774: creat d0/ff2 x:0 0 0 2024-05-09T06:30:32.852 INFO:tasks.workunit.client.1.smithi106.stdout:7/775: dread - d0/dc/d1a/d36/d30/d44/fd5 zero size 2024-05-09T06:30:32.852 INFO:tasks.workunit.client.1.smithi106.stdout:7/776: readlink d0/dc/d1a/d36/l37 0 2024-05-09T06:30:32.852 INFO:tasks.workunit.client.1.smithi106.stdout:9/807: mkdir d4/d54/d69/d99/d2a/d42/dfd 0 2024-05-09T06:30:32.853 INFO:tasks.workunit.client.1.smithi106.stdout:6/811: dread d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/fd1 [0,4194304] 0 2024-05-09T06:30:32.853 INFO:tasks.workunit.client.1.smithi106.stdout:7/777: symlink d0/dc/d1a/d36/d30/d44/ded/lf3 0 2024-05-09T06:30:32.853 INFO:tasks.workunit.client.1.smithi106.stdout:7/778: fsync d0/dc/d1a/f3d 0 2024-05-09T06:30:32.854 INFO:tasks.workunit.client.1.smithi106.stdout:9/808: symlink d4/d54/d69/d99/d2a/lfe 0 2024-05-09T06:30:32.855 INFO:tasks.workunit.client.1.smithi106.stdout:6/812: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d50/d115 0 2024-05-09T06:30:32.856 INFO:tasks.workunit.client.1.smithi106.stdout:7/779: mknod d0/dc/d1a/d36/d1e/cf4 0 2024-05-09T06:30:32.857 INFO:tasks.workunit.client.1.smithi106.stdout:9/809: symlink d4/d54/d69/d95/lff 0 2024-05-09T06:30:32.857 INFO:tasks.workunit.client.1.smithi106.stdout:9/810: chown d4/d54/d69/d99/d2a/f20 29 1 2024-05-09T06:30:32.858 INFO:tasks.workunit.client.1.smithi106.stdout:6/813: creat d0/d17/d34/d72/f116 x:0 0 0 2024-05-09T06:30:32.859 INFO:tasks.workunit.client.1.smithi106.stdout:5/842: read d8/f5f [3279515,4054] 0 2024-05-09T06:30:32.859 INFO:tasks.workunit.client.1.smithi106.stdout:5/843: write d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/f87 [5103668,75152] 0 2024-05-09T06:30:32.860 INFO:tasks.workunit.client.1.smithi106.stdout:5/844: fdatasync d8/d45/d4c/fe4 0 2024-05-09T06:30:32.860 INFO:tasks.workunit.client.1.smithi106.stdout:9/811: mkdir d4/d54/d100 0 2024-05-09T06:30:32.861 INFO:tasks.workunit.client.1.smithi106.stdout:6/814: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/f117 x:0 0 0 2024-05-09T06:30:32.863 INFO:tasks.workunit.client.1.smithi106.stdout:9/812: rmdir d4/d54/d69/d99/d2a/d42 39 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:0/807: sync 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/720: sync 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:0/808: readlink d1/d11/d23/d13/d58/l68 0 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:6/815: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/de2/c118 0 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:0/809: write d1/fa7 [1313211,50750] 0 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:0/810: chown d1/d11/d23/d13/d2c/d57 3126 1 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:0/811: write d1/d11/d23/d13/d58/da8/dd6/fd2 [1026496,104808] 0 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:0/812: chown d1/d11/lb7 136988809 1 2024-05-09T06:30:32.865 INFO:tasks.workunit.client.1.smithi106.stdout:9/813: symlink d4/d54/d69/d99/d2a/d61/l101 0 2024-05-09T06:30:32.866 INFO:tasks.workunit.client.1.smithi106.stdout:1/820: dwrite d4/d5/ff7 [0,4194304] 0 2024-05-09T06:30:32.866 INFO:tasks.workunit.client.1.smithi106.stdout:1/821: getdents d4/d5b/d75 0 2024-05-09T06:30:32.868 INFO:tasks.workunit.client.1.smithi106.stdout:0/813: dread d1/d11/d23/d13/f15 [0,4194304] 0 2024-05-09T06:30:32.868 INFO:tasks.workunit.client.1.smithi106.stdout:4/721: creat d7/d39/d35/dac/fed x:0 0 0 2024-05-09T06:30:32.868 INFO:tasks.workunit.client.1.smithi106.stdout:4/722: chown d7/d28/l68 706816579 1 2024-05-09T06:30:32.869 INFO:tasks.workunit.client.1.smithi106.stdout:9/814: creat d4/d54/d69/d95/d23/d16/dd1/d39/f102 x:0 0 0 2024-05-09T06:30:32.869 INFO:tasks.workunit.client.1.smithi106.stdout:9/815: stat d4/d54/d69/d99/d2a/f56 0 2024-05-09T06:30:32.870 INFO:tasks.workunit.client.0.smithi046.stdout:8/41: dwrite d1/f4 [0,4194304] 0 2024-05-09T06:30:32.873 INFO:tasks.workunit.client.1.smithi106.stdout:5/845: dread d8/d5a/d60/ff8 [0,4194304] 0 2024-05-09T06:30:32.873 INFO:tasks.workunit.client.1.smithi106.stdout:5/846: fdatasync d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/fab 0 2024-05-09T06:30:32.876 INFO:tasks.workunit.client.1.smithi106.stdout:0/814: rename d1/d11/d23/d13/d2c/d3d/l51 to d1/d11/d23/d13/l116 0 2024-05-09T06:30:32.876 INFO:tasks.workunit.client.1.smithi106.stdout:0/815: truncate d1/d11/d23/d22/fd1 1336313 0 2024-05-09T06:30:32.879 INFO:tasks.workunit.client.1.smithi106.stdout:4/723: unlink d7/d28/d2a/d80/fa6 0 2024-05-09T06:30:32.879 INFO:tasks.workunit.client.1.smithi106.stdout:4/724: fsync d7/d28/f27 0 2024-05-09T06:30:32.881 INFO:tasks.workunit.client.1.smithi106.stdout:9/816: link d4/d54/d69/d95/d23/d78/fe6 d4/d54/d69/d95/d23/d16/f103 0 2024-05-09T06:30:32.882 INFO:tasks.workunit.client.1.smithi106.stdout:1/822: dwrite d4/dbd/de6/f100 [0,4194304] 0 2024-05-09T06:30:32.884 INFO:tasks.workunit.client.1.smithi106.stdout:5/847: rmdir d8/d45/d4c/d85/dc3 0 2024-05-09T06:30:32.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/42: dread d1/f4 [0,4194304] 0 2024-05-09T06:30:32.888 INFO:tasks.workunit.client.1.smithi106.stdout:9/817: unlink d4/d54/d69/d95/d23/ca7 0 2024-05-09T06:30:32.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/23: sync 2024-05-09T06:30:32.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/24: truncate - no filename 2024-05-09T06:30:32.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/25: write - no filename 2024-05-09T06:30:32.890 INFO:tasks.workunit.client.1.smithi106.stdout:1/823: getdents d4/d76/d13/d60/d9c 0 2024-05-09T06:30:32.890 INFO:tasks.workunit.client.1.smithi106.stdout:1/824: write d4/d76/d13/d2f/fce [192452,71341] 0 2024-05-09T06:30:32.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/26: symlink d4/l8 0 2024-05-09T06:30:32.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/27: write - no filename 2024-05-09T06:30:32.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/28: dwrite - no filename 2024-05-09T06:30:32.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/29: creat d4/d5/f9 x:0 0 0 2024-05-09T06:30:32.899 INFO:tasks.workunit.client.1.smithi106.stdout:0/816: dwrite d1/fd9 [0,4194304] 0 2024-05-09T06:30:32.899 INFO:tasks.workunit.client.1.smithi106.stdout:0/817: write d1/da1/d83/fe4 [857458,31722] 0 2024-05-09T06:30:32.899 INFO:tasks.workunit.client.1.smithi106.stdout:0/818: fsync d1/d11/d23/d22/f84 0 2024-05-09T06:30:32.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/30: rename d4/d5/l7 to d4/d5/la 0 2024-05-09T06:30:32.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/31: read - d4/d5/f9 zero size 2024-05-09T06:30:32.909 INFO:tasks.workunit.client.1.smithi106.stdout:0/819: mknod d1/da1/c117 0 2024-05-09T06:30:32.909 INFO:tasks.workunit.client.1.smithi106.stdout:0/820: chown d1/d11/d23/d13/d8a/dc1 1 1 2024-05-09T06:30:32.909 INFO:tasks.workunit.client.1.smithi106.stdout:0/821: fdatasync d1/d11/d23/d22/f4e 0 2024-05-09T06:30:32.909 INFO:tasks.workunit.client.1.smithi106.stdout:9/818: dwrite d4/d54/d69/d95/d23/d78/d8f/d9a/fb7 [0,4194304] 0 2024-05-09T06:30:32.910 INFO:tasks.workunit.client.1.smithi106.stdout:9/819: chown d4/d54/d69/d95/d23/d16/dd1/d47/f4d 2407 1 2024-05-09T06:30:32.910 INFO:tasks.workunit.client.1.smithi106.stdout:4/725: dwrite d7/d39/d35/d4a/f93 [0,4194304] 0 2024-05-09T06:30:32.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/43: dwrite d1/f4 [4194304,4194304] 0 2024-05-09T06:30:32.911 INFO:tasks.workunit.client.1.smithi106.stdout:1/825: mknod d4/d76/d13/dbb/c127 0 2024-05-09T06:30:32.911 INFO:tasks.workunit.client.1.smithi106.stdout:1/826: chown d4/d37/d3d/c78 10 1 2024-05-09T06:30:32.911 INFO:tasks.workunit.client.1.smithi106.stdout:1/827: stat d4/f59 0 2024-05-09T06:30:32.912 INFO:tasks.workunit.client.1.smithi106.stdout:0/822: link d1/d11/d23/d13/d2c/f8b d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/f118 0 2024-05-09T06:30:32.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/44: symlink d1/l8 0 2024-05-09T06:30:32.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/45: creat d1/f9 x:0 0 0 2024-05-09T06:30:32.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/46: chown d1/d7 12109 1 2024-05-09T06:30:32.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/47: chown d1/f9 2249828 1 2024-05-09T06:30:32.916 INFO:tasks.workunit.client.1.smithi106.stdout:0/823: dread d1/d11/d23/d13/d8a/fc9 [0,4194304] 0 2024-05-09T06:30:32.919 INFO:tasks.workunit.client.0.smithi046.stdout:8/48: mknod d1/ca 0 2024-05-09T06:30:32.919 INFO:tasks.workunit.client.0.smithi046.stdout:8/49: write d1/f9 [835411,14594] 0 2024-05-09T06:30:32.922 INFO:tasks.workunit.client.1.smithi106.stdout:9/820: dwrite d4/d54/d69/d99/f3e [0,4194304] 0 2024-05-09T06:30:32.924 INFO:tasks.workunit.client.1.smithi106.stdout:4/726: link d7/d39/d35/d6f/d9c/cad d7/d39/d8c/da1/cee 0 2024-05-09T06:30:32.924 INFO:tasks.workunit.client.1.smithi106.stdout:4/727: chown d7/d39/d8c/da1 3239 1 2024-05-09T06:30:32.924 INFO:tasks.workunit.client.1.smithi106.stdout:4/728: stat d7/d10/f16 0 2024-05-09T06:30:32.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/32: getdents d4 0 2024-05-09T06:30:32.926 INFO:tasks.workunit.client.1.smithi106.stdout:1/828: symlink d4/d76/db3/l128 0 2024-05-09T06:30:32.930 INFO:tasks.workunit.client.1.smithi106.stdout:0/824: creat d1/d11/d23/d13/d58/da8/dd6/f119 x:0 0 0 2024-05-09T06:30:32.930 INFO:tasks.workunit.client.1.smithi106.stdout:0/825: dread - d1/d11/d7f/f10b zero size 2024-05-09T06:30:32.935 INFO:tasks.workunit.client.1.smithi106.stdout:4/729: creat d7/d28/d2a/d80/fef x:0 0 0 2024-05-09T06:30:32.935 INFO:tasks.workunit.client.1.smithi106.stdout:4/730: chown d7/d28 9554111 1 2024-05-09T06:30:32.935 INFO:tasks.workunit.client.1.smithi106.stdout:4/731: dread - d7/fc4 zero size 2024-05-09T06:30:32.936 INFO:tasks.workunit.client.1.smithi106.stdout:9/821: dread d4/d54/d69/d99/d2a/fae [0,4194304] 0 2024-05-09T06:30:32.937 INFO:tasks.workunit.client.1.smithi106.stdout:1/829: creat d4/d76/d1d/f129 x:0 0 0 2024-05-09T06:30:32.937 INFO:tasks.workunit.client.1.smithi106.stdout:1/830: truncate d4/f12 2515504 0 2024-05-09T06:30:32.938 INFO:tasks.workunit.client.0.smithi046.stdout:8/50: fsync d1/f9 0 2024-05-09T06:30:32.940 INFO:tasks.workunit.client.1.smithi106.stdout:0/826: creat d1/d11/d23/d13/d2c/f11a x:0 0 0 2024-05-09T06:30:32.941 INFO:tasks.workunit.client.1.smithi106.stdout:4/732: symlink d7/d39/d47/d89/lf0 0 2024-05-09T06:30:32.944 INFO:tasks.workunit.client.1.smithi106.stdout:1/831: rmdir d4/d76/d65/d8d/db5 39 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.1.smithi106.stdout:3/671: sync 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.1.smithi106.stdout:2/900: sync 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.1.smithi106.stdout:2/901: chown d2/d5/db/d1d/fc5 65090448 1 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.1.smithi106.stdout:2/902: truncate d2/d5/db/d68/f92 4318581 0 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.1.smithi106.stdout:2/903: dread - d2/d5/db/d1d/d23/d5e/fe7 zero size 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.1.smithi106.stdout:2/904: read - d2/d7/d62/d9a/f125 zero size 2024-05-09T06:30:32.945 INFO:tasks.workunit.client.0.smithi046.stdout:3/33: mknod d4/cb 0 2024-05-09T06:30:32.947 INFO:tasks.workunit.client.1.smithi106.stdout:9/822: write d4/d54/d69/d99/d2a/d42/d6c/d6d/fb5 [3605681,33929] 0 2024-05-09T06:30:32.947 INFO:tasks.workunit.client.1.smithi106.stdout:9/823: chown d4/d54/d69/d95/c66 3 1 2024-05-09T06:30:32.947 INFO:tasks.workunit.client.1.smithi106.stdout:4/733: mknod d7/d10/d1a/d5a/d1c/cf1 0 2024-05-09T06:30:32.947 INFO:tasks.workunit.client.1.smithi106.stdout:4/734: fdatasync d7/d39/d35/dac/dd5/fdb 0 2024-05-09T06:30:32.948 INFO:tasks.workunit.client.1.smithi106.stdout:2/905: dread d2/d7/d62/f108 [0,4194304] 0 2024-05-09T06:30:32.948 INFO:tasks.workunit.client.1.smithi106.stdout:2/906: write d2/f8d [429947,32346] 0 2024-05-09T06:30:32.949 INFO:tasks.workunit.client.1.smithi106.stdout:1/832: creat d4/d76/d13/d2f/f12a x:0 0 0 2024-05-09T06:30:32.949 INFO:tasks.workunit.client.1.smithi106.stdout:1/833: chown d4/d76/d13/d60/d9c/de4/l121 6278915 1 2024-05-09T06:30:32.949 INFO:tasks.workunit.client.1.smithi106.stdout:1/834: fdatasync d4/f59 0 2024-05-09T06:30:32.950 INFO:tasks.workunit.client.1.smithi106.stdout:1/835: write d4/d76/d13/d60/d9c/feb [694712,81321] 0 2024-05-09T06:30:32.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/34: dread - d4/d5/f9 zero size 2024-05-09T06:30:32.952 INFO:tasks.workunit.client.1.smithi106.stdout:3/672: mknod d5/d1c/d24/d89/d8c/dbb/cd5 0 2024-05-09T06:30:32.952 INFO:tasks.workunit.client.1.smithi106.stdout:3/673: chown d5/d1c/d24/d98/dc0/l5d 25215986 1 2024-05-09T06:30:32.953 INFO:tasks.workunit.client.1.smithi106.stdout:9/824: creat d4/d54/d69/d95/d23/d78/d8f/de4/f104 x:0 0 0 2024-05-09T06:30:32.953 INFO:tasks.workunit.client.1.smithi106.stdout:9/825: dread - d4/d54/d69/d95/d23/d16/dd1/f90 zero size 2024-05-09T06:30:32.953 INFO:tasks.workunit.client.1.smithi106.stdout:8/743: sync 2024-05-09T06:30:32.953 INFO:tasks.workunit.client.1.smithi106.stdout:8/744: read - d3/d5/d7/d15/d3e/d7d/fe7 zero size 2024-05-09T06:30:32.955 INFO:tasks.workunit.client.0.smithi046.stdout:3/35: creat d4/fc x:0 0 0 2024-05-09T06:30:32.956 INFO:tasks.workunit.client.1.smithi106.stdout:4/735: creat d7/d39/d35/d7c/da8/dd7/ff2 x:0 0 0 2024-05-09T06:30:32.956 INFO:tasks.workunit.client.1.smithi106.stdout:4/736: creat d7/d39/d47/d89/ff3 x:0 0 0 2024-05-09T06:30:32.957 INFO:tasks.workunit.client.1.smithi106.stdout:2/907: mknod d2/d5/db/d15/dd6/deb/c135 0 2024-05-09T06:30:32.958 INFO:tasks.workunit.client.1.smithi106.stdout:2/908: creat d2/d7/f136 x:0 0 0 2024-05-09T06:30:32.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/51: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:32.962 INFO:tasks.workunit.client.1.smithi106.stdout:0/827: dwrite d1/d11/d23/d22/f45 [0,4194304] 0 2024-05-09T06:30:32.963 INFO:tasks.workunit.client.1.smithi106.stdout:1/836: mkdir d4/d5/d12b 0 2024-05-09T06:30:32.963 INFO:tasks.workunit.client.1.smithi106.stdout:1/837: write d4/da7/fb1 [755822,72967] 0 2024-05-09T06:30:32.963 INFO:tasks.workunit.client.1.smithi106.stdout:3/674: link d5/d1c/d24/c2c d5/d1c/d24/d89/d8c/cd6 0 2024-05-09T06:30:32.964 INFO:tasks.workunit.client.0.smithi046.stdout:7/70: sync 2024-05-09T06:30:32.964 INFO:tasks.workunit.client.0.smithi046.stdout:1/52: sync 2024-05-09T06:30:32.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/124: sync 2024-05-09T06:30:32.964 INFO:tasks.workunit.client.0.smithi046.stdout:1/53: chown d7/fd 0 1 2024-05-09T06:30:32.964 INFO:tasks.workunit.client.0.smithi046.stdout:5/24: sync 2024-05-09T06:30:32.965 INFO:tasks.workunit.client.0.smithi046.stdout:4/94: sync 2024-05-09T06:30:32.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/52: sync 2024-05-09T06:30:32.966 INFO:tasks.workunit.client.0.smithi046.stdout:6/253: sync 2024-05-09T06:30:32.966 INFO:tasks.workunit.client.0.smithi046.stdout:6/254: fdatasync db/d10/d3f/f32 0 2024-05-09T06:30:32.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/203: sync 2024-05-09T06:30:32.967 INFO:tasks.workunit.client.1.smithi106.stdout:9/826: creat d4/d54/db3/db6/f105 x:0 0 0 2024-05-09T06:30:32.967 INFO:tasks.workunit.client.0.smithi046.stdout:9/53: dread d2/d6/d7/f8 [0,4194304] 0 2024-05-09T06:30:32.968 INFO:tasks.workunit.client.1.smithi106.stdout:8/745: stat d3/d5/d13/d3a/dbe/ccb 0 2024-05-09T06:30:32.968 INFO:tasks.workunit.client.1.smithi106.stdout:8/746: creat d3/d5/d35/d73/ffa x:0 0 0 2024-05-09T06:30:32.968 INFO:tasks.workunit.client.1.smithi106.stdout:8/747: write d3/d6b/fdf [1016844,67797] 0 2024-05-09T06:30:32.968 INFO:tasks.workunit.client.1.smithi106.stdout:4/737: dread d7/d39/d35/d4a/f93 [0,4194304] 0 2024-05-09T06:30:32.971 INFO:tasks.workunit.client.0.smithi046.stdout:3/36: getdents d4 0 2024-05-09T06:30:32.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/125: creat da/dc/f27 x:0 0 0 2024-05-09T06:30:32.975 INFO:tasks.workunit.client.1.smithi106.stdout:2/909: dwrite d2/d5/db/d1d/f3d [0,4194304] 0 2024-05-09T06:30:32.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/25: write d0/f4 [1342152,114643] 0 2024-05-09T06:30:32.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/26: stat d0/c5 0 2024-05-09T06:30:32.985 INFO:tasks.workunit.client.0.smithi046.stdout:6/255: symlink db/d10/d3f/d44/d46/l59 0 2024-05-09T06:30:32.985 INFO:tasks.workunit.client.0.smithi046.stdout:6/256: truncate db/f27 4153413 0 2024-05-09T06:30:32.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/204: unlink d11/d18/d27/d28/d2d/f40 0 2024-05-09T06:30:32.994 INFO:tasks.workunit.client.0.smithi046.stdout:9/54: symlink d2/dc/l13 0 2024-05-09T06:30:32.996 INFO:tasks.workunit.client.1.smithi106.stdout:3/675: dwrite d5/d1c/d24/d98/dc0/fa2 [0,4194304] 0 2024-05-09T06:30:32.997 INFO:tasks.workunit.client.1.smithi106.stdout:3/676: chown d5/d85/dc3/d65/d81/f94 0 1 2024-05-09T06:30:32.997 INFO:tasks.workunit.client.0.smithi046.stdout:2/126: creat da/de/d14/f28 x:0 0 0 2024-05-09T06:30:33.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/27: rename d0/l7 to d0/l9 0 2024-05-09T06:30:33.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/28: write d0/f4 [87481,42852] 0 2024-05-09T06:30:33.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/29: creat d0/fa x:0 0 0 2024-05-09T06:30:33.001 INFO:tasks.workunit.client.0.smithi046.stdout:4/95: rmdir d7/df/d10 39 2024-05-09T06:30:33.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/37: dwrite d4/d5/f9 [0,4194304] 0 2024-05-09T06:30:33.004 INFO:tasks.workunit.client.0.smithi046.stdout:6/257: creat db/d10/d3f/f5a x:0 0 0 2024-05-09T06:30:33.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/52: dwrite d1/f4 [4194304,4194304] 0 2024-05-09T06:30:33.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/53: readlink d1/l6 0 2024-05-09T06:30:33.006 INFO:tasks.workunit.client.0.smithi046.stdout:1/54: dwrite f4 [0,4194304] 0 2024-05-09T06:30:33.006 INFO:tasks.workunit.client.0.smithi046.stdout:1/55: creat d7/ff x:0 0 0 2024-05-09T06:30:33.007 INFO:tasks.workunit.client.1.smithi106.stdout:0/828: dwrite d1/d11/d23/d13/d58/da8/ff1 [0,4194304] 0 2024-05-09T06:30:33.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/205: unlink d11/d18/f1e 0 2024-05-09T06:30:33.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/206: readlink d11/d18/l2f 0 2024-05-09T06:30:33.010 INFO:tasks.workunit.client.0.smithi046.stdout:2/127: symlink da/dc/l29 0 2024-05-09T06:30:33.010 INFO:tasks.workunit.client.0.smithi046.stdout:2/128: dread - da/de/d14/f28 zero size 2024-05-09T06:30:33.011 INFO:tasks.workunit.client.0.smithi046.stdout:9/55: dwrite d2/dc/f11 [0,4194304] 0 2024-05-09T06:30:33.013 INFO:tasks.workunit.client.1.smithi106.stdout:1/838: creat d4/dbd/de6/f12c x:0 0 0 2024-05-09T06:30:33.014 INFO:tasks.workunit.client.1.smithi106.stdout:1/839: dread d4/d76/f7c [0,4194304] 0 2024-05-09T06:30:33.014 INFO:tasks.workunit.client.1.smithi106.stdout:1/840: readlink d4/d5b/d75/l91 0 2024-05-09T06:30:33.014 INFO:tasks.workunit.client.1.smithi106.stdout:1/841: write d4/d76/d65/d67/fb2 [2453345,6792] 0 2024-05-09T06:30:33.014 INFO:tasks.workunit.client.1.smithi106.stdout:1/842: chown d4/d76/c2c 883802782 1 2024-05-09T06:30:33.016 INFO:tasks.workunit.client.1.smithi106.stdout:9/827: symlink d4/d54/d91/dc7/d58/l106 0 2024-05-09T06:30:33.017 INFO:tasks.workunit.client.0.smithi046.stdout:3/38: write d4/d5/f9 [3511206,60709] 0 2024-05-09T06:30:33.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/56: dread d2/d6/d7/f8 [0,4194304] 0 2024-05-09T06:30:33.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/30: rename d0/c6 to d0/cb 0 2024-05-09T06:30:33.021 INFO:tasks.workunit.client.1.smithi106.stdout:6/816: sync 2024-05-09T06:30:33.021 INFO:tasks.workunit.client.1.smithi106.stdout:7/780: sync 2024-05-09T06:30:33.021 INFO:tasks.workunit.client.1.smithi106.stdout:5/848: sync 2024-05-09T06:30:33.021 INFO:tasks.workunit.client.1.smithi106.stdout:6/817: chown d0/d17/d34/d4e/d98/da9/db1 0 1 2024-05-09T06:30:33.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/96: dwrite d7/df/f1b [0,4194304] 0 2024-05-09T06:30:33.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/97: chown d7/df/d10/d1d/l21 1234485 1 2024-05-09T06:30:33.023 INFO:tasks.workunit.client.1.smithi106.stdout:8/748: mkdir d3/d5/d35/d4e/d32/d92/dfb 0 2024-05-09T06:30:33.025 INFO:tasks.workunit.client.1.smithi106.stdout:4/738: symlink d7/d39/d47/lf4 0 2024-05-09T06:30:33.027 INFO:tasks.workunit.client.0.smithi046.stdout:6/258: link db/f2b db/d10/d3c/f5b 0 2024-05-09T06:30:33.027 INFO:tasks.workunit.client.1.smithi106.stdout:1/843: write d4/d76/f16 [3431753,122724] 0 2024-05-09T06:30:33.028 INFO:tasks.workunit.client.1.smithi106.stdout:8/749: dread d3/d5/d35/d4e/fca [0,4194304] 0 2024-05-09T06:30:33.028 INFO:tasks.workunit.client.1.smithi106.stdout:2/910: symlink d2/d5/db/d1d/d23/d63/d7a/l137 0 2024-05-09T06:30:33.031 INFO:tasks.workunit.client.0.smithi046.stdout:8/54: mkdir d1/db 0 2024-05-09T06:30:33.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/259: write db/f1f [1951358,112620] 0 2024-05-09T06:30:33.038 INFO:tasks.workunit.client.1.smithi106.stdout:3/677: creat d5/d1c/d24/d5b/db1/fd7 x:0 0 0 2024-05-09T06:30:33.040 INFO:tasks.workunit.client.1.smithi106.stdout:2/911: dread d2/d7/db7/fbf [4194304,4194304] 0 2024-05-09T06:30:33.044 INFO:tasks.workunit.client.0.smithi046.stdout:0/207: rename d11/d18/c1f to d11/c48 0 2024-05-09T06:30:33.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/129: dwrite f6 [4194304,4194304] 0 2024-05-09T06:30:33.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/130: chown da/dc/f13 184897008 1 2024-05-09T06:30:33.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/131: fdatasync da/dc/f27 0 2024-05-09T06:30:33.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/132: chown da/de/d14 4632343 1 2024-05-09T06:30:33.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/133: dread da/de/d14/f1b [0,4194304] 0 2024-05-09T06:30:33.045 INFO:tasks.workunit.client.0.smithi046.stdout:8/55: dread d1/f4 [4194304,4194304] 0 2024-05-09T06:30:33.045 INFO:tasks.workunit.client.0.smithi046.stdout:8/56: chown d1/l8 372387 1 2024-05-09T06:30:33.045 INFO:tasks.workunit.client.1.smithi106.stdout:0/829: symlink d1/l11b 0 2024-05-09T06:30:33.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/31: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:33.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/32: chown d0/f4 6920944 1 2024-05-09T06:30:33.049 INFO:tasks.workunit.client.1.smithi106.stdout:6/818: dwrite d0/d66/d7e/f8c [0,4194304] 0 2024-05-09T06:30:33.049 INFO:tasks.workunit.client.1.smithi106.stdout:6/819: chown d0/d17/d34/d4e/d98/da9/db1/d8/d50/fca 1 1 2024-05-09T06:30:33.050 INFO:tasks.workunit.client.1.smithi106.stdout:9/828: rmdir d4/d54/d69/d99/d2a/d42/dc8 39 2024-05-09T06:30:33.050 INFO:tasks.workunit.client.1.smithi106.stdout:9/829: fdatasync d4/d54/d69/d95/d23/d78/d8f/d9a/fb7 0 2024-05-09T06:30:33.054 INFO:tasks.workunit.client.1.smithi106.stdout:7/781: creat d0/d53/deb/ff5 x:0 0 0 2024-05-09T06:30:33.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/208: write d11/d18/f32 [486083,2367] 0 2024-05-09T06:30:33.058 INFO:tasks.workunit.client.0.smithi046.stdout:9/57: symlink d2/d6/l14 0 2024-05-09T06:30:33.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/57: dread d1/f9 [0,4194304] 0 2024-05-09T06:30:33.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/739: mknod d7/dcb/cf5 0 2024-05-09T06:30:33.059 INFO:tasks.workunit.client.0.smithi046.stdout:9/58: dread d2/fb [0,4194304] 0 2024-05-09T06:30:33.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/260: mkdir db/d10/d30/d53/d5c 0 2024-05-09T06:30:33.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/261: chown db/d10/d3f 1 1 2024-05-09T06:30:33.062 INFO:tasks.workunit.client.1.smithi106.stdout:1/844: truncate d4/d76/d13/d60/d9c/dbe/fde 589655 0 2024-05-09T06:30:33.062 INFO:tasks.workunit.client.1.smithi106.stdout:1/845: write d4/d5b/f85 [1045593,110503] 0 2024-05-09T06:30:33.063 INFO:tasks.workunit.client.0.smithi046.stdout:1/56: getdents d7 0 2024-05-09T06:30:33.064 INFO:tasks.workunit.client.1.smithi106.stdout:8/750: mkdir d3/d5/d35/d61/dfc 0 2024-05-09T06:30:33.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/98: rename d7/df/d10/d1d/l21 to d7/l27 0 2024-05-09T06:30:33.068 INFO:tasks.workunit.client.1.smithi106.stdout:3/678: link d5/d1c/d24/d98/dc0/l40 d5/d85/dc3/d65/d81/d92/ld8 0 2024-05-09T06:30:33.075 INFO:tasks.workunit.client.1.smithi106.stdout:2/912: link d2/d5/f91 d2/d5/db/d1d/d90/f138 0 2024-05-09T06:30:33.075 INFO:tasks.workunit.client.1.smithi106.stdout:2/913: write d2/d7/db7/fa9 [644520,39623] 0 2024-05-09T06:30:33.075 INFO:tasks.workunit.client.1.smithi106.stdout:2/914: creat d2/d5/db/d1d/d90/f139 x:0 0 0 2024-05-09T06:30:33.075 INFO:tasks.workunit.client.1.smithi106.stdout:2/915: fsync d2/d5/db/d68/f92 0 2024-05-09T06:30:33.075 INFO:tasks.workunit.client.1.smithi106.stdout:2/916: write d2/d5/db/d15/d41/fe0 [543249,68192] 0 2024-05-09T06:30:33.075 INFO:tasks.workunit.client.1.smithi106.stdout:2/917: truncate d2/d7/d62/d9a/fcb 911462 0 2024-05-09T06:30:33.076 INFO:tasks.workunit.client.1.smithi106.stdout:2/918: fdatasync d2/d5/db/d15/d41/d60/dcc/fd0 0 2024-05-09T06:30:33.076 INFO:tasks.workunit.client.1.smithi106.stdout:2/919: chown d2/d5/db/f33 53800 1 2024-05-09T06:30:33.078 INFO:tasks.workunit.client.1.smithi106.stdout:6/820: symlink d0/d17/d34/d4e/l119 0 2024-05-09T06:30:33.078 INFO:tasks.workunit.client.1.smithi106.stdout:6/821: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/f117 [1033690,5713] 0 2024-05-09T06:30:33.080 INFO:tasks.workunit.client.1.smithi106.stdout:9/830: unlink d4/d54/d69/d95/d23/d16/dd1/d47/c55 0 2024-05-09T06:30:33.080 INFO:tasks.workunit.client.1.smithi106.stdout:1/846: dwrite d4/d76/d13/d60/d9c/dbe/fc0 [0,4194304] 0 2024-05-09T06:30:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:5/33: mknod d0/cc 0 2024-05-09T06:30:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:5/34: readlink d0/l9 0 2024-05-09T06:30:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/39: link d4/d5/f9 d4/fd 0 2024-05-09T06:30:33.088 INFO:tasks.workunit.client.0.smithi046.stdout:0/209: mknod d11/d18/d27/d28/c49 0 2024-05-09T06:30:33.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/210: creat d11/d18/d27/d28/d2d/f4a x:0 0 0 2024-05-09T06:30:33.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/211: fdatasync d11/d18/f1b 0 2024-05-09T06:30:33.091 INFO:tasks.workunit.client.1.smithi106.stdout:9/831: dread d4/d54/d69/d95/d23/d78/d8f/fb4 [0,4194304] 0 2024-05-09T06:30:33.091 INFO:tasks.workunit.client.1.smithi106.stdout:8/751: dwrite d3/d5/d7/f7f [0,4194304] 0 2024-05-09T06:30:33.091 INFO:tasks.workunit.client.1.smithi106.stdout:8/752: chown d3/d5/d7/d15/d47/d50 772527455 1 2024-05-09T06:30:33.094 INFO:tasks.workunit.client.0.smithi046.stdout:8/58: unlink d1/f4 0 2024-05-09T06:30:33.096 INFO:tasks.workunit.client.0.smithi046.stdout:9/59: creat d2/d6/f15 x:0 0 0 2024-05-09T06:30:33.096 INFO:tasks.workunit.client.0.smithi046.stdout:9/60: write d2/d6/d7/ff [1254897,43629] 0 2024-05-09T06:30:33.097 INFO:tasks.workunit.client.1.smithi106.stdout:2/920: dwrite f0 [0,4194304] 0 2024-05-09T06:30:33.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/262: mkdir db/d10/d57/d5d 0 2024-05-09T06:30:33.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/263: write db/f14 [4815302,125232] 0 2024-05-09T06:30:33.098 INFO:tasks.workunit.client.0.smithi046.stdout:8/59: dread d1/f9 [0,4194304] 0 2024-05-09T06:30:33.098 INFO:tasks.workunit.client.0.smithi046.stdout:8/60: readlink d1/l8 0 2024-05-09T06:30:33.099 INFO:tasks.workunit.client.0.smithi046.stdout:8/61: chown d1/l8 83 1 2024-05-09T06:30:33.100 INFO:tasks.workunit.client.1.smithi106.stdout:4/740: truncate d7/d28/f27 77622 0 2024-05-09T06:30:33.101 INFO:tasks.workunit.client.1.smithi106.stdout:9/832: dread d4/f3d [4194304,4194304] 0 2024-05-09T06:30:33.101 INFO:tasks.workunit.client.1.smithi106.stdout:9/833: getdents d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9 0 2024-05-09T06:30:33.102 INFO:tasks.workunit.client.0.smithi046.stdout:1/57: mkdir d7/d10 0 2024-05-09T06:30:33.103 INFO:tasks.workunit.client.1.smithi106.stdout:3/679: getdents d5/d1c/d24/d98 0 2024-05-09T06:30:33.108 INFO:tasks.workunit.client.0.smithi046.stdout:4/99: creat d7/df/d22/f28 x:0 0 0 2024-05-09T06:30:33.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/40: rename l3 to d4/d5/le 0 2024-05-09T06:30:33.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/41: chown d4/d5/la 93587 1 2024-05-09T06:30:33.114 INFO:tasks.workunit.client.0.smithi046.stdout:6/264: dwrite db/d10/d19/f1b [0,4194304] 0 2024-05-09T06:30:33.115 INFO:tasks.workunit.client.1.smithi106.stdout:6/822: creat d0/d17/d34/dd0/f11a x:0 0 0 2024-05-09T06:30:33.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/212: symlink d11/l4b 0 2024-05-09T06:30:33.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/61: rename d2/d6/ca to d2/d6/c16 0 2024-05-09T06:30:33.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/62: fdatasync f0 0 2024-05-09T06:30:33.124 INFO:tasks.workunit.client.1.smithi106.stdout:1/847: link d4/d5b/d75/f11d d4/d37/f12d 0 2024-05-09T06:30:33.124 INFO:tasks.workunit.client.1.smithi106.stdout:1/848: creat d4/d37/f12e x:0 0 0 2024-05-09T06:30:33.125 INFO:tasks.workunit.client.1.smithi106.stdout:1/849: write d4/d76/fc [1334680,116291] 0 2024-05-09T06:30:33.125 INFO:tasks.workunit.client.0.smithi046.stdout:8/62: mknod d1/db/cc 0 2024-05-09T06:30:33.126 INFO:tasks.workunit.client.1.smithi106.stdout:7/782: rmdir d0/dc/d45/da6 39 2024-05-09T06:30:33.126 INFO:tasks.workunit.client.1.smithi106.stdout:7/783: readlink d0/dc/d1a/d36/lac 0 2024-05-09T06:30:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/35: truncate d0/f1 504498 0 2024-05-09T06:30:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/36: chown d0/f4 582 1 2024-05-09T06:30:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/37: creat d0/fd x:0 0 0 2024-05-09T06:30:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/38: read d0/f4 [984501,51914] 0 2024-05-09T06:30:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/39: dread - d0/fd zero size 2024-05-09T06:30:33.129 INFO:tasks.workunit.client.1.smithi106.stdout:5/849: rename d8/d33/d3a to d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104 0 2024-05-09T06:30:33.130 INFO:tasks.workunit.client.1.smithi106.stdout:5/850: read d8/d5a/d60/fcb [879544,108765] 0 2024-05-09T06:30:33.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/58: dwrite f4 [0,4194304] 0 2024-05-09T06:30:33.131 INFO:tasks.workunit.client.0.smithi046.stdout:3/42: truncate d4/d5/f9 935962 0 2024-05-09T06:30:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/265: mkdir db/d10/d3f/d44/d5e 0 2024-05-09T06:30:33.139 INFO:tasks.workunit.client.0.smithi046.stdout:9/63: write d2/f4 [2718159,2738] 0 2024-05-09T06:30:33.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/63: dread d1/f9 [0,4194304] 0 2024-05-09T06:30:33.141 INFO:tasks.workunit.client.0.smithi046.stdout:8/64: chown d1/ca 1729 1 2024-05-09T06:30:33.141 INFO:tasks.workunit.client.0.smithi046.stdout:5/40: symlink d0/le 0 2024-05-09T06:30:33.141 INFO:tasks.workunit.client.0.smithi046.stdout:4/100: dwrite f1 [0,4194304] 0 2024-05-09T06:30:33.142 INFO:tasks.workunit.client.1.smithi106.stdout:1/850: dread d4/d76/d13/f39 [0,4194304] 0 2024-05-09T06:30:33.142 INFO:tasks.workunit.client.1.smithi106.stdout:4/741: dwrite d7/d10/d1a/d5a/f55 [8388608,4194304] 0 2024-05-09T06:30:33.142 INFO:tasks.workunit.client.1.smithi106.stdout:4/742: chown d7/d39/d35/dac/dd5 52 1 2024-05-09T06:30:33.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/213: dread d11/d18/d27/d28/f31 [0,4194304] 0 2024-05-09T06:30:33.143 INFO:tasks.workunit.client.0.smithi046.stdout:9/64: write d2/d6/d7/f8 [635829,128326] 0 2024-05-09T06:30:33.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/214: creat d11/d18/d27/d28/d2d/f4c x:0 0 0 2024-05-09T06:30:33.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/215: chown d11/d18/d27/d28/c49 6028 1 2024-05-09T06:30:33.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/59: truncate d7/ff 461044 0 2024-05-09T06:30:33.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/65: dread d1/f9 [0,4194304] 0 2024-05-09T06:30:33.150 INFO:tasks.workunit.client.0.smithi046.stdout:6/266: rmdir db/d10/d30/d53/d5c 0 2024-05-09T06:30:33.155 INFO:tasks.workunit.client.1.smithi106.stdout:2/921: symlink d2/d5/db/d1d/d23/d5e/de8/l13a 0 2024-05-09T06:30:33.156 INFO:tasks.workunit.client.0.smithi046.stdout:5/41: mknod d0/cf 0 2024-05-09T06:30:33.157 INFO:tasks.workunit.client.1.smithi106.stdout:3/680: symlink d5/d4d/d7a/da9/ld9 0 2024-05-09T06:30:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/101: getdents d7/df/d10 0 2024-05-09T06:30:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/102: dread - d7/df/d22/f28 zero size 2024-05-09T06:30:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/103: write d7/f1e [344498,130066] 0 2024-05-09T06:30:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:9/65: dread d2/f5 [0,4194304] 0 2024-05-09T06:30:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:9/66: read - d2/d6/f15 zero size 2024-05-09T06:30:33.159 INFO:tasks.workunit.client.1.smithi106.stdout:6/823: rmdir d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f 39 2024-05-09T06:30:33.162 INFO:tasks.workunit.client.1.smithi106.stdout:7/784: dwrite d0/dc/f2d [0,4194304] 0 2024-05-09T06:30:33.162 INFO:tasks.workunit.client.0.smithi046.stdout:0/216: dwrite d11/f25 [0,4194304] 0 2024-05-09T06:30:33.162 INFO:tasks.workunit.client.0.smithi046.stdout:0/217: getdents d11/d18/d27/d28/d36 0 2024-05-09T06:30:33.163 INFO:tasks.workunit.client.0.smithi046.stdout:3/43: dwrite d4/fc [0,4194304] 0 2024-05-09T06:30:33.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/60: fdatasync d7/fb 0 2024-05-09T06:30:33.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/61: truncate d7/ff 511677 0 2024-05-09T06:30:33.165 INFO:tasks.workunit.client.1.smithi106.stdout:5/851: mknod d8/c105 0 2024-05-09T06:30:33.166 INFO:tasks.workunit.client.0.smithi046.stdout:8/66: mkdir d1/db/dd 0 2024-05-09T06:30:33.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/62: dread f5 [0,4194304] 0 2024-05-09T06:30:33.169 INFO:tasks.workunit.client.0.smithi046.stdout:6/267: rename db/f1f to db/d10/d3f/d44/f5f 0 2024-05-09T06:30:33.169 INFO:tasks.workunit.client.0.smithi046.stdout:9/67: dread d2/d6/d7/f12 [0,4194304] 0 2024-05-09T06:30:33.171 INFO:tasks.workunit.client.1.smithi106.stdout:6/824: dread d0/d17/d34/f82 [0,4194304] 0 2024-05-09T06:30:33.171 INFO:tasks.workunit.client.1.smithi106.stdout:6/825: dread - d0/d17/d34/dd0/f11a zero size 2024-05-09T06:30:33.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/42: symlink d0/l10 0 2024-05-09T06:30:33.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/43: fdatasync d0/fd 0 2024-05-09T06:30:33.175 INFO:tasks.workunit.client.1.smithi106.stdout:4/743: rmdir d7/d39/d47 39 2024-05-09T06:30:33.175 INFO:tasks.workunit.client.1.smithi106.stdout:4/744: write d7/fda [933589,42252] 0 2024-05-09T06:30:33.175 INFO:tasks.workunit.client.1.smithi106.stdout:4/745: write d7/d39/f7b [2922388,23478] 0 2024-05-09T06:30:33.177 INFO:tasks.workunit.client.1.smithi106.stdout:0/830: sync 2024-05-09T06:30:33.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/104: link f3 d7/df/f29 0 2024-05-09T06:30:33.181 INFO:tasks.workunit.client.1.smithi106.stdout:1/851: symlink d4/d76/d13/d2f/l12f 0 2024-05-09T06:30:33.184 INFO:tasks.workunit.client.1.smithi106.stdout:2/922: mkdir d2/d5/db/d15/dd6/d109/d13b 0 2024-05-09T06:30:33.186 INFO:tasks.workunit.client.1.smithi106.stdout:3/681: mknod d5/d4d/d5f/cda 0 2024-05-09T06:30:33.187 INFO:tasks.workunit.client.0.smithi046.stdout:0/218: symlink d11/l4d 0 2024-05-09T06:30:33.189 INFO:tasks.workunit.client.0.smithi046.stdout:3/44: dwrite d4/fd [0,4194304] 0 2024-05-09T06:30:33.189 INFO:tasks.workunit.client.1.smithi106.stdout:5/852: dwrite d8/d5a/f73 [0,4194304] 0 2024-05-09T06:30:33.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/67: truncate d1/f9 2563854 0 2024-05-09T06:30:33.194 INFO:tasks.workunit.client.1.smithi106.stdout:8/753: rename d3/d5/d35/d73/d9d to d3/d5/d7/d15/df4/dfd 0 2024-05-09T06:30:33.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/63: creat d7/d10/f11 x:0 0 0 2024-05-09T06:30:33.199 INFO:tasks.workunit.client.0.smithi046.stdout:6/268: truncate db/f25 197230 0 2024-05-09T06:30:33.202 INFO:tasks.workunit.client.0.smithi046.stdout:9/68: symlink d2/d6/d7/l17 0 2024-05-09T06:30:33.202 INFO:tasks.workunit.client.0.smithi046.stdout:9/69: chown d2/dc/l13 17 1 2024-05-09T06:30:33.202 INFO:tasks.workunit.client.0.smithi046.stdout:9/70: fdatasync d2/d6/f15 0 2024-05-09T06:30:33.204 INFO:tasks.workunit.client.1.smithi106.stdout:7/785: mkdir d0/dc/d1a/df6 0 2024-05-09T06:30:33.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/44: mknod d0/c11 0 2024-05-09T06:30:33.208 INFO:tasks.workunit.client.1.smithi106.stdout:0/831: mknod d1/d11/d23/d13/d2c/d6d/dce/c11c 0 2024-05-09T06:30:33.208 INFO:tasks.workunit.client.1.smithi106.stdout:0/832: readlink d1/d11/d23/d13/l116 0 2024-05-09T06:30:33.209 INFO:tasks.workunit.client.0.smithi046.stdout:6/269: dread db/d10/f16 [0,4194304] 0 2024-05-09T06:30:33.212 INFO:tasks.workunit.client.1.smithi106.stdout:1/852: symlink d4/d76/d65/l130 0 2024-05-09T06:30:33.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/45: dwrite d4/fc [0,4194304] 0 2024-05-09T06:30:33.214 INFO:tasks.workunit.client.1.smithi106.stdout:2/923: truncate d2/d5/db/d15/d41/d58/f61 1931341 0 2024-05-09T06:30:33.214 INFO:tasks.workunit.client.1.smithi106.stdout:8/754: dwrite d3/d5/dbc/fc3 [0,4194304] 0 2024-05-09T06:30:33.218 INFO:tasks.workunit.client.0.smithi046.stdout:4/105: symlink d7/df/d22/d25/l2a 0 2024-05-09T06:30:33.220 INFO:tasks.workunit.client.0.smithi046.stdout:9/71: dread d2/dc/f11 [0,4194304] 0 2024-05-09T06:30:33.228 INFO:tasks.workunit.client.1.smithi106.stdout:5/853: creat d8/d5a/d60/da8/daa/dd2/f106 x:0 0 0 2024-05-09T06:30:33.228 INFO:tasks.workunit.client.1.smithi106.stdout:8/755: dread d3/d5/d7/f20 [0,4194304] 0 2024-05-09T06:30:33.230 INFO:tasks.workunit.client.1.smithi106.stdout:9/834: rename d4/d54/d69/d95/d23/f6e to d4/d54/f107 0 2024-05-09T06:30:33.231 INFO:tasks.workunit.client.0.smithi046.stdout:5/45: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:33.232 INFO:tasks.workunit.client.1.smithi106.stdout:7/786: dwrite d0/dc/f2d [0,4194304] 0 2024-05-09T06:30:33.233 INFO:tasks.workunit.client.1.smithi106.stdout:0/833: symlink d1/d11/d23/d13/d2c/d3d/dbe/l11d 0 2024-05-09T06:30:33.235 INFO:tasks.workunit.client.1.smithi106.stdout:1/853: getdents d4/d76/d13/d2f/db4 0 2024-05-09T06:30:33.237 INFO:tasks.workunit.client.1.smithi106.stdout:5/854: dread d8/d5a/d60/f75 [0,4194304] 0 2024-05-09T06:30:33.240 INFO:tasks.workunit.client.1.smithi106.stdout:2/924: mknod d2/d5/c13c 0 2024-05-09T06:30:33.240 INFO:tasks.workunit.client.1.smithi106.stdout:9/835: write d4/d54/d69/d95/d23/fdb [2002183,26740] 0 2024-05-09T06:30:33.241 INFO:tasks.workunit.client.1.smithi106.stdout:7/787: write d0/dc/d1a/f83 [2064535,109640] 0 2024-05-09T06:30:33.241 INFO:tasks.workunit.client.1.smithi106.stdout:7/788: readlink d0/dc/d1a/d36/d30/d44/d58/l60 0 2024-05-09T06:30:33.242 INFO:tasks.workunit.client.0.smithi046.stdout:1/64: dread d7/fd [0,4194304] 0 2024-05-09T06:30:33.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/270: creat db/d10/d3f/d4f/f60 x:0 0 0 2024-05-09T06:30:33.247 INFO:tasks.workunit.client.1.smithi106.stdout:3/682: mkdir d5/ddb 0 2024-05-09T06:30:33.248 INFO:tasks.workunit.client.0.smithi046.stdout:3/46: unlink d4/fd 0 2024-05-09T06:30:33.250 INFO:tasks.workunit.client.1.smithi106.stdout:6/826: rename d0/d17/d76/f9b to d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/d109/f11b 0 2024-05-09T06:30:33.250 INFO:tasks.workunit.client.1.smithi106.stdout:6/827: chown d0/d66/f110 9 1 2024-05-09T06:30:33.252 INFO:tasks.workunit.client.0.smithi046.stdout:4/106: mknod d7/df/d22/c2b 0 2024-05-09T06:30:33.252 INFO:tasks.workunit.client.0.smithi046.stdout:4/107: chown d7/df/d22 37712575 1 2024-05-09T06:30:33.252 INFO:tasks.workunit.client.0.smithi046.stdout:4/108: write f3 [140158,79587] 0 2024-05-09T06:30:33.255 INFO:tasks.workunit.client.0.smithi046.stdout:9/72: symlink d2/d6/d7/l18 0 2024-05-09T06:30:33.256 INFO:tasks.workunit.client.0.smithi046.stdout:4/109: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:33.256 INFO:tasks.workunit.client.0.smithi046.stdout:4/110: creat d7/df/d22/f2c x:0 0 0 2024-05-09T06:30:33.258 INFO:tasks.workunit.client.0.smithi046.stdout:0/219: rmdir d11/d18/d1c 39 2024-05-09T06:30:33.258 INFO:tasks.workunit.client.0.smithi046.stdout:0/220: fsync fe 0 2024-05-09T06:30:33.258 INFO:tasks.workunit.client.0.smithi046.stdout:0/221: truncate fe 587214 0 2024-05-09T06:30:33.261 INFO:tasks.workunit.client.1.smithi106.stdout:2/925: unlink d2/d5/d9c/dd3/c117 0 2024-05-09T06:30:33.262 INFO:tasks.workunit.client.0.smithi046.stdout:5/46: symlink d0/l12 0 2024-05-09T06:30:33.262 INFO:tasks.workunit.client.0.smithi046.stdout:5/47: fsync d0/f1 0 2024-05-09T06:30:33.264 INFO:tasks.workunit.client.1.smithi106.stdout:3/683: rename d5/d1c/d24/d89/d8e/dcd to d5/d85/dc3/d65/ddc 0 2024-05-09T06:30:33.264 INFO:tasks.workunit.client.1.smithi106.stdout:3/684: fdatasync d5/d85/fd2 0 2024-05-09T06:30:33.264 INFO:tasks.workunit.client.1.smithi106.stdout:3/685: truncate d5/d1c/d24/d5b/f95 654616 0 2024-05-09T06:30:33.266 INFO:tasks.workunit.client.0.smithi046.stdout:8/68: rmdir d1 39 2024-05-09T06:30:33.268 INFO:tasks.workunit.client.0.smithi046.stdout:6/271: creat db/d10/d57/d5d/f61 x:0 0 0 2024-05-09T06:30:33.269 INFO:tasks.workunit.client.0.smithi046.stdout:0/222: dread fc [0,4194304] 0 2024-05-09T06:30:33.270 INFO:tasks.workunit.client.0.smithi046.stdout:9/73: symlink d2/dc/l19 0 2024-05-09T06:30:33.270 INFO:tasks.workunit.client.0.smithi046.stdout:9/74: dread - d2/d6/f15 zero size 2024-05-09T06:30:33.272 INFO:tasks.workunit.client.0.smithi046.stdout:4/111: mkdir d7/df/d10/d2d 0 2024-05-09T06:30:33.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/48: mknod d0/c13 0 2024-05-09T06:30:33.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/49: chown d0/f4 6066 1 2024-05-09T06:30:33.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/50: creat d0/f14 x:0 0 0 2024-05-09T06:30:33.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/51: creat d0/f15 x:0 0 0 2024-05-09T06:30:33.275 INFO:tasks.workunit.client.0.smithi046.stdout:5/52: fsync d0/f1 0 2024-05-09T06:30:33.275 INFO:tasks.workunit.client.0.smithi046.stdout:5/53: creat d0/f16 x:0 0 0 2024-05-09T06:30:33.275 INFO:tasks.workunit.client.0.smithi046.stdout:5/54: dread - d0/fd zero size 2024-05-09T06:30:33.275 INFO:tasks.workunit.client.1.smithi106.stdout:2/926: write d2/d5/db/d1d/f3d [2620663,106270] 0 2024-05-09T06:30:33.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/69: mknod d1/ce 0 2024-05-09T06:30:33.276 INFO:tasks.workunit.client.0.smithi046.stdout:9/75: mkdir d2/d6/d7/d1a 0 2024-05-09T06:30:33.279 INFO:tasks.workunit.client.1.smithi106.stdout:9/836: dwrite d4/d54/d69/d99/d2a/d42/f4f [0,4194304] 0 2024-05-09T06:30:33.280 INFO:tasks.workunit.client.0.smithi046.stdout:3/47: dwrite d4/fc [4194304,4194304] 0 2024-05-09T06:30:33.281 INFO:tasks.workunit.client.1.smithi106.stdout:7/789: dwrite d0/dc/d1a/fc7 [0,4194304] 0 2024-05-09T06:30:33.281 INFO:tasks.workunit.client.1.smithi106.stdout:7/790: chown d0/dc/d1a/d36/d30/d44 298 1 2024-05-09T06:30:33.282 INFO:tasks.workunit.client.0.smithi046.stdout:6/272: dread db/f28 [0,4194304] 0 2024-05-09T06:30:33.285 INFO:tasks.workunit.client.0.smithi046.stdout:5/55: mknod d0/c17 0 2024-05-09T06:30:33.286 INFO:tasks.workunit.client.0.smithi046.stdout:0/223: dread f0 [0,4194304] 0 2024-05-09T06:30:33.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/65: dwrite d7/fd [0,4194304] 0 2024-05-09T06:30:33.287 INFO:tasks.workunit.client.1.smithi106.stdout:5/855: rmdir d8 39 2024-05-09T06:30:33.291 INFO:tasks.workunit.client.0.smithi046.stdout:4/112: read d7/f9 [191739,76880] 0 2024-05-09T06:30:33.292 INFO:tasks.workunit.client.1.smithi106.stdout:7/791: write d0/dc/d1a/d5a/f70 [2200068,85246] 0 2024-05-09T06:30:33.292 INFO:tasks.workunit.client.1.smithi106.stdout:7/792: fsync d0/dc/d1a/d5a/f97 0 2024-05-09T06:30:33.292 INFO:tasks.workunit.client.1.smithi106.stdout:7/793: fsync d0/dc/d1a/d36/d30/d44/d58/d65/d84/fa0 0 2024-05-09T06:30:33.293 INFO:tasks.workunit.client.1.smithi106.stdout:6/828: rename d0/d17/d34/d4e/d98/da9/db1/d8/d50/df7 to d0/d66/d7e/d11c 0 2024-05-09T06:30:33.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/273: creat db/d10/d3c/f62 x:0 0 0 2024-05-09T06:30:33.296 INFO:tasks.workunit.client.1.smithi106.stdout:3/686: write d5/f63 [102984,92292] 0 2024-05-09T06:30:33.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/70: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.297 INFO:tasks.workunit.client.1.smithi106.stdout:2/927: mkdir d2/d5/db/d13d 0 2024-05-09T06:30:33.301 INFO:tasks.workunit.client.1.smithi106.stdout:9/837: rmdir d4/d54/d69 39 2024-05-09T06:30:33.301 INFO:tasks.workunit.client.0.smithi046.stdout:9/76: getdents d2/dc 0 2024-05-09T06:30:33.301 INFO:tasks.workunit.client.0.smithi046.stdout:9/77: creat d2/d6/d7/f1b x:0 0 0 2024-05-09T06:30:33.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/66: rename f4 to d7/d10/f12 0 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/113: write d7/fb [1364713,39022] 0 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/114: chown d7/df 30225655 1 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/115: chown d7/df/d22/f2c 341 1 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/116: chown d7/fc 44908621 1 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/117: dread - d7/df/d22/f28 zero size 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/118: truncate d7/f1e 1446941 0 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/119: write d7/df/d22/f2c [356872,86985] 0 2024-05-09T06:30:33.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/120: creat d7/f2e x:0 0 0 2024-05-09T06:30:33.307 INFO:tasks.workunit.client.1.smithi106.stdout:6/829: write d0/d17/f29 [2373132,100466] 0 2024-05-09T06:30:33.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/274: write db/d10/d3c/f45 [469509,39010] 0 2024-05-09T06:30:33.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/275: creat db/d10/d3f/d4f/f63 x:0 0 0 2024-05-09T06:30:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:0/224: dwrite f9 [4194304,4194304] 0 2024-05-09T06:30:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:9/78: mknod d2/d6/d7/d1a/c1c 0 2024-05-09T06:30:33.315 INFO:tasks.workunit.client.1.smithi106.stdout:5/856: symlink d8/d5a/d60/df6/d101/l107 0 2024-05-09T06:30:33.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/838: dread d4/d54/d69/d95/d23/dc6/f8c [0,4194304] 0 2024-05-09T06:30:33.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/839: creat d4/d54/d69/d99/d2a/d42/d6c/d6d/f108 x:0 0 0 2024-05-09T06:30:33.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/840: fdatasync d4/d54/d91/dbf/ff3 0 2024-05-09T06:30:33.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/841: write d4/d54/d69/d95/d23/d78/fbb [268121,54631] 0 2024-05-09T06:30:33.315 INFO:tasks.workunit.client.1.smithi106.stdout:9/842: stat d4/d54/d69/d95/d23/d16/dd1/d31/f92 0 2024-05-09T06:30:33.317 INFO:tasks.workunit.client.0.smithi046.stdout:3/48: rename d4/l8 to d4/lf 0 2024-05-09T06:30:33.319 INFO:tasks.workunit.client.0.smithi046.stdout:5/56: getdents d0 0 2024-05-09T06:30:33.319 INFO:tasks.workunit.client.0.smithi046.stdout:5/57: dread - d0/f14 zero size 2024-05-09T06:30:33.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/79: dread d2/d6/d7/f8 [0,4194304] 0 2024-05-09T06:30:33.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/80: chown d2/f4 92130 1 2024-05-09T06:30:33.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/81: stat d2/d6/d7/f12 0 2024-05-09T06:30:33.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/82: write d2/d6/d7/f12 [2237481,23024] 0 2024-05-09T06:30:33.323 INFO:tasks.workunit.client.1.smithi106.stdout:7/794: symlink d0/dc/d1a/d5a/lf7 0 2024-05-09T06:30:33.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:33 smithi106 ceph-mon[34679]: pgmap v23: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 151 MiB/s rd, 199 MiB/s wr, 534 op/s 2024-05-09T06:30:33.324 INFO:tasks.workunit.client.0.smithi046.stdout:4/121: mkdir d7/df/d10/d2f 0 2024-05-09T06:30:33.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/122: read d7/f18 [121186,94878] 0 2024-05-09T06:30:33.327 INFO:tasks.workunit.client.1.smithi106.stdout:3/687: unlink d5/d1c/d24/d98/dc0/l6f 0 2024-05-09T06:30:33.328 INFO:tasks.workunit.client.1.smithi106.stdout:3/688: write d5/d1c/d24/d5b/f95 [269032,69734] 0 2024-05-09T06:30:33.332 INFO:tasks.workunit.client.1.smithi106.stdout:2/928: unlink d2/d7/l3b 0 2024-05-09T06:30:33.332 INFO:tasks.workunit.client.1.smithi106.stdout:2/929: dread - d2/d5/db/d15/dc6/fe2 zero size 2024-05-09T06:30:33.332 INFO:tasks.workunit.client.1.smithi106.stdout:2/930: read - d2/d5/db/d1d/d23/d5e/fd2 zero size 2024-05-09T06:30:33.332 INFO:tasks.workunit.client.1.smithi106.stdout:2/931: truncate d2/d5/db/d1d/d90/d103/f132 793760 0 2024-05-09T06:30:33.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/276: creat db/d10/d3f/d44/d46/f64 x:0 0 0 2024-05-09T06:30:33.334 INFO:tasks.workunit.client.0.smithi046.stdout:6/277: getdents db/d10/d3f/d44/d5e 0 2024-05-09T06:30:33.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:33 smithi046 ceph-mon[26924]: pgmap v23: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 151 MiB/s rd, 199 MiB/s wr, 534 op/s 2024-05-09T06:30:33.336 INFO:tasks.workunit.client.0.smithi046.stdout:8/71: truncate d1/f9 1439847 0 2024-05-09T06:30:33.338 INFO:tasks.workunit.client.1.smithi106.stdout:4/746: sync 2024-05-09T06:30:33.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/225: dwrite d11/d3f/f47 [0,4194304] 0 2024-05-09T06:30:33.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/226: dread - d11/d18/d27/d28/d2d/f3e zero size 2024-05-09T06:30:33.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/49: dwrite d4/fc [8388608,4194304] 0 2024-05-09T06:30:33.341 INFO:tasks.workunit.client.1.smithi106.stdout:8/756: sync 2024-05-09T06:30:33.342 INFO:tasks.workunit.client.0.smithi046.stdout:1/67: dwrite d7/fe [0,4194304] 0 2024-05-09T06:30:33.342 INFO:tasks.workunit.client.0.smithi046.stdout:1/68: fsync d7/fe 0 2024-05-09T06:30:33.342 INFO:tasks.workunit.client.0.smithi046.stdout:1/69: creat d7/d10/f13 x:0 0 0 2024-05-09T06:30:33.342 INFO:tasks.workunit.client.0.smithi046.stdout:4/123: dwrite d7/df/f29 [0,4194304] 0 2024-05-09T06:30:33.344 INFO:tasks.workunit.client.1.smithi106.stdout:5/857: link d8/d33/d74/lf4 d8/d45/d4c/l108 0 2024-05-09T06:30:33.352 INFO:tasks.workunit.client.1.smithi106.stdout:7/795: link d0/dc/d1a/d36/d30/d44/d6a/f7c d0/dc/d1a/d5a/ff8 0 2024-05-09T06:30:33.352 INFO:tasks.workunit.client.1.smithi106.stdout:7/796: creat d0/dc/d1a/d36/d30/d44/ff9 x:0 0 0 2024-05-09T06:30:33.353 INFO:tasks.workunit.client.1.smithi106.stdout:1/854: sync 2024-05-09T06:30:33.354 INFO:tasks.workunit.client.1.smithi106.stdout:0/834: sync 2024-05-09T06:30:33.354 INFO:tasks.workunit.client.1.smithi106.stdout:1/855: readlink d4/d37/d74/lc8 0 2024-05-09T06:30:33.354 INFO:tasks.workunit.client.1.smithi106.stdout:1/856: write d4/d5/f50 [2766874,99269] 0 2024-05-09T06:30:33.354 INFO:tasks.workunit.client.1.smithi106.stdout:0/835: write d1/d11/d7f/f10b [828601,81837] 0 2024-05-09T06:30:33.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/278: dwrite db/d10/d3c/f45 [0,4194304] 0 2024-05-09T06:30:33.357 INFO:tasks.workunit.client.1.smithi106.stdout:3/689: truncate d5/d1c/d24/d98/dc0/fa2 3653983 0 2024-05-09T06:30:33.358 INFO:tasks.workunit.client.1.smithi106.stdout:3/690: stat d5/d1c/d24/d89/d8c/fcf 0 2024-05-09T06:30:33.358 INFO:tasks.workunit.client.1.smithi106.stdout:3/691: write d5/d1c/d24/f28 [9333054,108436] 0 2024-05-09T06:30:33.358 INFO:tasks.workunit.client.0.smithi046.stdout:5/58: mknod d0/c18 0 2024-05-09T06:30:33.360 INFO:tasks.workunit.client.1.smithi106.stdout:2/932: mkdir d2/d5/db/d1d/d23/d13e 0 2024-05-09T06:30:33.362 INFO:tasks.workunit.client.1.smithi106.stdout:4/747: mknod d7/d39/d47/d89/dc1/cf6 0 2024-05-09T06:30:33.362 INFO:tasks.workunit.client.1.smithi106.stdout:4/748: stat d7/d10/d1a/d5a/d46/f54 0 2024-05-09T06:30:33.363 INFO:tasks.workunit.client.0.smithi046.stdout:8/72: mkdir d1/d7/df 0 2024-05-09T06:30:33.364 INFO:tasks.workunit.client.1.smithi106.stdout:8/757: mknod d3/d5/d35/d61/d6c/d83/dcc/de9/cfe 0 2024-05-09T06:30:33.366 INFO:tasks.workunit.client.1.smithi106.stdout:5/858: creat d8/d45/d4c/d32/f109 x:0 0 0 2024-05-09T06:30:33.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/73: dread d1/f9 [0,4194304] 0 2024-05-09T06:30:33.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/74: stat d1/db 0 2024-05-09T06:30:33.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/227: link l6 d11/d18/d27/d28/d36/l4e 0 2024-05-09T06:30:33.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/228: readlink d11/d18/d27/d28/l29 0 2024-05-09T06:30:33.371 INFO:tasks.workunit.client.1.smithi106.stdout:8/758: dread d3/d5/d13/f40 [0,4194304] 0 2024-05-09T06:30:33.371 INFO:tasks.workunit.client.0.smithi046.stdout:3/50: write d4/d5/f9 [4368071,68016] 0 2024-05-09T06:30:33.374 INFO:tasks.workunit.client.1.smithi106.stdout:7/797: creat d0/dc/d1a/d36/d30/d44/d58/ffa x:0 0 0 2024-05-09T06:30:33.377 INFO:tasks.workunit.client.1.smithi106.stdout:8/759: dread d3/d5/f12 [0,4194304] 0 2024-05-09T06:30:33.377 INFO:tasks.workunit.client.1.smithi106.stdout:8/760: fsync d3/d5/d35/d61/d6c/f70 0 2024-05-09T06:30:33.377 INFO:tasks.workunit.client.1.smithi106.stdout:8/761: creat d3/d5/d7/d15/fff x:0 0 0 2024-05-09T06:30:33.380 INFO:tasks.workunit.client.1.smithi106.stdout:1/857: mknod d4/d5/c131 0 2024-05-09T06:30:33.384 INFO:tasks.workunit.client.1.smithi106.stdout:0/836: symlink d1/d11/d23/d13/d2c/d3d/l11e 0 2024-05-09T06:30:33.385 INFO:tasks.workunit.client.1.smithi106.stdout:0/837: write d1/d11/d7f/fdf [869828,3813] 0 2024-05-09T06:30:33.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/124: mkdir d7/df/d10/d2f/d30 0 2024-05-09T06:30:33.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/125: truncate d7/df/d22/f2c 1263558 0 2024-05-09T06:30:33.393 INFO:tasks.workunit.client.1.smithi106.stdout:2/933: symlink d2/d5/db/d1d/d133/l13f 0 2024-05-09T06:30:33.394 INFO:tasks.workunit.client.0.smithi046.stdout:1/70: dwrite d7/f8 [0,4194304] 0 2024-05-09T06:30:33.397 INFO:tasks.workunit.client.1.smithi106.stdout:4/749: mkdir d7/df7 0 2024-05-09T06:30:33.397 INFO:tasks.workunit.client.1.smithi106.stdout:4/750: chown d7/d28/d2a/c59 988 1 2024-05-09T06:30:33.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/279: truncate db/d10/f1e 2723678 0 2024-05-09T06:30:33.400 INFO:tasks.workunit.client.1.smithi106.stdout:5/859: rename d8/d45/cc4 to d8/d5a/d60/df6/c10a 0 2024-05-09T06:30:33.402 INFO:tasks.workunit.client.0.smithi046.stdout:5/59: creat d0/f19 x:0 0 0 2024-05-09T06:30:33.402 INFO:tasks.workunit.client.0.smithi046.stdout:5/60: creat d0/f1a x:0 0 0 2024-05-09T06:30:33.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/83: rmdir d2/d6/d7 39 2024-05-09T06:30:33.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/71: dread d7/f8 [0,4194304] 0 2024-05-09T06:30:33.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/72: chown d7/d10/f12 1 1 2024-05-09T06:30:33.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/73: fsync f6 0 2024-05-09T06:30:33.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/74: chown d7/fd 2944473 1 2024-05-09T06:30:33.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/75: chown d7/fe 5840 1 2024-05-09T06:30:33.406 INFO:tasks.workunit.client.1.smithi106.stdout:8/762: unlink d3/d5/d7/ld 0 2024-05-09T06:30:33.406 INFO:tasks.workunit.client.1.smithi106.stdout:8/763: truncate d3/d5/d35/d73/ff2 22146 0 2024-05-09T06:30:33.406 INFO:tasks.workunit.client.1.smithi106.stdout:8/764: write d3/d5/d35/d73/f4f [6609390,20726] 0 2024-05-09T06:30:33.406 INFO:tasks.workunit.client.1.smithi106.stdout:8/765: fdatasync d3/d5/d35/d4e/fca 0 2024-05-09T06:30:33.406 INFO:tasks.workunit.client.0.smithi046.stdout:8/75: mkdir d1/db/dd/d10 0 2024-05-09T06:30:33.407 INFO:tasks.workunit.client.0.smithi046.stdout:8/76: stat d1/ca 0 2024-05-09T06:30:33.407 INFO:tasks.workunit.client.0.smithi046.stdout:8/77: readlink d1/l6 0 2024-05-09T06:30:33.408 INFO:tasks.workunit.client.1.smithi106.stdout:2/934: dwrite d2/d5/db/d15/fca [0,4194304] 0 2024-05-09T06:30:33.408 INFO:tasks.workunit.client.1.smithi106.stdout:1/858: unlink d4/f59 0 2024-05-09T06:30:33.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/229: mkdir d11/d4f 0 2024-05-09T06:30:33.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/230: dread - d11/d18/d27/d28/d36/f37 zero size 2024-05-09T06:30:33.411 INFO:tasks.workunit.client.1.smithi106.stdout:2/935: dread d2/d5/db/d15/d41/f53 [0,4194304] 0 2024-05-09T06:30:33.411 INFO:tasks.workunit.client.1.smithi106.stdout:2/936: truncate d2/fc2 732988 0 2024-05-09T06:30:33.411 INFO:tasks.workunit.client.1.smithi106.stdout:2/937: chown d2/d7/d2c/l31 2 1 2024-05-09T06:30:33.412 INFO:tasks.workunit.client.1.smithi106.stdout:0/838: mknod d1/da1/dd8/d106/c11f 0 2024-05-09T06:30:33.413 INFO:tasks.workunit.client.1.smithi106.stdout:4/751: mkdir d7/d39/d8c/da1/df8 0 2024-05-09T06:30:33.414 INFO:tasks.workunit.client.0.smithi046.stdout:4/126: truncate d7/fc 3403379 0 2024-05-09T06:30:33.414 INFO:tasks.workunit.client.1.smithi106.stdout:5/860: rmdir d8/d45/d4c 39 2024-05-09T06:30:33.418 INFO:tasks.workunit.client.0.smithi046.stdout:7/71: sync 2024-05-09T06:30:33.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/76: dread f6 [0,4194304] 0 2024-05-09T06:30:33.418 INFO:tasks.workunit.client.0.smithi046.stdout:2/134: sync 2024-05-09T06:30:33.419 INFO:tasks.workunit.client.0.smithi046.stdout:6/280: mknod db/d10/d3f/d4f/c65 0 2024-05-09T06:30:33.420 INFO:tasks.workunit.client.1.smithi106.stdout:1/859: mkdir d4/d37/d3d/d132 0 2024-05-09T06:30:33.423 INFO:tasks.workunit.client.1.smithi106.stdout:2/938: creat d2/d5/db/d1d/f140 x:0 0 0 2024-05-09T06:30:33.424 INFO:tasks.workunit.client.1.smithi106.stdout:4/752: dread d7/d28/d2a/f9f [0,4194304] 0 2024-05-09T06:30:33.424 INFO:tasks.workunit.client.1.smithi106.stdout:4/753: write d7/d10/d1a/d5a/d7a/d7f/fe1 [147027,25991] 0 2024-05-09T06:30:33.427 INFO:tasks.workunit.client.0.smithi046.stdout:5/61: unlink d0/c13 0 2024-05-09T06:30:33.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/72: dread d3/f4 [4194304,4194304] 0 2024-05-09T06:30:33.429 INFO:tasks.workunit.client.0.smithi046.stdout:6/281: write db/d10/d19/f1b [3092191,130099] 0 2024-05-09T06:30:33.430 INFO:tasks.workunit.client.1.smithi106.stdout:5/861: mknod d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104/c10b 0 2024-05-09T06:30:33.430 INFO:tasks.workunit.client.1.smithi106.stdout:5/862: readlink d8/lc1 0 2024-05-09T06:30:33.431 INFO:tasks.workunit.client.0.smithi046.stdout:9/84: unlink d2/fb 0 2024-05-09T06:30:33.434 INFO:tasks.workunit.client.1.smithi106.stdout:8/766: dwrite d3/d5/d7/f60 [0,4194304] 0 2024-05-09T06:30:33.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/231: creat d11/d18/d27/d28/f50 x:0 0 0 2024-05-09T06:30:33.437 INFO:tasks.workunit.client.0.smithi046.stdout:8/78: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.437 INFO:tasks.workunit.client.1.smithi106.stdout:0/839: dwrite d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/df2/ff8 [0,4194304] 0 2024-05-09T06:30:33.438 INFO:tasks.workunit.client.0.smithi046.stdout:3/51: symlink d4/l10 0 2024-05-09T06:30:33.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/127: creat d7/df/d10/d1d/f31 x:0 0 0 2024-05-09T06:30:33.445 INFO:tasks.workunit.client.0.smithi046.stdout:4/128: truncate d7/df/d22/f28 75578 0 2024-05-09T06:30:33.447 INFO:tasks.workunit.client.0.smithi046.stdout:1/77: readlink d7/la 0 2024-05-09T06:30:33.448 INFO:tasks.workunit.client.1.smithi106.stdout:1/860: mkdir d4/d133 0 2024-05-09T06:30:33.451 INFO:tasks.workunit.client.1.smithi106.stdout:2/939: link d2/d7/d62/f108 d2/d5/db/d1d/f141 0 2024-05-09T06:30:33.452 INFO:tasks.workunit.client.0.smithi046.stdout:5/62: mkdir d0/d1b 0 2024-05-09T06:30:33.452 INFO:tasks.workunit.client.0.smithi046.stdout:5/63: creat d0/f1c x:0 0 0 2024-05-09T06:30:33.453 INFO:tasks.workunit.client.1.smithi106.stdout:4/754: creat d7/d39/d35/d7c/dd1/ff9 x:0 0 0 2024-05-09T06:30:33.453 INFO:tasks.workunit.client.1.smithi106.stdout:4/755: dread - d7/d39/d8c/f8d zero size 2024-05-09T06:30:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:7/73: mkdir d3/d7/d19 0 2024-05-09T06:30:33.457 INFO:tasks.workunit.client.1.smithi106.stdout:5/863: link d8/d5a/d60/da8/daa/db4/f9a d8/d5a/d60/dd6/f10c 0 2024-05-09T06:30:33.458 INFO:tasks.workunit.client.1.smithi106.stdout:5/864: fdatasync d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/fa4 0 2024-05-09T06:30:33.458 INFO:tasks.workunit.client.1.smithi106.stdout:5/865: dread - d8/d5a/d60/fb5 zero size 2024-05-09T06:30:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/282: mkdir db/d10/d19/d66 0 2024-05-09T06:30:33.461 INFO:tasks.workunit.client.0.smithi046.stdout:9/85: creat d2/d6/d7/f1d x:0 0 0 2024-05-09T06:30:33.465 INFO:tasks.workunit.client.0.smithi046.stdout:0/232: creat d11/d3f/f51 x:0 0 0 2024-05-09T06:30:33.468 INFO:tasks.workunit.client.0.smithi046.stdout:1/78: symlink d7/d10/l14 0 2024-05-09T06:30:33.468 INFO:tasks.workunit.client.0.smithi046.stdout:1/79: write f5 [722656,96138] 0 2024-05-09T06:30:33.469 INFO:tasks.workunit.client.0.smithi046.stdout:2/135: rmdir da/de/d14/d1f 39 2024-05-09T06:30:33.469 INFO:tasks.workunit.client.0.smithi046.stdout:6/283: write db/fd [1605856,116676] 0 2024-05-09T06:30:33.470 INFO:tasks.workunit.client.1.smithi106.stdout:0/840: mkdir d1/d11/d120 0 2024-05-09T06:30:33.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/74: symlink d3/l1a 0 2024-05-09T06:30:33.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/75: fsync d3/f8 0 2024-05-09T06:30:33.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/86: dread f0 [0,4194304] 0 2024-05-09T06:30:33.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/79: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.473 INFO:tasks.workunit.client.1.smithi106.stdout:0/841: dread d1/f5 [4194304,4194304] 0 2024-05-09T06:30:33.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/233: creat d11/f52 x:0 0 0 2024-05-09T06:30:33.475 INFO:tasks.workunit.client.1.smithi106.stdout:1/861: dread d4/d76/d65/d67/fe1 [0,4194304] 0 2024-05-09T06:30:33.475 INFO:tasks.workunit.client.1.smithi106.stdout:1/862: truncate d4/d76/fdf 815346 0 2024-05-09T06:30:33.475 INFO:tasks.workunit.client.1.smithi106.stdout:2/940: symlink d2/d5/db/d15/d41/l142 0 2024-05-09T06:30:33.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/136: truncate f6 6472206 0 2024-05-09T06:30:33.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/129: dwrite d7/df/d22/f28 [0,4194304] 0 2024-05-09T06:30:33.480 INFO:tasks.workunit.client.0.smithi046.stdout:6/284: unlink db/d10/d3f/c21 0 2024-05-09T06:30:33.480 INFO:tasks.workunit.client.0.smithi046.stdout:6/285: creat db/d10/d3f/f67 x:0 0 0 2024-05-09T06:30:33.481 INFO:tasks.workunit.client.1.smithi106.stdout:5/866: mknod d8/d5a/d60/d7e/dae/c10d 0 2024-05-09T06:30:33.482 INFO:tasks.workunit.client.1.smithi106.stdout:8/767: dwrite d3/d6b/fdf [0,4194304] 0 2024-05-09T06:30:33.482 INFO:tasks.workunit.client.1.smithi106.stdout:0/842: unlink d1/d11/c4c 0 2024-05-09T06:30:33.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/76: dread f2 [0,4194304] 0 2024-05-09T06:30:33.486 INFO:tasks.workunit.client.1.smithi106.stdout:1/863: getdents d4/d76/d13/d60/d9c/de4 0 2024-05-09T06:30:33.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/87: mkdir d2/d6/d7/d1e 0 2024-05-09T06:30:33.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/88: fdatasync d2/d6/d7/ff 0 2024-05-09T06:30:33.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/130: dread f5 [0,4194304] 0 2024-05-09T06:30:33.491 INFO:tasks.workunit.client.1.smithi106.stdout:5/867: getdents d8/d5a/d60/da8/daa/dd2 0 2024-05-09T06:30:33.491 INFO:tasks.workunit.client.1.smithi106.stdout:5/868: write d8/d45/d4c/fdb [25203,118212] 0 2024-05-09T06:30:33.491 INFO:tasks.workunit.client.0.smithi046.stdout:8/80: mkdir d1/db/dd/d11 0 2024-05-09T06:30:33.491 INFO:tasks.workunit.client.0.smithi046.stdout:8/81: readlink d1/l6 0 2024-05-09T06:30:33.494 INFO:tasks.workunit.client.0.smithi046.stdout:0/234: mkdir d11/d18/d1c/d53 0 2024-05-09T06:30:33.497 INFO:tasks.workunit.client.0.smithi046.stdout:1/80: mknod d7/c15 0 2024-05-09T06:30:33.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/81: fdatasync d7/f8 0 2024-05-09T06:30:33.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/82: chown d7/ff 273089770 1 2024-05-09T06:30:33.499 INFO:tasks.workunit.client.0.smithi046.stdout:2/137: symlink da/de/d14/l2a 0 2024-05-09T06:30:33.508 INFO:tasks.workunit.client.1.smithi106.stdout:6/830: sync 2024-05-09T06:30:33.509 INFO:tasks.workunit.client.1.smithi106.stdout:8/768: mknod d3/d5/d35/d73/c100 0 2024-05-09T06:30:33.512 INFO:tasks.workunit.client.1.smithi106.stdout:0/843: mknod d1/d11/d23/d13/d58/da8/dd6/c121 0 2024-05-09T06:30:33.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/52: truncate d4/d5/f9 2363069 0 2024-05-09T06:30:33.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/864: symlink d4/d76/d13/d2f/df5/dfd/l134 0 2024-05-09T06:30:33.517 INFO:tasks.workunit.client.0.smithi046.stdout:6/286: link db/fc db/d10/d3f/d44/f68 0 2024-05-09T06:30:33.517 INFO:tasks.workunit.client.0.smithi046.stdout:6/287: fsync db/d10/f16 0 2024-05-09T06:30:33.519 INFO:tasks.workunit.client.1.smithi106.stdout:5/869: link d8/d5a/d60/d7e/dae/dd9/def/faf d8/d5a/d60/da8/daa/f10e 0 2024-05-09T06:30:33.519 INFO:tasks.workunit.client.1.smithi106.stdout:5/870: write d8/d45/d4c/d85/fe1 [247193,86876] 0 2024-05-09T06:30:33.519 INFO:tasks.workunit.client.1.smithi106.stdout:5/871: chown d8/d5a 53 1 2024-05-09T06:30:33.521 INFO:tasks.workunit.client.0.smithi046.stdout:3/53: write d4/fc [654104,33334] 0 2024-05-09T06:30:33.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/77: creat d3/f1b x:0 0 0 2024-05-09T06:30:33.521 INFO:tasks.workunit.client.1.smithi106.stdout:8/769: dread d3/d5/d35/d61/d6c/fa6 [0,4194304] 0 2024-05-09T06:30:33.521 INFO:tasks.workunit.client.1.smithi106.stdout:8/770: stat d3/d5/d35/d73/fa5 0 2024-05-09T06:30:33.522 INFO:tasks.workunit.client.0.smithi046.stdout:7/78: write d3/d7/f11 [139292,77628] 0 2024-05-09T06:30:33.522 INFO:tasks.workunit.client.1.smithi106.stdout:0/844: mkdir d1/d11/d23/d13/d58/da8/dd6/dfc/d122 0 2024-05-09T06:30:33.522 INFO:tasks.workunit.client.1.smithi106.stdout:0/845: truncate d1/d11/d23/d13/d2c/f88 5036680 0 2024-05-09T06:30:33.524 INFO:tasks.workunit.client.0.smithi046.stdout:9/89: mknod d2/d6/c1f 0 2024-05-09T06:30:33.524 INFO:tasks.workunit.client.0.smithi046.stdout:9/90: read - d2/d6/d7/f1d zero size 2024-05-09T06:30:33.525 INFO:tasks.workunit.client.1.smithi106.stdout:8/771: rename d3/d5/d35 to d3/d5/d35/d4e/d32/d101 22 2024-05-09T06:30:33.526 INFO:tasks.workunit.client.1.smithi106.stdout:1/865: dread d4/dbd/de6/f100 [0,4194304] 0 2024-05-09T06:30:33.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/235: mknod d11/d4f/c54 0 2024-05-09T06:30:33.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/236: stat d11/d3f 0 2024-05-09T06:30:33.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/237: chown ff 8902 1 2024-05-09T06:30:33.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/238: creat d11/d3f/f55 x:0 0 0 2024-05-09T06:30:33.528 INFO:tasks.workunit.client.1.smithi106.stdout:0/846: mkdir d1/d11/d123 0 2024-05-09T06:30:33.530 INFO:tasks.workunit.client.0.smithi046.stdout:1/83: symlink d7/d10/l16 0 2024-05-09T06:30:33.530 INFO:tasks.workunit.client.1.smithi106.stdout:9/843: sync 2024-05-09T06:30:33.530 INFO:tasks.workunit.client.1.smithi106.stdout:7/798: sync 2024-05-09T06:30:33.531 INFO:tasks.workunit.client.1.smithi106.stdout:3/692: sync 2024-05-09T06:30:33.531 INFO:tasks.workunit.client.1.smithi106.stdout:3/693: write d5/d85/dc3/f45 [1352769,69064] 0 2024-05-09T06:30:33.531 INFO:tasks.workunit.client.1.smithi106.stdout:8/772: getdents d3/d5/d35/d4e 0 2024-05-09T06:30:33.532 INFO:tasks.workunit.client.0.smithi046.stdout:8/82: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.532 INFO:tasks.workunit.client.0.smithi046.stdout:8/83: chown d1/db/cc 24 1 2024-05-09T06:30:33.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/54: creat d4/f11 x:0 0 0 2024-05-09T06:30:33.534 INFO:tasks.workunit.client.1.smithi106.stdout:2/941: dwrite d2/d7/db7/fbf [0,4194304] 0 2024-05-09T06:30:33.534 INFO:tasks.workunit.client.1.smithi106.stdout:2/942: readlink d2/d7/l67 0 2024-05-09T06:30:33.534 INFO:tasks.workunit.client.1.smithi106.stdout:2/943: chown d2/fc2 52 1 2024-05-09T06:30:33.534 INFO:tasks.workunit.client.1.smithi106.stdout:2/944: readlink d2/d5/db/d1d/lc9 0 2024-05-09T06:30:33.534 INFO:tasks.workunit.client.1.smithi106.stdout:5/872: dread d8/d5a/d60/dd6/f10c [0,4194304] 0 2024-05-09T06:30:33.534 INFO:tasks.workunit.client.1.smithi106.stdout:5/873: chown d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dda/cad 2 1 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/79: mkdir d3/d7/d1c 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/80: creat d3/f1d x:0 0 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/81: write d3/f1d [378997,90597] 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:6/288: dwrite db/d10/d57/d5d/f61 [0,4194304] 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:6/289: creat db/d10/d3c/f69 x:0 0 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:6/290: fsync db/d10/d3f/d44/f5f 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:6/291: truncate db/d10/d3f/f33 5052481 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/131: dwrite f5 [4194304,4194304] 0 2024-05-09T06:30:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/132: fsync d7/f2e 0 2024-05-09T06:30:33.537 INFO:tasks.workunit.client.0.smithi046.stdout:4/133: chown d7/df/d22/f28 3253873 1 2024-05-09T06:30:33.537 INFO:tasks.workunit.client.1.smithi106.stdout:3/694: creat d5/d1c/d24/d52/dc6/fdd x:0 0 0 2024-05-09T06:30:33.539 INFO:tasks.workunit.client.0.smithi046.stdout:9/91: mkdir d2/d20 0 2024-05-09T06:30:33.544 INFO:tasks.workunit.client.1.smithi106.stdout:2/945: mknod d2/d5/c143 0 2024-05-09T06:30:33.552 INFO:tasks.workunit.client.0.smithi046.stdout:0/239: mkdir d11/d18/d1c/d56 0 2024-05-09T06:30:33.552 INFO:tasks.workunit.client.0.smithi046.stdout:0/240: creat d11/d18/d27/d28/d2d/f57 x:0 0 0 2024-05-09T06:30:33.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/241: dread - d11/d18/f3b zero size 2024-05-09T06:30:33.554 INFO:tasks.workunit.client.1.smithi106.stdout:1/866: dwrite d4/d76/d13/d60/d9c/feb [0,4194304] 0 2024-05-09T06:30:33.555 INFO:tasks.workunit.client.0.smithi046.stdout:1/84: write d7/fc [5144947,117213] 0 2024-05-09T06:30:33.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/82: read d3/f8 [1794895,49841] 0 2024-05-09T06:30:33.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/84: rename d1/d7/df to d1/d7/d12 0 2024-05-09T06:30:33.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/85: readlink d1/l6 0 2024-05-09T06:30:33.566 INFO:tasks.workunit.client.0.smithi046.stdout:3/55: mknod d4/d5/c12 0 2024-05-09T06:30:33.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/56: chown d4 4 1 2024-05-09T06:30:33.569 INFO:tasks.workunit.client.1.smithi106.stdout:7/799: dwrite d0/dc/d1a/d36/d30/d44/d6a/f6d [4194304,4194304] 0 2024-05-09T06:30:33.569 INFO:tasks.workunit.client.1.smithi106.stdout:7/800: truncate d0/dc/d1a/d36/d30/d44/fd5 915968 0 2024-05-09T06:30:33.569 INFO:tasks.workunit.client.1.smithi106.stdout:5/874: dread d8/d33/d74/f84 [0,4194304] 0 2024-05-09T06:30:33.574 INFO:tasks.workunit.client.1.smithi106.stdout:1/867: unlink d4/dbd/de6/c120 0 2024-05-09T06:30:33.574 INFO:tasks.workunit.client.1.smithi106.stdout:1/868: truncate d4/d37/f92 1173998 0 2024-05-09T06:30:33.574 INFO:tasks.workunit.client.1.smithi106.stdout:1/869: dread d4/f45 [0,4194304] 0 2024-05-09T06:30:33.574 INFO:tasks.workunit.client.1.smithi106.stdout:1/870: truncate d4/d76/d65/d8d/db5/fea 111890 0 2024-05-09T06:30:33.575 INFO:tasks.workunit.client.1.smithi106.stdout:2/946: getdents d2/d5/db/d15/dc6 0 2024-05-09T06:30:33.578 INFO:tasks.workunit.client.0.smithi046.stdout:6/292: symlink db/d10/d3f/l6a 0 2024-05-09T06:30:33.581 INFO:tasks.workunit.client.1.smithi106.stdout:2/947: creat d2/d7/d89/d104/d12b/f144 x:0 0 0 2024-05-09T06:30:33.583 INFO:tasks.workunit.client.1.smithi106.stdout:9/844: dwrite d4/d54/d69/d99/d2a/d42/d6c/d6d/fb5 [0,4194304] 0 2024-05-09T06:30:33.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/92: rename d2/d6/f15 to d2/d6/f21 0 2024-05-09T06:30:33.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/93: creat d2/d6/f22 x:0 0 0 2024-05-09T06:30:33.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/94: creat d2/d6/d7/f23 x:0 0 0 2024-05-09T06:30:33.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/95: stat d2/d20 0 2024-05-09T06:30:33.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/96: truncate d2/dc/f11 4795395 0 2024-05-09T06:30:33.585 INFO:tasks.workunit.client.0.smithi046.stdout:4/134: dwrite d7/fb [4194304,4194304] 0 2024-05-09T06:30:33.585 INFO:tasks.workunit.client.1.smithi106.stdout:3/695: dwrite d5/d1c/d24/d98/faa [0,4194304] 0 2024-05-09T06:30:33.585 INFO:tasks.workunit.client.1.smithi106.stdout:3/696: fdatasync d5/d85/dc3/d26/f9e 0 2024-05-09T06:30:33.585 INFO:tasks.workunit.client.1.smithi106.stdout:3/697: truncate d5/d1c/d24/d52/dc6/fdd 370725 0 2024-05-09T06:30:33.586 INFO:tasks.workunit.client.1.smithi106.stdout:2/948: unlink d2/d7/c59 0 2024-05-09T06:30:33.588 INFO:tasks.workunit.client.0.smithi046.stdout:3/57: read d4/d5/f9 [284439,119807] 0 2024-05-09T06:30:33.589 INFO:tasks.workunit.client.1.smithi106.stdout:9/845: getdents d4/d54/d69/d95/d23/d16/dd1/d38 0 2024-05-09T06:30:33.590 INFO:tasks.workunit.client.0.smithi046.stdout:0/242: rename d11/d18/d27/d28/d36/l41 to d11/d18/d1c/d53/l58 0 2024-05-09T06:30:33.591 INFO:tasks.workunit.client.0.smithi046.stdout:0/243: write d11/d18/d27/d28/d36/f37 [72223,1797] 0 2024-05-09T06:30:33.591 INFO:tasks.workunit.client.0.smithi046.stdout:0/244: fdatasync d11/d18/d27/d28/d2d/f4c 0 2024-05-09T06:30:33.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/83: link d3/f1b d3/f1e 0 2024-05-09T06:30:33.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/84: write d3/f1e [902329,104682] 0 2024-05-09T06:30:33.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/85: truncate d3/d7/f11 1292119 0 2024-05-09T06:30:33.595 INFO:tasks.workunit.client.1.smithi106.stdout:9/846: mknod d4/d54/d69/d95/d23/d16/dd1/dbc/c109 0 2024-05-09T06:30:33.595 INFO:tasks.workunit.client.1.smithi106.stdout:9/847: write d4/d54/d69/d99/d2a/d42/d6c/d6d/fd6 [4220981,48187] 0 2024-05-09T06:30:33.596 INFO:tasks.workunit.client.1.smithi106.stdout:3/698: rmdir d5/d1c/d24/d89 39 2024-05-09T06:30:33.596 INFO:tasks.workunit.client.1.smithi106.stdout:3/699: stat d5/d85/dc3/d65/d81/f94 0 2024-05-09T06:30:33.598 INFO:tasks.workunit.client.1.smithi106.stdout:9/848: mknod d4/d54/d69/d95/d23/d16/dd1/d47/c10a 0 2024-05-09T06:30:33.598 INFO:tasks.workunit.client.1.smithi106.stdout:9/849: chown d4/d54/d69/d95/d23/d16/f24 6674 1 2024-05-09T06:30:33.599 INFO:tasks.workunit.client.1.smithi106.stdout:3/700: mknod d5/d4d/d7a/da9/da8/cde 0 2024-05-09T06:30:33.600 INFO:tasks.workunit.client.0.smithi046.stdout:9/97: dread d2/dc/f11 [0,4194304] 0 2024-05-09T06:30:33.600 INFO:tasks.workunit.client.0.smithi046.stdout:9/98: write d2/d6/d7/fd [273825,52756] 0 2024-05-09T06:30:33.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/245: mknod d11/d18/d27/c59 0 2024-05-09T06:30:33.603 INFO:tasks.workunit.client.0.smithi046.stdout:7/86: mknod d3/d7/c1f 0 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/135: rmdir d7/df/d22 39 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/136: truncate d7/df/d10/f24 318669 0 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/137: readlink d7/l27 0 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/138: stat d7/fb 0 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/139: creat d7/df/f32 x:0 0 0 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/99: link d2/d6/d7/d1a/c1c d2/c24 0 2024-05-09T06:30:33.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/100: read d2/f4 [1035252,3572] 0 2024-05-09T06:30:33.608 INFO:tasks.workunit.client.0.smithi046.stdout:4/140: dread d7/df/d22/f2c [0,4194304] 0 2024-05-09T06:30:33.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/87: unlink f2 0 2024-05-09T06:30:33.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/88: symlink d3/d7/d1c/l20 0 2024-05-09T06:30:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/89: readlink l0 0 2024-05-09T06:30:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/90: readlink d3/d7/d1c/l20 0 2024-05-09T06:30:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/91: read - d3/d7/fa zero size 2024-05-09T06:30:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/92: truncate d3/f12 284935 0 2024-05-09T06:30:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/93: stat d3/d7/d1c 0 2024-05-09T06:30:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/94: symlink d3/l21 0 2024-05-09T06:30:33.613 INFO:tasks.workunit.client.0.smithi046.stdout:7/95: fdatasync d3/f5 0 2024-05-09T06:30:33.613 INFO:tasks.workunit.client.0.smithi046.stdout:1/85: dwrite d7/fb [0,4194304] 0 2024-05-09T06:30:33.613 INFO:tasks.workunit.client.1.smithi106.stdout:0/847: dwrite d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/f10d [0,4194304] 0 2024-05-09T06:30:33.613 INFO:tasks.workunit.client.1.smithi106.stdout:3/701: write d5/d1c/d24/d98/dc0/d32/f6e [5714879,27648] 0 2024-05-09T06:30:33.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/141: read d7/df/f29 [3369376,113077] 0 2024-05-09T06:30:33.619 INFO:tasks.workunit.client.1.smithi106.stdout:8/773: dwrite d3/d5/d35/d4e/d32/fac [0,4194304] 0 2024-05-09T06:30:33.619 INFO:tasks.workunit.client.1.smithi106.stdout:8/774: chown d3/d5/d13/d3a/f90 44983 1 2024-05-09T06:30:33.623 INFO:tasks.workunit.client.1.smithi106.stdout:5/875: dwrite d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dda/fea [0,4194304] 0 2024-05-09T06:30:33.623 INFO:tasks.workunit.client.0.smithi046.stdout:4/142: mknod d7/df/d10/d1d/c33 0 2024-05-09T06:30:33.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/246: read d11/d18/d27/d28/f31 [939395,29756] 0 2024-05-09T06:30:33.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/247: fsync d11/d18/f3a 0 2024-05-09T06:30:33.628 INFO:tasks.workunit.client.0.smithi046.stdout:4/143: mknod d7/df/d10/d2f/c34 0 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:0/248: unlink d11/d18/d27/c59 0 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:0/249: dread - d11/d18/d27/d28/f50 zero size 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:0/250: dread - d11/d3f/f51 zero size 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:0/251: fsync d11/d18/f32 0 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/86: dread d7/fd [0,4194304] 0 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/87: write f5 [1669941,75370] 0 2024-05-09T06:30:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:9/101: dwrite d2/d6/d7/f23 [0,4194304] 0 2024-05-09T06:30:33.632 INFO:tasks.workunit.client.0.smithi046.stdout:8/86: dwrite d1/f9 [4194304,4194304] 0 2024-05-09T06:30:33.634 INFO:tasks.workunit.client.1.smithi106.stdout:9/850: dwrite d4/d54/f107 [0,4194304] 0 2024-05-09T06:30:33.634 INFO:tasks.workunit.client.1.smithi106.stdout:2/949: dwrite d2/d5/db/f88 [0,4194304] 0 2024-05-09T06:30:33.634 INFO:tasks.workunit.client.1.smithi106.stdout:1/871: dwrite d4/d5b/f8c [0,4194304] 0 2024-05-09T06:30:33.634 INFO:tasks.workunit.client.1.smithi106.stdout:2/950: stat d2/d5/db/d68/f76 0 2024-05-09T06:30:33.634 INFO:tasks.workunit.client.1.smithi106.stdout:2/951: stat d2/f8d 0 2024-05-09T06:30:33.635 INFO:tasks.workunit.client.1.smithi106.stdout:0/848: mkdir d1/d11/d23/d13/d58/da8/d124 0 2024-05-09T06:30:33.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/102: write d2/dc/f11 [2747532,121711] 0 2024-05-09T06:30:33.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/103: creat d2/d6/f25 x:0 0 0 2024-05-09T06:30:33.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/104: chown d2/d6/d7 5289 1 2024-05-09T06:30:33.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/144: symlink d7/df/l35 0 2024-05-09T06:30:33.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/145: readlink d7/df/d10/d1d/l23 0 2024-05-09T06:30:33.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/146: creat d7/df/f36 x:0 0 0 2024-05-09T06:30:33.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/147: getdents d7/df/d10/d2f/d30 0 2024-05-09T06:30:33.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/148: write f4 [4701735,80613] 0 2024-05-09T06:30:33.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/149: write d7/f9 [5224270,4859] 0 2024-05-09T06:30:33.640 INFO:tasks.workunit.client.0.smithi046.stdout:4/150: creat d7/df/d10/d1d/f37 x:0 0 0 2024-05-09T06:30:33.643 INFO:tasks.workunit.client.0.smithi046.stdout:0/252: mkdir d11/d18/d27/d28/d36/d5a 0 2024-05-09T06:30:33.648 INFO:tasks.workunit.client.1.smithi106.stdout:8/775: getdents d3/d5/d35/d61/d82 0 2024-05-09T06:30:33.649 INFO:tasks.workunit.client.1.smithi106.stdout:5/876: dwrite d8/d45/d4c/d32/fc2 [0,4194304] 0 2024-05-09T06:30:33.649 INFO:tasks.workunit.client.1.smithi106.stdout:5/877: chown d8/d45/d4c/ddd/ff3 6843 1 2024-05-09T06:30:33.649 INFO:tasks.workunit.client.1.smithi106.stdout:5/878: fdatasync d8/f51 0 2024-05-09T06:30:33.649 INFO:tasks.workunit.client.1.smithi106.stdout:5/879: chown d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/dde 100343966 1 2024-05-09T06:30:33.655 INFO:tasks.workunit.client.1.smithi106.stdout:3/702: dwrite d5/d1c/d24/d89/fc1 [4194304,4194304] 0 2024-05-09T06:30:33.662 INFO:tasks.workunit.client.1.smithi106.stdout:5/880: write d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/f2c [6037952,8646] 0 2024-05-09T06:30:33.682 INFO:tasks.workunit.client.0.smithi046.stdout:3/58: dwrite d4/fc [0,4194304] 0 2024-05-09T06:30:33.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/87: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.684 INFO:tasks.workunit.client.0.smithi046.stdout:4/151: dwrite f1 [0,4194304] 0 2024-05-09T06:30:33.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/253: dwrite d11/d3f/f47 [4194304,4194304] 0 2024-05-09T06:30:33.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/254: stat d11/d18/d27/f3c 0 2024-05-09T06:30:33.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/59: write d4/fc [99604,44541] 0 2024-05-09T06:30:33.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/60: chown d4/f11 1714 1 2024-05-09T06:30:33.690 INFO:tasks.workunit.client.0.smithi046.stdout:0/255: write d11/f25 [3728711,89793] 0 2024-05-09T06:30:33.690 INFO:tasks.workunit.client.0.smithi046.stdout:0/256: chown d11/d18/f1a 0 1 2024-05-09T06:30:33.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/257: dread - d11/d3f/f55 zero size 2024-05-09T06:30:33.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/258: write d11/d18/d27/f3c [888593,7134] 0 2024-05-09T06:30:33.694 INFO:tasks.workunit.client.0.smithi046.stdout:3/61: write d4/fc [6485405,3899] 0 2024-05-09T06:30:33.694 INFO:tasks.workunit.client.0.smithi046.stdout:3/62: write d4/fc [2712296,50020] 0 2024-05-09T06:30:33.695 INFO:tasks.workunit.client.0.smithi046.stdout:8/88: write d1/f9 [1105010,113574] 0 2024-05-09T06:30:33.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/259: write d11/d18/f1a [4068526,75691] 0 2024-05-09T06:30:33.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/260: truncate fc 4593336 0 2024-05-09T06:30:33.712 INFO:tasks.workunit.client.0.smithi046.stdout:8/89: dwrite d1/f9 [4194304,4194304] 0 2024-05-09T06:30:33.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/90: dwrite d1/f9 [4194304,4194304] 0 2024-05-09T06:30:33.773 INFO:tasks.workunit.client.1.smithi106.stdout:9/851: rmdir d4/d54/d69/d95/d23/d16/dd1/d31 39 2024-05-09T06:30:33.775 INFO:tasks.workunit.client.1.smithi106.stdout:2/952: dread - d2/d5/db/d1d/d23/d63/f101 zero size 2024-05-09T06:30:33.775 INFO:tasks.workunit.client.1.smithi106.stdout:2/953: chown d2/d5/db/d15/d41/le4 3510168 1 2024-05-09T06:30:33.775 INFO:tasks.workunit.client.1.smithi106.stdout:2/954: write d2/f2b [742673,93756] 0 2024-05-09T06:30:33.778 INFO:tasks.workunit.client.1.smithi106.stdout:0/849: rename d1/fb to d1/d11/d23/d22/f125 0 2024-05-09T06:30:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/105: mkdir d2/d26 0 2024-05-09T06:30:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/106: write d2/d6/d7/ff [557834,59157] 0 2024-05-09T06:30:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/107: write d2/d6/d7/f1d [180962,51797] 0 2024-05-09T06:30:33.780 INFO:tasks.workunit.client.1.smithi106.stdout:8/776: mknod d3/d5/d35/d61/d82/c102 0 2024-05-09T06:30:33.789 INFO:tasks.workunit.client.0.smithi046.stdout:1/88: rename d7/fb to d7/f17 0 2024-05-09T06:30:33.791 INFO:tasks.workunit.client.1.smithi106.stdout:3/703: mknod d5/d1c/d24/d52/cdf 0 2024-05-09T06:30:33.792 INFO:tasks.workunit.client.0.smithi046.stdout:4/152: rmdir d7/df/d10/d2d 0 2024-05-09T06:30:33.794 INFO:tasks.workunit.client.1.smithi106.stdout:5/881: link d8/d45/d4c/d32/f109 d8/d5a/d60/d7e/dae/dd9/def/f10f 0 2024-05-09T06:30:33.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/96: getdents d3 0 2024-05-09T06:30:33.797 INFO:tasks.workunit.client.0.smithi046.stdout:9/108: dwrite f0 [0,4194304] 0 2024-05-09T06:30:33.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/261: mkdir d11/d4f/d5b 0 2024-05-09T06:30:33.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/262: fsync d11/f35 0 2024-05-09T06:30:33.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/263: dread - d11/d18/f3b zero size 2024-05-09T06:30:33.805 INFO:tasks.workunit.client.1.smithi106.stdout:2/955: creat d2/d7/db7/f145 x:0 0 0 2024-05-09T06:30:33.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/91: creat d1/db/dd/f13 x:0 0 0 2024-05-09T06:30:33.809 INFO:tasks.workunit.client.1.smithi106.stdout:0/850: mknod d1/da1/dd8/c126 0 2024-05-09T06:30:33.809 INFO:tasks.workunit.client.1.smithi106.stdout:0/851: chown d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/f118 5 1 2024-05-09T06:30:33.809 INFO:tasks.workunit.client.1.smithi106.stdout:0/852: fdatasync d1/d11/d23/f1a 0 2024-05-09T06:30:33.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/89: dwrite d7/f8 [0,4194304] 0 2024-05-09T06:30:33.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/90: chown d7/f17 965 1 2024-05-09T06:30:33.813 INFO:tasks.workunit.client.1.smithi106.stdout:3/704: mkdir d5/d1c/d24/d5b/de0 0 2024-05-09T06:30:33.813 INFO:tasks.workunit.client.1.smithi106.stdout:4/756: sync 2024-05-09T06:30:33.813 INFO:tasks.workunit.client.1.smithi106.stdout:6/831: sync 2024-05-09T06:30:33.814 INFO:tasks.workunit.client.0.smithi046.stdout:7/97: dwrite d3/d7/dd/f15 [0,4194304] 0 2024-05-09T06:30:33.819 INFO:tasks.workunit.client.1.smithi106.stdout:2/956: creat d2/d5/db/d1d/d6a/f146 x:0 0 0 2024-05-09T06:30:33.821 INFO:tasks.workunit.client.1.smithi106.stdout:0/853: truncate d1/d11/f56 67999 0 2024-05-09T06:30:33.823 INFO:tasks.workunit.client.0.smithi046.stdout:4/153: rename d7/f18 to d7/df/f38 0 2024-05-09T06:30:33.824 INFO:tasks.workunit.client.1.smithi106.stdout:8/777: getdents d3/d6b 0 2024-05-09T06:30:33.824 INFO:tasks.workunit.client.1.smithi106.stdout:8/778: write d3/d5/d35/d61/d6c/d83/d89/fd2 [528805,31357] 0 2024-05-09T06:30:33.824 INFO:tasks.workunit.client.1.smithi106.stdout:8/779: write d3/d5/d35/d61/f80 [71233,71772] 0 2024-05-09T06:30:33.825 INFO:tasks.workunit.client.0.smithi046.stdout:9/109: mkdir d2/d6/d7/d1a/d27 0 2024-05-09T06:30:33.827 INFO:tasks.workunit.client.1.smithi106.stdout:4/757: mkdir d7/d39/d35/d7c/dfa 0 2024-05-09T06:30:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:3/63: getdents d4/d5 0 2024-05-09T06:30:33.831 INFO:tasks.workunit.client.0.smithi046.stdout:0/264: mkdir d11/d18/d27/d28/d2d/d5c 0 2024-05-09T06:30:33.831 INFO:tasks.workunit.client.1.smithi106.stdout:6/832: dwrite d0/d17/d34/dd0/df2/fc1 [0,4194304] 0 2024-05-09T06:30:33.833 INFO:tasks.workunit.client.1.smithi106.stdout:2/957: unlink d2/d5/db/d1d/d23/c6c 0 2024-05-09T06:30:33.839 INFO:tasks.workunit.client.1.smithi106.stdout:0/854: creat d1/d11/d23/d13/d2c/d57/de1/f127 x:0 0 0 2024-05-09T06:30:33.843 INFO:tasks.workunit.client.0.smithi046.stdout:8/92: mkdir d1/db/dd/d14 0 2024-05-09T06:30:33.843 INFO:tasks.workunit.client.1.smithi106.stdout:2/958: dread d2/d5/db/d15/d41/d58/f61 [0,4194304] 0 2024-05-09T06:30:33.846 INFO:tasks.workunit.client.1.smithi106.stdout:8/780: dwrite d3/d5/d35/d73/f4f [4194304,4194304] 0 2024-05-09T06:30:33.850 INFO:tasks.workunit.client.1.smithi106.stdout:6/833: getdents d0/d17/d34/d4e/d98/da9/db1/d8 0 2024-05-09T06:30:33.856 INFO:tasks.workunit.client.1.smithi106.stdout:2/959: creat d2/d5/db/d1d/d23/d63/f147 x:0 0 0 2024-05-09T06:30:33.859 INFO:tasks.workunit.client.1.smithi106.stdout:7/801: sync 2024-05-09T06:30:33.863 INFO:tasks.workunit.client.1.smithi106.stdout:6/834: rmdir d0/d66/d7e/d11c 0 2024-05-09T06:30:33.869 INFO:tasks.workunit.client.0.smithi046.stdout:7/98: rmdir d3/d7/d19 0 2024-05-09T06:30:33.873 INFO:tasks.workunit.client.1.smithi106.stdout:1/872: dwrite d4/f12 [0,4194304] 0 2024-05-09T06:30:33.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/93: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/94: truncate d1/f9 8867036 0 2024-05-09T06:30:33.876 INFO:tasks.workunit.client.0.smithi046.stdout:4/154: creat d7/df/d22/f39 x:0 0 0 2024-05-09T06:30:33.877 INFO:tasks.workunit.client.1.smithi106.stdout:0/855: dwrite d1/d11/d23/d13/f3f [0,4194304] 0 2024-05-09T06:30:33.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/110: mknod d2/dc/c28 0 2024-05-09T06:30:33.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/873: link d4/d76/d13/d2f/db4/ff4 d4/f135 0 2024-05-09T06:30:33.882 INFO:tasks.workunit.client.1.smithi106.stdout:4/758: dwrite d7/d39/d35/f99 [0,4194304] 0 2024-05-09T06:30:33.882 INFO:tasks.workunit.client.1.smithi106.stdout:7/802: dread d0/fa [4194304,4194304] 0 2024-05-09T06:30:33.882 INFO:tasks.workunit.client.1.smithi106.stdout:8/781: dwrite d3/d5/d7/d15/d3e/d7d/f84 [0,4194304] 0 2024-05-09T06:30:33.882 INFO:tasks.workunit.client.1.smithi106.stdout:8/782: fdatasync d3/d5/d35/d61/d6c/d83/f8f 0 2024-05-09T06:30:33.882 INFO:tasks.workunit.client.1.smithi106.stdout:8/783: creat d3/d5/d7/d15/f103 x:0 0 0 2024-05-09T06:30:33.884 INFO:tasks.workunit.client.0.smithi046.stdout:0/265: unlink d11/f25 0 2024-05-09T06:30:33.891 INFO:tasks.workunit.client.1.smithi106.stdout:2/960: dwrite d2/d7/d2c/f80 [4194304,4194304] 0 2024-05-09T06:30:33.891 INFO:tasks.workunit.client.1.smithi106.stdout:2/961: chown d2/d7/d62/lfc 2195831 1 2024-05-09T06:30:33.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/91: rename d7/ff to d7/f18 0 2024-05-09T06:30:33.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/92: truncate d7/d10/f11 679223 0 2024-05-09T06:30:33.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/93: readlink d7/d10/l16 0 2024-05-09T06:30:33.892 INFO:tasks.workunit.client.1.smithi106.stdout:6/835: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/f3c [0,4194304] 0 2024-05-09T06:30:33.894 INFO:tasks.workunit.client.0.smithi046.stdout:4/155: unlink d7/df/d10/d1d/f37 0 2024-05-09T06:30:33.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/266: write d11/d18/d1c/f1d [3987573,67756] 0 2024-05-09T06:30:33.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/267: chown d11/f14 346610153 1 2024-05-09T06:30:33.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/268: stat d11/d18/d27/d28/c49 0 2024-05-09T06:30:33.895 INFO:tasks.workunit.client.1.smithi106.stdout:0/856: symlink d1/da1/l128 0 2024-05-09T06:30:33.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/64: symlink d4/l13 0 2024-05-09T06:30:33.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/65: write d4/fc [5999150,8537] 0 2024-05-09T06:30:33.900 INFO:tasks.workunit.client.1.smithi106.stdout:1/874: link d4/d76/d65/f88 d4/d37/f136 0 2024-05-09T06:30:33.900 INFO:tasks.workunit.client.1.smithi106.stdout:1/875: chown d4/d76/d13/d60/fac 1 1 2024-05-09T06:30:33.900 INFO:tasks.workunit.client.1.smithi106.stdout:1/876: stat d4/d76/f27 0 2024-05-09T06:30:33.900 INFO:tasks.workunit.client.1.smithi106.stdout:1/877: creat d4/d37/d74/f137 x:0 0 0 2024-05-09T06:30:33.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/94: stat d7/c9 0 2024-05-09T06:30:33.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/99: dwrite d3/f5 [4194304,4194304] 0 2024-05-09T06:30:33.905 INFO:tasks.workunit.client.0.smithi046.stdout:8/95: dwrite d1/f9 [4194304,4194304] 0 2024-05-09T06:30:33.907 INFO:tasks.workunit.client.0.smithi046.stdout:0/269: unlink d11/d18/d27/d28/d36/l4e 0 2024-05-09T06:30:33.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/95: truncate d7/fd 3537620 0 2024-05-09T06:30:33.911 INFO:tasks.workunit.client.0.smithi046.stdout:9/111: dwrite f0 [0,4194304] 0 2024-05-09T06:30:33.912 INFO:tasks.workunit.client.1.smithi106.stdout:4/759: mkdir d7/d10/d1a/d5a/d1c/dfb 0 2024-05-09T06:30:33.914 INFO:tasks.workunit.client.1.smithi106.stdout:9/852: dwrite d4/d54/d69/d99/d2a/fae [0,4194304] 0 2024-05-09T06:30:33.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/66: dread d4/fc [0,4194304] 0 2024-05-09T06:30:33.918 INFO:tasks.workunit.client.0.smithi046.stdout:0/270: dread d11/d18/d27/d28/f2e [0,4194304] 0 2024-05-09T06:30:33.920 INFO:tasks.workunit.client.1.smithi106.stdout:7/803: mknod d0/dc/d45/da6/db2/cfb 0 2024-05-09T06:30:33.920 INFO:tasks.workunit.client.1.smithi106.stdout:7/804: readlink d0/dc/d45/l8d 0 2024-05-09T06:30:33.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/96: dread d7/fe [0,4194304] 0 2024-05-09T06:30:33.925 INFO:tasks.workunit.client.0.smithi046.stdout:1/97: readlink d7/d10/l14 0 2024-05-09T06:30:33.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/96: dwrite d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:33.925 INFO:tasks.workunit.client.1.smithi106.stdout:9/853: write d4/d54/d69/d99/d2a/f1e [621476,44393] 0 2024-05-09T06:30:33.925 INFO:tasks.workunit.client.0.smithi046.stdout:7/100: mknod d3/d7/d1c/c22 0 2024-05-09T06:30:33.928 INFO:tasks.workunit.client.0.smithi046.stdout:3/67: symlink d4/d5/l14 0 2024-05-09T06:30:33.928 INFO:tasks.workunit.client.0.smithi046.stdout:3/68: read d4/d5/f9 [268628,107509] 0 2024-05-09T06:30:33.931 INFO:tasks.workunit.client.0.smithi046.stdout:1/98: creat d7/f19 x:0 0 0 2024-05-09T06:30:33.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/112: dwrite d2/d6/f21 [0,4194304] 0 2024-05-09T06:30:33.933 INFO:tasks.workunit.client.1.smithi106.stdout:2/962: mknod d2/d5/db/d15/d41/d60/dcc/c148 0 2024-05-09T06:30:33.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/99: dread f6 [0,4194304] 0 2024-05-09T06:30:33.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/100: readlink d7/d10/l14 0 2024-05-09T06:30:33.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/69: mkdir d4/d5/d15 0 2024-05-09T06:30:33.942 INFO:tasks.workunit.client.1.smithi106.stdout:6/836: mknod d0/d66/d7e/d9f/c11d 0 2024-05-09T06:30:33.942 INFO:tasks.workunit.client.1.smithi106.stdout:6/837: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/fca [1020179,70734] 0 2024-05-09T06:30:33.942 INFO:tasks.workunit.client.1.smithi106.stdout:6/838: truncate d0/d17/d34/fbe 204630 0 2024-05-09T06:30:33.942 INFO:tasks.workunit.client.1.smithi106.stdout:6/839: write d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f104 [104850,95933] 0 2024-05-09T06:30:33.944 INFO:tasks.workunit.client.0.smithi046.stdout:8/97: dwrite d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:9/113: link d2/d6/d7/f23 d2/d6/f29 0 2024-05-09T06:30:33.953 INFO:tasks.workunit.client.1.smithi106.stdout:1/878: readlink d4/d76/d13/dbb/l51 0 2024-05-09T06:30:33.953 INFO:tasks.workunit.client.1.smithi106.stdout:1/879: chown d4/d76/d65/fa0 379486578 1 2024-05-09T06:30:33.955 INFO:tasks.workunit.client.1.smithi106.stdout:4/760: creat d7/d28/d2a/d80/dcf/ffc x:0 0 0 2024-05-09T06:30:33.955 INFO:tasks.workunit.client.1.smithi106.stdout:4/761: dread - d7/d39/d35/d7c/dd1/ff9 zero size 2024-05-09T06:30:33.956 INFO:tasks.workunit.client.0.smithi046.stdout:8/98: creat d1/db/dd/d10/f15 x:0 0 0 2024-05-09T06:30:33.956 INFO:tasks.workunit.client.0.smithi046.stdout:8/99: dread - d1/db/dd/d10/f15 zero size 2024-05-09T06:30:33.958 INFO:tasks.workunit.client.0.smithi046.stdout:4/156: rename d7/df/d22 to d7/df/d3a 0 2024-05-09T06:30:33.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/114: mkdir d2/d6/d7/d1a/d27/d2a 0 2024-05-09T06:30:33.963 INFO:tasks.workunit.client.1.smithi106.stdout:7/805: rename d0/dc/d1a/d36/d30/d44/db3 to d0/dfc 0 2024-05-09T06:30:33.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/101: rmdir d7/d10 39 2024-05-09T06:30:33.966 INFO:tasks.workunit.client.0.smithi046.stdout:4/157: creat d7/df/d10/d2f/f3b x:0 0 0 2024-05-09T06:30:33.966 INFO:tasks.workunit.client.0.smithi046.stdout:4/158: chown d7/df/f38 3575 1 2024-05-09T06:30:33.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/159: unlink d7/df/d10/l1f 0 2024-05-09T06:30:33.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/160: stat d7/df/d10 0 2024-05-09T06:30:33.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/161: getdents d7/df/d10/d2f/d30 0 2024-05-09T06:30:33.971 INFO:tasks.workunit.client.1.smithi106.stdout:8/784: rmdir d3/d5/d35/d61/d6c 39 2024-05-09T06:30:33.972 INFO:tasks.workunit.client.1.smithi106.stdout:8/785: fdatasync d3/d5/d7/d15/d47/f62 0 2024-05-09T06:30:33.972 INFO:tasks.workunit.client.1.smithi106.stdout:2/963: symlink d2/d5/db/d13d/l149 0 2024-05-09T06:30:33.972 INFO:tasks.workunit.client.1.smithi106.stdout:2/964: chown d2/d7/c1a 215002 1 2024-05-09T06:30:33.972 INFO:tasks.workunit.client.1.smithi106.stdout:2/965: read d2/d7/db7/fa9 [678065,108038] 0 2024-05-09T06:30:33.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/162: dread d7/f15 [0,4194304] 0 2024-05-09T06:30:33.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/100: dwrite d1/f9 [0,4194304] 0 2024-05-09T06:30:33.973 INFO:tasks.workunit.client.1.smithi106.stdout:6/840: getdents d0/d17/d34/d4e/d98/da9/db1/d8/d27 0 2024-05-09T06:30:33.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/101: unlink d1/l8 0 2024-05-09T06:30:33.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/102: dread d7/f8 [0,4194304] 0 2024-05-09T06:30:33.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/163: mknod d7/df/d3a/d25/c3c 0 2024-05-09T06:30:33.978 INFO:tasks.workunit.client.0.smithi046.stdout:1/103: symlink d7/d10/l1a 0 2024-05-09T06:30:33.979 INFO:tasks.workunit.client.0.smithi046.stdout:4/164: symlink d7/df/d10/d2f/l3d 0 2024-05-09T06:30:33.981 INFO:tasks.workunit.client.1.smithi106.stdout:2/966: write d2/d7/db7/f7c [4042931,48125] 0 2024-05-09T06:30:33.981 INFO:tasks.workunit.client.0.smithi046.stdout:4/165: symlink d7/df/d10/d2f/d30/l3e 0 2024-05-09T06:30:33.982 INFO:tasks.workunit.client.0.smithi046.stdout:1/104: link d7/d10/f12 d7/f1b 0 2024-05-09T06:30:33.982 INFO:tasks.workunit.client.0.smithi046.stdout:8/102: dread d1/f9 [4194304,4194304] 0 2024-05-09T06:30:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:4/166: mkdir d7/d3f 0 2024-05-09T06:30:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:4/167: write d7/df/d10/f24 [592393,45313] 0 2024-05-09T06:30:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:1/105: link f5 d7/d10/f1c 0 2024-05-09T06:30:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/103: link d1/db/dd/f13 d1/db/f16 0 2024-05-09T06:30:33.988 INFO:tasks.workunit.client.0.smithi046.stdout:4/168: creat d7/df/d10/f40 x:0 0 0 2024-05-09T06:30:33.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/104: getdents d1/d7 0 2024-05-09T06:30:33.991 INFO:tasks.workunit.client.0.smithi046.stdout:4/169: truncate d7/df/f29 2535660 0 2024-05-09T06:30:33.991 INFO:tasks.workunit.client.0.smithi046.stdout:4/170: chown d7/df/d3a/d25/c3c 495 1 2024-05-09T06:30:33.992 INFO:tasks.workunit.client.1.smithi106.stdout:0/857: rmdir d1 39 2024-05-09T06:30:33.992 INFO:tasks.workunit.client.1.smithi106.stdout:0/858: chown d1/d11/d23/d13/lc5 70578 1 2024-05-09T06:30:33.994 INFO:tasks.workunit.client.1.smithi106.stdout:4/762: symlink d7/d10/d1a/d5a/d46/lfd 0 2024-05-09T06:30:33.996 INFO:tasks.workunit.client.1.smithi106.stdout:7/806: mkdir d0/dc/d1a/d36/d30/d44/d80/dfd 0 2024-05-09T06:30:33.996 INFO:tasks.workunit.client.1.smithi106.stdout:8/786: rmdir d3/d5/d35/d61/d6c/d83/d89/d9b 39 2024-05-09T06:30:33.997 INFO:tasks.workunit.client.1.smithi106.stdout:6/841: mknod d0/d17/d34/d72/c11e 0 2024-05-09T06:30:34.001 INFO:tasks.workunit.client.1.smithi106.stdout:0/859: rename d1/d11/d23/d13/d58/da8/dd6/lfa to d1/d11/d120/l129 0 2024-05-09T06:30:34.001 INFO:tasks.workunit.client.1.smithi106.stdout:1/880: getdents d4/dbd/de6 0 2024-05-09T06:30:34.001 INFO:tasks.workunit.client.1.smithi106.stdout:1/881: read - d4/f113 zero size 2024-05-09T06:30:34.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/105: dread d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:34.002 INFO:tasks.workunit.client.1.smithi106.stdout:4/763: symlink d7/lfe 0 2024-05-09T06:30:34.002 INFO:tasks.workunit.client.1.smithi106.stdout:4/764: read d7/d10/f65 [1126472,71085] 0 2024-05-09T06:30:34.004 INFO:tasks.workunit.client.0.smithi046.stdout:8/106: creat d1/d7/f17 x:0 0 0 2024-05-09T06:30:34.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/64: sync 2024-05-09T06:30:34.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/967: getdents d2/d5/db/d1d/d23/d63 0 2024-05-09T06:30:34.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/968: getdents d2/d5/db/d15/dd6/d109/d13b 0 2024-05-09T06:30:34.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/969: truncate d2/d5/db/d1d/d90/f130 590722 0 2024-05-09T06:30:34.007 INFO:tasks.workunit.client.1.smithi106.stdout:2/970: getdents d2/d5/db/d1d/d23/d13e 0 2024-05-09T06:30:34.008 INFO:tasks.workunit.client.1.smithi106.stdout:8/787: read d3/d5/d35/d61/d6c/d83/d89/d9b/fc4 [4009202,96488] 0 2024-05-09T06:30:34.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/107: mknod d1/db/dd/d11/c18 0 2024-05-09T06:30:34.009 INFO:tasks.workunit.client.0.smithi046.stdout:8/108: write d1/db/dd/d10/f15 [962498,52279] 0 2024-05-09T06:30:34.009 INFO:tasks.workunit.client.1.smithi106.stdout:4/765: dread d7/d10/f8f [4194304,4194304] 0 2024-05-09T06:30:34.010 INFO:tasks.workunit.client.0.smithi046.stdout:1/106: dwrite f6 [0,4194304] 0 2024-05-09T06:30:34.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/101: dwrite d3/d7/fa [0,4194304] 0 2024-05-09T06:30:34.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/102: truncate d3/f12 1314722 0 2024-05-09T06:30:34.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/103: fsync d3/f8 0 2024-05-09T06:30:34.011 INFO:tasks.workunit.client.1.smithi106.stdout:7/807: rename d0/dc/d1a/d5a/ce6 to d0/d53/deb/cfe 0 2024-05-09T06:30:34.011 INFO:tasks.workunit.client.1.smithi106.stdout:7/808: write d0/dc/d1a/d36/d30/fcf [458115,115025] 0 2024-05-09T06:30:34.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/65: stat d0/l9 0 2024-05-09T06:30:34.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/66: read - d0/f16 zero size 2024-05-09T06:30:34.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/109: link d1/db/dd/f13 d1/db/dd/d14/f19 0 2024-05-09T06:30:34.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/110: creat d1/db/dd/f1a x:0 0 0 2024-05-09T06:30:34.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/111: chown d1/db/dd/d14 286 1 2024-05-09T06:30:34.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/112: chown d1/f9 20 1 2024-05-09T06:30:34.019 INFO:tasks.workunit.client.1.smithi106.stdout:1/882: creat d4/d76/d13/d60/d9c/de4/f138 x:0 0 0 2024-05-09T06:30:34.028 INFO:tasks.workunit.client.0.smithi046.stdout:5/67: mknod d0/d1b/c1d 0 2024-05-09T06:30:34.028 INFO:tasks.workunit.client.1.smithi106.stdout:5/882: sync 2024-05-09T06:30:34.029 INFO:tasks.workunit.client.1.smithi106.stdout:2/971: mkdir d2/d5/db/d15/dd6/d109/d14a 0 2024-05-09T06:30:34.031 INFO:tasks.workunit.client.1.smithi106.stdout:4/766: mknod d7/d39/d35/cff 0 2024-05-09T06:30:34.031 INFO:tasks.workunit.client.1.smithi106.stdout:6/842: getdents d0/d66/d7e/d9f 0 2024-05-09T06:30:34.032 INFO:tasks.workunit.client.1.smithi106.stdout:6/843: truncate d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f87 255448 0 2024-05-09T06:30:34.032 INFO:tasks.workunit.client.1.smithi106.stdout:6/844: stat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47 0 2024-05-09T06:30:34.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/107: dwrite d7/fd [0,4194304] 0 2024-05-09T06:30:34.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/108: stat d7/d10/l1a 0 2024-05-09T06:30:34.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/109: truncate d7/d10/f13 368661 0 2024-05-09T06:30:34.035 INFO:tasks.workunit.client.1.smithi106.stdout:8/788: rename d3/d5/dbc/fc3 to d3/d5/d35/d4e/d32/d92/dfb/f104 0 2024-05-09T06:30:34.035 INFO:tasks.workunit.client.0.smithi046.stdout:8/113: creat d1/d7/d12/f1b x:0 0 0 2024-05-09T06:30:34.035 INFO:tasks.workunit.client.0.smithi046.stdout:1/110: dread d7/d10/f13 [0,4194304] 0 2024-05-09T06:30:34.036 INFO:tasks.workunit.client.1.smithi106.stdout:3/705: sync 2024-05-09T06:30:34.037 INFO:tasks.workunit.client.0.smithi046.stdout:5/68: creat d0/d1b/f1e x:0 0 0 2024-05-09T06:30:34.039 INFO:tasks.workunit.client.1.smithi106.stdout:1/883: mkdir d4/d76/d65/d8d/db5/d10f/d139 0 2024-05-09T06:30:34.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/111: write d7/fe [2716126,111535] 0 2024-05-09T06:30:34.041 INFO:tasks.workunit.client.1.smithi106.stdout:5/883: truncate d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/fab 879460 0 2024-05-09T06:30:34.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/104: dwrite d3/d7/dd/f15 [0,4194304] 0 2024-05-09T06:30:34.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/105: fsync d3/f4 0 2024-05-09T06:30:34.042 INFO:tasks.workunit.client.1.smithi106.stdout:7/809: dwrite d0/dc/fea [0,4194304] 0 2024-05-09T06:30:34.044 INFO:tasks.workunit.client.0.smithi046.stdout:8/114: rename d1/d7/d12/f1b to d1/db/dd/f1c 0 2024-05-09T06:30:34.046 INFO:tasks.workunit.client.1.smithi106.stdout:5/884: read d8/d5a/d60/d7e/dae/dd9/def/faf [1051884,90116] 0 2024-05-09T06:30:34.047 INFO:tasks.workunit.client.1.smithi106.stdout:4/767: unlink d7/d39/d35/d6f/d9c/cad 0 2024-05-09T06:30:34.049 INFO:tasks.workunit.client.1.smithi106.stdout:8/789: dread d3/d5/d35/d61/d6c/d83/dcc/de9/fef [0,4194304] 0 2024-05-09T06:30:34.049 INFO:tasks.workunit.client.1.smithi106.stdout:2/972: dwrite d2/d5/db/d1d/d23/d63/d7a/fba [0,4194304] 0 2024-05-09T06:30:34.051 INFO:tasks.workunit.client.1.smithi106.stdout:6/845: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d9c/d11f 0 2024-05-09T06:30:34.060 INFO:tasks.workunit.client.1.smithi106.stdout:4/768: write d7/d39/d35/d4a/f93 [535844,30124] 0 2024-05-09T06:30:34.060 INFO:tasks.workunit.client.1.smithi106.stdout:4/769: fdatasync d7/d39/d35/fc2 0 2024-05-09T06:30:34.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/112: dread d7/f17 [0,4194304] 0 2024-05-09T06:30:34.061 INFO:tasks.workunit.client.0.smithi046.stdout:8/115: mkdir d1/d7/d12/d1d 0 2024-05-09T06:30:34.063 INFO:tasks.workunit.client.1.smithi106.stdout:1/884: rename d4/d76/d13/d60/d9c/de4/c11e to d4/d76/c13a 0 2024-05-09T06:30:34.064 INFO:tasks.workunit.client.0.smithi046.stdout:1/113: creat d7/f1d x:0 0 0 2024-05-09T06:30:34.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/69: dwrite d0/f15 [0,4194304] 0 2024-05-09T06:30:34.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/70: chown d0/c11 1667421802 1 2024-05-09T06:30:34.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/71: chown d0/l10 109481 1 2024-05-09T06:30:34.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/72: fdatasync d0/fd 0 2024-05-09T06:30:34.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/73: fdatasync d0/fd 0 2024-05-09T06:30:34.067 INFO:tasks.workunit.client.0.smithi046.stdout:8/116: dread d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:34.067 INFO:tasks.workunit.client.0.smithi046.stdout:8/117: readlink d1/l6 0 2024-05-09T06:30:34.071 INFO:tasks.workunit.client.0.smithi046.stdout:1/114: fsync d7/fc 0 2024-05-09T06:30:34.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/293: sync 2024-05-09T06:30:34.072 INFO:tasks.workunit.client.0.smithi046.stdout:2/138: sync 2024-05-09T06:30:34.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/74: mknod d0/c1f 0 2024-05-09T06:30:34.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/75: stat d0 0 2024-05-09T06:30:34.075 INFO:tasks.workunit.client.1.smithi106.stdout:8/790: dwrite d3/d5/d35/d4e/d32/f75 [0,4194304] 0 2024-05-09T06:30:34.076 INFO:tasks.workunit.client.1.smithi106.stdout:7/810: dwrite d0/dc/d1a/f3d [0,4194304] 0 2024-05-09T06:30:34.076 INFO:tasks.workunit.client.1.smithi106.stdout:7/811: write d0/dc/d1a/d36/d30/d44/df0/f92 [548002,84163] 0 2024-05-09T06:30:34.078 INFO:tasks.workunit.client.0.smithi046.stdout:1/115: write d7/f17 [4054711,77192] 0 2024-05-09T06:30:34.079 INFO:tasks.workunit.client.0.smithi046.stdout:1/116: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:34.079 INFO:tasks.workunit.client.0.smithi046.stdout:8/118: unlink d1/d7/f17 0 2024-05-09T06:30:34.081 INFO:tasks.workunit.client.1.smithi106.stdout:5/885: symlink d8/d5a/d60/da8/l110 0 2024-05-09T06:30:34.083 INFO:tasks.workunit.client.0.smithi046.stdout:6/294: unlink db/d10/d3f/l6a 0 2024-05-09T06:30:34.083 INFO:tasks.workunit.client.0.smithi046.stdout:6/295: dread - db/d10/d3f/d44/d46/f64 zero size 2024-05-09T06:30:34.084 INFO:tasks.workunit.client.0.smithi046.stdout:6/296: fsync db/f36 0 2024-05-09T06:30:34.088 INFO:tasks.workunit.client.0.smithi046.stdout:8/119: write d1/db/dd/f13 [2925359,66775] 0 2024-05-09T06:30:34.090 INFO:tasks.workunit.client.1.smithi106.stdout:2/973: rmdir d2/d5/db/d68 39 2024-05-09T06:30:34.092 INFO:tasks.workunit.client.1.smithi106.stdout:6/846: creat d0/d17/d34/d4e/d98/da9/db1/d40/f120 x:0 0 0 2024-05-09T06:30:34.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/117: truncate f5 1394759 0 2024-05-09T06:30:34.097 INFO:tasks.workunit.client.1.smithi106.stdout:3/706: rmdir d5/d1c/d24/d80 39 2024-05-09T06:30:34.097 INFO:tasks.workunit.client.1.smithi106.stdout:3/707: readlink d5/d4d/d72/l73 0 2024-05-09T06:30:34.098 INFO:tasks.workunit.client.0.smithi046.stdout:8/120: symlink d1/db/dd/l1e 0 2024-05-09T06:30:34.101 INFO:tasks.workunit.client.1.smithi106.stdout:4/770: rename d7/d10/d1a/d5a/d1c/l4d to d7/d39/d35/d7c/dd1/l100 0 2024-05-09T06:30:34.102 INFO:tasks.workunit.client.1.smithi106.stdout:1/885: truncate d4/d37/d3d/f73 1097508 0 2024-05-09T06:30:34.106 INFO:tasks.workunit.client.1.smithi106.stdout:8/791: symlink d3/d5/d7/d15/df4/l105 0 2024-05-09T06:30:34.108 INFO:tasks.workunit.client.1.smithi106.stdout:0/860: write d1/d11/d23/d13/d2c/f88 [2550199,26057] 0 2024-05-09T06:30:34.108 INFO:tasks.workunit.client.1.smithi106.stdout:0/861: truncate d1/d11/d23/d13/d58/da8/dd6/fd2 1254534 0 2024-05-09T06:30:34.111 INFO:tasks.workunit.client.1.smithi106.stdout:7/812: link d0/dc/d1a/d36/d1e/f46 d0/fff 0 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/139: dwrite da/dc/f27 [0,4194304] 0 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/140: write da/de/d14/f1b [723141,54958] 0 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/141: fdatasync da/de/d14/f28 0 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/142: dread - da/de/d14/f28 zero size 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:4/171: dwrite d7/fc [0,4194304] 0 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:4/172: creat d7/df/d10/f41 x:0 0 0 2024-05-09T06:30:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/76: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:34.114 INFO:tasks.workunit.client.1.smithi106.stdout:5/886: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dda/f111 x:0 0 0 2024-05-09T06:30:34.114 INFO:tasks.workunit.client.1.smithi106.stdout:5/887: fsync d8/d45/d4c/d32/fc2 0 2024-05-09T06:30:34.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/974: creat d2/d5/db/d13d/f14b x:0 0 0 2024-05-09T06:30:34.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/975: fsync d2/d5/db/d15/ffb 0 2024-05-09T06:30:34.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/976: read d2/d5/db/d1d/d6a/f99 [3772010,48440] 0 2024-05-09T06:30:34.117 INFO:tasks.workunit.client.1.smithi106.stdout:2/977: write d2/d7/d2c/f78 [1099707,117468] 0 2024-05-09T06:30:34.119 INFO:tasks.workunit.client.1.smithi106.stdout:1/886: dwrite d4/d76/f11 [4194304,4194304] 0 2024-05-09T06:30:34.120 INFO:tasks.workunit.client.1.smithi106.stdout:1/887: dread - d4/dbd/fcd zero size 2024-05-09T06:30:34.120 INFO:tasks.workunit.client.1.smithi106.stdout:1/888: write d4/d76/d13/f1b [4772543,122024] 0 2024-05-09T06:30:34.122 INFO:tasks.workunit.client.1.smithi106.stdout:6/847: unlink d0/lfe 0 2024-05-09T06:30:34.122 INFO:tasks.workunit.client.1.smithi106.stdout:6/848: chown d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/d109/f11b 744 1 2024-05-09T06:30:34.123 INFO:tasks.workunit.client.1.smithi106.stdout:6/849: dread - d0/d17/d34/f69 zero size 2024-05-09T06:30:34.126 INFO:tasks.workunit.client.1.smithi106.stdout:3/708: creat d5/d4d/d7a/dce/fe1 x:0 0 0 2024-05-09T06:30:34.126 INFO:tasks.workunit.client.1.smithi106.stdout:3/709: write d5/d1c/f6d [150453,81080] 0 2024-05-09T06:30:34.127 INFO:tasks.workunit.client.1.smithi106.stdout:0/862: dwrite d1/da1/fb3 [0,4194304] 0 2024-05-09T06:30:34.129 INFO:tasks.workunit.client.1.smithi106.stdout:4/771: rename d7/d10/d1a/d5a/d7a/d7f/fe1 to d7/d28/d2a/d80/f101 0 2024-05-09T06:30:34.130 INFO:tasks.workunit.client.0.smithi046.stdout:8/121: rename d1/db/dd/f1c to d1/d7/d12/f1f 0 2024-05-09T06:30:34.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/173: truncate d7/fa 3303442 0 2024-05-09T06:30:34.134 INFO:tasks.workunit.client.1.smithi106.stdout:8/792: creat d3/d5/d35/d61/d6c/d83/d89/d9b/f106 x:0 0 0 2024-05-09T06:30:34.136 INFO:tasks.workunit.client.1.smithi106.stdout:5/888: dwrite d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/f2c [0,4194304] 0 2024-05-09T06:30:34.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/77: unlink d0/c18 0 2024-05-09T06:30:34.138 INFO:tasks.workunit.client.1.smithi106.stdout:4/772: write d7/d28/d2a/f9f [2067913,55574] 0 2024-05-09T06:30:34.141 INFO:tasks.workunit.client.1.smithi106.stdout:7/813: creat d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/dce/f100 x:0 0 0 2024-05-09T06:30:34.141 INFO:tasks.workunit.client.1.smithi106.stdout:7/814: write d0/dc/d1a/d36/f9c [438070,63155] 0 2024-05-09T06:30:34.141 INFO:tasks.workunit.client.1.smithi106.stdout:7/815: readlink d0/dc/d45/l6f 0 2024-05-09T06:30:34.141 INFO:tasks.workunit.client.1.smithi106.stdout:7/816: stat d0/dc/d1a/d5a 0 2024-05-09T06:30:34.141 INFO:tasks.workunit.client.1.smithi106.stdout:7/817: creat d0/dc/d1a/d36/d30/d44/d58/f101 x:0 0 0 2024-05-09T06:30:34.149 INFO:tasks.workunit.client.1.smithi106.stdout:8/793: write d3/d5/d13/f29 [7575262,38428] 0 2024-05-09T06:30:34.150 INFO:tasks.workunit.client.1.smithi106.stdout:2/978: unlink d2/d5/db/d15/c38 0 2024-05-09T06:30:34.154 INFO:tasks.workunit.client.1.smithi106.stdout:7/818: dread d0/dc/d1a/d36/d30/d44/d6a/f9e [0,4194304] 0 2024-05-09T06:30:34.154 INFO:tasks.workunit.client.1.smithi106.stdout:9/854: sync 2024-05-09T06:30:34.154 INFO:tasks.workunit.client.1.smithi106.stdout:4/773: write d7/d39/d35/f76 [8338802,18296] 0 2024-05-09T06:30:34.155 INFO:tasks.workunit.client.0.smithi046.stdout:4/174: dwrite f1 [8388608,4194304] 0 2024-05-09T06:30:34.155 INFO:tasks.workunit.client.0.smithi046.stdout:4/175: chown d7/df/l35 6909395 1 2024-05-09T06:30:34.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/122: rename d1/f9 to d1/d7/d12/f20 0 2024-05-09T06:30:34.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/123: write d1/db/dd/d14/f19 [3276173,38747] 0 2024-05-09T06:30:34.158 INFO:tasks.workunit.client.1.smithi106.stdout:1/889: unlink d4/d5b/lb7 0 2024-05-09T06:30:34.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/106: dwrite d3/f12 [0,4194304] 0 2024-05-09T06:30:34.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/107: write d3/d7/dd/fe [1624729,39973] 0 2024-05-09T06:30:34.165 INFO:tasks.workunit.client.1.smithi106.stdout:6/850: mknod d0/d17/d34/d4e/d98/da9/db1/d40/c121 0 2024-05-09T06:30:34.168 INFO:tasks.workunit.client.1.smithi106.stdout:3/710: symlink d5/d1c/d24/d5b/le2 0 2024-05-09T06:30:34.168 INFO:tasks.workunit.client.1.smithi106.stdout:3/711: dread - d5/d1c/d24/d98/dc0/d32/fd4 zero size 2024-05-09T06:30:34.172 INFO:tasks.workunit.client.1.smithi106.stdout:0/863: truncate d1/fa7 599498 0 2024-05-09T06:30:34.174 INFO:tasks.workunit.client.0.smithi046.stdout:8/124: mknod d1/d7/c21 0 2024-05-09T06:30:34.174 INFO:tasks.workunit.client.0.smithi046.stdout:8/125: truncate d1/d7/d12/f1f 1037003 0 2024-05-09T06:30:34.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/126: write d1/d7/d12/f1f [641484,42127] 0 2024-05-09T06:30:34.182 INFO:tasks.workunit.client.0.smithi046.stdout:1/118: dread f5 [0,4194304] 0 2024-05-09T06:30:34.184 INFO:tasks.workunit.client.1.smithi106.stdout:6/851: dwrite d0/d5c/faf [0,4194304] 0 2024-05-09T06:30:34.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/108: truncate d3/d7/f9 827167 0 2024-05-09T06:30:34.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/109: chown d3/f4 215722 1 2024-05-09T06:30:34.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/110: truncate d3/f1e 1382649 0 2024-05-09T06:30:34.185 INFO:tasks.workunit.client.0.smithi046.stdout:7/111: creat d3/d7/dd/f23 x:0 0 0 2024-05-09T06:30:34.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/78: rmdir d0/d1b 39 2024-05-09T06:30:34.195 INFO:tasks.workunit.client.0.smithi046.stdout:6/297: write db/f27 [92338,123947] 0 2024-05-09T06:30:34.195 INFO:tasks.workunit.client.0.smithi046.stdout:6/298: fsync db/d10/d19/f54 0 2024-05-09T06:30:34.196 INFO:tasks.workunit.client.1.smithi106.stdout:8/794: mknod d3/d5/d35/d61/d6c/d83/d89/d9b/c107 0 2024-05-09T06:30:34.199 INFO:tasks.workunit.client.1.smithi106.stdout:2/979: symlink d2/d7/d62/l14c 0 2024-05-09T06:30:34.201 INFO:tasks.workunit.client.1.smithi106.stdout:7/819: truncate d0/dc/d1a/d5a/fab 608190 0 2024-05-09T06:30:34.204 INFO:tasks.workunit.client.0.smithi046.stdout:1/119: dwrite d7/f8 [0,4194304] 0 2024-05-09T06:30:34.205 INFO:tasks.workunit.client.1.smithi106.stdout:7/820: dread d0/dc/d1a/d36/d1e/f21 [0,4194304] 0 2024-05-09T06:30:34.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/299: dread db/d10/f16 [0,4194304] 0 2024-05-09T06:30:34.207 INFO:tasks.workunit.client.1.smithi106.stdout:6/852: dwrite d0/d66/d7e/f26 [0,4194304] 0 2024-05-09T06:30:34.207 INFO:tasks.workunit.client.1.smithi106.stdout:6/853: fdatasync d0/d17/d34/dd0/f11a 0 2024-05-09T06:30:34.207 INFO:tasks.workunit.client.1.smithi106.stdout:9/855: creat d4/d54/d69/d95/d23/d16/dd1/d38/f10b x:0 0 0 2024-05-09T06:30:34.207 INFO:tasks.workunit.client.1.smithi106.stdout:9/856: readlink d4/d54/d69/d95/d23/d16/ld7 0 2024-05-09T06:30:34.210 INFO:tasks.workunit.client.1.smithi106.stdout:4/774: symlink d7/d10/d1a/d5a/d7a/d7f/dc8/l102 0 2024-05-09T06:30:34.212 INFO:tasks.workunit.client.0.smithi046.stdout:4/176: getdents d7/df/d10 0 2024-05-09T06:30:34.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/112: creat d3/d7/d1c/f24 x:0 0 0 2024-05-09T06:30:34.218 INFO:tasks.workunit.client.1.smithi106.stdout:8/795: dwrite d3/d5/d35/d61/d6c/d83/dcc/de9/fef [0,4194304] 0 2024-05-09T06:30:34.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/79: rename d0/f15 to d0/d1b/f20 0 2024-05-09T06:30:34.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/120: rename d7/d10/f1c to d7/d10/f1e 0 2024-05-09T06:30:34.229 INFO:tasks.workunit.client.0.smithi046.stdout:4/177: mknod d7/df/d3a/c42 0 2024-05-09T06:30:34.232 INFO:tasks.workunit.client.0.smithi046.stdout:7/113: mknod d3/c25 0 2024-05-09T06:30:34.233 INFO:tasks.workunit.client.1.smithi106.stdout:6/854: dwrite d0/d66/d7e/de5/f103 [0,4194304] 0 2024-05-09T06:30:34.234 INFO:tasks.workunit.client.1.smithi106.stdout:2/980: dwrite d2/d5/db/d15/d41/d60/dcc/ffa [0,4194304] 0 2024-05-09T06:30:34.234 INFO:tasks.workunit.client.1.smithi106.stdout:2/981: write d2/d7/d89/d104/f123 [727121,90449] 0 2024-05-09T06:30:34.234 INFO:tasks.workunit.client.1.smithi106.stdout:2/982: chown d2/d5/db/d15/dc6/fe2 31714 1 2024-05-09T06:30:34.235 INFO:tasks.workunit.client.0.smithi046.stdout:5/80: mkdir d0/d1b/d21 0 2024-05-09T06:30:34.235 INFO:tasks.workunit.client.0.smithi046.stdout:5/81: chown d0/f4 990299783 1 2024-05-09T06:30:34.237 INFO:tasks.workunit.client.0.smithi046.stdout:6/300: dwrite db/f27 [0,4194304] 0 2024-05-09T06:30:34.240 INFO:tasks.workunit.client.1.smithi106.stdout:3/712: mkdir d5/d85/dc3/d65/de3 0 2024-05-09T06:30:34.240 INFO:tasks.workunit.client.1.smithi106.stdout:3/713: read - d5/d1c/d24/f55 zero size 2024-05-09T06:30:34.240 INFO:tasks.workunit.client.1.smithi106.stdout:3/714: chown d5/d1c/d24/d98/dc0/fa2 2193 1 2024-05-09T06:30:34.240 INFO:tasks.workunit.client.1.smithi106.stdout:3/715: creat d5/d1c/d24/d5b/fe4 x:0 0 0 2024-05-09T06:30:34.240 INFO:tasks.workunit.client.1.smithi106.stdout:3/716: fdatasync d5/d1c/d24/d5b/f61 0 2024-05-09T06:30:34.241 INFO:tasks.workunit.client.0.smithi046.stdout:4/178: creat d7/df/d3a/d25/f43 x:0 0 0 2024-05-09T06:30:34.241 INFO:tasks.workunit.client.0.smithi046.stdout:4/179: write d7/df/f36 [405165,93971] 0 2024-05-09T06:30:34.243 INFO:tasks.workunit.client.1.smithi106.stdout:0/864: mkdir d1/d11/d23/d13/d8a/d12a 0 2024-05-09T06:30:34.245 INFO:tasks.workunit.client.0.smithi046.stdout:6/301: dread db/d10/d19/f1b [0,4194304] 0 2024-05-09T06:30:34.246 INFO:tasks.workunit.client.1.smithi106.stdout:7/821: creat d0/dc/d1a/d36/d30/d44/df0/f102 x:0 0 0 2024-05-09T06:30:34.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/82: symlink d0/d1b/l22 0 2024-05-09T06:30:34.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/180: dread d7/df/f36 [0,4194304] 0 2024-05-09T06:30:34.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/181: write d7/df/f38 [119482,59383] 0 2024-05-09T06:30:34.254 INFO:tasks.workunit.client.1.smithi106.stdout:9/857: mkdir d4/d54/d69/d95/d23/d78/d8f/d9a/d10c 0 2024-05-09T06:30:34.256 INFO:tasks.workunit.client.1.smithi106.stdout:4/775: creat d7/d10/d1a/d5a/d7a/d7f/f103 x:0 0 0 2024-05-09T06:30:34.259 INFO:tasks.workunit.client.0.smithi046.stdout:4/182: link d7/df/f32 d7/df/d10/d2f/f44 0 2024-05-09T06:30:34.262 INFO:tasks.workunit.client.1.smithi106.stdout:8/796: link d3/d5/d7/fcd d3/d5/d7/d15/df4/dfd/da9/dbd/f108 0 2024-05-09T06:30:34.265 INFO:tasks.workunit.client.1.smithi106.stdout:9/858: dread d4/d54/d69/d95/d23/fdb [0,4194304] 0 2024-05-09T06:30:34.266 INFO:tasks.workunit.client.1.smithi106.stdout:6/855: symlink d0/d5c/l122 0 2024-05-09T06:30:34.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/183: dread f5 [8388608,4194304] 0 2024-05-09T06:30:34.269 INFO:tasks.workunit.client.1.smithi106.stdout:2/983: mknod d2/d5/db/d15/c14d 0 2024-05-09T06:30:34.273 INFO:tasks.workunit.client.1.smithi106.stdout:1/890: symlink d4/d76/d13/dbb/l13b 0 2024-05-09T06:30:34.274 INFO:tasks.workunit.client.1.smithi106.stdout:2/984: dread d2/d7/f1c [0,4194304] 0 2024-05-09T06:30:34.274 INFO:tasks.workunit.client.1.smithi106.stdout:2/985: readlink d2/d5/db/d15/lf6 0 2024-05-09T06:30:34.274 INFO:tasks.workunit.client.1.smithi106.stdout:2/986: chown d2/d5/db/d15/dd6/deb/f120 5244985 1 2024-05-09T06:30:34.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/302: dwrite db/d10/d3c/f62 [0,4194304] 0 2024-05-09T06:30:34.277 INFO:tasks.workunit.client.0.smithi046.stdout:5/83: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:34.277 INFO:tasks.workunit.client.0.smithi046.stdout:5/84: dread - d0/fa zero size 2024-05-09T06:30:34.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/184: mkdir d7/df/d3a/d45 0 2024-05-09T06:30:34.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/185: chown d7/df/f38 745560114 1 2024-05-09T06:30:34.278 INFO:tasks.workunit.client.1.smithi106.stdout:4/776: dwrite d7/d28/d2a/d80/dcf/ffc [0,4194304] 0 2024-05-09T06:30:34.279 INFO:tasks.workunit.client.1.smithi106.stdout:3/717: rename d5/d1c/d24/d89/d8c/dbb to d5/d4d/d7a/da9/da8/de5 0 2024-05-09T06:30:34.283 INFO:tasks.workunit.client.1.smithi106.stdout:0/865: truncate d1/d11/d23/d13/d2c/d6d/f6f 819443 0 2024-05-09T06:30:34.288 INFO:tasks.workunit.client.1.smithi106.stdout:7/822: symlink d0/dc/d1a/d36/d30/d44/l103 0 2024-05-09T06:30:34.289 INFO:tasks.workunit.client.0.smithi046.stdout:6/303: read db/f27 [875065,107341] 0 2024-05-09T06:30:34.289 INFO:tasks.workunit.client.0.smithi046.stdout:6/304: stat db/d10/d30/d53 0 2024-05-09T06:30:34.291 INFO:tasks.workunit.client.1.smithi106.stdout:8/797: symlink d3/d5/d13/l109 0 2024-05-09T06:30:34.291 INFO:tasks.workunit.client.1.smithi106.stdout:8/798: fsync d3/d5/d35/d4e/d32/dd3/fe2 0 2024-05-09T06:30:34.293 INFO:tasks.workunit.client.1.smithi106.stdout:9/859: mkdir d4/d54/d69/d95/d10d 0 2024-05-09T06:30:34.293 INFO:tasks.workunit.client.1.smithi106.stdout:9/860: stat d4/d54/d69/d99/d2a/d42/d6c/d6d/f108 0 2024-05-09T06:30:34.293 INFO:tasks.workunit.client.1.smithi106.stdout:9/861: creat d4/d54/d69/d99/f10e x:0 0 0 2024-05-09T06:30:34.294 INFO:tasks.workunit.client.0.smithi046.stdout:5/85: symlink d0/d1b/d21/l23 0 2024-05-09T06:30:34.294 INFO:tasks.workunit.client.0.smithi046.stdout:5/86: creat d0/f24 x:0 0 0 2024-05-09T06:30:34.294 INFO:tasks.workunit.client.0.smithi046.stdout:5/87: stat d0/fd 0 2024-05-09T06:30:34.296 INFO:tasks.workunit.client.1.smithi106.stdout:6/856: truncate d0/d17/d34/d4e/d98/da9/db1/d8/f3c 3465033 0 2024-05-09T06:30:34.296 INFO:tasks.workunit.client.1.smithi106.stdout:6/857: fsync d0/d17/d34/d4e/d98/da9/db1/d8/d50/fca 0 2024-05-09T06:30:34.296 INFO:tasks.workunit.client.1.smithi106.stdout:6/858: write d0/d17/d76/fcc [851597,114977] 0 2024-05-09T06:30:34.296 INFO:tasks.workunit.client.1.smithi106.stdout:6/859: chown d0/d17/d34/d4e/d98/da9/db1/d40/f41 17529 1 2024-05-09T06:30:34.296 INFO:tasks.workunit.client.1.smithi106.stdout:6/860: chown d0/d17/d34/d4e/d98/da9/db1/d40/f10a 18335176 1 2024-05-09T06:30:34.298 INFO:tasks.workunit.client.0.smithi046.stdout:4/186: rename d7/df/d10/d1d/f31 to d7/f46 0 2024-05-09T06:30:34.299 INFO:tasks.workunit.client.1.smithi106.stdout:1/891: creat d4/d76/d13/d2f/df5/f13c x:0 0 0 2024-05-09T06:30:34.301 INFO:tasks.workunit.client.1.smithi106.stdout:2/987: mkdir d2/d5/db/d15/dd6/d109/d14a/d14e 0 2024-05-09T06:30:34.301 INFO:tasks.workunit.client.1.smithi106.stdout:2/988: dread - d2/d7/d62/fe9 zero size 2024-05-09T06:30:34.308 INFO:tasks.workunit.client.1.smithi106.stdout:1/892: dread d4/d76/f53 [0,4194304] 0 2024-05-09T06:30:34.309 INFO:tasks.workunit.client.1.smithi106.stdout:4/777: getdents d7/d39/d35/d6f 0 2024-05-09T06:30:34.309 INFO:tasks.workunit.client.1.smithi106.stdout:1/893: write d4/d76/fa3 [72208,95838] 0 2024-05-09T06:30:34.312 INFO:tasks.workunit.client.1.smithi106.stdout:0/866: rename d1/d11/d23/d22/f49 to d1/d11/d23/d13/d2c/d57/de1/f12b 0 2024-05-09T06:30:34.313 INFO:tasks.workunit.client.1.smithi106.stdout:0/867: readlink d1/d11/d23/d13/d2c/d6d/d70/ld7 0 2024-05-09T06:30:34.313 INFO:tasks.workunit.client.1.smithi106.stdout:0/868: truncate d1/d11/d23/d13/d58/da8/dd6/f119 639367 0 2024-05-09T06:30:34.313 INFO:tasks.workunit.client.1.smithi106.stdout:0/869: write d1/f43 [282470,57043] 0 2024-05-09T06:30:34.317 INFO:tasks.workunit.client.1.smithi106.stdout:8/799: symlink d3/d5/d13/l10a 0 2024-05-09T06:30:34.325 INFO:tasks.workunit.client.1.smithi106.stdout:6/861: unlink d0/d17/d34/c39 0 2024-05-09T06:30:34.325 INFO:tasks.workunit.client.1.smithi106.stdout:0/870: dread d1/d11/d23/d13/d58/fb2 [0,4194304] 0 2024-05-09T06:30:34.325 INFO:tasks.workunit.client.1.smithi106.stdout:0/871: stat d1/d11/d23/d13/d2c/d3d/dbe/fee 0 2024-05-09T06:30:34.326 INFO:tasks.workunit.client.0.smithi046.stdout:6/305: mkdir db/d10/d6b 0 2024-05-09T06:30:34.326 INFO:tasks.workunit.client.0.smithi046.stdout:6/306: dread - db/d10/d3f/f32 zero size 2024-05-09T06:30:34.326 INFO:tasks.workunit.client.1.smithi106.stdout:9/862: dwrite d4/d54/d91/feb [0,4194304] 0 2024-05-09T06:30:34.326 INFO:tasks.workunit.client.1.smithi106.stdout:9/863: fdatasync d4/d54/d69/d99/d2a/d42/d6c/d6d/fb5 0 2024-05-09T06:30:34.328 INFO:tasks.workunit.client.1.smithi106.stdout:3/718: dwrite d5/f63 [0,4194304] 0 2024-05-09T06:30:34.328 INFO:tasks.workunit.client.1.smithi106.stdout:3/719: readlink d5/l9d 0 2024-05-09T06:30:34.329 INFO:tasks.workunit.client.0.smithi046.stdout:5/88: dwrite d0/f24 [0,4194304] 0 2024-05-09T06:30:34.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/800: dread d3/d5/d35/d73/fd5 [0,4194304] 0 2024-05-09T06:30:34.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/801: write d3/d5/d13/d3a/f55 [167389,456] 0 2024-05-09T06:30:34.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/802: chown d3 38882 1 2024-05-09T06:30:34.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/803: read d3/d5/d35/d61/f63 [1311857,73741] 0 2024-05-09T06:30:34.331 INFO:tasks.workunit.client.0.smithi046.stdout:4/187: mkdir d7/df/d10/d2f/d47 0 2024-05-09T06:30:34.332 INFO:tasks.workunit.client.0.smithi046.stdout:4/188: getdents d7/df/d10 0 2024-05-09T06:30:34.332 INFO:tasks.workunit.client.1.smithi106.stdout:0/872: dread d1/f5 [4194304,4194304] 0 2024-05-09T06:30:34.333 INFO:tasks.workunit.client.1.smithi106.stdout:1/894: creat d4/d76/d65/d8d/db5/d10f/f13d x:0 0 0 2024-05-09T06:30:34.334 INFO:tasks.workunit.client.0.smithi046.stdout:6/307: mknod db/d10/d30/c6c 0 2024-05-09T06:30:34.334 INFO:tasks.workunit.client.0.smithi046.stdout:6/308: readlink db/l12 0 2024-05-09T06:30:34.335 INFO:tasks.workunit.client.0.smithi046.stdout:6/309: truncate db/f25 249057 0 2024-05-09T06:30:34.338 INFO:tasks.workunit.client.1.smithi106.stdout:4/778: rename d7/d39/d35/d4a/l4b to d7/d10/d1a/d5a/d7a/d7f/l104 0 2024-05-09T06:30:34.342 INFO:tasks.workunit.client.1.smithi106.stdout:0/873: dread d1/d11/d23/d13/d2c/d3d/f82 [0,4194304] 0 2024-05-09T06:30:34.343 INFO:tasks.workunit.client.1.smithi106.stdout:7/823: rmdir d0/dc/d1a/d36/d30/d44/d80 39 2024-05-09T06:30:34.343 INFO:tasks.workunit.client.1.smithi106.stdout:7/824: stat d0/dc/d1a/d36/d30/d44/d6a/d72/cbd 0 2024-05-09T06:30:34.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/89: rename d0/cb to d0/d1b/d21/c25 0 2024-05-09T06:30:34.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/121: getdents d7/d10 0 2024-05-09T06:30:34.350 INFO:tasks.workunit.client.1.smithi106.stdout:6/862: mkdir d0/d17/d34/d4e/deb/d123 0 2024-05-09T06:30:34.353 INFO:tasks.workunit.client.0.smithi046.stdout:4/189: rename d7/df/d10/d2f/c34 to d7/df/d10/d2f/c48 0 2024-05-09T06:30:34.353 INFO:tasks.workunit.client.0.smithi046.stdout:4/190: readlink d7/df/d10/l11 0 2024-05-09T06:30:34.358 INFO:tasks.workunit.client.0.smithi046.stdout:6/310: rename db/f36 to db/d10/d3c/f6d 0 2024-05-09T06:30:34.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/90: dread d0/f24 [0,4194304] 0 2024-05-09T06:30:34.361 INFO:tasks.workunit.client.0.smithi046.stdout:4/191: truncate f4 2363494 0 2024-05-09T06:30:34.361 INFO:tasks.workunit.client.0.smithi046.stdout:4/192: write d7/df/d10/d2f/f3b [276890,55841] 0 2024-05-09T06:30:34.366 INFO:tasks.workunit.client.1.smithi106.stdout:9/864: unlink d4/d54/d69/d95/lff 0 2024-05-09T06:30:34.368 INFO:tasks.workunit.client.1.smithi106.stdout:4/779: dwrite d7/d39/d35/d7c/dd1/ff9 [0,4194304] 0 2024-05-09T06:30:34.370 INFO:tasks.workunit.client.0.smithi046.stdout:4/193: creat d7/df/d3a/d45/f49 x:0 0 0 2024-05-09T06:30:34.371 INFO:tasks.workunit.client.1.smithi106.stdout:4/780: dread d7/fda [0,4194304] 0 2024-05-09T06:30:34.373 INFO:tasks.workunit.client.1.smithi106.stdout:5/889: sync 2024-05-09T06:30:34.373 INFO:tasks.workunit.client.0.smithi046.stdout:5/91: dread d0/f1 [0,4194304] 0 2024-05-09T06:30:34.374 INFO:tasks.workunit.client.0.smithi046.stdout:7/114: truncate d3/f1e 557875 0 2024-05-09T06:30:34.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/311: getdents db/d10/d57/d5d 0 2024-05-09T06:30:34.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/312: read - db/d10/d3f/f32 zero size 2024-05-09T06:30:34.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/313: fsync db/f25 0 2024-05-09T06:30:34.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/314: read - db/d10/d3c/f6d zero size 2024-05-09T06:30:34.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/315: chown db/d10/d30/c51 96 1 2024-05-09T06:30:34.379 INFO:tasks.workunit.client.1.smithi106.stdout:9/865: dread d4/f25 [0,4194304] 0 2024-05-09T06:30:34.379 INFO:tasks.workunit.client.1.smithi106.stdout:6/863: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d27/fdc [0,4194304] 0 2024-05-09T06:30:34.383 INFO:tasks.workunit.client.0.smithi046.stdout:1/122: dwrite d7/d10/f1e [0,4194304] 0 2024-05-09T06:30:34.383 INFO:tasks.workunit.client.0.smithi046.stdout:1/123: write d7/f18 [1147216,44065] 0 2024-05-09T06:30:34.383 INFO:tasks.workunit.client.0.smithi046.stdout:1/124: write d7/d10/f13 [547083,120810] 0 2024-05-09T06:30:34.387 INFO:tasks.workunit.client.1.smithi106.stdout:3/720: truncate d5/d4d/d72/fd0 552665 0 2024-05-09T06:30:34.387 INFO:tasks.workunit.client.1.smithi106.stdout:3/721: fsync d5/d8f/fd1 0 2024-05-09T06:30:34.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/115: mknod d3/d7/c26 0 2024-05-09T06:30:34.391 INFO:tasks.workunit.client.1.smithi106.stdout:8/804: mkdir d3/d5/d35/d73/d10b 0 2024-05-09T06:30:34.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/92: dwrite d0/f16 [0,4194304] 0 2024-05-09T06:30:34.395 INFO:tasks.workunit.client.1.smithi106.stdout:1/895: symlink d4/d5b/d75/l13e 0 2024-05-09T06:30:34.398 INFO:tasks.workunit.client.0.smithi046.stdout:6/316: symlink db/d10/d57/d5d/l6e 0 2024-05-09T06:30:34.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/317: read - db/d10/d30/f52 zero size 2024-05-09T06:30:34.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/318: dread - db/d10/d3f/f67 zero size 2024-05-09T06:30:34.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/93: write d0/f24 [3472769,40699] 0 2024-05-09T06:30:34.405 INFO:tasks.workunit.client.1.smithi106.stdout:0/874: link d1/d11/d23/d13/d2c/l72 d1/da1/d83/l12c 0 2024-05-09T06:30:34.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/319: dread db/d10/d3c/f45 [0,4194304] 0 2024-05-09T06:30:34.412 INFO:tasks.workunit.client.1.smithi106.stdout:8/805: dwrite d3/d5/d35/d4e/d32/f9a [0,4194304] 0 2024-05-09T06:30:34.412 INFO:tasks.workunit.client.1.smithi106.stdout:8/806: write d3/d5/d7/d98/faa [454643,56125] 0 2024-05-09T06:30:34.412 INFO:tasks.workunit.client.1.smithi106.stdout:8/807: write d3/d5/d7/d15/df4/dfd/da9/fd6 [25226,14641] 0 2024-05-09T06:30:34.419 INFO:tasks.workunit.client.0.smithi046.stdout:6/320: dread db/d10/d3f/d44/f68 [0,4194304] 0 2024-05-09T06:30:34.419 INFO:tasks.workunit.client.0.smithi046.stdout:6/321: creat db/d10/d3f/f6f x:0 0 0 2024-05-09T06:30:34.420 INFO:tasks.workunit.client.0.smithi046.stdout:1/125: creat d7/d10/f1f x:0 0 0 2024-05-09T06:30:34.423 INFO:tasks.workunit.client.0.smithi046.stdout:7/116: link d3/d7/dd/f23 d3/d7/dd/f27 0 2024-05-09T06:30:34.431 INFO:tasks.workunit.client.1.smithi106.stdout:4/781: mknod d7/d39/d47/d66/c105 0 2024-05-09T06:30:34.432 INFO:tasks.workunit.client.1.smithi106.stdout:4/782: write d7/d39/d35/d7c/da8/dd7/ff2 [342917,36992] 0 2024-05-09T06:30:34.434 INFO:tasks.workunit.client.1.smithi106.stdout:5/890: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/f112 x:0 0 0 2024-05-09T06:30:34.434 INFO:tasks.workunit.client.1.smithi106.stdout:5/891: truncate d8/d5a/d60/d7e/dae/fd5 4573270 0 2024-05-09T06:30:34.436 INFO:tasks.workunit.client.1.smithi106.stdout:9/866: mkdir d4/d54/d69/d95/d23/d78/d8f/d10f 0 2024-05-09T06:30:34.440 INFO:tasks.workunit.client.1.smithi106.stdout:6/864: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d9c/d124 0 2024-05-09T06:30:34.442 INFO:tasks.workunit.client.1.smithi106.stdout:3/722: mknod d5/d1c/d24/d98/ce6 0 2024-05-09T06:30:34.443 INFO:tasks.workunit.client.1.smithi106.stdout:4/783: write d7/d39/d35/f76 [948289,109740] 0 2024-05-09T06:30:34.444 INFO:tasks.workunit.client.1.smithi106.stdout:4/784: write d7/d39/d35/dac/dd5/fdb [4886949,47094] 0 2024-05-09T06:30:34.445 INFO:tasks.workunit.client.1.smithi106.stdout:1/896: symlink d4/d76/d65/d8d/l13f 0 2024-05-09T06:30:34.448 INFO:tasks.workunit.client.0.smithi046.stdout:5/94: rename d0/cc to d0/d1b/d21/c26 0 2024-05-09T06:30:34.453 INFO:tasks.workunit.client.0.smithi046.stdout:6/322: mkdir db/d10/d3f/d44/d46/d70 0 2024-05-09T06:30:34.453 INFO:tasks.workunit.client.1.smithi106.stdout:4/785: write d7/d39/f44 [152325,34784] 0 2024-05-09T06:30:34.453 INFO:tasks.workunit.client.1.smithi106.stdout:8/808: truncate d3/d5/d13/f36 1144982 0 2024-05-09T06:30:34.454 INFO:tasks.workunit.client.1.smithi106.stdout:6/865: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/faa [0,4194304] 0 2024-05-09T06:30:34.455 INFO:tasks.workunit.client.1.smithi106.stdout:6/866: truncate d0/d17/d34/d4e/d98/fe9 587645 0 2024-05-09T06:30:34.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/95: rename d0/c5 to d0/c27 0 2024-05-09T06:30:34.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/96: fdatasync d0/f1 0 2024-05-09T06:30:34.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/97: read - d0/f1c zero size 2024-05-09T06:30:34.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/323: dread db/f28 [0,4194304] 0 2024-05-09T06:30:34.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/324: fsync f6 0 2024-05-09T06:30:34.468 INFO:tasks.workunit.client.1.smithi106.stdout:9/867: truncate d4/d54/d69/d95/d23/d16/dd1/d31/f92 890681 0 2024-05-09T06:30:34.473 INFO:tasks.workunit.client.0.smithi046.stdout:5/98: symlink d0/d1b/l28 0 2024-05-09T06:30:34.473 INFO:tasks.workunit.client.0.smithi046.stdout:5/99: creat d0/f29 x:0 0 0 2024-05-09T06:30:34.475 INFO:tasks.workunit.client.0.smithi046.stdout:6/325: write db/d10/d57/d5d/f61 [4682402,52280] 0 2024-05-09T06:30:34.477 INFO:tasks.workunit.client.1.smithi106.stdout:1/897: mkdir d4/d76/d13/d2f/df5/dfd/d140 0 2024-05-09T06:30:34.479 INFO:tasks.workunit.client.0.smithi046.stdout:7/117: rename d3/d7/d1c to d3/d7/d28 0 2024-05-09T06:30:34.479 INFO:tasks.workunit.client.0.smithi046.stdout:7/118: write d3/d7/f11 [1941265,34840] 0 2024-05-09T06:30:34.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/119: dread d3/f8 [0,4194304] 0 2024-05-09T06:30:34.485 INFO:tasks.workunit.client.1.smithi106.stdout:9/868: symlink d4/d54/d69/d95/d23/l110 0 2024-05-09T06:30:34.486 INFO:tasks.workunit.client.0.smithi046.stdout:6/326: truncate db/f27 2799448 0 2024-05-09T06:30:34.486 INFO:tasks.workunit.client.1.smithi106.stdout:3/723: rmdir d5/d4d/d7a/dce 39 2024-05-09T06:30:34.488 INFO:tasks.workunit.client.0.smithi046.stdout:7/120: mkdir d3/d7/d28/d29 0 2024-05-09T06:30:34.489 INFO:tasks.workunit.client.1.smithi106.stdout:4/786: dwrite d7/d10/f1d [0,4194304] 0 2024-05-09T06:30:34.490 INFO:tasks.workunit.client.1.smithi106.stdout:8/809: dwrite d3/d5/d7/d15/d47/f62 [0,4194304] 0 2024-05-09T06:30:34.490 INFO:tasks.workunit.client.1.smithi106.stdout:8/810: fsync d3/d5/d35/d73/f54 0 2024-05-09T06:30:34.490 INFO:tasks.workunit.client.1.smithi106.stdout:8/811: creat d3/d5/d35/d61/d6c/d83/d89/d9b/f10c x:0 0 0 2024-05-09T06:30:34.490 INFO:tasks.workunit.client.1.smithi106.stdout:8/812: chown d3/d5/d7/f20 42712418 1 2024-05-09T06:30:34.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/100: dwrite d0/fa [0,4194304] 0 2024-05-09T06:30:34.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/327: unlink db/f23 0 2024-05-09T06:30:34.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/121: dread d3/d7/dd/f15 [0,4194304] 0 2024-05-09T06:30:34.499 INFO:tasks.workunit.client.0.smithi046.stdout:6/328: mknod db/d10/d3f/c71 0 2024-05-09T06:30:34.501 INFO:tasks.workunit.client.1.smithi106.stdout:1/898: rename d4/d76/d13/d60/fc5 to d4/d76/db3/f141 0 2024-05-09T06:30:34.502 INFO:tasks.workunit.client.1.smithi106.stdout:6/867: rmdir d0/d66/d7e/de5 39 2024-05-09T06:30:34.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/101: dwrite d0/d1b/f1e [0,4194304] 0 2024-05-09T06:30:34.504 INFO:tasks.workunit.client.0.smithi046.stdout:5/102: creat d0/f2a x:0 0 0 2024-05-09T06:30:34.504 INFO:tasks.workunit.client.0.smithi046.stdout:7/122: rename d3/d7/dd/f27 to d3/d7/d28/f2a 0 2024-05-09T06:30:34.506 INFO:tasks.workunit.client.1.smithi106.stdout:9/869: rmdir d4/d54/d69 39 2024-05-09T06:30:34.506 INFO:tasks.workunit.client.1.smithi106.stdout:9/870: rename d4 to d4/d54/d111 22 2024-05-09T06:30:34.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/329: mknod db/d10/d3f/d44/d46/d70/c72 0 2024-05-09T06:30:34.510 INFO:tasks.workunit.client.0.smithi046.stdout:5/103: dread d0/f16 [0,4194304] 0 2024-05-09T06:30:34.510 INFO:tasks.workunit.client.0.smithi046.stdout:5/104: readlink d0/l3 0 2024-05-09T06:30:34.511 INFO:tasks.workunit.client.1.smithi106.stdout:3/724: creat d5/d1c/d24/d89/fe7 x:0 0 0 2024-05-09T06:30:34.517 INFO:tasks.workunit.client.1.smithi106.stdout:4/787: mkdir d7/d10/d106 0 2024-05-09T06:30:34.522 INFO:tasks.workunit.client.0.smithi046.stdout:6/330: mknod db/d10/d57/c73 0 2024-05-09T06:30:34.522 INFO:tasks.workunit.client.0.smithi046.stdout:6/331: write db/d10/d3f/d4f/f60 [870032,130760] 0 2024-05-09T06:30:34.523 INFO:tasks.workunit.client.1.smithi106.stdout:1/899: dwrite d4/dbd/de6/f12c [0,4194304] 0 2024-05-09T06:30:34.523 INFO:tasks.workunit.client.1.smithi106.stdout:1/900: read - d4/d76/d65/d8d/db5/fe9 zero size 2024-05-09T06:30:34.523 INFO:tasks.workunit.client.1.smithi106.stdout:2/989: dwrite d2/d5/db/d1d/f4a [0,4194304] 0 2024-05-09T06:30:34.524 INFO:tasks.workunit.client.0.smithi046.stdout:4/194: getdents d7/df/d10/d2f 0 2024-05-09T06:30:34.525 INFO:tasks.workunit.client.0.smithi046.stdout:4/195: read d7/df/d3a/f2c [796653,95104] 0 2024-05-09T06:30:34.526 INFO:tasks.workunit.client.0.smithi046.stdout:5/105: mknod d0/d1b/c2b 0 2024-05-09T06:30:34.526 INFO:tasks.workunit.client.0.smithi046.stdout:5/106: write d0/f29 [481489,20332] 0 2024-05-09T06:30:34.528 INFO:tasks.workunit.client.1.smithi106.stdout:8/813: mknod d3/d5/d13/d3a/c10d 0 2024-05-09T06:30:34.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/332: mkdir db/d10/d3f/d44/d74 0 2024-05-09T06:30:34.532 INFO:tasks.workunit.client.1.smithi106.stdout:6/868: truncate d0/d17/d34/d4e/d98/da9/db1/d8/f1d 1917155 0 2024-05-09T06:30:34.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/123: dwrite d3/d7/f11 [0,4194304] 0 2024-05-09T06:30:34.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/124: stat d3/d7/dd/f15 0 2024-05-09T06:30:34.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/196: creat d7/df/d3a/f4a x:0 0 0 2024-05-09T06:30:34.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/197: truncate d7/df/d3a/d45/f49 977517 0 2024-05-09T06:30:34.538 INFO:tasks.workunit.client.1.smithi106.stdout:9/871: mknod d4/d54/d69/d99/d2a/d42/dc8/de3/c112 0 2024-05-09T06:30:34.538 INFO:tasks.workunit.client.1.smithi106.stdout:9/872: write d4/d54/d91/dbf/ff3 [1369751,2627] 0 2024-05-09T06:30:34.539 INFO:tasks.workunit.client.0.smithi046.stdout:5/107: symlink d0/l2c 0 2024-05-09T06:30:34.540 INFO:tasks.workunit.client.1.smithi106.stdout:8/814: dread d3/d5/d35/d73/f4f [4194304,4194304] 0 2024-05-09T06:30:34.542 INFO:tasks.workunit.client.1.smithi106.stdout:3/725: link d5/d1c/d24/d98/dc0/lbc d5/d1c/d24/d98/dc0/le8 0 2024-05-09T06:30:34.542 INFO:tasks.workunit.client.1.smithi106.stdout:3/726: chown d5/d1c/d24/l36 2 1 2024-05-09T06:30:34.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/333: dwrite db/d10/d3c/f62 [0,4194304] 0 2024-05-09T06:30:34.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/334: fsync db/fc 0 2024-05-09T06:30:34.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/335: dread - db/d10/d3f/d44/d46/f4d zero size 2024-05-09T06:30:34.544 INFO:tasks.workunit.client.0.smithi046.stdout:4/198: dread d7/df/d10/d2f/f3b [0,4194304] 0 2024-05-09T06:30:34.546 INFO:tasks.workunit.client.1.smithi106.stdout:4/788: unlink d7/d39/d47/d66/l8a 0 2024-05-09T06:30:34.548 INFO:tasks.workunit.client.0.smithi046.stdout:7/125: truncate d3/d7/dd/f15 2552690 0 2024-05-09T06:30:34.553 INFO:tasks.workunit.client.1.smithi106.stdout:1/901: dread - d4/d76/d13/dbb/fa8 zero size 2024-05-09T06:30:34.553 INFO:tasks.workunit.client.1.smithi106.stdout:1/902: chown d4/d76/d65 4511 1 2024-05-09T06:30:34.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/336: mknod db/d10/d30/d53/c75 0 2024-05-09T06:30:34.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/337: chown db/d10/d3c/f6d 774 1 2024-05-09T06:30:34.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/338: write db/d10/d57/d5d/f61 [4392573,4609] 0 2024-05-09T06:30:34.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/339: write db/d10/d3f/d44/f68 [7692459,127046] 0 2024-05-09T06:30:34.558 INFO:tasks.workunit.client.0.smithi046.stdout:4/199: unlink d7/df/l16 0 2024-05-09T06:30:34.558 INFO:tasks.workunit.client.0.smithi046.stdout:4/200: chown d7/f1a 29 1 2024-05-09T06:30:34.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/126: symlink d3/d7/dd/l2b 0 2024-05-09T06:30:34.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/340: mkdir db/d10/d76 0 2024-05-09T06:30:34.566 INFO:tasks.workunit.client.1.smithi106.stdout:2/990: creat d2/d5/db/d1d/d23/d63/f14f x:0 0 0 2024-05-09T06:30:34.566 INFO:tasks.workunit.client.1.smithi106.stdout:2/991: write d2/d7/d89/d104/d12b/f144 [210398,110710] 0 2024-05-09T06:30:34.567 INFO:tasks.workunit.client.0.smithi046.stdout:4/201: rmdir d7/d3f 0 2024-05-09T06:30:34.568 INFO:tasks.workunit.client.0.smithi046.stdout:1/126: rmdir d7/d10 39 2024-05-09T06:30:34.570 INFO:tasks.workunit.client.0.smithi046.stdout:7/127: creat d3/d7/d28/f2c x:0 0 0 2024-05-09T06:30:34.573 INFO:tasks.workunit.client.1.smithi106.stdout:6/869: mkdir d0/d17/d34/d4e/d98/da9/db1/d125 0 2024-05-09T06:30:34.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/202: rmdir d7/df/d10/d2f/d30 39 2024-05-09T06:30:34.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/203: creat d7/f4b x:0 0 0 2024-05-09T06:30:34.577 INFO:tasks.workunit.client.1.smithi106.stdout:3/727: mknod d5/d85/dc3/d65/ce9 0 2024-05-09T06:30:34.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/127: sync 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/70: sync 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/71: chown d4/d5/l14 144672 1 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/72: getdents d4/d5/d15 0 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/143: sync 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:0/271: sync 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/144: chown da/dc/l18 231107860 1 2024-05-09T06:30:34.580 INFO:tasks.workunit.client.0.smithi046.stdout:0/272: stat d11/d4f/d5b 0 2024-05-09T06:30:34.585 INFO:tasks.workunit.client.1.smithi106.stdout:4/789: rmdir d7/d28/d2a/d80/dcf 39 2024-05-09T06:30:34.585 INFO:tasks.workunit.client.1.smithi106.stdout:4/790: write d7/d39/d35/f76 [4952054,53445] 0 2024-05-09T06:30:34.586 INFO:tasks.workunit.client.0.smithi046.stdout:3/73: dread d4/d5/f9 [0,4194304] 0 2024-05-09T06:30:34.588 INFO:tasks.workunit.client.1.smithi106.stdout:1/903: creat d4/dbd/de6/f142 x:0 0 0 2024-05-09T06:30:34.589 INFO:tasks.workunit.client.0.smithi046.stdout:9/115: sync 2024-05-09T06:30:34.591 INFO:tasks.workunit.client.1.smithi106.stdout:2/992: unlink d2/d5/db/d15/dd6/deb/c129 0 2024-05-09T06:30:34.592 INFO:tasks.workunit.client.0.smithi046.stdout:4/204: mknod d7/df/d3a/d45/c4c 0 2024-05-09T06:30:34.594 INFO:tasks.workunit.client.1.smithi106.stdout:6/870: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/c126 0 2024-05-09T06:30:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/127: rename d7/d10/f1f to d7/f20 0 2024-05-09T06:30:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/128: rename d7/d10 to d7/d10/d21 22 2024-05-09T06:30:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:9/116: dread d2/d6/d7/fd [0,4194304] 0 2024-05-09T06:30:34.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/117: chown d2/d6/c16 2371089 1 2024-05-09T06:30:34.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/118: write d2/d6/d7/fd [541098,34095] 0 2024-05-09T06:30:34.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/145: symlink da/de/d14/l2b 0 2024-05-09T06:30:34.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/146: read f3 [753259,62513] 0 2024-05-09T06:30:34.601 INFO:tasks.workunit.client.1.smithi106.stdout:3/728: symlink d5/d4d/lea 0 2024-05-09T06:30:34.603 INFO:tasks.workunit.client.0.smithi046.stdout:8/128: dwrite d1/db/f16 [0,4194304] 0 2024-05-09T06:30:34.605 INFO:tasks.workunit.client.1.smithi106.stdout:1/904: rename d4/d76/d13/dbb/l13b to d4/d76/d65/d67/l143 0 2024-05-09T06:30:34.605 INFO:tasks.workunit.client.1.smithi106.stdout:1/905: truncate d4/d76/d13/dbb/fa8 643260 0 2024-05-09T06:30:34.606 INFO:tasks.workunit.client.1.smithi106.stdout:4/791: dwrite d7/fb2 [0,4194304] 0 2024-05-09T06:30:34.606 INFO:tasks.workunit.client.1.smithi106.stdout:4/792: write d7/d10/d1a/d5a/d1c/fb6 [700197,75796] 0 2024-05-09T06:30:34.606 INFO:tasks.workunit.client.1.smithi106.stdout:4/793: chown d7/d10/d1a/c30 921 1 2024-05-09T06:30:34.606 INFO:tasks.workunit.client.0.smithi046.stdout:3/74: mknod d4/d5/d15/c16 0 2024-05-09T06:30:34.607 INFO:tasks.workunit.client.1.smithi106.stdout:2/993: creat d2/d5/db/d1d/d23/d5e/de8/f150 x:0 0 0 2024-05-09T06:30:34.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/205: unlink d7/df/f32 0 2024-05-09T06:30:34.611 INFO:tasks.workunit.client.1.smithi106.stdout:6/871: rmdir d0/d17/d34/d4e/d98/da9/db1/d8/d27 39 2024-05-09T06:30:34.611 INFO:tasks.workunit.client.1.smithi106.stdout:6/872: dread - d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/d62/f112 zero size 2024-05-09T06:30:34.611 INFO:tasks.workunit.client.1.smithi106.stdout:6/873: readlink d0/d5c/l8d 0 2024-05-09T06:30:34.615 INFO:tasks.workunit.client.1.smithi106.stdout:3/729: unlink d5/d4d/d5f/fbe 0 2024-05-09T06:30:34.615 INFO:tasks.workunit.client.1.smithi106.stdout:4/794: dread d7/d10/f1d [0,4194304] 0 2024-05-09T06:30:34.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/206: read f1 [12139488,118405] 0 2024-05-09T06:30:34.620 INFO:tasks.workunit.client.0.smithi046.stdout:9/119: symlink d2/d6/d7/d1a/d27/d2a/l2b 0 2024-05-09T06:30:34.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/273: getdents d11/d18/d27/d28 0 2024-05-09T06:30:34.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/274: write d11/f14 [508287,115601] 0 2024-05-09T06:30:34.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/275: creat d11/d3f/f5d x:0 0 0 2024-05-09T06:30:34.627 INFO:tasks.workunit.client.0.smithi046.stdout:8/129: mknod d1/d7/d12/c22 0 2024-05-09T06:30:34.627 INFO:tasks.workunit.client.1.smithi106.stdout:6/874: dread d0/d17/d34/dd0/df2/fc1 [0,4194304] 0 2024-05-09T06:30:34.627 INFO:tasks.workunit.client.1.smithi106.stdout:6/875: write d0/d5c/fb9 [498597,3492] 0 2024-05-09T06:30:34.628 INFO:tasks.workunit.client.1.smithi106.stdout:2/994: mkdir d2/d5/db/d68/d151 0 2024-05-09T06:30:34.628 INFO:tasks.workunit.client.1.smithi106.stdout:1/906: dwrite f2 [0,4194304] 0 2024-05-09T06:30:34.628 INFO:tasks.workunit.client.1.smithi106.stdout:4/795: dwrite d7/d10/d1a/d5a/d7a/fb8 [0,4194304] 0 2024-05-09T06:30:34.628 INFO:tasks.workunit.client.1.smithi106.stdout:3/730: mknod d5/d1c/d24/d5b/ceb 0 2024-05-09T06:30:34.629 INFO:tasks.workunit.client.1.smithi106.stdout:3/731: dread - d5/d1c/d24/d80/fb0 zero size 2024-05-09T06:30:34.630 INFO:tasks.workunit.client.1.smithi106.stdout:6/876: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/c127 0 2024-05-09T06:30:34.633 INFO:tasks.workunit.client.1.smithi106.stdout:2/995: symlink d2/d5/db/d1d/d23/d5e/l152 0 2024-05-09T06:30:34.636 INFO:tasks.workunit.client.0.smithi046.stdout:5/108: truncate d0/fa 776777 0 2024-05-09T06:30:34.636 INFO:tasks.workunit.client.0.smithi046.stdout:5/109: stat d0/f19 0 2024-05-09T06:30:34.636 INFO:tasks.workunit.client.0.smithi046.stdout:5/110: creat d0/f2d x:0 0 0 2024-05-09T06:30:34.636 INFO:tasks.workunit.client.1.smithi106.stdout:4/796: dread d7/d39/d35/d7c/dd1/ff9 [0,4194304] 0 2024-05-09T06:30:34.636 INFO:tasks.workunit.client.1.smithi106.stdout:4/797: stat d7/d10/d1a/d5a/d1c/f2c 0 2024-05-09T06:30:34.641 INFO:tasks.workunit.client.0.smithi046.stdout:6/341: rmdir db/d10/d3f/d44/d46 39 2024-05-09T06:30:34.644 INFO:tasks.workunit.client.0.smithi046.stdout:1/129: symlink d7/l22 0 2024-05-09T06:30:34.648 INFO:tasks.workunit.client.0.smithi046.stdout:9/120: getdents d2/dc 0 2024-05-09T06:30:34.649 INFO:tasks.workunit.client.1.smithi106.stdout:7/825: sync 2024-05-09T06:30:34.649 INFO:tasks.workunit.client.1.smithi106.stdout:1/907: rmdir d4/d76/d65/d8d 39 2024-05-09T06:30:34.650 INFO:tasks.workunit.client.1.smithi106.stdout:1/908: write d4/dbd/de6/f142 [567925,63694] 0 2024-05-09T06:30:34.650 INFO:tasks.workunit.client.1.smithi106.stdout:1/909: dread d4/d5b/d75/fb0 [0,4194304] 0 2024-05-09T06:30:34.653 INFO:tasks.workunit.client.0.smithi046.stdout:0/276: mknod d11/d18/d1c/d56/c5e 0 2024-05-09T06:30:34.655 INFO:tasks.workunit.client.1.smithi106.stdout:4/798: dwrite d7/d10/f8f [0,4194304] 0 2024-05-09T06:30:34.655 INFO:tasks.workunit.client.1.smithi106.stdout:4/799: chown d7/d10/d1a/d5a/d1c/da7/fdf 225737 1 2024-05-09T06:30:34.656 INFO:tasks.workunit.client.1.smithi106.stdout:3/732: mknod d5/d85/dc3/d65/ddc/cec 0 2024-05-09T06:30:34.658 INFO:tasks.workunit.client.1.smithi106.stdout:6/877: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/d47/c128 0 2024-05-09T06:30:34.660 INFO:tasks.workunit.client.1.smithi106.stdout:2/996: creat d2/d5/db/d15/d41/df8/f153 x:0 0 0 2024-05-09T06:30:34.661 INFO:tasks.workunit.client.0.smithi046.stdout:3/75: rename d4/d5/c12 to d4/c17 0 2024-05-09T06:30:34.663 INFO:tasks.workunit.client.0.smithi046.stdout:6/342: creat db/d10/d30/f77 x:0 0 0 2024-05-09T06:30:34.665 INFO:tasks.workunit.client.1.smithi106.stdout:7/826: creat d0/dc/d45/da6/f104 x:0 0 0 2024-05-09T06:30:34.665 INFO:tasks.workunit.client.0.smithi046.stdout:9/121: mkdir d2/d26/d2c 0 2024-05-09T06:30:34.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/122: chown d2/d6/d7/l17 37200 1 2024-05-09T06:30:34.667 INFO:tasks.workunit.client.1.smithi106.stdout:1/910: symlink d4/d76/d65/d67/l144 0 2024-05-09T06:30:34.672 INFO:tasks.workunit.client.1.smithi106.stdout:4/800: unlink d7/d10/d1a/d5a/f86 0 2024-05-09T06:30:34.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/130: rename d7/f17 to d7/d10/f23 0 2024-05-09T06:30:34.674 INFO:tasks.workunit.client.0.smithi046.stdout:1/131: chown d7/c15 2 1 2024-05-09T06:30:34.674 INFO:tasks.workunit.client.1.smithi106.stdout:3/733: mknod d5/d1c/d24/d5b/ced 0 2024-05-09T06:30:34.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/76: creat d4/d5/d15/f18 x:0 0 0 2024-05-09T06:30:34.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/77: creat d4/d5/d15/f19 x:0 0 0 2024-05-09T06:30:34.677 INFO:tasks.workunit.client.1.smithi106.stdout:6/878: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/f129 x:0 0 0 2024-05-09T06:30:34.677 INFO:tasks.workunit.client.1.smithi106.stdout:6/879: getdents d0/d66/d7e/d9f 0 2024-05-09T06:30:34.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/123: link d2/d6/c16 d2/d6/d7/d1e/c2d 0 2024-05-09T06:30:34.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/124: write d2/d6/d7/ff [382288,57099] 0 2024-05-09T06:30:34.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/125: truncate d2/d6/d7/f1b 532271 0 2024-05-09T06:30:34.681 INFO:tasks.workunit.client.1.smithi106.stdout:0/875: sync 2024-05-09T06:30:34.681 INFO:tasks.workunit.client.1.smithi106.stdout:0/876: chown d1/d11/d7f/f10b 769726 1 2024-05-09T06:30:34.681 INFO:tasks.workunit.client.1.smithi106.stdout:2/997: mknod d2/d7/c154 0 2024-05-09T06:30:34.685 INFO:tasks.workunit.client.1.smithi106.stdout:7/827: rename d0/dc/d1a/d36/d30/d44/d6a/d72/dc4/fcb to d0/dc/d1a/d36/d30/d44/d6a/f105 0 2024-05-09T06:30:34.685 INFO:tasks.workunit.client.1.smithi106.stdout:7/828: truncate d0/f5b 4440201 0 2024-05-09T06:30:34.685 INFO:tasks.workunit.client.1.smithi106.stdout:5/892: sync 2024-05-09T06:30:34.687 INFO:tasks.workunit.client.1.smithi106.stdout:4/801: mkdir d7/d10/d1a/d5a/d1c/d107 0 2024-05-09T06:30:34.688 INFO:tasks.workunit.client.1.smithi106.stdout:3/734: symlink d5/d1c/d24/d98/lee 0 2024-05-09T06:30:34.689 INFO:tasks.workunit.client.0.smithi046.stdout:0/277: rmdir d11/d18/d27 39 2024-05-09T06:30:34.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/128: write d3/d7/f9 [657949,23601] 0 2024-05-09T06:30:34.691 INFO:tasks.workunit.client.1.smithi106.stdout:9/873: truncate d4/d54/d91/dbf/ff3 1076539 0 2024-05-09T06:30:34.692 INFO:tasks.workunit.client.1.smithi106.stdout:9/874: chown d4/d54/d69/d99/d2a/d42/f57 6386 1 2024-05-09T06:30:34.693 INFO:tasks.workunit.client.0.smithi046.stdout:1/132: creat d7/d10/f24 x:0 0 0 2024-05-09T06:30:34.696 INFO:tasks.workunit.client.1.smithi106.stdout:2/998: link d2/d5/db/l57 d2/d5/db/d1d/d23/d63/d7a/l155 0 2024-05-09T06:30:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/78: creat d4/d5/f1a x:0 0 0 2024-05-09T06:30:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/79: dread - d4/f11 zero size 2024-05-09T06:30:34.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/80: creat d4/d5/d15/f1b x:0 0 0 2024-05-09T06:30:34.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/343: rmdir db/d10/d3f/d4f 39 2024-05-09T06:30:34.703 INFO:tasks.workunit.client.0.smithi046.stdout:6/344: dread - db/d10/d3f/d4f/f63 zero size 2024-05-09T06:30:34.705 INFO:tasks.workunit.client.1.smithi106.stdout:1/911: rename d4/d76/c2e to d4/d76/d1d/d118/c145 0 2024-05-09T06:30:34.709 INFO:tasks.workunit.client.1.smithi106.stdout:7/829: mkdir d0/dc/d45/da6/dc5/d106 0 2024-05-09T06:30:34.709 INFO:tasks.workunit.client.1.smithi106.stdout:7/830: dread - d0/dc/d1a/d36/d30/d44/d6a/f105 zero size 2024-05-09T06:30:34.710 INFO:tasks.workunit.client.1.smithi106.stdout:3/735: dwrite d5/d3f/f9f [0,4194304] 0 2024-05-09T06:30:34.710 INFO:tasks.workunit.client.1.smithi106.stdout:3/736: creat d5/d1c/d24/d52/fef x:0 0 0 2024-05-09T06:30:34.711 INFO:tasks.workunit.client.0.smithi046.stdout:9/126: rename d2/d6/d7/f8 to d2/d6/d7/d1a/f2e 0 2024-05-09T06:30:34.716 INFO:tasks.workunit.client.1.smithi106.stdout:5/893: truncate d8/f12 4081281 0 2024-05-09T06:30:34.716 INFO:tasks.workunit.client.1.smithi106.stdout:5/894: dread - d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/fa4 zero size 2024-05-09T06:30:34.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/278: mkdir d11/d4f/d5b/d5f 0 2024-05-09T06:30:34.721 INFO:tasks.workunit.client.0.smithi046.stdout:6/345: dwrite db/d10/d19/f1b [0,4194304] 0 2024-05-09T06:30:34.721 INFO:tasks.workunit.client.0.smithi046.stdout:6/346: readlink db/d10/l2e 0 2024-05-09T06:30:34.721 INFO:tasks.workunit.client.0.smithi046.stdout:6/347: dread - db/d10/d3f/d4f/f63 zero size 2024-05-09T06:30:34.726 INFO:tasks.workunit.client.1.smithi106.stdout:5/895: dread d8/d5a/d60/d7e/dae/dd9/def/faf [0,4194304] 0 2024-05-09T06:30:34.729 INFO:tasks.workunit.client.1.smithi106.stdout:3/737: dwrite d5/d1c/d24/d98/dc0/f7e [0,4194304] 0 2024-05-09T06:30:34.731 INFO:tasks.workunit.client.0.smithi046.stdout:7/129: rename d3/f5 to d3/d7/f2d 0 2024-05-09T06:30:34.734 INFO:tasks.workunit.client.0.smithi046.stdout:0/279: mknod d11/d18/d27/d28/d36/d5a/c60 0 2024-05-09T06:30:34.734 INFO:tasks.workunit.client.0.smithi046.stdout:0/280: chown d11/d18/d1c/d56/c5e 947 1 2024-05-09T06:30:34.735 INFO:tasks.workunit.client.0.smithi046.stdout:9/127: dwrite f0 [0,4194304] 0 2024-05-09T06:30:34.735 INFO:tasks.workunit.client.0.smithi046.stdout:9/128: readlink d2/d6/d7/l18 0 2024-05-09T06:30:34.737 INFO:tasks.workunit.client.0.smithi046.stdout:1/133: rename d7/f1b to d7/f25 0 2024-05-09T06:30:34.740 INFO:tasks.workunit.client.1.smithi106.stdout:1/912: dwrite d4/d76/d13/d60/d9c/feb [0,4194304] 0 2024-05-09T06:30:34.745 INFO:tasks.workunit.client.0.smithi046.stdout:6/348: rename db/d10/d57/d5d/l6e to db/d10/d3f/d44/d5e/l78 0 2024-05-09T06:30:34.746 INFO:tasks.workunit.client.0.smithi046.stdout:0/281: getdents d11/d18/d27/d28/d36 0 2024-05-09T06:30:34.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/130: write d3/d7/f2d [7807154,77452] 0 2024-05-09T06:30:34.748 INFO:tasks.workunit.client.1.smithi106.stdout:2/999: symlink d2/d5/d9c/dd3/l156 0 2024-05-09T06:30:34.749 INFO:tasks.workunit.client.1.smithi106.stdout:3/738: dwrite d5/d85/dc3/f23 [0,4194304] 0 2024-05-09T06:30:34.749 INFO:tasks.workunit.client.0.smithi046.stdout:9/129: symlink d2/d6/d7/d1e/l2f 0 2024-05-09T06:30:34.749 INFO:tasks.workunit.client.0.smithi046.stdout:9/130: chown d2/d6/d7/f1d 72 1 2024-05-09T06:30:34.751 INFO:tasks.workunit.client.1.smithi106.stdout:1/913: write d4/dbd/de6/f12c [2495353,89083] 0 2024-05-09T06:30:34.753 INFO:tasks.workunit.client.1.smithi106.stdout:7/831: symlink d0/dc/d1a/d36/d1e/l107 0 2024-05-09T06:30:34.754 INFO:tasks.workunit.client.1.smithi106.stdout:7/832: readlink d0/lb4 0 2024-05-09T06:30:34.754 INFO:tasks.workunit.client.1.smithi106.stdout:7/833: stat d0/dc/d1a/d36/d30/d44/d58/d65/d84/d87/dce 0 2024-05-09T06:30:34.756 INFO:tasks.workunit.client.0.smithi046.stdout:6/349: creat db/d10/d3f/d44/d46/d70/f79 x:0 0 0 2024-05-09T06:30:34.758 INFO:tasks.workunit.client.0.smithi046.stdout:7/131: creat d3/d7/d28/d29/f2e x:0 0 0 2024-05-09T06:30:34.758 INFO:tasks.workunit.client.0.smithi046.stdout:7/132: rename d3 to d3/d7/dd/d2f 22 2024-05-09T06:30:34.758 INFO:tasks.workunit.client.0.smithi046.stdout:7/133: chown d3/d7/dd/f23 6685 1 2024-05-09T06:30:34.761 INFO:tasks.workunit.client.1.smithi106.stdout:4/802: mkdir d7/d39/d8c/da1/d108 0 2024-05-09T06:30:34.761 INFO:tasks.workunit.client.1.smithi106.stdout:4/803: chown d7/d39/d35/d6f/d9d/cc6 209774 1 2024-05-09T06:30:34.761 INFO:tasks.workunit.client.1.smithi106.stdout:4/804: dread - d7/d39/d35/d6f/d9c/fbc zero size 2024-05-09T06:30:34.761 INFO:tasks.workunit.client.0.smithi046.stdout:4/207: truncate f4 242007 0 2024-05-09T06:30:34.764 INFO:tasks.workunit.client.1.smithi106.stdout:5/896: link d8/d5a/l97 d8/d45/d4c/l113 0 2024-05-09T06:30:34.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/350: mknod db/d10/d19/c7a 0 2024-05-09T06:30:34.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/134: rmdir d3 39 2024-05-09T06:30:34.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/135: stat d3/d7/c26 0 2024-05-09T06:30:34.769 INFO:tasks.workunit.client.0.smithi046.stdout:7/136: fdatasync d3/f8 0 2024-05-09T06:30:34.769 INFO:tasks.workunit.client.0.smithi046.stdout:7/137: creat d3/d7/d28/d29/f30 x:0 0 0 2024-05-09T06:30:34.772 INFO:tasks.workunit.client.1.smithi106.stdout:3/739: getdents d5/d8f 0 2024-05-09T06:30:34.772 INFO:tasks.workunit.client.1.smithi106.stdout:3/740: fdatasync d5/d1c/d24/d98/dc0/fa2 0 2024-05-09T06:30:34.772 INFO:tasks.workunit.client.1.smithi106.stdout:4/805: dread d7/d39/d47/d66/f87 [0,4194304] 0 2024-05-09T06:30:34.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/351: mknod db/d10/d19/d66/c7b 0 2024-05-09T06:30:34.775 INFO:tasks.workunit.client.1.smithi106.stdout:5/897: write d8/d45/f70 [3358162,13738] 0 2024-05-09T06:30:34.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/130: truncate d1/db/dd/d14/f19 3223690 0 2024-05-09T06:30:34.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/131: creat d1/d7/f23 x:0 0 0 2024-05-09T06:30:34.778 INFO:tasks.workunit.client.0.smithi046.stdout:7/138: symlink d3/d7/l31 0 2024-05-09T06:30:34.778 INFO:tasks.workunit.client.0.smithi046.stdout:7/139: readlink d3/l1a 0 2024-05-09T06:30:34.781 INFO:tasks.workunit.client.0.smithi046.stdout:6/352: write db/d10/f16 [2757122,28533] 0 2024-05-09T06:30:34.781 INFO:tasks.workunit.client.0.smithi046.stdout:6/353: readlink db/d10/d3f/d44/d46/l59 0 2024-05-09T06:30:34.782 INFO:tasks.workunit.client.1.smithi106.stdout:3/741: dread d5/d1c/d24/d52/f71 [0,4194304] 0 2024-05-09T06:30:34.782 INFO:tasks.workunit.client.1.smithi106.stdout:3/742: truncate d5/d1c/d24/d5b/da4/fb3 413693 0 2024-05-09T06:30:34.782 INFO:tasks.workunit.client.1.smithi106.stdout:3/743: truncate d5/d4d/d72/fba 931415 0 2024-05-09T06:30:34.783 INFO:tasks.workunit.client.0.smithi046.stdout:0/282: dwrite d11/d18/d27/d28/f2e [4194304,4194304] 0 2024-05-09T06:30:34.784 INFO:tasks.workunit.client.0.smithi046.stdout:0/283: dread - d11/f22 zero size 2024-05-09T06:30:34.784 INFO:tasks.workunit.client.1.smithi106.stdout:1/914: dwrite d4/d76/d13/d60/fac [0,4194304] 0 2024-05-09T06:30:34.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/131: dwrite d2/d6/d7/ff [0,4194304] 0 2024-05-09T06:30:34.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/132: write d2/d6/f25 [215903,51637] 0 2024-05-09T06:30:34.786 INFO:tasks.workunit.client.1.smithi106.stdout:6/880: rmdir d0/d17/d34 39 2024-05-09T06:30:34.790 INFO:tasks.workunit.client.0.smithi046.stdout:8/132: creat d1/db/dd/d11/f24 x:0 0 0 2024-05-09T06:30:34.791 INFO:tasks.workunit.client.1.smithi106.stdout:5/898: symlink d8/d5a/d60/l114 0 2024-05-09T06:30:34.792 INFO:tasks.workunit.client.1.smithi106.stdout:5/899: dread - d8/d33/f96 zero size 2024-05-09T06:30:34.792 INFO:tasks.workunit.client.1.smithi106.stdout:5/900: readlink d8/d5a/d60/d7e/dae/ld7 0 2024-05-09T06:30:34.793 INFO:tasks.workunit.client.0.smithi046.stdout:8/133: dread d1/db/dd/d10/f15 [0,4194304] 0 2024-05-09T06:30:34.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/140: creat d3/d7/f32 x:0 0 0 2024-05-09T06:30:34.797 INFO:tasks.workunit.client.1.smithi106.stdout:3/744: unlink d5/d1c/f76 0 2024-05-09T06:30:34.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/354: unlink db/d10/d19/c7a 0 2024-05-09T06:30:34.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/355: dread - db/d10/d30/f52 zero size 2024-05-09T06:30:34.800 INFO:tasks.workunit.client.1.smithi106.stdout:8/815: sync 2024-05-09T06:30:34.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/134: rmdir d7/d10 39 2024-05-09T06:30:34.803 INFO:tasks.workunit.client.0.smithi046.stdout:7/141: write d3/f4 [4223438,69899] 0 2024-05-09T06:30:34.804 INFO:tasks.workunit.client.1.smithi106.stdout:1/915: dwrite d4/d76/d13/f82 [0,4194304] 0 2024-05-09T06:30:34.804 INFO:tasks.workunit.client.1.smithi106.stdout:6/881: dwrite d0/d17/d34/d95/ff3 [0,4194304] 0 2024-05-09T06:30:34.804 INFO:tasks.workunit.client.1.smithi106.stdout:6/882: write d0/d17/d34/d4e/d98/fdf [736210,85] 0 2024-05-09T06:30:34.805 INFO:tasks.workunit.client.0.smithi046.stdout:3/81: fsync d4/d5/d15/f19 0 2024-05-09T06:30:34.805 INFO:tasks.workunit.client.0.smithi046.stdout:3/82: read - d4/d5/f1a zero size 2024-05-09T06:30:34.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/83: fsync d4/d5/f1a 0 2024-05-09T06:30:34.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/84: write d4/d5/d15/f1b [939392,96839] 0 2024-05-09T06:30:34.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/85: creat d4/d5/f1c x:0 0 0 2024-05-09T06:30:34.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/86: stat d4/d5/d15 0 2024-05-09T06:30:34.808 INFO:tasks.workunit.client.0.smithi046.stdout:3/87: write d4/d5/f9 [2268778,76871] 0 2024-05-09T06:30:34.808 INFO:tasks.workunit.client.0.smithi046.stdout:3/88: write d4/d5/f1a [968118,14358] 0 2024-05-09T06:30:34.813 INFO:tasks.workunit.client.1.smithi106.stdout:1/916: read d4/d76/d13/f1b [888494,71008] 0 2024-05-09T06:30:34.813 INFO:tasks.workunit.client.1.smithi106.stdout:1/917: chown d4/d76/d65/d8d/dad/c11f 41676926 1 2024-05-09T06:30:34.813 INFO:tasks.workunit.client.1.smithi106.stdout:1/918: write d4/d76/d65/fa0 [81398,38945] 0 2024-05-09T06:30:34.813 INFO:tasks.workunit.client.1.smithi106.stdout:1/919: write d4/d76/d65/d8d/dad/ffe [3584447,28950] 0 2024-05-09T06:30:34.813 INFO:tasks.workunit.client.1.smithi106.stdout:1/920: write d4/d5b/d75/fb9 [1676205,118763] 0 2024-05-09T06:30:34.815 INFO:tasks.workunit.client.0.smithi046.stdout:6/356: mkdir db/d10/d3f/d44/d7c 0 2024-05-09T06:30:34.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/142: link d3/d7/d28/f2a d3/d7/d28/f33 0 2024-05-09T06:30:34.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/208: rmdir d7/df/d10/d2f/d47 0 2024-05-09T06:30:34.822 INFO:tasks.workunit.client.0.smithi046.stdout:4/209: write d7/f9 [2188932,39100] 0 2024-05-09T06:30:34.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/89: creat d4/f1d x:0 0 0 2024-05-09T06:30:34.828 INFO:tasks.workunit.client.0.smithi046.stdout:3/90: dread - d4/f11 zero size 2024-05-09T06:30:34.830 INFO:tasks.workunit.client.0.smithi046.stdout:6/357: rename db/d10/d3f/c58 to db/d10/d6b/c7d 0 2024-05-09T06:30:34.837 INFO:tasks.workunit.client.0.smithi046.stdout:6/358: truncate db/fd 8007649 0 2024-05-09T06:30:34.840 INFO:tasks.workunit.client.0.smithi046.stdout:6/359: creat db/d10/d57/d5d/f7e x:0 0 0 2024-05-09T06:30:34.840 INFO:tasks.workunit.client.0.smithi046.stdout:6/360: chown db/d10/d3f/d44/f48 24218087 1 2024-05-09T06:30:34.840 INFO:tasks.workunit.client.1.smithi106.stdout:0/877: sync 2024-05-09T06:30:34.845 INFO:tasks.workunit.client.1.smithi106.stdout:5/901: mkdir d8/d5a/d60/df6/d101/d115 0 2024-05-09T06:30:34.845 INFO:tasks.workunit.client.1.smithi106.stdout:5/902: chown d8/d5a/d60/da8/daa/fb0 429964 1 2024-05-09T06:30:34.846 INFO:tasks.workunit.client.1.smithi106.stdout:3/745: symlink d5/d1c/d24/d98/dc0/d32/d96/lf0 0 2024-05-09T06:30:34.846 INFO:tasks.workunit.client.1.smithi106.stdout:3/746: readlink d5/d85/dc3/d26/l20 0 2024-05-09T06:30:34.852 INFO:tasks.workunit.client.1.smithi106.stdout:5/903: write d8/d33/d74/fb6 [1261045,73271] 0 2024-05-09T06:30:34.855 INFO:tasks.workunit.client.1.smithi106.stdout:6/883: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d9c/c12a 0 2024-05-09T06:30:34.857 INFO:tasks.workunit.client.0.smithi046.stdout:3/91: write d4/d5/d15/f1b [356894,24922] 0 2024-05-09T06:30:34.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/92: chown d4/d5/f1a 28710792 1 2024-05-09T06:30:34.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/143: dwrite d3/d7/f32 [0,4194304] 0 2024-05-09T06:30:34.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/144: readlink d3/l17 0 2024-05-09T06:30:34.860 INFO:tasks.workunit.client.1.smithi106.stdout:1/921: symlink d4/dbd/l146 0 2024-05-09T06:30:34.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/361: dwrite db/d10/d3f/f56 [0,4194304] 0 2024-05-09T06:30:34.863 INFO:tasks.workunit.client.1.smithi106.stdout:0/878: link d1/d11/lb7 d1/d11/d23/d13/d8a/dc1/l12d 0 2024-05-09T06:30:34.863 INFO:tasks.workunit.client.1.smithi106.stdout:0/879: fdatasync d1/d11/d23/d13/d58/f71 0 2024-05-09T06:30:34.863 INFO:tasks.workunit.client.1.smithi106.stdout:0/880: truncate d1/da1/dd8/fdc 761883 0 2024-05-09T06:30:34.865 INFO:tasks.workunit.client.1.smithi106.stdout:7/834: rename d0/dc to d0/da5/d108 0 2024-05-09T06:30:34.866 INFO:tasks.workunit.client.0.smithi046.stdout:3/93: mknod d4/d5/d15/c1e 0 2024-05-09T06:30:34.866 INFO:tasks.workunit.client.0.smithi046.stdout:3/94: chown d4/d5/f9 7897012 1 2024-05-09T06:30:34.866 INFO:tasks.workunit.client.0.smithi046.stdout:3/95: read d4/d5/d15/f1b [276123,57712] 0 2024-05-09T06:30:34.870 INFO:tasks.workunit.client.0.smithi046.stdout:8/134: dread d1/db/f16 [0,4194304] 0 2024-05-09T06:30:34.874 INFO:tasks.workunit.client.1.smithi106.stdout:7/835: write d0/fa [1674658,31723] 0 2024-05-09T06:30:34.874 INFO:tasks.workunit.client.0.smithi046.stdout:8/135: dread d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/136: chown d1/db/dd/d14/f19 224928 1 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/137: chown d1/l6 8324065 1 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.1.smithi106.stdout:5/904: creat d8/d5a/d60/d7e/dae/dd9/f116 x:0 0 0 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.1.smithi106.stdout:5/905: write d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/fab [1225338,63914] 0 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.1.smithi106.stdout:5/906: chown d8/d33/d74/c7d 123750 1 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.1.smithi106.stdout:5/907: truncate d8/d5a/d60/d7e/dae/dd9/def/d99/df0/ffe 493575 0 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.1.smithi106.stdout:5/908: write d8/d5a/d60/d7e/fce [746056,67298] 0 2024-05-09T06:30:34.875 INFO:tasks.workunit.client.1.smithi106.stdout:5/909: write d8/d5a/d60/d7e/dae/dd9/def/f10f [594899,72782] 0 2024-05-09T06:30:34.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/884: link d0/d17/d34/d4e/d98/da9/db1/d8/c1a d0/d17/d34/d4e/d98/da9/db1/d8/c12b 0 2024-05-09T06:30:34.880 INFO:tasks.workunit.client.1.smithi106.stdout:0/881: dwrite d1/d11/d23/d13/d2c/d6d/dce/ffb [0,4194304] 0 2024-05-09T06:30:34.880 INFO:tasks.workunit.client.1.smithi106.stdout:0/882: fdatasync d1/da1/d83/f89 0 2024-05-09T06:30:34.881 INFO:tasks.workunit.client.1.smithi106.stdout:1/922: truncate d4/d37/f93 1312254 0 2024-05-09T06:30:34.882 INFO:tasks.workunit.client.0.smithi046.stdout:3/96: dwrite d4/d5/d15/f18 [0,4194304] 0 2024-05-09T06:30:34.882 INFO:tasks.workunit.client.0.smithi046.stdout:3/97: chown d4/d5/d15/f19 1010230 1 2024-05-09T06:30:34.882 INFO:tasks.workunit.client.0.smithi046.stdout:3/98: truncate d4/d5/d15/f19 664500 0 2024-05-09T06:30:34.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/362: rename db/d10/d3f/d44/f68 to db/d10/d3f/d44/f7f 0 2024-05-09T06:30:34.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/363: truncate db/d10/d3f/f67 496543 0 2024-05-09T06:30:34.892 INFO:tasks.workunit.client.1.smithi106.stdout:3/747: link d5/d4d/d5f/l75 d5/lf1 0 2024-05-09T06:30:34.893 INFO:tasks.workunit.client.1.smithi106.stdout:3/748: read d5/d1c/d24/d5b/f95 [158797,129282] 0 2024-05-09T06:30:34.895 INFO:tasks.workunit.client.1.smithi106.stdout:5/910: mknod d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/d100/c117 0 2024-05-09T06:30:34.897 INFO:tasks.workunit.client.1.smithi106.stdout:1/923: dwrite d4/d76/fb8 [0,4194304] 0 2024-05-09T06:30:34.897 INFO:tasks.workunit.client.1.smithi106.stdout:6/885: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/f3c [0,4194304] 0 2024-05-09T06:30:34.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/99: link d4/l10 d4/d5/l1f 0 2024-05-09T06:30:34.900 INFO:tasks.workunit.client.0.smithi046.stdout:6/364: creat db/d10/d3f/d44/d74/f80 x:0 0 0 2024-05-09T06:30:34.901 INFO:tasks.workunit.client.1.smithi106.stdout:0/883: rmdir d1/d11/d23/d13/d58/da8/dd6/dfc/d122 0 2024-05-09T06:30:34.903 INFO:tasks.workunit.client.0.smithi046.stdout:8/138: rmdir d1/d7 39 2024-05-09T06:30:34.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/145: write d3/d7/f32 [4979066,109605] 0 2024-05-09T06:30:34.905 INFO:tasks.workunit.client.0.smithi046.stdout:7/146: write d3/f1b [170812,104916] 0 2024-05-09T06:30:34.907 INFO:tasks.workunit.client.0.smithi046.stdout:8/139: dread d1/db/f16 [0,4194304] 0 2024-05-09T06:30:34.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/365: unlink db/c11 0 2024-05-09T06:30:34.909 INFO:tasks.workunit.client.1.smithi106.stdout:6/886: dread d0/d17/d34/fbf [0,4194304] 0 2024-05-09T06:30:34.911 INFO:tasks.workunit.client.1.smithi106.stdout:9/875: sync 2024-05-09T06:30:34.911 INFO:tasks.workunit.client.1.smithi106.stdout:9/876: read - d4/d54/d91/dbf/fdd zero size 2024-05-09T06:30:34.911 INFO:tasks.workunit.client.1.smithi106.stdout:9/877: readlink d4/d54/d69/d99/d2a/d42/d6c/l80 0 2024-05-09T06:30:34.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/147: dread d3/d7/dd/fe [0,4194304] 0 2024-05-09T06:30:34.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/148: creat d3/d7/dd/f34 x:0 0 0 2024-05-09T06:30:34.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/149: fdatasync d3/f12 0 2024-05-09T06:30:34.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/150: truncate d3/f1e 739163 0 2024-05-09T06:30:34.913 INFO:tasks.workunit.client.0.smithi046.stdout:3/100: mkdir d4/d20 0 2024-05-09T06:30:34.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/140: dread d1/d7/d12/f20 [4194304,4194304] 0 2024-05-09T06:30:34.917 INFO:tasks.workunit.client.1.smithi106.stdout:3/749: mknod d5/d1c/d24/cf2 0 2024-05-09T06:30:34.917 INFO:tasks.workunit.client.1.smithi106.stdout:3/750: write d5/d1c/d24/d5b/da4/fb3 [677336,18838] 0 2024-05-09T06:30:34.921 INFO:tasks.workunit.client.1.smithi106.stdout:5/911: getdents d8/d5a 0 2024-05-09T06:30:34.921 INFO:tasks.workunit.client.1.smithi106.stdout:5/912: chown d8/d33/d74/fb6 670717 1 2024-05-09T06:30:34.921 INFO:tasks.workunit.client.1.smithi106.stdout:5/913: write d8/d5a/d60/d7e/dae/dd9/def/fca [435415,69863] 0 2024-05-09T06:30:34.922 INFO:tasks.workunit.client.0.smithi046.stdout:8/141: dread d1/db/f16 [0,4194304] 0 2024-05-09T06:30:34.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/101: mknod d4/d5/d15/c21 0 2024-05-09T06:30:34.926 INFO:tasks.workunit.client.0.smithi046.stdout:8/142: link d1/db/dd/d11/c18 d1/db/c25 0 2024-05-09T06:30:34.927 INFO:tasks.workunit.client.1.smithi106.stdout:0/884: mkdir d1/d12e 0 2024-05-09T06:30:34.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/102: symlink d4/d5/d15/l22 0 2024-05-09T06:30:34.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/103: readlink d4/d5/la 0 2024-05-09T06:30:34.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/104: chown d4/d5/d15/l22 9 1 2024-05-09T06:30:34.930 INFO:tasks.workunit.client.0.smithi046.stdout:3/105: dread - d4/f11 zero size 2024-05-09T06:30:34.930 INFO:tasks.workunit.client.0.smithi046.stdout:3/106: creat d4/d5/f23 x:0 0 0 2024-05-09T06:30:34.930 INFO:tasks.workunit.client.0.smithi046.stdout:8/143: write d1/db/dd/f13 [2335212,19143] 0 2024-05-09T06:30:34.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/366: dwrite f6 [0,4194304] 0 2024-05-09T06:30:34.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/367: write db/d10/d3c/f6d [989340,40805] 0 2024-05-09T06:30:34.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/151: dwrite d3/f8 [0,4194304] 0 2024-05-09T06:30:34.931 INFO:tasks.workunit.client.1.smithi106.stdout:6/887: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/dbb/f12c x:0 0 0 2024-05-09T06:30:34.931 INFO:tasks.workunit.client.1.smithi106.stdout:9/878: stat d4/d54/d69/d95/d23/d16/dd1/d47/ldf 0 2024-05-09T06:30:34.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/368: unlink db/d10/d30/c6c 0 2024-05-09T06:30:34.943 INFO:tasks.workunit.client.1.smithi106.stdout:3/751: unlink d5/d1c/d24/d80/fb0 0 2024-05-09T06:30:34.944 INFO:tasks.workunit.client.1.smithi106.stdout:3/752: fsync d5/d4d/d5f/fcb 0 2024-05-09T06:30:34.946 INFO:tasks.workunit.client.0.smithi046.stdout:7/152: unlink d3/f12 0 2024-05-09T06:30:34.950 INFO:tasks.workunit.client.1.smithi106.stdout:0/885: creat d1/d11/d23/d13/d58/da8/d124/f12f x:0 0 0 2024-05-09T06:30:34.950 INFO:tasks.workunit.client.1.smithi106.stdout:9/879: dwrite d4/d54/f5f [0,4194304] 0 2024-05-09T06:30:34.955 INFO:tasks.workunit.client.1.smithi106.stdout:6/888: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d50/d12d 0 2024-05-09T06:30:34.955 INFO:tasks.workunit.client.1.smithi106.stdout:6/889: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/fd4 [869520,109628] 0 2024-05-09T06:30:34.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/753: readlink d5/l18 0 2024-05-09T06:30:34.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/369: dwrite db/d10/d3c/f5b [0,4194304] 0 2024-05-09T06:30:34.961 INFO:tasks.workunit.client.1.smithi106.stdout:0/886: mknod d1/d11/d120/c130 0 2024-05-09T06:30:34.962 INFO:tasks.workunit.client.1.smithi106.stdout:0/887: write d1/d11/f3c [2497480,121313] 0 2024-05-09T06:30:34.963 INFO:tasks.workunit.client.1.smithi106.stdout:6/890: symlink d0/d17/d34/d4e/d98/da9/db1/d125/l12e 0 2024-05-09T06:30:34.965 INFO:tasks.workunit.client.1.smithi106.stdout:3/754: link d5/d85/dc3/f19 d5/d1c/d24/d5b/da4/ff3 0 2024-05-09T06:30:34.966 INFO:tasks.workunit.client.1.smithi106.stdout:9/880: dwrite d4/d54/d91/dc7/da2/fda [0,4194304] 0 2024-05-09T06:30:34.969 INFO:tasks.workunit.client.1.smithi106.stdout:0/888: mknod d1/d11/d23/d13/d2c/d57/de1/c131 0 2024-05-09T06:30:34.969 INFO:tasks.workunit.client.1.smithi106.stdout:0/889: chown d1/da1/d83/c97 288 1 2024-05-09T06:30:34.971 INFO:tasks.workunit.client.1.smithi106.stdout:6/891: dread d0/d17/d34/fbe [0,4194304] 0 2024-05-09T06:30:34.974 INFO:tasks.workunit.client.1.smithi106.stdout:9/881: read d4/d54/d69/d95/f2e [3367700,78810] 0 2024-05-09T06:30:34.974 INFO:tasks.workunit.client.1.smithi106.stdout:9/882: stat d4/d54/d69/d99/ce8 0 2024-05-09T06:30:34.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/883: dread d4/d54/d69/d99/f65 [0,4194304] 0 2024-05-09T06:30:34.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/884: write d4/d54/db3/fc5 [2898951,12415] 0 2024-05-09T06:30:34.982 INFO:tasks.workunit.client.1.smithi106.stdout:9/885: chown d4/d54/d69/d95/d23/d78/d8f/l96 8 1 2024-05-09T06:30:34.984 INFO:tasks.workunit.client.1.smithi106.stdout:3/755: dwrite d5/d85/dc3/fa0 [0,4194304] 0 2024-05-09T06:30:34.984 INFO:tasks.workunit.client.1.smithi106.stdout:3/756: write d5/d4d/d5f/fcb [762186,92197] 0 2024-05-09T06:30:34.987 INFO:tasks.workunit.client.1.smithi106.stdout:0/890: getdents d1/d11/d120 0 2024-05-09T06:30:34.988 INFO:tasks.workunit.client.1.smithi106.stdout:0/891: stat d1/d11/d23/d13/d2c/d3d/l11e 0 2024-05-09T06:30:34.988 INFO:tasks.workunit.client.1.smithi106.stdout:6/892: dwrite d0/d17/f63 [0,4194304] 0 2024-05-09T06:30:34.988 INFO:tasks.workunit.client.1.smithi106.stdout:6/893: creat d0/d66/f12f x:0 0 0 2024-05-09T06:30:34.989 INFO:tasks.workunit.client.1.smithi106.stdout:6/894: chown d0/d17/d34/d4e/d98/da9/db1/d40 20099316 1 2024-05-09T06:30:34.989 INFO:tasks.workunit.client.1.smithi106.stdout:6/895: write d0/d17/d34/f6d [4217466,101429] 0 2024-05-09T06:30:34.991 INFO:tasks.workunit.client.0.smithi046.stdout:7/153: getdents d3/d7/d28 0 2024-05-09T06:30:34.996 INFO:tasks.workunit.client.1.smithi106.stdout:9/886: dwrite d4/d54/d69/d95/d23/d16/f24 [0,4194304] 0 2024-05-09T06:30:34.997 INFO:tasks.workunit.client.0.smithi046.stdout:6/370: rmdir db/d10/d3f/d44/d7c 0 2024-05-09T06:30:34.997 INFO:tasks.workunit.client.0.smithi046.stdout:6/371: chown db/c4b 34 1 2024-05-09T06:30:34.997 INFO:tasks.workunit.client.0.smithi046.stdout:6/372: write db/d10/d3f/d44/f7f [9122172,101090] 0 2024-05-09T06:30:34.997 INFO:tasks.workunit.client.1.smithi106.stdout:9/887: dread d4/d54/d91/dc7/d58/ffa [0,4194304] 0 2024-05-09T06:30:34.998 INFO:tasks.workunit.client.1.smithi106.stdout:3/757: unlink d5/d1c/d24/f28 0 2024-05-09T06:30:35.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/107: rename d4/d5/d15 to d4/d20/d24 0 2024-05-09T06:30:35.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/108: fsync d4/f11 0 2024-05-09T06:30:35.000 INFO:tasks.workunit.client.1.smithi106.stdout:3/758: write d5/d85/dc3/f74 [109901,102099] 0 2024-05-09T06:30:35.002 INFO:tasks.workunit.client.1.smithi106.stdout:0/892: link d1/d11/d23/d22/fcf d1/d11/d23/d13/d58/da8/dd6/dfc/f132 0 2024-05-09T06:30:35.002 INFO:tasks.workunit.client.1.smithi106.stdout:0/893: fsync d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/f109 0 2024-05-09T06:30:35.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/154: mkdir d3/d7/d28/d29/d35 0 2024-05-09T06:30:35.006 INFO:tasks.workunit.client.1.smithi106.stdout:0/894: dread d1/d11/d23/d13/d2c/d6d/f6f [0,4194304] 0 2024-05-09T06:30:35.006 INFO:tasks.workunit.client.0.smithi046.stdout:6/373: symlink db/d10/d3c/l81 0 2024-05-09T06:30:35.007 INFO:tasks.workunit.client.1.smithi106.stdout:8/816: sync 2024-05-09T06:30:35.007 INFO:tasks.workunit.client.1.smithi106.stdout:4/806: sync 2024-05-09T06:30:35.007 INFO:tasks.workunit.client.1.smithi106.stdout:4/807: chown d7/d10 13 1 2024-05-09T06:30:35.007 INFO:tasks.workunit.client.1.smithi106.stdout:8/817: chown d3/d5/d35/d61/d6c 433761621 1 2024-05-09T06:30:35.007 INFO:tasks.workunit.client.1.smithi106.stdout:8/818: truncate d3/d5/d35/d4e/d32/f97 4833509 0 2024-05-09T06:30:35.007 INFO:tasks.workunit.client.1.smithi106.stdout:9/888: dwrite d4/d54/d91/f93 [0,4194304] 0 2024-05-09T06:30:35.009 INFO:tasks.workunit.client.0.smithi046.stdout:8/144: rename d1/d7/d12/f20 to d1/f26 0 2024-05-09T06:30:35.012 INFO:tasks.workunit.client.0.smithi046.stdout:7/155: creat d3/d7/d28/f36 x:0 0 0 2024-05-09T06:30:35.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/374: symlink db/d10/l82 0 2024-05-09T06:30:35.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/109: rename d4/d20/d24/f19 to d4/d20/f25 0 2024-05-09T06:30:35.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/110: chown d4/d20/f25 49743983 1 2024-05-09T06:30:35.026 INFO:tasks.workunit.client.1.smithi106.stdout:9/889: dread d4/d54/d69/d95/f15 [0,4194304] 0 2024-05-09T06:30:35.026 INFO:tasks.workunit.client.1.smithi106.stdout:9/890: stat d4/d54/d69 0 2024-05-09T06:30:35.026 INFO:tasks.workunit.client.1.smithi106.stdout:9/891: chown d4/d54/d69/d99/d2a/d42/d6c/dd0/lef 1461039 1 2024-05-09T06:30:35.029 INFO:tasks.workunit.client.1.smithi106.stdout:6/896: symlink d0/d17/d34/d72/l130 0 2024-05-09T06:30:35.036 INFO:tasks.workunit.client.1.smithi106.stdout:1/924: sync 2024-05-09T06:30:35.036 INFO:tasks.workunit.client.1.smithi106.stdout:7/836: sync 2024-05-09T06:30:35.036 INFO:tasks.workunit.client.1.smithi106.stdout:7/837: stat d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/d87/dce 0 2024-05-09T06:30:35.040 INFO:tasks.workunit.client.1.smithi106.stdout:3/759: mknod d5/d85/dc3/cf4 0 2024-05-09T06:30:35.040 INFO:tasks.workunit.client.1.smithi106.stdout:3/760: chown d5/d3f/l67 1964 1 2024-05-09T06:30:35.040 INFO:tasks.workunit.client.1.smithi106.stdout:3/761: write d5/d1c/d24/d5b/f95 [1676828,97744] 0 2024-05-09T06:30:35.042 INFO:tasks.workunit.client.1.smithi106.stdout:4/808: link d7/d10/d1a/d5a/d7a/d7f/dc8/l102 d7/d10/l109 0 2024-05-09T06:30:35.042 INFO:tasks.workunit.client.1.smithi106.stdout:6/897: write d0/d17/d34/d4e/fda [2637191,24814] 0 2024-05-09T06:30:35.043 INFO:tasks.workunit.client.0.smithi046.stdout:7/156: rmdir d3 39 2024-05-09T06:30:35.043 INFO:tasks.workunit.client.0.smithi046.stdout:7/157: fdatasync d3/d7/f9 0 2024-05-09T06:30:35.044 INFO:tasks.workunit.client.1.smithi106.stdout:0/895: dwrite d1/d11/d23/d13/d58/f98 [4194304,4194304] 0 2024-05-09T06:30:35.044 INFO:tasks.workunit.client.1.smithi106.stdout:0/896: fdatasync d1/d11/d23/d13/d2c/d3d/dbe/f111 0 2024-05-09T06:30:35.044 INFO:tasks.workunit.client.1.smithi106.stdout:0/897: readlink d1/d11/lca 0 2024-05-09T06:30:35.044 INFO:tasks.workunit.client.1.smithi106.stdout:8/819: dwrite d3/d5/d7/d15/d47/f62 [0,4194304] 0 2024-05-09T06:30:35.047 INFO:tasks.workunit.client.1.smithi106.stdout:5/914: sync 2024-05-09T06:30:35.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/375: rmdir db/d10/d30 39 2024-05-09T06:30:35.051 INFO:tasks.workunit.client.0.smithi046.stdout:3/111: getdents d4 0 2024-05-09T06:30:35.054 INFO:tasks.workunit.client.1.smithi106.stdout:7/838: rmdir d0/da5/d108/d1a/d36/d30/d44/d80/dfd 0 2024-05-09T06:30:35.054 INFO:tasks.workunit.client.1.smithi106.stdout:7/839: chown d0/da5/d108/d1a/d36/d30/d44/d6a/d72 16 1 2024-05-09T06:30:35.054 INFO:tasks.workunit.client.1.smithi106.stdout:7/840: truncate d0/da5/d108/d1a/d36/d30/f91 5237282 0 2024-05-09T06:30:35.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/158: rmdir d3/d7/dd 39 2024-05-09T06:30:35.055 INFO:tasks.workunit.client.1.smithi106.stdout:8/820: write d3/d5/d35/d61/d6c/d83/dcc/de9/fef [861237,43336] 0 2024-05-09T06:30:35.055 INFO:tasks.workunit.client.1.smithi106.stdout:9/892: dwrite d4/f25 [0,4194304] 0 2024-05-09T06:30:35.057 INFO:tasks.workunit.client.0.smithi046.stdout:3/112: rename d4/d5/f1a to d4/d20/f26 0 2024-05-09T06:30:35.057 INFO:tasks.workunit.client.0.smithi046.stdout:3/113: truncate d4/d20/d24/f1b 1087916 0 2024-05-09T06:30:35.057 INFO:tasks.workunit.client.0.smithi046.stdout:3/114: stat d4/cb 0 2024-05-09T06:30:35.058 INFO:tasks.workunit.client.0.smithi046.stdout:7/159: creat d3/d7/dd/f37 x:0 0 0 2024-05-09T06:30:35.058 INFO:tasks.workunit.client.0.smithi046.stdout:7/160: write d3/d7/d28/f2c [309571,34081] 0 2024-05-09T06:30:35.059 INFO:tasks.workunit.client.0.smithi046.stdout:7/161: dread - d3/d7/d28/f2a zero size 2024-05-09T06:30:35.059 INFO:tasks.workunit.client.1.smithi106.stdout:4/809: symlink d7/d39/d8c/l10a 0 2024-05-09T06:30:35.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/115: mknod d4/c27 0 2024-05-09T06:30:35.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/162: link d3/l1a d3/d7/d28/d29/d35/l38 0 2024-05-09T06:30:35.062 INFO:tasks.workunit.client.1.smithi106.stdout:0/898: mknod d1/d11/d23/da6/c133 0 2024-05-09T06:30:35.062 INFO:tasks.workunit.client.0.smithi046.stdout:3/116: mknod d4/d20/c28 0 2024-05-09T06:30:35.063 INFO:tasks.workunit.client.0.smithi046.stdout:3/117: read - d4/d5/f23 zero size 2024-05-09T06:30:35.064 INFO:tasks.workunit.client.1.smithi106.stdout:5/915: mkdir d8/d45/d4c/d85/d118 0 2024-05-09T06:30:35.064 INFO:tasks.workunit.client.1.smithi106.stdout:5/916: fsync d8/d5a/d60/da8/fcf 0 2024-05-09T06:30:35.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/163: truncate d3/f6 116021 0 2024-05-09T06:30:35.066 INFO:tasks.workunit.client.1.smithi106.stdout:7/841: mknod d0/da5/c109 0 2024-05-09T06:30:35.066 INFO:tasks.workunit.client.1.smithi106.stdout:7/842: write d0/da5/d108/d1a/d36/d30/fb8 [354001,20708] 0 2024-05-09T06:30:35.066 INFO:tasks.workunit.client.1.smithi106.stdout:7/843: chown d0/da5/d108/d1a/d36/d30/d44/d58 6902 1 2024-05-09T06:30:35.066 INFO:tasks.workunit.client.1.smithi106.stdout:7/844: write d0/da5/d108/d1a/d36/d30/d44/fd5 [390667,117946] 0 2024-05-09T06:30:35.066 INFO:tasks.workunit.client.1.smithi106.stdout:7/845: chown d0/da5/d108/d45/da6/faa 0 1 2024-05-09T06:30:35.067 INFO:tasks.workunit.client.1.smithi106.stdout:9/893: symlink d4/d54/d69/d95/d23/d78/d8f/l113 0 2024-05-09T06:30:35.067 INFO:tasks.workunit.client.1.smithi106.stdout:9/894: truncate d4/d54/d69/d99/d2a/d42/d6c/d6d/fd6 4797908 0 2024-05-09T06:30:35.068 INFO:tasks.workunit.client.1.smithi106.stdout:8/821: write d3/d5/d13/d3a/f90 [351260,108230] 0 2024-05-09T06:30:35.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/164: link d3/lc d3/d7/d28/d29/l39 0 2024-05-09T06:30:35.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/165: readlink d3/lc 0 2024-05-09T06:30:35.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/166: readlink d3/d7/dd/l14 0 2024-05-09T06:30:35.069 INFO:tasks.workunit.client.1.smithi106.stdout:3/762: getdents d5/d1c/d24/d52 0 2024-05-09T06:30:35.069 INFO:tasks.workunit.client.1.smithi106.stdout:3/763: readlink d5/d1c/d24/d89/d8e/lbd 0 2024-05-09T06:30:35.069 INFO:tasks.workunit.client.1.smithi106.stdout:3/764: stat d5/d85/dc3/d65/d81/f94 0 2024-05-09T06:30:35.069 INFO:tasks.workunit.client.1.smithi106.stdout:3/765: chown d5/d85/fd2 3694601 1 2024-05-09T06:30:35.069 INFO:tasks.workunit.client.1.smithi106.stdout:3/766: chown d5/d4d/c93 59898 1 2024-05-09T06:30:35.070 INFO:tasks.workunit.client.1.smithi106.stdout:4/810: creat d7/d10/d1a/d5a/d46/f10b x:0 0 0 2024-05-09T06:30:35.071 INFO:tasks.workunit.client.1.smithi106.stdout:0/899: getdents d1/d11/d23/d13/d2c/d6d 0 2024-05-09T06:30:35.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/167: dread d3/f1b [0,4194304] 0 2024-05-09T06:30:35.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/168: stat d3/d7/dd/f34 0 2024-05-09T06:30:35.071 INFO:tasks.workunit.client.1.smithi106.stdout:6/898: dwrite d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f104 [0,4194304] 0 2024-05-09T06:30:35.072 INFO:tasks.workunit.client.1.smithi106.stdout:5/917: creat d8/d5a/d60/d7e/dae/dd9/def/f119 x:0 0 0 2024-05-09T06:30:35.072 INFO:tasks.workunit.client.1.smithi106.stdout:7/846: stat d0/da5/d108/d1a/d36/d30/d44/d58/d65/ld1 0 2024-05-09T06:30:35.073 INFO:tasks.workunit.client.1.smithi106.stdout:1/925: dwrite d4/d5b/fe8 [0,4194304] 0 2024-05-09T06:30:35.073 INFO:tasks.workunit.client.0.smithi046.stdout:6/376: dwrite db/f42 [0,4194304] 0 2024-05-09T06:30:35.074 INFO:tasks.workunit.client.1.smithi106.stdout:9/895: creat d4/d54/d69/d95/d23/d16/dd1/d47/f114 x:0 0 0 2024-05-09T06:30:35.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/169: read d3/d7/dd/f15 [2477960,106076] 0 2024-05-09T06:30:35.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/170: chown d3/f6 895492987 1 2024-05-09T06:30:35.077 INFO:tasks.workunit.client.0.smithi046.stdout:6/377: rename db/d10/d19/f1b to db/d10/d19/f83 0 2024-05-09T06:30:35.080 INFO:tasks.workunit.client.1.smithi106.stdout:8/822: unlink d3/d5/d35/d4e/l57 0 2024-05-09T06:30:35.080 INFO:tasks.workunit.client.1.smithi106.stdout:8/823: chown d3/d5/d7/d15/d47/l74 3149 1 2024-05-09T06:30:35.080 INFO:tasks.workunit.client.1.smithi106.stdout:8/824: write d3/d5/d35/d61/d6c/d83/fc9 [811955,7625] 0 2024-05-09T06:30:35.080 INFO:tasks.workunit.client.1.smithi106.stdout:8/825: write d3/d5/d7/fb5 [620609,12981] 0 2024-05-09T06:30:35.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/171: symlink d3/d7/d28/d29/l3a 0 2024-05-09T06:30:35.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/172: write d3/d7/d28/f24 [158228,37663] 0 2024-05-09T06:30:35.084 INFO:tasks.workunit.client.1.smithi106.stdout:0/900: dread d1/d11/d23/d22/f84 [0,4194304] 0 2024-05-09T06:30:35.084 INFO:tasks.workunit.client.1.smithi106.stdout:9/896: write d4/d54/d69/d95/d23/f21 [1956238,122617] 0 2024-05-09T06:30:35.084 INFO:tasks.workunit.client.1.smithi106.stdout:9/897: chown d4/d54/d69/d95/d23/d16/dd1/d47/f9d 1 1 2024-05-09T06:30:35.085 INFO:tasks.workunit.client.0.smithi046.stdout:6/378: rmdir db/d10/d6b 39 2024-05-09T06:30:35.086 INFO:tasks.workunit.client.1.smithi106.stdout:6/899: write d0/d17/d34/d4e/d98/da9/db1/d8/d50/f81 [3780350,11272] 0 2024-05-09T06:30:35.086 INFO:tasks.workunit.client.1.smithi106.stdout:6/900: read d0/d17/d34/d4e/d98/da9/db1/d8/f6e [1010462,11314] 0 2024-05-09T06:30:35.086 INFO:tasks.workunit.client.1.smithi106.stdout:4/811: rmdir d7/d10/d1a 39 2024-05-09T06:30:35.086 INFO:tasks.workunit.client.1.smithi106.stdout:4/812: chown d7/d10/d1a/d5a/c9e 300226 1 2024-05-09T06:30:35.088 INFO:tasks.workunit.client.0.smithi046.stdout:7/173: truncate d3/f4 8138049 0 2024-05-09T06:30:35.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/379: creat db/d10/d3f/d44/d5e/f84 x:0 0 0 2024-05-09T06:30:35.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/380: fdatasync db/d10/d3f/d44/d74/f80 0 2024-05-09T06:30:35.091 INFO:tasks.workunit.client.0.smithi046.stdout:7/174: mkdir d3/d7/d28/d29/d3b 0 2024-05-09T06:30:35.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/175: truncate d3/d7/d28/f2a 655505 0 2024-05-09T06:30:35.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/176: write d3/d7/d28/f24 [1172649,81847] 0 2024-05-09T06:30:35.094 INFO:tasks.workunit.client.1.smithi106.stdout:7/847: unlink d0/da5/d108/d45/da6/fe0 0 2024-05-09T06:30:35.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/118: dwrite d4/f11 [0,4194304] 0 2024-05-09T06:30:35.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/119: write d4/d5/f1c [242340,124949] 0 2024-05-09T06:30:35.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/120: chown d4/d20/d24/f18 4227 1 2024-05-09T06:30:35.095 INFO:tasks.workunit.client.0.smithi046.stdout:6/381: symlink db/d10/d30/l85 0 2024-05-09T06:30:35.095 INFO:tasks.workunit.client.1.smithi106.stdout:5/918: dwrite d8/d5a/d60/da8/daa/fb0 [0,4194304] 0 2024-05-09T06:30:35.095 INFO:tasks.workunit.client.1.smithi106.stdout:4/813: read d7/d10/d1a/d5a/d1c/fcc [1442741,63177] 0 2024-05-09T06:30:35.097 INFO:tasks.workunit.client.0.smithi046.stdout:7/177: creat d3/d7/d28/d29/f3c x:0 0 0 2024-05-09T06:30:35.100 INFO:tasks.workunit.client.1.smithi106.stdout:1/926: rmdir d4/d133 0 2024-05-09T06:30:35.104 INFO:tasks.workunit.client.0.smithi046.stdout:6/382: rename db/d10/d3f/f33 to db/d10/d3f/d44/d5e/f86 0 2024-05-09T06:30:35.105 INFO:tasks.workunit.client.1.smithi106.stdout:3/767: getdents d5/d1c/d24/d98/dc0 0 2024-05-09T06:30:35.107 INFO:tasks.workunit.client.1.smithi106.stdout:0/901: creat d1/d11/d23/d13/d2c/f134 x:0 0 0 2024-05-09T06:30:35.108 INFO:tasks.workunit.client.0.smithi046.stdout:7/178: mkdir d3/d3d 0 2024-05-09T06:30:35.109 INFO:tasks.workunit.client.1.smithi106.stdout:9/898: symlink d4/d54/d69/d95/d23/d16/dd1/d31/db0/l115 0 2024-05-09T06:30:35.110 INFO:tasks.workunit.client.0.smithi046.stdout:7/179: write d3/d7/d28/f24 [306494,58351] 0 2024-05-09T06:30:35.113 INFO:tasks.workunit.client.1.smithi106.stdout:6/901: creat d0/d17/d34/d4e/d98/f131 x:0 0 0 2024-05-09T06:30:35.115 INFO:tasks.workunit.client.1.smithi106.stdout:7/848: creat d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/d87/dce/f10a x:0 0 0 2024-05-09T06:30:35.116 INFO:tasks.workunit.client.0.smithi046.stdout:7/180: mkdir d3/d7/dd/d3e 0 2024-05-09T06:30:35.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/181: creat d3/d7/d28/d29/d3b/f3f x:0 0 0 2024-05-09T06:30:35.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/182: write d3/d7/dd/f37 [243349,120933] 0 2024-05-09T06:30:35.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/383: dwrite db/d10/d3c/f5b [0,4194304] 0 2024-05-09T06:30:35.123 INFO:tasks.workunit.client.1.smithi106.stdout:5/919: rename d8/d33/d74/f84 to d8/d5a/d60/d7e/dae/dd9/f11a 0 2024-05-09T06:30:35.124 INFO:tasks.workunit.client.1.smithi106.stdout:4/814: truncate d7/d10/d1a/fa2 2183785 0 2024-05-09T06:30:35.124 INFO:tasks.workunit.client.1.smithi106.stdout:4/815: chown d7/d10/d1a/d5a/d1c/da7 23768470 1 2024-05-09T06:30:35.126 INFO:tasks.workunit.client.0.smithi046.stdout:7/183: rename d3/l17 to d3/d3d/l40 0 2024-05-09T06:30:35.127 INFO:tasks.workunit.client.1.smithi106.stdout:7/849: write d0/da5/d108/d1a/d36/f79 [1137782,3329] 0 2024-05-09T06:30:35.127 INFO:tasks.workunit.client.1.smithi106.stdout:1/927: symlink d4/d76/d1d/l147 0 2024-05-09T06:30:35.129 INFO:tasks.workunit.client.1.smithi106.stdout:8/826: rmdir d3/d5/d7/d15/d3e/d7d 39 2024-05-09T06:30:35.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/384: mkdir db/d10/d19/d66/d87 0 2024-05-09T06:30:35.131 INFO:tasks.workunit.client.1.smithi106.stdout:3/768: symlink d5/d4d/d7a/da9/da8/lf5 0 2024-05-09T06:30:35.133 INFO:tasks.workunit.client.1.smithi106.stdout:0/902: mknod d1/da1/dd8/c135 0 2024-05-09T06:30:35.134 INFO:tasks.workunit.client.0.smithi046.stdout:7/184: creat d3/d3d/f41 x:0 0 0 2024-05-09T06:30:35.136 INFO:tasks.workunit.client.1.smithi106.stdout:9/899: mknod d4/d54/d69/d95/d23/d16/dd1/c116 0 2024-05-09T06:30:35.137 INFO:tasks.workunit.client.1.smithi106.stdout:6/902: mknod d0/d17/d34/d4e/d98/da9/db1/d8/d9c/d11f/c132 0 2024-05-09T06:30:35.139 INFO:tasks.workunit.client.0.smithi046.stdout:7/185: rename d3/d7/d28/d29/l3a to d3/d7/l42 0 2024-05-09T06:30:35.144 INFO:tasks.workunit.client.1.smithi106.stdout:5/920: mknod d8/d45/d4c/d32/c11b 0 2024-05-09T06:30:35.145 INFO:tasks.workunit.client.1.smithi106.stdout:7/850: dwrite d0/ff2 [0,4194304] 0 2024-05-09T06:30:35.146 INFO:tasks.workunit.client.0.smithi046.stdout:6/385: dwrite db/d10/d19/f54 [0,4194304] 0 2024-05-09T06:30:35.147 INFO:tasks.workunit.client.0.smithi046.stdout:6/386: dread - db/d10/d3f/d44/d46/f64 zero size 2024-05-09T06:30:35.147 INFO:tasks.workunit.client.1.smithi106.stdout:4/816: mknod d7/d10/d1a/d5a/d46/c10c 0 2024-05-09T06:30:35.147 INFO:tasks.workunit.client.1.smithi106.stdout:4/817: fsync d7/d10/d1a/f85 0 2024-05-09T06:30:35.149 INFO:tasks.workunit.client.1.smithi106.stdout:1/928: link d4/d37/d3d/f96 d4/d76/d1d/d118/f148 0 2024-05-09T06:30:35.149 INFO:tasks.workunit.client.1.smithi106.stdout:1/929: read - d4/d76/d65/ff1 zero size 2024-05-09T06:30:35.153 INFO:tasks.workunit.client.1.smithi106.stdout:8/827: write d3/d5/d7/d15/fa7 [1197601,22089] 0 2024-05-09T06:30:35.153 INFO:tasks.workunit.client.1.smithi106.stdout:8/828: readlink d3/d5/d35/d61/lc1 0 2024-05-09T06:30:35.153 INFO:tasks.workunit.client.1.smithi106.stdout:8/829: readlink d3/d5/d35/d4e/d32/d92/le3 0 2024-05-09T06:30:35.155 INFO:tasks.workunit.client.1.smithi106.stdout:3/769: unlink d5/d1c/l37 0 2024-05-09T06:30:35.157 INFO:tasks.workunit.client.1.smithi106.stdout:0/903: creat d1/da1/f136 x:0 0 0 2024-05-09T06:30:35.157 INFO:tasks.workunit.client.1.smithi106.stdout:0/904: chown d1/d11/c44 1360985480 1 2024-05-09T06:30:35.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/387: write db/d10/d3c/f62 [2469530,122456] 0 2024-05-09T06:30:35.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/388: creat db/d10/d3f/d44/d5e/f88 x:0 0 0 2024-05-09T06:30:35.159 INFO:tasks.workunit.client.1.smithi106.stdout:9/900: mkdir d4/d54/d69/d99/d117 0 2024-05-09T06:30:35.159 INFO:tasks.workunit.client.1.smithi106.stdout:9/901: chown d4/d54/d69/d95/d23/f21 221491196 1 2024-05-09T06:30:35.160 INFO:tasks.workunit.client.1.smithi106.stdout:6/903: stat d0/d17/d34/d4e/d98/da9/db1/d8/l2f 0 2024-05-09T06:30:35.160 INFO:tasks.workunit.client.1.smithi106.stdout:6/904: write d0/d17/d34/d95/fa4 [2807456,18027] 0 2024-05-09T06:30:35.160 INFO:tasks.workunit.client.1.smithi106.stdout:6/905: write d0/d17/f29 [3191416,37353] 0 2024-05-09T06:30:35.161 INFO:tasks.workunit.client.1.smithi106.stdout:6/906: readlink d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/dad/le0 0 2024-05-09T06:30:35.161 INFO:tasks.workunit.client.1.smithi106.stdout:5/921: mkdir d8/d5a/d60/da8/daa/dd2/d11c 0 2024-05-09T06:30:35.167 INFO:tasks.workunit.client.1.smithi106.stdout:7/851: unlink d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/d86/ccc 0 2024-05-09T06:30:35.167 INFO:tasks.workunit.client.1.smithi106.stdout:7/852: creat d0/d53/d7a/f10b x:0 0 0 2024-05-09T06:30:35.167 INFO:tasks.workunit.client.1.smithi106.stdout:7/853: fdatasync d0/da5/d108/d1a/d36/d30/d44/d6a/d72/dc4/fc8 0 2024-05-09T06:30:35.167 INFO:tasks.workunit.client.1.smithi106.stdout:7/854: write d0/da5/d108/d1a/d36/d1e/f46 [530992,119579] 0 2024-05-09T06:30:35.168 INFO:tasks.workunit.client.0.smithi046.stdout:7/186: dwrite d3/d7/dd/f34 [0,4194304] 0 2024-05-09T06:30:35.170 INFO:tasks.workunit.client.1.smithi106.stdout:4/818: creat d7/d28/d2a/f10d x:0 0 0 2024-05-09T06:30:35.175 INFO:tasks.workunit.client.1.smithi106.stdout:8/830: rmdir d3/d5/d35/d61 39 2024-05-09T06:30:35.175 INFO:tasks.workunit.client.1.smithi106.stdout:8/831: chown d3/d5/d13/c3d 6038866 1 2024-05-09T06:30:35.175 INFO:tasks.workunit.client.1.smithi106.stdout:8/832: getdents d3/d5/d35/d61/dfc 0 2024-05-09T06:30:35.175 INFO:tasks.workunit.client.1.smithi106.stdout:8/833: dread - d3/d5/d35/d61/d6c/d83/dcc/de9/fd8 zero size 2024-05-09T06:30:35.175 INFO:tasks.workunit.client.1.smithi106.stdout:8/834: creat d3/d5/d35/d73/f10e x:0 0 0 2024-05-09T06:30:35.176 INFO:tasks.workunit.client.1.smithi106.stdout:3/770: creat d5/ff6 x:0 0 0 2024-05-09T06:30:35.178 INFO:tasks.workunit.client.1.smithi106.stdout:0/905: creat d1/d11/d23/d13/d2c/d6d/d70/f137 x:0 0 0 2024-05-09T06:30:35.181 INFO:tasks.workunit.client.1.smithi106.stdout:9/902: mkdir d4/d54/d69/d99/d2a/d42/dc8/de3/d118 0 2024-05-09T06:30:35.184 INFO:tasks.workunit.client.1.smithi106.stdout:8/835: read d3/d5/f5a [3850953,68982] 0 2024-05-09T06:30:35.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/187: dwrite d3/f1d [0,4194304] 0 2024-05-09T06:30:35.191 INFO:tasks.workunit.client.0.smithi046.stdout:6/389: dwrite db/d10/d3c/f62 [0,4194304] 0 2024-05-09T06:30:35.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/390: chown db/d10/d3f/f6f 13 1 2024-05-09T06:30:35.193 INFO:tasks.workunit.client.1.smithi106.stdout:9/903: dread d4/d54/d69/d99/d2a/f1e [0,4194304] 0 2024-05-09T06:30:35.195 INFO:tasks.workunit.client.1.smithi106.stdout:8/836: dread d3/d5/d7/d15/d3e/d7d/f84 [0,4194304] 0 2024-05-09T06:30:35.195 INFO:tasks.workunit.client.1.smithi106.stdout:8/837: write d3/d5/d35/d4e/fca [1280371,60110] 0 2024-05-09T06:30:35.197 INFO:tasks.workunit.client.1.smithi106.stdout:6/907: rmdir d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e 39 2024-05-09T06:30:35.199 INFO:tasks.workunit.client.1.smithi106.stdout:5/922: mknod d8/d45/d4c/c11d 0 2024-05-09T06:30:35.199 INFO:tasks.workunit.client.1.smithi106.stdout:5/923: fsync d8/d33/f4a 0 2024-05-09T06:30:35.201 INFO:tasks.workunit.client.0.smithi046.stdout:7/188: getdents d3/d7/d28 0 2024-05-09T06:30:35.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/391: mkdir db/d10/d3f/d4f/d89 0 2024-05-09T06:30:35.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/392: unlink db/d10/d30/l85 0 2024-05-09T06:30:35.208 INFO:tasks.workunit.client.0.smithi046.stdout:7/189: write d3/d7/fa [1391378,58891] 0 2024-05-09T06:30:35.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/393: mkdir db/d10/d3f/d4f/d8a 0 2024-05-09T06:30:35.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/190: creat d3/d7/d28/d29/d35/f43 x:0 0 0 2024-05-09T06:30:35.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/191: link d3/f1e d3/d7/dd/f44 0 2024-05-09T06:30:35.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/192: fdatasync d3/d7/d28/f33 0 2024-05-09T06:30:35.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/147: sync 2024-05-09T06:30:35.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/193: creat d3/d7/d28/d29/f45 x:0 0 0 2024-05-09T06:30:35.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/194: mknod d3/d7/d28/d29/d35/c46 0 2024-05-09T06:30:35.224 INFO:tasks.workunit.client.1.smithi106.stdout:7/855: creat d0/da5/d108/d1a/d36/f10c x:0 0 0 2024-05-09T06:30:35.225 INFO:tasks.workunit.client.0.smithi046.stdout:6/394: dwrite db/d10/d3c/f62 [0,4194304] 0 2024-05-09T06:30:35.226 INFO:tasks.workunit.client.1.smithi106.stdout:4/819: rename d7/l23 to d7/dcb/l10e 0 2024-05-09T06:30:35.228 INFO:tasks.workunit.client.0.smithi046.stdout:6/395: link db/d10/d3f/d44/d46/l59 db/d10/d30/d53/l8b 0 2024-05-09T06:30:35.229 INFO:tasks.workunit.client.1.smithi106.stdout:0/906: symlink d1/d11/d23/d13/d8a/l138 0 2024-05-09T06:30:35.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/148: write da/de/f10 [228556,84682] 0 2024-05-09T06:30:35.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/149: chown da/dc/l18 0 1 2024-05-09T06:30:35.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/150: write da/de/d14/f28 [445773,15071] 0 2024-05-09T06:30:35.231 INFO:tasks.workunit.client.0.smithi046.stdout:2/151: readlink da/dc/l12 0 2024-05-09T06:30:35.231 INFO:tasks.workunit.client.1.smithi106.stdout:9/904: symlink d4/d54/d69/d99/d2a/d42/d6c/l119 0 2024-05-09T06:30:35.231 INFO:tasks.workunit.client.1.smithi106.stdout:0/907: dread d1/d11/d23/f5f [0,4194304] 0 2024-05-09T06:30:35.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/396: creat db/d10/d30/d53/f8c x:0 0 0 2024-05-09T06:30:35.232 INFO:tasks.workunit.client.1.smithi106.stdout:8/838: creat d3/d5/d35/d61/dfc/f10f x:0 0 0 2024-05-09T06:30:35.235 INFO:tasks.workunit.client.0.smithi046.stdout:2/152: symlink da/de/d1c/l2c 0 2024-05-09T06:30:35.238 INFO:tasks.workunit.client.1.smithi106.stdout:5/924: getdents d8/d5a/d60/d7e/dae/dd9/def/d99 0 2024-05-09T06:30:35.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/195: dread d3/d7/f11 [0,4194304] 0 2024-05-09T06:30:35.239 INFO:tasks.workunit.client.0.smithi046.stdout:6/397: symlink db/d10/l8d 0 2024-05-09T06:30:35.239 INFO:tasks.workunit.client.1.smithi106.stdout:7/856: symlink d0/da5/d108/l10d 0 2024-05-09T06:30:35.240 INFO:tasks.workunit.client.0.smithi046.stdout:2/153: mkdir da/d2d 0 2024-05-09T06:30:35.246 INFO:tasks.workunit.client.0.smithi046.stdout:2/154: link da/dc/f13 da/db/f2e 0 2024-05-09T06:30:35.250 INFO:tasks.workunit.client.1.smithi106.stdout:3/771: rename d5/d3f/f9f to d5/d1c/d24/ff7 0 2024-05-09T06:30:35.250 INFO:tasks.workunit.client.0.smithi046.stdout:6/398: dread db/d10/d3c/f45 [0,4194304] 0 2024-05-09T06:30:35.254 INFO:tasks.workunit.client.1.smithi106.stdout:4/820: mkdir d7/d10/d10f 0 2024-05-09T06:30:35.257 INFO:tasks.workunit.client.1.smithi106.stdout:9/905: link d4/d54/db3/db6/f105 d4/d54/d69/d99/d2a/d42/d6c/dd0/f11a 0 2024-05-09T06:30:35.257 INFO:tasks.workunit.client.1.smithi106.stdout:4/821: dread d7/d10/d1a/d5a/f63 [0,4194304] 0 2024-05-09T06:30:35.257 INFO:tasks.workunit.client.1.smithi106.stdout:4/822: stat d7/d39/caf 0 2024-05-09T06:30:35.261 INFO:tasks.workunit.client.1.smithi106.stdout:0/908: creat d1/d11/d23/d13/d2c/d6d/dce/f139 x:0 0 0 2024-05-09T06:30:35.262 INFO:tasks.workunit.client.0.smithi046.stdout:7/196: dwrite d3/d7/d28/d29/f45 [0,4194304] 0 2024-05-09T06:30:35.262 INFO:tasks.workunit.client.0.smithi046.stdout:7/197: creat d3/d3d/f47 x:0 0 0 2024-05-09T06:30:35.262 INFO:tasks.workunit.client.0.smithi046.stdout:7/198: chown d3/d7/c26 752516 1 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/199: creat d3/d7/d28/d29/d35/f48 x:0 0 0 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/200: write d3/d7/fa [4107505,119142] 0 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/201: creat d3/d7/d28/d29/d3b/f49 x:0 0 0 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/202: read - d3/d7/d28/d29/f2e zero size 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/203: chown d3/d3d/l40 248076 1 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/204: creat d3/d7/d28/d29/d3b/f4a x:0 0 0 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/205: write d3/d7/f9 [917960,56742] 0 2024-05-09T06:30:35.263 INFO:tasks.workunit.client.1.smithi106.stdout:8/839: mkdir d3/d5/dbc/d110 0 2024-05-09T06:30:35.264 INFO:tasks.workunit.client.1.smithi106.stdout:8/840: read - d3/d5/d35/d61/d6c/d83/dcc/de9/fd4 zero size 2024-05-09T06:30:35.266 INFO:tasks.workunit.client.1.smithi106.stdout:6/908: write d0/d17/d34/fbe [243325,42072] 0 2024-05-09T06:30:35.267 INFO:tasks.workunit.client.1.smithi106.stdout:5/925: unlink d8/d45/d4c/d32/c44 0 2024-05-09T06:30:35.269 INFO:tasks.workunit.client.1.smithi106.stdout:3/772: dwrite d5/d4d/d72/f7b [0,4194304] 0 2024-05-09T06:30:35.271 INFO:tasks.workunit.client.1.smithi106.stdout:7/857: dwrite d0/da5/d108/f8b [0,4194304] 0 2024-05-09T06:30:35.275 INFO:tasks.workunit.client.1.smithi106.stdout:0/909: dread d1/f43 [0,4194304] 0 2024-05-09T06:30:35.290 INFO:tasks.workunit.client.1.smithi106.stdout:5/926: dwrite d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/f41 [0,4194304] 0 2024-05-09T06:30:35.290 INFO:tasks.workunit.client.1.smithi106.stdout:5/927: read d8/d5a/d60/da8/daa/fb2 [268224,27782] 0 2024-05-09T06:30:35.290 INFO:tasks.workunit.client.1.smithi106.stdout:5/928: fdatasync d8/d5a/d60/d7e/dae/dd9/def/faf 0 2024-05-09T06:30:35.297 INFO:tasks.workunit.client.1.smithi106.stdout:7/858: dwrite d0/da5/d108/d1a/d36/d1e/f46 [0,4194304] 0 2024-05-09T06:30:35.298 INFO:tasks.workunit.client.1.smithi106.stdout:3/773: dwrite d5/d1c/d24/ff7 [0,4194304] 0 2024-05-09T06:30:35.302 INFO:tasks.workunit.client.1.smithi106.stdout:5/929: write d8/fa [7933285,118678] 0 2024-05-09T06:30:35.307 INFO:tasks.workunit.client.1.smithi106.stdout:3/774: dread d5/d85/dc3/d26/f9e [0,4194304] 0 2024-05-09T06:30:35.321 INFO:tasks.workunit.client.1.smithi106.stdout:5/930: dwrite d8/d45/d4c/d85/fbf [0,4194304] 0 2024-05-09T06:30:35.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:35 smithi106 ceph-mon[34679]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 240 MiB/s rd, 312 MiB/s wr, 698 op/s 2024-05-09T06:30:35.324 INFO:tasks.workunit.client.1.smithi106.stdout:5/931: dread d8/f51 [0,4194304] 0 2024-05-09T06:30:35.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:35 smithi046 ceph-mon[26924]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 240 MiB/s rd, 312 MiB/s wr, 698 op/s 2024-05-09T06:30:35.345 INFO:tasks.workunit.client.1.smithi106.stdout:1/930: sync 2024-05-09T06:30:35.345 INFO:tasks.workunit.client.1.smithi106.stdout:1/931: chown d4/fdd 410 1 2024-05-09T06:30:35.348 INFO:tasks.workunit.client.1.smithi106.stdout:6/909: creat d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3e/f133 x:0 0 0 2024-05-09T06:30:35.348 INFO:tasks.workunit.client.1.smithi106.stdout:6/910: readlink d0/d66/l9e 0 2024-05-09T06:30:35.350 INFO:tasks.workunit.client.1.smithi106.stdout:1/932: dread d4/d76/d13/dbb/f87 [0,4194304] 0 2024-05-09T06:30:35.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/206: rename d3/l1a to d3/d7/d28/d29/d35/l4b 0 2024-05-09T06:30:35.357 INFO:tasks.workunit.client.1.smithi106.stdout:6/911: read d0/f8a [3598432,117124] 0 2024-05-09T06:30:35.359 INFO:tasks.workunit.client.1.smithi106.stdout:0/910: getdents d1/d11/d23/d13/d58/da8/dd6/dfc 0 2024-05-09T06:30:35.369 INFO:tasks.workunit.client.1.smithi106.stdout:0/911: write d1/d11/d23/d22/f99 [1918796,39988] 0 2024-05-09T06:30:35.371 INFO:tasks.workunit.client.1.smithi106.stdout:6/912: dwrite d0/fb5 [0,4194304] 0 2024-05-09T06:30:35.385 INFO:tasks.workunit.client.1.smithi106.stdout:0/912: dwrite d1/d11/d23/d13/d2c/d57/de1/feb [0,4194304] 0 2024-05-09T06:30:35.437 INFO:tasks.workunit.client.1.smithi106.stdout:7/859: mkdir d0/da5/d108/d45/da6/db2/d10e 0 2024-05-09T06:30:35.437 INFO:tasks.workunit.client.1.smithi106.stdout:7/860: stat d0/da5/d108/d1a/d36/l38 0 2024-05-09T06:30:35.456 INFO:tasks.workunit.client.1.smithi106.stdout:7/861: dwrite d0/da5/d108/d1a/d36/d30/d44/d6a/f7c [0,4194304] 0 2024-05-09T06:30:35.456 INFO:tasks.workunit.client.1.smithi106.stdout:7/862: chown d0/da5/d108/d1a/d36/d30/d44/fd8 30588527 1 2024-05-09T06:30:35.461 INFO:tasks.workunit.client.1.smithi106.stdout:3/775: truncate d5/d1c/d24/d5b/f66 1402929 0 2024-05-09T06:30:35.491 INFO:tasks.workunit.client.1.smithi106.stdout:1/933: symlink d4/d76/d65/d8d/db5/l149 0 2024-05-09T06:30:35.499 INFO:tasks.workunit.client.1.smithi106.stdout:6/913: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/de2/d134 0 2024-05-09T06:30:35.502 INFO:tasks.workunit.client.1.smithi106.stdout:0/913: mknod d1/d11/d7f/c13a 0 2024-05-09T06:30:35.504 INFO:tasks.workunit.client.1.smithi106.stdout:7/863: rmdir d0/da5/d108/d45/da6/db2/d10e 0 2024-05-09T06:30:35.504 INFO:tasks.workunit.client.1.smithi106.stdout:7/864: fsync d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/d86/fa3 0 2024-05-09T06:30:35.507 INFO:tasks.workunit.client.1.smithi106.stdout:1/934: mknod d4/d76/d13/d60/d9c/de4/c14a 0 2024-05-09T06:30:35.508 INFO:tasks.workunit.client.1.smithi106.stdout:6/914: mkdir d0/d17/d34/d4e/d98/da9/db1/d8/d9c/d11f/d135 0 2024-05-09T06:30:35.509 INFO:tasks.workunit.client.1.smithi106.stdout:0/914: creat d1/d11/d23/d13/d2c/d6d/d10a/f13b x:0 0 0 2024-05-09T06:30:35.512 INFO:tasks.workunit.client.1.smithi106.stdout:6/915: creat d0/d17/d34/d4e/d98/da9/db1/d8/d50/d8f/de2/f136 x:0 0 0 2024-05-09T06:30:35.514 INFO:tasks.workunit.client.1.smithi106.stdout:1/935: write d4/f12 [1487537,84026] 0 2024-05-09T06:30:35.514 INFO:tasks.workunit.client.1.smithi106.stdout:0/915: creat d1/d11/d23/d13/d2c/d3d/dbe/f13c x:0 0 0 2024-05-09T06:30:35.514 INFO:tasks.workunit.client.1.smithi106.stdout:0/916: write d1/d11/d23/d22/f10c [566601,75427] 0 2024-05-09T06:30:35.514 INFO:tasks.workunit.client.1.smithi106.stdout:0/917: fsync d1/d11/f3c 0 2024-05-09T06:30:35.515 INFO:tasks.workunit.client.1.smithi106.stdout:6/916: creat d0/d17/d34/d4e/deb/f137 x:0 0 0 2024-05-09T06:30:35.516 INFO:tasks.workunit.client.1.smithi106.stdout:1/936: write d4/f1a [506424,108893] 0 2024-05-09T06:30:35.518 INFO:tasks.workunit.client.1.smithi106.stdout:0/918: symlink d1/da1/dd8/l13d 0 2024-05-09T06:30:35.520 INFO:tasks.workunit.client.1.smithi106.stdout:6/917: link d0/d5c/la3 d0/d17/d34/d4e/d98/da9/db1/d40/l138 0 2024-05-09T06:30:35.522 INFO:tasks.workunit.client.1.smithi106.stdout:1/937: mkdir d4/d76/d65/d8d/db5/d10f/d139/d14b 0 2024-05-09T06:30:35.523 INFO:tasks.workunit.client.1.smithi106.stdout:0/919: creat d1/da1/d93/d114/f13e x:0 0 0 2024-05-09T06:30:35.524 INFO:tasks.workunit.client.1.smithi106.stdout:6/918: symlink d0/d17/d34/dd0/l139 0 2024-05-09T06:30:35.524 INFO:tasks.workunit.client.1.smithi106.stdout:6/919: fdatasync d0/d17/d34/d4e/d98/da9/db1/d8/d50/d88/ff1 0 2024-05-09T06:30:35.524 INFO:tasks.workunit.client.1.smithi106.stdout:0/920: stat d1/d11/d23/d13/d58/da8/dd6/d7e/l81 0 2024-05-09T06:30:35.527 INFO:tasks.workunit.client.1.smithi106.stdout:6/920: rename d0/d17/d34/d4e/d98/da9/db1/d8/d27/d3b/dad/ff6 to d0/d17/d34/d4e/d98/da9/db1/d40/f13a 0 2024-05-09T06:30:35.527 INFO:tasks.workunit.client.1.smithi106.stdout:6/921: chown d0/d17/d34/cb0 4 1 2024-05-09T06:30:35.543 INFO:tasks.workunit.client.1.smithi106.stdout:1/938: dwrite d4/d37/d3d/f69 [0,4194304] 0 2024-05-09T06:30:35.544 INFO:tasks.workunit.client.1.smithi106.stdout:0/921: dwrite d1/fd9 [0,4194304] 0 2024-05-09T06:30:35.552 INFO:tasks.workunit.client.1.smithi106.stdout:1/939: unlink d4/da7/fb1 0 2024-05-09T06:30:35.553 INFO:tasks.workunit.client.1.smithi106.stdout:0/922: dread d1/f7 [0,4194304] 0 2024-05-09T06:30:35.567 INFO:tasks.workunit.client.1.smithi106.stdout:0/923: dwrite d1/da1/d83/f89 [0,4194304] 0 2024-05-09T06:30:35.570 INFO:tasks.workunit.client.1.smithi106.stdout:0/924: creat d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/f13f x:0 0 0 2024-05-09T06:30:35.570 INFO:tasks.workunit.client.1.smithi106.stdout:0/925: write d1/d11/d23/d13/d2c/d57/de1/f127 [558474,33631] 0 2024-05-09T06:30:35.571 INFO:tasks.workunit.client.1.smithi106.stdout:0/926: unlink d1/d11/d23/d13/d8a/l9e 0 2024-05-09T06:30:35.571 INFO:tasks.workunit.client.1.smithi106.stdout:0/927: write d1/d11/d23/d22/f91 [940951,127527] 0 2024-05-09T06:30:35.573 INFO:tasks.workunit.client.1.smithi106.stdout:0/928: link d1/d11/d23/d13/d2c/d3d/l11e d1/da1/d93/l140 0 2024-05-09T06:30:35.573 INFO:tasks.workunit.client.1.smithi106.stdout:0/929: write d1/d11/d23/da6/fac [937199,120807] 0 2024-05-09T06:30:35.580 INFO:tasks.workunit.client.1.smithi106.stdout:0/930: link d1/d11/d23/d13/d2c/d6d/l115 d1/d11/d23/l141 0 2024-05-09T06:30:35.590 INFO:tasks.workunit.client.1.smithi106.stdout:5/932: mkdir d8/d5a/d60/d11e 0 2024-05-09T06:30:35.603 INFO:tasks.workunit.client.1.smithi106.stdout:0/931: dwrite d1/da1/fad [0,4194304] 0 2024-05-09T06:30:35.604 INFO:tasks.workunit.client.1.smithi106.stdout:0/932: dread - d1/d11/d23/d13/d2c/d3d/dbe/f111 zero size 2024-05-09T06:30:35.608 INFO:tasks.workunit.client.1.smithi106.stdout:0/933: symlink d1/d11/d120/l142 0 2024-05-09T06:30:35.608 INFO:tasks.workunit.client.1.smithi106.stdout:0/934: dread - d1/d11/d23/d13/d58/f8d zero size 2024-05-09T06:30:35.611 INFO:tasks.workunit.client.1.smithi106.stdout:5/933: dwrite d8/d45/d4c/f7b [0,4194304] 0 2024-05-09T06:30:35.613 INFO:tasks.workunit.client.1.smithi106.stdout:5/934: rmdir d8/d5a/d60/dd6 39 2024-05-09T06:30:35.616 INFO:tasks.workunit.client.1.smithi106.stdout:5/935: rmdir d8/d5a/d60/d7e/dae/dd9 39 2024-05-09T06:30:35.617 INFO:tasks.workunit.client.1.smithi106.stdout:5/936: fdatasync d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104/fe3 0 2024-05-09T06:30:35.625 INFO:tasks.workunit.client.1.smithi106.stdout:5/937: dread d8/f12 [0,4194304] 0 2024-05-09T06:30:35.626 INFO:tasks.workunit.client.1.smithi106.stdout:5/938: getdents d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104 0 2024-05-09T06:30:35.635 INFO:tasks.workunit.client.1.smithi106.stdout:5/939: read d8/d5a/f73 [962647,11522] 0 2024-05-09T06:30:35.636 INFO:tasks.workunit.client.1.smithi106.stdout:5/940: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/f11f x:0 0 0 2024-05-09T06:30:35.637 INFO:tasks.workunit.client.1.smithi106.stdout:5/941: creat d8/d5a/d60/f120 x:0 0 0 2024-05-09T06:30:35.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/207: mkdir d3/d7/d4c 0 2024-05-09T06:30:35.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/208: symlink d3/d7/d28/d29/l4d 0 2024-05-09T06:30:35.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/209: getdents d3/d7/dd 0 2024-05-09T06:30:35.653 INFO:tasks.workunit.client.1.smithi106.stdout:8/841: mkdir d3/d5/d111 0 2024-05-09T06:30:35.654 INFO:tasks.workunit.client.1.smithi106.stdout:7/865: creat d0/f10f x:0 0 0 2024-05-09T06:30:35.656 INFO:tasks.workunit.client.1.smithi106.stdout:8/842: truncate d3/d5/d7/d15/d47/f62 4164117 0 2024-05-09T06:30:35.656 INFO:tasks.workunit.client.1.smithi106.stdout:8/843: stat d3/d5/d35/d61/d6c/d83/dcc/de9 0 2024-05-09T06:30:35.656 INFO:tasks.workunit.client.1.smithi106.stdout:8/844: chown d3/d5/d7/d15/c24 28383 1 2024-05-09T06:30:35.656 INFO:tasks.workunit.client.1.smithi106.stdout:8/845: fsync d3/d5/d7/d15/df4/dfd/da9/dbd/fd1 0 2024-05-09T06:30:35.657 INFO:tasks.workunit.client.1.smithi106.stdout:7/866: mkdir d0/da5/d108/d1a/df6/d110 0 2024-05-09T06:30:35.658 INFO:tasks.workunit.client.1.smithi106.stdout:1/940: mkdir d4/d37/d14c 0 2024-05-09T06:30:35.658 INFO:tasks.workunit.client.1.smithi106.stdout:8/846: getdents d3/d5/d35/d61/d6c 0 2024-05-09T06:30:35.660 INFO:tasks.workunit.client.1.smithi106.stdout:1/941: creat d4/d37/d14c/f14d x:0 0 0 2024-05-09T06:30:35.660 INFO:tasks.workunit.client.1.smithi106.stdout:1/942: fdatasync d4/d5b/d75/f11d 0 2024-05-09T06:30:35.660 INFO:tasks.workunit.client.1.smithi106.stdout:1/943: fdatasync d4/d76/d13/d60/d9c/dbe/fde 0 2024-05-09T06:30:35.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/823: symlink d7/d10/d1a/d5a/l110 0 2024-05-09T06:30:35.663 INFO:tasks.workunit.client.0.smithi046.stdout:7/210: dwrite d3/d3d/f47 [0,4194304] 0 2024-05-09T06:30:35.664 INFO:tasks.workunit.client.0.smithi046.stdout:7/211: truncate d3/d7/d28/f33 1662725 0 2024-05-09T06:30:35.664 INFO:tasks.workunit.client.0.smithi046.stdout:7/212: truncate d3/d7/d28/d29/f2e 67275 0 2024-05-09T06:30:35.664 INFO:tasks.workunit.client.1.smithi106.stdout:1/944: mknod d4/d76/d65/d8d/db5/d10f/d139/c14e 0 2024-05-09T06:30:35.664 INFO:tasks.workunit.client.0.smithi046.stdout:7/213: read d3/d7/d28/f2a [1373149,18987] 0 2024-05-09T06:30:35.665 INFO:tasks.workunit.client.1.smithi106.stdout:8/847: rmdir d3/d5/d35/d4e/d32/d92 39 2024-05-09T06:30:35.665 INFO:tasks.workunit.client.1.smithi106.stdout:8/848: readlink d3/d5/d35/d4e/d32/dd3/le1 0 2024-05-09T06:30:35.665 INFO:tasks.workunit.client.1.smithi106.stdout:8/849: read - d3/d5/d7/d15/d3e/d7d/fe7 zero size 2024-05-09T06:30:35.668 INFO:tasks.workunit.client.1.smithi106.stdout:4/824: link d7/d28/d2a/d80/fef d7/d39/d47/d66/f111 0 2024-05-09T06:30:35.668 INFO:tasks.workunit.client.1.smithi106.stdout:4/825: fsync d7/d39/f3f 0 2024-05-09T06:30:35.669 INFO:tasks.workunit.client.1.smithi106.stdout:7/867: dread d0/da5/d108/d1a/d36/d30/d44/fd5 [0,4194304] 0 2024-05-09T06:30:35.669 INFO:tasks.workunit.client.1.smithi106.stdout:7/868: dread - d0/da5/d108/d1a/d36/d30/d44/d58/ffa zero size 2024-05-09T06:30:35.673 INFO:tasks.workunit.client.1.smithi106.stdout:8/850: creat d3/d5/d35/d61/d6c/d83/f112 x:0 0 0 2024-05-09T06:30:35.681 INFO:tasks.workunit.client.1.smithi106.stdout:6/922: rename d0/d17/d34 to d0/d66/d13b 0 2024-05-09T06:30:35.683 INFO:tasks.workunit.client.0.smithi046.stdout:7/214: dwrite d3/d7/d28/d29/f45 [0,4194304] 0 2024-05-09T06:30:35.684 INFO:tasks.workunit.client.1.smithi106.stdout:0/935: rename d1/da1/fb3 to d1/da1/d83/f143 0 2024-05-09T06:30:35.684 INFO:tasks.workunit.client.1.smithi106.stdout:0/936: read - d1/d11/d23/d13/d58/da8/fb6 zero size 2024-05-09T06:30:35.684 INFO:tasks.workunit.client.1.smithi106.stdout:0/937: fsync d1/d11/fc7 0 2024-05-09T06:30:35.684 INFO:tasks.workunit.client.1.smithi106.stdout:6/923: rmdir d0/d66/d13b/d4e/d98/da9/db1/d8 39 2024-05-09T06:30:35.687 INFO:tasks.workunit.client.1.smithi106.stdout:5/942: rename d8/d45/d4c/l31 to d8/d5a/d60/da8/l121 0 2024-05-09T06:30:35.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/215: mknod d3/d3d/c4e 0 2024-05-09T06:30:35.689 INFO:tasks.workunit.client.1.smithi106.stdout:0/938: mkdir d1/d11/d23/d13/d8a/dc1/d144 0 2024-05-09T06:30:35.690 INFO:tasks.workunit.client.1.smithi106.stdout:6/924: creat d0/d66/d13b/d95/f13c x:0 0 0 2024-05-09T06:30:35.690 INFO:tasks.workunit.client.1.smithi106.stdout:6/925: getdents d0/d66/d13b/d4e/d98/dfa 0 2024-05-09T06:30:35.692 INFO:tasks.workunit.client.1.smithi106.stdout:1/945: rename d4/d37/d74/l9d to d4/d76/d13/d60/d124/l14f 0 2024-05-09T06:30:35.693 INFO:tasks.workunit.client.1.smithi106.stdout:5/943: mknod d8/d5a/d60/d7e/dae/dd9/def/c122 0 2024-05-09T06:30:35.695 INFO:tasks.workunit.client.1.smithi106.stdout:6/926: creat d0/d66/d13b/d4e/d98/da9/db1/d8/d9c/d124/f13d x:0 0 0 2024-05-09T06:30:35.695 INFO:tasks.workunit.client.1.smithi106.stdout:0/939: dread d1/d11/d23/d22/f59 [0,4194304] 0 2024-05-09T06:30:35.695 INFO:tasks.workunit.client.1.smithi106.stdout:0/940: fdatasync d1/f5 0 2024-05-09T06:30:35.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/135: sync 2024-05-09T06:30:35.698 INFO:tasks.workunit.client.0.smithi046.stdout:0/284: sync 2024-05-09T06:30:35.698 INFO:tasks.workunit.client.0.smithi046.stdout:4/210: sync 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:5/111: sync 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/155: sync 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:3/121: sync 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:9/133: sync 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:9/134: chown d2/d6/f25 27888 1 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:8/145: sync 2024-05-09T06:30:35.699 INFO:tasks.workunit.client.0.smithi046.stdout:6/399: sync 2024-05-09T06:30:35.700 INFO:tasks.workunit.client.1.smithi106.stdout:1/946: creat d4/d76/d65/d8d/db5/d10f/d139/d14b/f150 x:0 0 0 2024-05-09T06:30:35.700 INFO:tasks.workunit.client.1.smithi106.stdout:1/947: creat d4/dbd/de6/f151 x:0 0 0 2024-05-09T06:30:35.702 INFO:tasks.workunit.client.0.smithi046.stdout:7/216: dwrite d3/d7/d28/d29/f2e [0,4194304] 0 2024-05-09T06:30:35.703 INFO:tasks.workunit.client.1.smithi106.stdout:5/944: mkdir d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/d100/d123 0 2024-05-09T06:30:35.703 INFO:tasks.workunit.client.1.smithi106.stdout:5/945: truncate d8/d5a/d60/ffa 892926 0 2024-05-09T06:30:35.703 INFO:tasks.workunit.client.1.smithi106.stdout:5/946: stat d8/d45/c62 0 2024-05-09T06:30:35.704 INFO:tasks.workunit.client.1.smithi106.stdout:5/947: read d8/d45/fc8 [11855,49614] 0 2024-05-09T06:30:35.704 INFO:tasks.workunit.client.1.smithi106.stdout:5/948: chown d8/d5a/d60/lc9 250375817 1 2024-05-09T06:30:35.704 INFO:tasks.workunit.client.0.smithi046.stdout:6/400: read db/d10/d3f/d4f/f60 [362413,4462] 0 2024-05-09T06:30:35.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/136: mknod d7/d10/c26 0 2024-05-09T06:30:35.708 INFO:tasks.workunit.client.1.smithi106.stdout:6/927: mkdir d0/d66/d13b/d4e/d98/da9/db1/d8/d13e 0 2024-05-09T06:30:35.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/285: creat d11/d18/d1c/d53/f61 x:0 0 0 2024-05-09T06:30:35.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/112: symlink d0/l2e 0 2024-05-09T06:30:35.715 INFO:tasks.workunit.client.0.smithi046.stdout:2/156: symlink da/de/d11/l2f 0 2024-05-09T06:30:35.715 INFO:tasks.workunit.client.1.smithi106.stdout:9/906: sync 2024-05-09T06:30:35.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/122: unlink d4/d5/l14 0 2024-05-09T06:30:35.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/135: rmdir d2/d26 39 2024-05-09T06:30:35.724 INFO:tasks.workunit.client.1.smithi106.stdout:1/948: unlink d4/d76/d13/dbb/fa8 0 2024-05-09T06:30:35.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 -- 172.21.15.46:0/3034045449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 msgr2=0x7f49940fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 --2- 172.21.15.46:0/3034045449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f49940fc0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4984004940 tx=0x7f4984009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 -- 172.21.15.46:0/3034045449 shutdown_connections 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 --2- 172.21.15.46:0/3034045449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f49940fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 --2- 172.21.15.46:0/3034045449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f49940fc0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 -- 172.21.15.46:0/3034045449 >> 172.21.15.46:0/3034045449 conn(0x7f49940f7430 msgr2=0x7f49940f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 -- 172.21.15.46:0/3034045449 shutdown_connections 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.742+0000 7f49992ac700 1 -- 172.21.15.46:0/3034045449 wait complete. 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49992ac700 1 Processor -- start 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49992ac700 1 -- start start 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49992ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f4994110680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:35.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49992ac700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f4994112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49992ac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4994066340 con 0x7f49940fbcb0 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49992ac700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4994066480 con 0x7f49940fcf60 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f4992ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f4994110680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49927fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f4994112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f4992ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f4994110680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50810/0 (socket says 172.21.15.46:50810) 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f49927fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f4994112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:37718/0 (socket says 172.21.15.46:37718) 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.743+0000 7f4992ffd700 1 -- 172.21.15.46:0/1625176970 learned_addr learned my addr 172.21.15.46:0/1625176970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f49927fc700 1 -- 172.21.15.46:0/1625176970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 msgr2=0x7f4994110680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f49927fc700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f4994110680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:35.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f49927fc700 1 -- 172.21.15.46:0/1625176970 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984005040 con 0x7f49940fcf60 2024-05-09T06:30:35.728 INFO:tasks.workunit.client.1.smithi106.stdout:5/949: symlink d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/d100/l124 0 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f49927fc700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f4994112bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4988009fd0 tx=0x7f498800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4988004e90 con 0x7f49940fcf60 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4994113170 con 0x7f49940fcf60 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49941136e0 con 0x7f49940fcf60 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f498800f040 con 0x7f49940fcf60 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.744+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f498800ca50 con 0x7f49940fcf60 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.746+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49800052e0 con 0x7f49940fcf60 2024-05-09T06:30:35.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.746+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f4988007cc0 con 0x7f49940fcf60 2024-05-09T06:30:35.730 INFO:tasks.workunit.client.1.smithi106.stdout:9/907: creat d4/d54/d69/d95/d23/d78/d8f/d10f/f11b x:0 0 0 2024-05-09T06:30:35.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.747+0000 7f497b7fe700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f497c070bb0 0x7f497c073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:35.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.747+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f49880902b0 con 0x7f49940fcf60 2024-05-09T06:30:35.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.747+0000 7f4992ffd700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f497c070bb0 0x7f497c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:35.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.748+0000 7f4992ffd700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f497c070bb0 0x7f497c073060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f498400b0d0 tx=0x7f4984009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:35.731 INFO:tasks.workunit.client.1.smithi106.stdout:7/869: rename d0/d53 to d0/da5/d108/d1a/d36/d30/d44/dc1/d111 0 2024-05-09T06:30:35.733 INFO:tasks.workunit.client.0.smithi046.stdout:6/401: rename db/d10/d3f/c71 to db/d10/d3f/d4f/d8a/c8e 0 2024-05-09T06:30:35.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/146: dwrite d1/db/dd/f1a [0,4194304] 0 2024-05-09T06:30:35.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/147: chown d1/d7/c21 52861 1 2024-05-09T06:30:35.733 INFO:tasks.workunit.client.0.smithi046.stdout:4/211: dwrite d7/df/f1b [4194304,4194304] 0 2024-05-09T06:30:35.733 INFO:tasks.workunit.client.1.smithi106.stdout:0/941: dwrite d1/d11/d23/d13/d58/da8/dd6/fd2 [0,4194304] 0 2024-05-09T06:30:35.735 INFO:tasks.workunit.client.1.smithi106.stdout:3/776: sync 2024-05-09T06:30:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:9/136: read d2/d6/d7/f23 [1162901,41791] 0 2024-05-09T06:30:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:9/137: chown d2/d6/l14 2029 1 2024-05-09T06:30:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:9/138: rename d2/d6/d7 to d2/d6/d7/d1a/d30 22 2024-05-09T06:30:35.736 INFO:tasks.workunit.client.0.smithi046.stdout:8/148: dread d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:35.736 INFO:tasks.workunit.client.0.smithi046.stdout:8/149: truncate d1/d7/d12/f1f 1640166 0 2024-05-09T06:30:35.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:35.754+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f49880516c0 con 0x7f49940fcf60 2024-05-09T06:30:35.737 INFO:tasks.workunit.client.0.smithi046.stdout:8/150: creat d1/db/dd/d11/f27 x:0 0 0 2024-05-09T06:30:35.737 INFO:tasks.workunit.client.0.smithi046.stdout:8/151: write d1/db/f16 [2323066,45246] 0 2024-05-09T06:30:35.737 INFO:tasks.workunit.client.0.smithi046.stdout:8/152: write d1/db/dd/d11/f27 [532743,114047] 0 2024-05-09T06:30:35.738 INFO:tasks.workunit.client.1.smithi106.stdout:5/950: mknod d8/d5a/d60/d7e/dae/dd9/c125 0 2024-05-09T06:30:35.739 INFO:tasks.workunit.client.0.smithi046.stdout:5/113: getdents d0/d1b/d21 0 2024-05-09T06:30:35.741 INFO:tasks.workunit.client.1.smithi106.stdout:3/777: dread d5/d1c/d24/d5b/da4/ff3 [4194304,4194304] 0 2024-05-09T06:30:35.742 INFO:tasks.workunit.client.1.smithi106.stdout:3/778: readlink d5/d4d/d5f/l8d 0 2024-05-09T06:30:35.742 INFO:tasks.workunit.client.0.smithi046.stdout:2/157: mknod da/de/d14/d1f/d20/c30 0 2024-05-09T06:30:35.742 INFO:tasks.workunit.client.0.smithi046.stdout:2/158: write f1 [4304972,96584] 0 2024-05-09T06:30:35.743 INFO:tasks.workunit.client.1.smithi106.stdout:7/870: unlink d0/da5/d108/d1a/d36/d30/d44/dc1/d111/deb/cfe 0 2024-05-09T06:30:35.743 INFO:tasks.workunit.client.1.smithi106.stdout:7/871: fsync d0/f90 0 2024-05-09T06:30:35.744 INFO:tasks.workunit.client.0.smithi046.stdout:3/123: mkdir d4/d20/d24/d29 0 2024-05-09T06:30:35.748 INFO:tasks.workunit.client.0.smithi046.stdout:5/114: write d0/d1b/f20 [734163,30377] 0 2024-05-09T06:30:35.751 INFO:tasks.workunit.client.1.smithi106.stdout:0/942: symlink d1/d11/d23/d13/d8a/dc1/l145 0 2024-05-09T06:30:35.751 INFO:tasks.workunit.client.1.smithi106.stdout:0/943: chown d1/d11/d23/d13/d2c/d6d 2530553 1 2024-05-09T06:30:35.752 INFO:tasks.workunit.client.1.smithi106.stdout:7/872: write d0/da5/d108/d1a/f3d [573326,123859] 0 2024-05-09T06:30:35.755 INFO:tasks.workunit.client.0.smithi046.stdout:6/402: creat db/d10/d6b/f8f x:0 0 0 2024-05-09T06:30:35.755 INFO:tasks.workunit.client.0.smithi046.stdout:6/403: chown db/d10/d6b/c7d 82 1 2024-05-09T06:30:35.757 INFO:tasks.workunit.client.1.smithi106.stdout:5/951: mkdir d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104/d126 0 2024-05-09T06:30:35.757 INFO:tasks.workunit.client.1.smithi106.stdout:5/952: chown d8/d45/d4c/fdb 82318432 1 2024-05-09T06:30:35.761 INFO:tasks.workunit.client.0.smithi046.stdout:4/212: unlink d7/df/f36 0 2024-05-09T06:30:35.762 INFO:tasks.workunit.client.1.smithi106.stdout:1/949: getdents d4/dbd/de6 0 2024-05-09T06:30:35.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/217: write d3/d7/d28/d29/f2e [4949937,45501] 0 2024-05-09T06:30:35.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/218: chown d3/d7/dd/f44 1247830058 1 2024-05-09T06:30:35.766 INFO:tasks.workunit.client.0.smithi046.stdout:9/139: getdents d2/d6/d7/d1a 0 2024-05-09T06:30:35.766 INFO:tasks.workunit.client.0.smithi046.stdout:9/140: write d2/d6/f29 [4161038,112417] 0 2024-05-09T06:30:35.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/141: getdents d2/d6/d7/d1a 0 2024-05-09T06:30:35.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/142: read d2/d6/d7/f1d [8140,26326] 0 2024-05-09T06:30:35.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/143: chown d2/dc/l13 1 1 2024-05-09T06:30:35.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/144: read d2/f4 [1009986,119879] 0 2024-05-09T06:30:35.773 INFO:tasks.workunit.client.0.smithi046.stdout:8/153: rename d1/db/dd/d11/f24 to d1/db/f28 0 2024-05-09T06:30:35.774 INFO:tasks.workunit.client.1.smithi106.stdout:3/779: creat d5/d85/dc3/dc8/ff8 x:0 0 0 2024-05-09T06:30:35.775 INFO:tasks.workunit.client.1.smithi106.stdout:3/780: creat d5/d4d/d5f/ff9 x:0 0 0 2024-05-09T06:30:35.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/137: rmdir d7 39 2024-05-09T06:30:35.777 INFO:tasks.workunit.client.1.smithi106.stdout:3/781: dread d5/d1c/f6d [0,4194304] 0 2024-05-09T06:30:35.777 INFO:tasks.workunit.client.1.smithi106.stdout:0/944: chown d1/d11/d23/d13/d2c/f77 113 1 2024-05-09T06:30:35.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/404: dwrite db/d10/d3f/d44/d46/f4d [0,4194304] 0 2024-05-09T06:30:35.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/405: write f6 [4327019,58476] 0 2024-05-09T06:30:35.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/406: fdatasync db/d10/d3f/d44/f5f 0 2024-05-09T06:30:35.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/407: fsync db/f27 0 2024-05-09T06:30:35.779 INFO:tasks.workunit.client.1.smithi106.stdout:3/782: dread d5/d1c/d24/f59 [0,4194304] 0 2024-05-09T06:30:35.779 INFO:tasks.workunit.client.1.smithi106.stdout:3/783: read d5/d1c/d24/f59 [134358,94137] 0 2024-05-09T06:30:35.779 INFO:tasks.workunit.client.1.smithi106.stdout:3/784: fdatasync d5/d1c/f6d 0 2024-05-09T06:30:35.779 INFO:tasks.workunit.client.1.smithi106.stdout:3/785: write d5/d1c/d24/d5b/da4/fb3 [767893,129675] 0 2024-05-09T06:30:35.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/159: symlink da/de/l31 0 2024-05-09T06:30:35.784 INFO:tasks.workunit.client.1.smithi106.stdout:1/950: symlink d4/d37/d14c/l152 0 2024-05-09T06:30:35.784 INFO:tasks.workunit.client.1.smithi106.stdout:1/951: chown d4/d37/d74/l99 843948722 1 2024-05-09T06:30:35.785 INFO:tasks.workunit.client.0.smithi046.stdout:3/124: mkdir d4/d20/d24/d2a 0 2024-05-09T06:30:35.785 INFO:tasks.workunit.client.0.smithi046.stdout:3/125: dread - d4/d5/f23 zero size 2024-05-09T06:30:35.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/126: dread d4/d5/f1c [0,4194304] 0 2024-05-09T06:30:35.787 INFO:tasks.workunit.client.0.smithi046.stdout:3/127: write d4/d5/f1c [863980,24390] 0 2024-05-09T06:30:35.787 INFO:tasks.workunit.client.1.smithi106.stdout:9/908: rename d4/d54/d69/d99/d2a/d42/d6c/d6d to d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c 0 2024-05-09T06:30:35.796 INFO:tasks.workunit.client.1.smithi106.stdout:1/952: symlink d4/d76/d13/d2f/df5/l153 0 2024-05-09T06:30:35.799 INFO:tasks.workunit.client.1.smithi106.stdout:5/953: rename d8/d5a/d60/d7e/dae/dd9/def/d99/f80 to d8/d33/d74/f127 0 2024-05-09T06:30:35.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/145: mknod d2/d6/d7/d1a/d27/d2a/c31 0 2024-05-09T06:30:35.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/146: getdents d2/d26/d2c 0 2024-05-09T06:30:35.802 INFO:tasks.workunit.client.1.smithi106.stdout:9/909: creat d4/d54/d91/dc7/f11d x:0 0 0 2024-05-09T06:30:35.802 INFO:tasks.workunit.client.1.smithi106.stdout:9/910: dread - d4/d54/fab zero size 2024-05-09T06:30:35.802 INFO:tasks.workunit.client.1.smithi106.stdout:9/911: chown d4/d54/d69/d95/d23/d16/dd1/d47/c4b 13 1 2024-05-09T06:30:35.803 INFO:tasks.workunit.client.1.smithi106.stdout:5/954: creat d8/d5a/d60/dd6/f128 x:0 0 0 2024-05-09T06:30:35.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/154: truncate d1/f26 4478993 0 2024-05-09T06:30:35.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/155: write d1/db/dd/d11/f27 [1066349,109782] 0 2024-05-09T06:30:35.805 INFO:tasks.workunit.client.0.smithi046.stdout:1/138: truncate d7/d10/f1e 3095353 0 2024-05-09T06:30:35.808 INFO:tasks.workunit.client.1.smithi106.stdout:0/945: dwrite d1/da1/f102 [0,4194304] 0 2024-05-09T06:30:35.808 INFO:tasks.workunit.client.1.smithi106.stdout:0/946: fdatasync d1/d11/d23/f5f 0 2024-05-09T06:30:35.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/408: mknod db/d10/d3f/d4f/c90 0 2024-05-09T06:30:35.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/409: dread - db/d10/d30/f77 zero size 2024-05-09T06:30:35.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/410: stat db/d10/d3f/d44/d74/f80 0 2024-05-09T06:30:35.809 INFO:tasks.workunit.client.0.smithi046.stdout:3/128: unlink d4/d5/f1c 0 2024-05-09T06:30:35.809 INFO:tasks.workunit.client.0.smithi046.stdout:3/129: write d4/d20/f26 [1939861,42640] 0 2024-05-09T06:30:35.809 INFO:tasks.workunit.client.0.smithi046.stdout:3/130: fdatasync d4/d20/d24/f18 0 2024-05-09T06:30:35.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/213: getdents d7/df/d10/d1d 0 2024-05-09T06:30:35.812 INFO:tasks.workunit.client.1.smithi106.stdout:1/953: dread d4/d76/d13/d2f/f7f [0,4194304] 0 2024-05-09T06:30:35.814 INFO:tasks.workunit.client.1.smithi106.stdout:5/955: dread d8/d5a/d60/da8/daa/f10e [0,4194304] 0 2024-05-09T06:30:35.814 INFO:tasks.workunit.client.1.smithi106.stdout:5/956: chown d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/f87 0 1 2024-05-09T06:30:35.815 INFO:tasks.workunit.client.0.smithi046.stdout:7/219: dwrite d3/d7/dd/f23 [0,4194304] 0 2024-05-09T06:30:35.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/160: dwrite da/de/d14/f1b [0,4194304] 0 2024-05-09T06:30:35.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/161: stat da/db 0 2024-05-09T06:30:35.816 INFO:tasks.workunit.client.1.smithi106.stdout:1/954: unlink d4/d76/d1d/cab 0 2024-05-09T06:30:35.819 INFO:tasks.workunit.client.0.smithi046.stdout:1/139: creat d7/d10/f27 x:0 0 0 2024-05-09T06:30:35.821 INFO:tasks.workunit.client.1.smithi106.stdout:5/957: symlink d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dec/l129 0 2024-05-09T06:30:35.823 INFO:tasks.workunit.client.1.smithi106.stdout:5/958: write d8/f1a [1828288,39161] 0 2024-05-09T06:30:35.823 INFO:tasks.workunit.client.0.smithi046.stdout:6/411: unlink db/d10/d57/d5d/f61 0 2024-05-09T06:30:35.827 INFO:tasks.workunit.client.1.smithi106.stdout:1/955: rename d4/d76/d65/d8d/db5/l149 to d4/d37/d74/l154 0 2024-05-09T06:30:35.827 INFO:tasks.workunit.client.1.smithi106.stdout:1/956: chown d4/d76/d13/dbb/f81 3423 1 2024-05-09T06:30:35.828 INFO:tasks.workunit.client.0.smithi046.stdout:3/131: mkdir d4/d20/d24/d29/d2b 0 2024-05-09T06:30:35.831 INFO:tasks.workunit.client.1.smithi106.stdout:1/957: mknod d4/d5/d12b/c155 0 2024-05-09T06:30:35.833 INFO:tasks.workunit.client.1.smithi106.stdout:4/826: sync 2024-05-09T06:30:35.834 INFO:tasks.workunit.client.1.smithi106.stdout:4/827: readlink d7/d28/d2a/l2d 0 2024-05-09T06:30:35.836 INFO:tasks.workunit.client.1.smithi106.stdout:1/958: symlink d4/d37/d3d/l156 0 2024-05-09T06:30:35.839 INFO:tasks.workunit.client.0.smithi046.stdout:9/147: rmdir d2/d6 39 2024-05-09T06:30:35.839 INFO:tasks.workunit.client.0.smithi046.stdout:9/148: chown d2/d6 379 1 2024-05-09T06:30:35.845 INFO:tasks.workunit.client.0.smithi046.stdout:1/140: mkdir d7/d10/d28 0 2024-05-09T06:30:35.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/412: rmdir db/d10 39 2024-05-09T06:30:35.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/413: write db/d10/d6b/f8f [300777,23374] 0 2024-05-09T06:30:35.849 INFO:tasks.workunit.client.1.smithi106.stdout:1/959: dread d4/d37/f43 [0,4194304] 0 2024-05-09T06:30:35.851 INFO:tasks.workunit.client.0.smithi046.stdout:3/132: unlink d4/f11 0 2024-05-09T06:30:35.852 INFO:tasks.workunit.client.1.smithi106.stdout:9/912: dwrite d4/d54/db3/fc4 [0,4194304] 0 2024-05-09T06:30:35.853 INFO:tasks.workunit.client.0.smithi046.stdout:4/214: symlink d7/df/d10/d2f/d30/l4d 0 2024-05-09T06:30:35.854 INFO:tasks.workunit.client.0.smithi046.stdout:7/220: getdents d3/d3d 0 2024-05-09T06:30:35.854 INFO:tasks.workunit.client.0.smithi046.stdout:7/221: fsync d3/d7/f11 0 2024-05-09T06:30:35.857 INFO:tasks.workunit.client.0.smithi046.stdout:1/141: truncate f6 389954 0 2024-05-09T06:30:35.859 INFO:tasks.workunit.client.0.smithi046.stdout:6/414: mkdir db/d10/d3c/d91 0 2024-05-09T06:30:35.860 INFO:tasks.workunit.client.1.smithi106.stdout:9/913: mknod d4/d54/d69/d95/d23/d16/dd1/d38/d68/c11e 0 2024-05-09T06:30:35.861 INFO:tasks.workunit.client.1.smithi106.stdout:9/914: readlink d4/d54/lde 0 2024-05-09T06:30:35.862 INFO:tasks.workunit.client.0.smithi046.stdout:3/133: creat d4/f2c x:0 0 0 2024-05-09T06:30:35.863 INFO:tasks.workunit.client.0.smithi046.stdout:7/222: mkdir d3/d7/d4c/d4f 0 2024-05-09T06:30:35.863 INFO:tasks.workunit.client.1.smithi106.stdout:3/786: dwrite d5/d1c/d24/d98/dc0/d32/fcc [0,4194304] 0 2024-05-09T06:30:35.863 INFO:tasks.workunit.client.1.smithi106.stdout:3/787: write d5/ff6 [1025916,112143] 0 2024-05-09T06:30:35.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/142: symlink d7/d10/l29 0 2024-05-09T06:30:35.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/143: readlink d7/l22 0 2024-05-09T06:30:35.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/415: write db/d10/d3c/f62 [497373,127743] 0 2024-05-09T06:30:35.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/416: chown db/d10/d19/c26 1 1 2024-05-09T06:30:35.870 INFO:tasks.workunit.client.0.smithi046.stdout:6/417: creat db/d10/d3f/d44/d74/f92 x:0 0 0 2024-05-09T06:30:35.870 INFO:tasks.workunit.client.0.smithi046.stdout:6/418: write db/d10/d3f/f32 [439178,99504] 0 2024-05-09T06:30:35.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/156: dwrite d1/db/f16 [0,4194304] 0 2024-05-09T06:30:35.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/157: chown d1/db/cc 58284949 1 2024-05-09T06:30:35.877 INFO:tasks.workunit.client.0.smithi046.stdout:8/158: readlink d1/l6 0 2024-05-09T06:30:35.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/149: dwrite d2/d6/d7/fd [0,4194304] 0 2024-05-09T06:30:35.877 INFO:tasks.workunit.client.1.smithi106.stdout:5/959: dwrite d8/d45/d4c/d85/fe1 [0,4194304] 0 2024-05-09T06:30:35.877 INFO:tasks.workunit.client.1.smithi106.stdout:0/947: dwrite d1/da1/f113 [0,4194304] 0 2024-05-09T06:30:35.877 INFO:tasks.workunit.client.1.smithi106.stdout:4/828: dwrite d7/d10/d1a/d5a/d46/f54 [4194304,4194304] 0 2024-05-09T06:30:35.878 INFO:tasks.workunit.client.1.smithi106.stdout:4/829: write d7/d39/f94 [909859,932] 0 2024-05-09T06:30:35.878 INFO:tasks.workunit.client.1.smithi106.stdout:1/960: dwrite d4/d37/f12d [0,4194304] 0 2024-05-09T06:30:35.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/830: write d7/d10/d1a/d5a/f55 [1606146,14233] 0 2024-05-09T06:30:35.890 INFO:tasks.workunit.client.1.smithi106.stdout:5/960: dread d8/fc [0,4194304] 0 2024-05-09T06:30:35.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/215: rename d7/df/d10/d2f/f3b to d7/df/d3a/d25/f4e 0 2024-05-09T06:30:35.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/216: fdatasync f1 0 2024-05-09T06:30:35.895 INFO:tasks.workunit.client.1.smithi106.stdout:9/915: write d4/d54/d69/d95/f5e [4140481,109665] 0 2024-05-09T06:30:35.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/223: creat d3/d7/d28/f50 x:0 0 0 2024-05-09T06:30:35.901 INFO:tasks.workunit.client.1.smithi106.stdout:3/788: creat d5/d85/ffa x:0 0 0 2024-05-09T06:30:35.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/159: dwrite d1/db/f28 [0,4194304] 0 2024-05-09T06:30:35.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/160: write d1/d7/f23 [106042,34186] 0 2024-05-09T06:30:35.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/144: rmdir d7 39 2024-05-09T06:30:35.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/145: truncate d7/d10/f24 226750 0 2024-05-09T06:30:35.904 INFO:tasks.workunit.client.0.smithi046.stdout:9/150: dwrite d2/d6/f29 [4194304,4194304] 0 2024-05-09T06:30:35.904 INFO:tasks.workunit.client.0.smithi046.stdout:9/151: read d2/d6/f25 [87723,113626] 0 2024-05-09T06:30:35.907 INFO:tasks.workunit.client.1.smithi106.stdout:4/831: dwrite d7/d10/d1a/d5a/d7a/fb8 [4194304,4194304] 0 2024-05-09T06:30:35.917 INFO:tasks.workunit.client.1.smithi106.stdout:0/948: link d1/d11/d23/d13/d58/c5e d1/d11/d23/d13/c146 0 2024-05-09T06:30:35.917 INFO:tasks.workunit.client.1.smithi106.stdout:4/832: dread d7/d39/d35/d7c/dd1/ff9 [0,4194304] 0 2024-05-09T06:30:35.919 INFO:tasks.workunit.client.0.smithi046.stdout:9/152: dwrite d2/d6/d7/f1b [0,4194304] 0 2024-05-09T06:30:35.929 INFO:tasks.workunit.client.1.smithi106.stdout:1/961: symlink d4/d37/d3d/l157 0 2024-05-09T06:30:35.929 INFO:tasks.workunit.client.1.smithi106.stdout:1/962: dread - d4/d76/db3/fee zero size 2024-05-09T06:30:35.929 INFO:tasks.workunit.client.1.smithi106.stdout:1/963: fdatasync f2 0 2024-05-09T06:30:35.930 INFO:tasks.workunit.client.1.smithi106.stdout:8/851: sync 2024-05-09T06:30:35.930 INFO:tasks.workunit.client.1.smithi106.stdout:8/852: chown d3/d5/d7/c9 52148787 1 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.1.smithi106.stdout:8/853: write d3/d5/d35/d61/d6c/d83/d89/f94 [663044,23136] 0 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.1.smithi106.stdout:4/833: dwrite d7/d28/faa [0,4194304] 0 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.1.smithi106.stdout:8/854: write d3/d5/f5a [1941728,39549] 0 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.1.smithi106.stdout:4/834: chown d7/d10/d1a 7 1 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.1.smithi106.stdout:4/835: chown d7/d28/f7d 6188730 1 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/134: rename d4/f1d to d4/d20/d24/d2a/f2d 0 2024-05-09T06:30:35.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/135: write d4/f2c [346026,49938] 0 2024-05-09T06:30:35.933 INFO:tasks.workunit.client.1.smithi106.stdout:5/961: creat d8/d5a/d60/da8/daa/dd2/f12a x:0 0 0 2024-05-09T06:30:35.934 INFO:tasks.workunit.client.0.smithi046.stdout:7/224: getdents d3/d7 0 2024-05-09T06:30:35.934 INFO:tasks.workunit.client.0.smithi046.stdout:7/225: readlink d3/d7/d28/d29/l39 0 2024-05-09T06:30:35.938 INFO:tasks.workunit.client.1.smithi106.stdout:9/916: symlink d4/d54/d69/d99/d2a/d42/l11f 0 2024-05-09T06:30:35.938 INFO:tasks.workunit.client.1.smithi106.stdout:9/917: chown d4/d54/d69/d95/d23/d16/dd1/d47/c10a 345208 1 2024-05-09T06:30:35.942 INFO:tasks.workunit.client.1.smithi106.stdout:3/789: creat d5/d85/dc3/d65/d81/ffb x:0 0 0 2024-05-09T06:30:35.942 INFO:tasks.workunit.client.1.smithi106.stdout:3/790: getdents d5/ddb 0 2024-05-09T06:30:35.942 INFO:tasks.workunit.client.1.smithi106.stdout:3/791: write d5/d1c/d24/d5b/da4/ff3 [2486237,51677] 0 2024-05-09T06:30:35.942 INFO:tasks.workunit.client.1.smithi106.stdout:3/792: truncate d5/d4d/d72/f7b 4641700 0 2024-05-09T06:30:35.942 INFO:tasks.workunit.client.1.smithi106.stdout:5/962: read d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dda/fea [2791445,121706] 0 2024-05-09T06:30:35.943 INFO:tasks.workunit.client.1.smithi106.stdout:5/963: fdatasync d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104/fb3 0 2024-05-09T06:30:35.947 INFO:tasks.workunit.client.1.smithi106.stdout:0/949: symlink d1/da1/d93/l147 0 2024-05-09T06:30:35.950 INFO:tasks.workunit.client.1.smithi106.stdout:1/964: mkdir d4/d76/d13/d2f/df5/d158 0 2024-05-09T06:30:35.951 INFO:tasks.workunit.client.0.smithi046.stdout:7/226: dwrite d3/d7/d28/d29/f2e [0,4194304] 0 2024-05-09T06:30:35.952 INFO:tasks.workunit.client.1.smithi106.stdout:9/918: write d4/d54/d69/d99/d2a/d42/fc3 [2255122,124043] 0 2024-05-09T06:30:35.955 INFO:tasks.workunit.client.1.smithi106.stdout:6/928: sync 2024-05-09T06:30:35.958 INFO:tasks.workunit.client.1.smithi106.stdout:8/855: rename d3/d5/f5a to d3/d5/d13/f113 0 2024-05-09T06:30:35.959 INFO:tasks.workunit.client.0.smithi046.stdout:9/153: rmdir d2/d6/d7/d1a/d27 39 2024-05-09T06:30:35.961 INFO:tasks.workunit.client.1.smithi106.stdout:4/836: mknod d7/d10/d106/c112 0 2024-05-09T06:30:35.963 INFO:tasks.workunit.client.1.smithi106.stdout:7/873: sync 2024-05-09T06:30:35.964 INFO:tasks.workunit.client.1.smithi106.stdout:9/919: dread d4/d54/d69/d95/f11 [0,4194304] 0 2024-05-09T06:30:35.966 INFO:tasks.workunit.client.1.smithi106.stdout:3/793: mknod d5/d1c/d24/d89/d8e/cfc 0 2024-05-09T06:30:35.969 INFO:tasks.workunit.client.1.smithi106.stdout:5/964: rmdir d8/d5a/d60/da8 39 2024-05-09T06:30:35.971 INFO:tasks.workunit.client.0.smithi046.stdout:3/136: creat d4/d20/d24/f2e x:0 0 0 2024-05-09T06:30:35.973 INFO:tasks.workunit.client.1.smithi106.stdout:0/950: creat d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/df2/f148 x:0 0 0 2024-05-09T06:30:35.974 INFO:tasks.workunit.client.0.smithi046.stdout:4/217: symlink d7/df/d10/d2f/l4f 0 2024-05-09T06:30:35.976 INFO:tasks.workunit.client.1.smithi106.stdout:8/856: symlink d3/d5/d7/d15/df4/dfd/da9/dbd/dd7/l114 0 2024-05-09T06:30:35.977 INFO:tasks.workunit.client.0.smithi046.stdout:8/161: rmdir d1/db/dd/d11 39 2024-05-09T06:30:35.978 INFO:tasks.workunit.client.0.smithi046.stdout:4/218: dread d7/df/d3a/d25/f4e [0,4194304] 0 2024-05-09T06:30:35.978 INFO:tasks.workunit.client.1.smithi106.stdout:4/837: unlink d7/dcb/cf5 0 2024-05-09T06:30:35.979 INFO:tasks.workunit.client.0.smithi046.stdout:1/146: symlink d7/l2a 0 2024-05-09T06:30:35.981 INFO:tasks.workunit.client.1.smithi106.stdout:7/874: truncate d0/da5/d108/d1a/d5a/f6c 1329376 0 2024-05-09T06:30:35.983 INFO:tasks.workunit.client.1.smithi106.stdout:9/920: mknod d4/d54/d69/d95/d23/d78/d8f/c120 0 2024-05-09T06:30:35.985 INFO:tasks.workunit.client.1.smithi106.stdout:3/794: mknod d5/d1c/d24/d98/cfd 0 2024-05-09T06:30:35.989 INFO:tasks.workunit.client.1.smithi106.stdout:5/965: rename d8/d5a/d60/da8/daa/fb2 to d8/d5a/d60/d7e/dae/f12b 0 2024-05-09T06:30:35.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/162: mkdir d1/d7/d12/d29 0 2024-05-09T06:30:35.991 INFO:tasks.workunit.client.1.smithi106.stdout:0/951: truncate d1/d11/d23/d13/f15 2012129 0 2024-05-09T06:30:35.991 INFO:tasks.workunit.client.1.smithi106.stdout:7/875: dread d0/da5/d108/d1a/d36/d30/d44/fd5 [0,4194304] 0 2024-05-09T06:30:35.991 INFO:tasks.workunit.client.1.smithi106.stdout:0/952: creat d1/d11/d23/d13/d58/da8/d124/f149 x:0 0 0 2024-05-09T06:30:35.991 INFO:tasks.workunit.client.0.smithi046.stdout:4/219: creat d7/df/d10/d2f/f50 x:0 0 0 2024-05-09T06:30:35.992 INFO:tasks.workunit.client.0.smithi046.stdout:4/220: dread - d7/df/d3a/f4a zero size 2024-05-09T06:30:35.993 INFO:tasks.workunit.client.1.smithi106.stdout:8/857: creat d3/d5/f115 x:0 0 0 2024-05-09T06:30:35.993 INFO:tasks.workunit.client.1.smithi106.stdout:8/858: write d3/d5/d7/d98/ff6 [604251,82005] 0 2024-05-09T06:30:35.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/419: rename db/d10/d57/d5d to db/d93 0 2024-05-09T06:30:35.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/420: stat db/c3e 0 2024-05-09T06:30:35.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/421: chown db/d10/d76 1 1 2024-05-09T06:30:35.994 INFO:tasks.workunit.client.1.smithi106.stdout:9/921: getdents d4/d54/d69/d95 0 2024-05-09T06:30:35.996 INFO:tasks.workunit.client.0.smithi046.stdout:6/422: rename db/f18 to db/d10/d30/d53/f94 0 2024-05-09T06:30:35.998 INFO:tasks.workunit.client.1.smithi106.stdout:7/876: creat d0/da5/d108/d1a/d5a/f112 x:0 0 0 2024-05-09T06:30:35.998 INFO:tasks.workunit.client.1.smithi106.stdout:7/877: write d0/da5/d108/d1a/d36/d1e/f4c [3812765,70475] 0 2024-05-09T06:30:35.999 INFO:tasks.workunit.client.1.smithi106.stdout:0/953: creat d1/d11/d23/d13/d2c/d57/f14a x:0 0 0 2024-05-09T06:30:35.999 INFO:tasks.workunit.client.1.smithi106.stdout:0/954: write d1/d11/d23/d13/d58/f8d [476627,102245] 0 2024-05-09T06:30:36.000 INFO:tasks.workunit.client.1.smithi106.stdout:8/859: mkdir d3/d5/d7/d15/df4/dfd/da9/dbd/dd7/d116 0 2024-05-09T06:30:36.001 INFO:tasks.workunit.client.1.smithi106.stdout:9/922: symlink d4/d54/d69/d99/d2a/d61/l121 0 2024-05-09T06:30:36.001 INFO:tasks.workunit.client.1.smithi106.stdout:9/923: fdatasync d4/d54/db3/fc4 0 2024-05-09T06:30:36.002 INFO:tasks.workunit.client.1.smithi106.stdout:3/795: rmdir d5/d4d/d5f 39 2024-05-09T06:30:36.005 INFO:tasks.workunit.client.1.smithi106.stdout:0/955: unlink d1/d11/d23/d13/d2c/d3d/dbe/c107 0 2024-05-09T06:30:36.005 INFO:tasks.workunit.client.1.smithi106.stdout:0/956: truncate d1/d11/d23/d13/d58/da8/dd6/f119 934963 0 2024-05-09T06:30:36.005 INFO:tasks.workunit.client.1.smithi106.stdout:0/957: readlink d1/d11/l16 0 2024-05-09T06:30:36.006 INFO:tasks.workunit.client.1.smithi106.stdout:8/860: truncate d3/d5/d35/d4e/d32/fac 2021996 0 2024-05-09T06:30:36.007 INFO:tasks.workunit.client.1.smithi106.stdout:9/924: rename d4/d54/d69/d99/d117 to d4/d54/d69/d99/d2a/d42/d6c/d122 0 2024-05-09T06:30:36.008 INFO:tasks.workunit.client.1.smithi106.stdout:5/966: dread d8/f50 [0,4194304] 0 2024-05-09T06:30:36.008 INFO:tasks.workunit.client.1.smithi106.stdout:3/796: getdents d5/d85/dc3/d65/ddc 0 2024-05-09T06:30:36.008 INFO:tasks.workunit.client.1.smithi106.stdout:6/929: dwrite d0/d66/f110 [0,4194304] 0 2024-05-09T06:30:36.009 INFO:tasks.workunit.client.1.smithi106.stdout:0/958: rmdir d1/d11/d23/d22/dbc 39 2024-05-09T06:30:36.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/163: dread d1/db/f16 [0,4194304] 0 2024-05-09T06:30:36.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/227: dwrite d3/d7/d28/d29/d3b/f49 [0,4194304] 0 2024-05-09T06:30:36.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/228: write d3/d7/dd/f44 [991769,111929] 0 2024-05-09T06:30:36.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/229: chown l0 1354210 1 2024-05-09T06:30:36.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/230: write d3/d7/dd/fe [1970954,96232] 0 2024-05-09T06:30:36.013 INFO:tasks.workunit.client.1.smithi106.stdout:1/965: dwrite d4/f8a [8388608,4194304] 0 2024-05-09T06:30:36.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/164: dread d1/db/dd/d14/f19 [0,4194304] 0 2024-05-09T06:30:36.016 INFO:tasks.workunit.client.1.smithi106.stdout:8/861: unlink d3/d5/d7/d15/df4/l105 0 2024-05-09T06:30:36.019 INFO:tasks.workunit.client.1.smithi106.stdout:9/925: mknod d4/d54/d69/d99/d2a/d61/c123 0 2024-05-09T06:30:36.022 INFO:tasks.workunit.client.1.smithi106.stdout:5/967: dread d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/f87 [0,4194304] 0 2024-05-09T06:30:36.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/231: creat d3/f51 x:0 0 0 2024-05-09T06:30:36.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/232: chown d3/d7/dd/f34 987936201 1 2024-05-09T06:30:36.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/165: unlink d1/db/dd/l1e 0 2024-05-09T06:30:36.027 INFO:tasks.workunit.client.1.smithi106.stdout:4/838: fsync d7/d39/f94 0 2024-05-09T06:30:36.027 INFO:tasks.workunit.client.1.smithi106.stdout:4/839: chown d7/d39/d35/d6f/l70 857525 1 2024-05-09T06:30:36.027 INFO:tasks.workunit.client.1.smithi106.stdout:4/840: write d7/d28/d2a/d80/fef [105145,106644] 0 2024-05-09T06:30:36.028 INFO:tasks.workunit.client.1.smithi106.stdout:3/797: creat d5/d1c/d24/d5b/de0/ffe x:0 0 0 2024-05-09T06:30:36.028 INFO:tasks.workunit.client.1.smithi106.stdout:3/798: fsync d5/d4d/d72/fba 0 2024-05-09T06:30:36.029 INFO:tasks.workunit.client.1.smithi106.stdout:0/959: mknod d1/d11/d23/d13/d2c/d6d/d10a/c14b 0 2024-05-09T06:30:36.029 INFO:tasks.workunit.client.0.smithi046.stdout:1/147: dwrite d7/f8 [0,4194304] 0 2024-05-09T06:30:36.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/221: dwrite d7/fc [0,4194304] 0 2024-05-09T06:30:36.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/222: creat d7/df/d3a/d45/f51 x:0 0 0 2024-05-09T06:30:36.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/223: creat d7/df/d3a/d25/f52 x:0 0 0 2024-05-09T06:30:36.032 INFO:tasks.workunit.client.0.smithi046.stdout:6/423: dwrite db/d10/d30/f4a [0,4194304] 0 2024-05-09T06:30:36.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/137: dwrite d4/d5/f23 [0,4194304] 0 2024-05-09T06:30:36.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/138: chown d4/lf 1 1 2024-05-09T06:30:36.033 INFO:tasks.workunit.client.0.smithi046.stdout:9/154: dwrite d2/d6/d7/d1a/f2e [0,4194304] 0 2024-05-09T06:30:36.033 INFO:tasks.workunit.client.0.smithi046.stdout:8/166: rename d1/f26 to d1/db/dd/d10/f2a 0 2024-05-09T06:30:36.033 INFO:tasks.workunit.client.1.smithi106.stdout:7/878: dwrite d0/da5/d108/d1a/d5a/f70 [0,4194304] 0 2024-05-09T06:30:36.033 INFO:tasks.workunit.client.1.smithi106.stdout:7/879: dread - d0/da5/d108/d1a/d36/d30/d44/d58/ffa zero size 2024-05-09T06:30:36.033 INFO:tasks.workunit.client.1.smithi106.stdout:7/880: chown d0/da5/d108/d1a/d36/d30/d44/dc1/d111/d7a/fd7 225 1 2024-05-09T06:30:36.034 INFO:tasks.workunit.client.1.smithi106.stdout:7/881: readlink d0/da5/d108/d1a/d36/l38 0 2024-05-09T06:30:36.034 INFO:tasks.workunit.client.0.smithi046.stdout:8/167: write d1/db/dd/d10/f15 [666189,108264] 0 2024-05-09T06:30:36.034 INFO:tasks.workunit.client.1.smithi106.stdout:1/966: getdents d4/d76/d1d/d118 0 2024-05-09T06:30:36.037 INFO:tasks.workunit.client.1.smithi106.stdout:8/862: symlink d3/d5/d13/d3a/l117 0 2024-05-09T06:30:36.037 INFO:tasks.workunit.client.1.smithi106.stdout:8/863: dread - d3/d5/dbc/fe8 zero size 2024-05-09T06:30:36.039 INFO:tasks.workunit.client.0.smithi046.stdout:7/233: write d3/d3d/f47 [984467,65794] 0 2024-05-09T06:30:36.039 INFO:tasks.workunit.client.0.smithi046.stdout:4/224: dread d7/df/d3a/d45/f49 [0,4194304] 0 2024-05-09T06:30:36.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/148: link d7/f19 d7/d10/f2b 0 2024-05-09T06:30:36.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/149: dread - d7/f19 zero size 2024-05-09T06:30:36.047 INFO:tasks.workunit.client.1.smithi106.stdout:9/926: creat d4/d54/d69/d99/d2a/d42/f124 x:0 0 0 2024-05-09T06:30:36.049 INFO:tasks.workunit.client.1.smithi106.stdout:4/841: dwrite d7/d10/d1a/d5a/f97 [0,4194304] 0 2024-05-09T06:30:36.049 INFO:tasks.workunit.client.1.smithi106.stdout:4/842: write d7/d10/d1a/d5a/f97 [5002176,82677] 0 2024-05-09T06:30:36.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/234: write d3/d7/d28/d29/f45 [665419,4726] 0 2024-05-09T06:30:36.050 INFO:tasks.workunit.client.1.smithi106.stdout:9/927: dread d4/d54/d69/d95/d23/d16/dd1/d31/f92 [0,4194304] 0 2024-05-09T06:30:36.051 INFO:tasks.workunit.client.1.smithi106.stdout:5/968: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/d100/d123/f12c x:0 0 0 2024-05-09T06:30:36.051 INFO:tasks.workunit.client.1.smithi106.stdout:5/969: dread - d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/f11f zero size 2024-05-09T06:30:36.056 INFO:tasks.workunit.client.1.smithi106.stdout:0/960: creat d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/f14c x:0 0 0 2024-05-09T06:30:36.064 INFO:tasks.workunit.client.1.smithi106.stdout:7/882: dwrite d0/da5/d108/d1a/d36/d30/fcf [0,4194304] 0 2024-05-09T06:30:36.064 INFO:tasks.workunit.client.1.smithi106.stdout:7/883: fdatasync d0/da5/d108/d1a/d36/f3f 0 2024-05-09T06:30:36.064 INFO:tasks.workunit.client.1.smithi106.stdout:7/884: fsync d0/da5/d108/d1a/d5a/ff8 0 2024-05-09T06:30:36.067 INFO:tasks.workunit.client.1.smithi106.stdout:3/799: write d5/d1c/f2b [2410179,58648] 0 2024-05-09T06:30:36.069 INFO:tasks.workunit.client.1.smithi106.stdout:0/961: dread d1/d11/d23/da6/f7a [0,4194304] 0 2024-05-09T06:30:36.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/424: symlink db/d10/d3f/d4f/d89/l95 0 2024-05-09T06:30:36.074 INFO:tasks.workunit.client.1.smithi106.stdout:1/967: mknod d4/dbd/c159 0 2024-05-09T06:30:36.074 INFO:tasks.workunit.client.1.smithi106.stdout:1/968: write d4/d76/d13/dbb/f87 [2655128,58727] 0 2024-05-09T06:30:36.074 INFO:tasks.workunit.client.1.smithi106.stdout:1/969: stat d4/d76/d65/d67/l144 0 2024-05-09T06:30:36.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/139: mknod d4/d20/d24/d2a/c2f 0 2024-05-09T06:30:36.076 INFO:tasks.workunit.client.1.smithi106.stdout:3/800: dread d5/f63 [0,4194304] 0 2024-05-09T06:30:36.076 INFO:tasks.workunit.client.1.smithi106.stdout:8/864: link d3/d5/f12 d3/d5/d35/d61/d6c/d83/dcc/f118 0 2024-05-09T06:30:36.080 INFO:tasks.workunit.client.0.smithi046.stdout:9/155: mkdir d2/dc/d32 0 2024-05-09T06:30:36.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/168: symlink d1/db/dd/l2b 0 2024-05-09T06:30:36.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/169: dread d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:36.088 INFO:tasks.workunit.client.0.smithi046.stdout:4/225: mkdir d7/df/d53 0 2024-05-09T06:30:36.092 INFO:tasks.workunit.client.0.smithi046.stdout:8/170: dread d1/db/dd/d14/f19 [0,4194304] 0 2024-05-09T06:30:36.098 INFO:tasks.workunit.client.0.smithi046.stdout:4/226: dread d7/f9 [0,4194304] 0 2024-05-09T06:30:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.116+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4980000bf0 con 0x7f497c070bb0 2024-05-09T06:30:36.099 INFO:tasks.workunit.client.1.smithi106.stdout:4/843: rename d7/d10/d1a/cae to d7/d10/d1a/d5a/d1c/dfb/c113 0 2024-05-09T06:30:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.118+0000 7f497b7fe700 1 -- 172.21.15.46:0/1625176970 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4980000bf0 con 0x7f497c070bb0 2024-05-09T06:30:36.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/235: creat d3/d7/f52 x:0 0 0 2024-05-09T06:30:36.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/236: creat d3/d7/d28/d29/f53 x:0 0 0 2024-05-09T06:30:36.103 INFO:tasks.workunit.client.1.smithi106.stdout:9/928: unlink d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/f108 0 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f497c070bb0 msgr2=0x7f497c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f497c070bb0 0x7f497c073060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f498400b0d0 tx=0x7f4984009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 msgr2=0x7f4994112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f4994112bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4988009fd0 tx=0x7f498800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 shutdown_connections 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f497c070bb0 0x7f497c073060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49940fbcb0 0x7f4994110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 --2- 172.21.15.46:0/1625176970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f49940fcf60 0x7f4994112bd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 >> 172.21.15.46:0/1625176970 conn(0x7f49940f7430 msgr2=0x7f49940f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.121+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 shutdown_connections 2024-05-09T06:30:36.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.122+0000 7f49992ac700 1 -- 172.21.15.46:0/1625176970 wait complete. 2024-05-09T06:30:36.105 INFO:tasks.workunit.client.1.smithi106.stdout:9/929: write d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/f77 [481717,125193] 0 2024-05-09T06:30:36.106 INFO:tasks.workunit.client.0.smithi046.stdout:3/140: link d4/c27 d4/d20/d24/d29/d2b/c30 0 2024-05-09T06:30:36.107 INFO:tasks.workunit.client.1.smithi106.stdout:5/970: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104/f12d x:0 0 0 2024-05-09T06:30:36.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/156: mkdir d2/d6/d33 0 2024-05-09T06:30:36.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/157: getdents d2/d26/d2c 0 2024-05-09T06:30:36.109 INFO:tasks.workunit.client.0.smithi046.stdout:0/286: sync 2024-05-09T06:30:36.109 INFO:tasks.workunit.client.0.smithi046.stdout:5/115: sync 2024-05-09T06:30:36.112 INFO:tasks.workunit.client.0.smithi046.stdout:8/171: unlink d1/d7/f23 0 2024-05-09T06:30:36.115 INFO:tasks.workunit.client.0.smithi046.stdout:3/141: dread d4/d20/d24/f18 [0,4194304] 0 2024-05-09T06:30:36.115 INFO:tasks.workunit.client.0.smithi046.stdout:1/150: rename d7/fd to d7/f2c 0 2024-05-09T06:30:36.115 INFO:tasks.workunit.client.0.smithi046.stdout:3/142: write d4/d20/d24/f1b [1400243,65065] 0 2024-05-09T06:30:36.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/151: dread d7/d10/f11 [0,4194304] 0 2024-05-09T06:30:36.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/152: readlink d7/d10/l1a 0 2024-05-09T06:30:36.117 INFO:tasks.workunit.client.1.smithi106.stdout:7/885: creat d0/da5/d108/d1a/d36/d1e/f113 x:0 0 0 2024-05-09T06:30:36.118 INFO:tasks.workunit.client.1.smithi106.stdout:7/886: readlink d0/da5/d108/d1a/d36/d30/d44/d80/ld2 0 2024-05-09T06:30:36.118 INFO:tasks.workunit.client.1.smithi106.stdout:7/887: dread - d0/da5/d108/d1a/d36/d30/d44/d80/f95 zero size 2024-05-09T06:30:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:30:36.122 INFO:tasks.workunit.client.1.smithi106.stdout:0/962: mkdir d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/d14d 0 2024-05-09T06:30:36.122 INFO:tasks.workunit.client.1.smithi106.stdout:0/963: chown d1/d11/d23/d13/d58/lc2 5253378 1 2024-05-09T06:30:36.122 INFO:tasks.workunit.client.1.smithi106.stdout:0/964: truncate d1/d11/d23/d13/d58/da8/d124/f12f 129516 0 2024-05-09T06:30:36.125 INFO:tasks.workunit.client.0.smithi046.stdout:5/116: rename d0/c8 to d0/d1b/d21/c2f 0 2024-05-09T06:30:36.125 INFO:tasks.workunit.client.0.smithi046.stdout:5/117: readlink d0/l12 0 2024-05-09T06:30:36.126 INFO:tasks.workunit.client.0.smithi046.stdout:1/153: dread d7/fe [0,4194304] 0 2024-05-09T06:30:36.129 INFO:tasks.workunit.client.1.smithi106.stdout:1/970: truncate d4/d76/d1d/f4e 335568 0 2024-05-09T06:30:36.130 INFO:tasks.workunit.client.0.smithi046.stdout:9/158: dwrite d2/f5 [4194304,4194304] 0 2024-05-09T06:30:36.131 INFO:tasks.workunit.client.1.smithi106.stdout:3/801: write d5/d1c/d24/d98/dc0/d32/fd4 [651240,50555] 0 2024-05-09T06:30:36.133 INFO:tasks.workunit.client.1.smithi106.stdout:8/865: mknod d3/d5/d7/c119 0 2024-05-09T06:30:36.134 INFO:tasks.workunit.client.0.smithi046.stdout:1/154: creat d7/d10/d28/f2d x:0 0 0 2024-05-09T06:30:36.140 INFO:tasks.workunit.client.0.smithi046.stdout:9/159: creat d2/d6/d7/d1a/d27/f34 x:0 0 0 2024-05-09T06:30:36.143 INFO:tasks.workunit.client.0.smithi046.stdout:4/227: getdents d7/df 0 2024-05-09T06:30:36.143 INFO:tasks.workunit.client.0.smithi046.stdout:4/228: creat d7/df/d3a/d25/f54 x:0 0 0 2024-05-09T06:30:36.143 INFO:tasks.workunit.client.0.smithi046.stdout:4/229: fsync d7/df/f29 0 2024-05-09T06:30:36.143 INFO:tasks.workunit.client.1.smithi106.stdout:8/866: write d3/d5/f8a [2811580,13177] 0 2024-05-09T06:30:36.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/155: symlink d7/d10/l2e 0 2024-05-09T06:30:36.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/118: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:36.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/119: write d0/f1a [135484,58357] 0 2024-05-09T06:30:36.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/120: fdatasync d0/f1 0 2024-05-09T06:30:36.146 INFO:tasks.workunit.client.0.smithi046.stdout:2/162: sync 2024-05-09T06:30:36.147 INFO:tasks.workunit.client.0.smithi046.stdout:3/143: rename d4/d20 to d4/d20/d31 22 2024-05-09T06:30:36.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/172: rename d1/db/dd/d10 to d1/d7/d2c 0 2024-05-09T06:30:36.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/173: readlink d1/db/dd/l2b 0 2024-05-09T06:30:36.148 INFO:tasks.workunit.client.1.smithi106.stdout:9/930: mkdir d4/d54/d125 0 2024-05-09T06:30:36.152 INFO:tasks.workunit.client.0.smithi046.stdout:9/160: write d2/d6/f21 [1720372,41535] 0 2024-05-09T06:30:36.155 INFO:tasks.workunit.client.1.smithi106.stdout:5/971: rename d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dda/cad to d8/d5a/d60/d7e/dae/dd9/def/d99/c12e 0 2024-05-09T06:30:36.156 INFO:tasks.workunit.client.1.smithi106.stdout:9/931: write d4/d54/d69/d95/f34 [4154047,45608] 0 2024-05-09T06:30:36.157 INFO:tasks.workunit.client.0.smithi046.stdout:1/156: mknod d7/d10/d28/c2f 0 2024-05-09T06:30:36.158 INFO:tasks.workunit.client.1.smithi106.stdout:7/888: creat d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/f114 x:0 0 0 2024-05-09T06:30:36.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/121: creat d0/d1b/f30 x:0 0 0 2024-05-09T06:30:36.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/122: write d0/f4 [1215623,30117] 0 2024-05-09T06:30:36.162 INFO:tasks.workunit.client.1.smithi106.stdout:0/965: mkdir d1/da1/dd8/d14e 0 2024-05-09T06:30:36.164 INFO:tasks.workunit.client.0.smithi046.stdout:3/144: mknod d4/d20/c32 0 2024-05-09T06:30:36.164 INFO:tasks.workunit.client.0.smithi046.stdout:3/145: chown d4/d20/d24/d29 46852 1 2024-05-09T06:30:36.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/230: dwrite d7/df/d3a/d25/f4e [0,4194304] 0 2024-05-09T06:30:36.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/163: dwrite f7 [0,4194304] 0 2024-05-09T06:30:36.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/164: creat da/de/d14/f32 x:0 0 0 2024-05-09T06:30:36.167 INFO:tasks.workunit.client.1.smithi106.stdout:3/802: creat d5/d1c/d24/d98/dc0/d32/fff x:0 0 0 2024-05-09T06:30:36.167 INFO:tasks.workunit.client.1.smithi106.stdout:3/803: chown d5/d1c/f2b 98 1 2024-05-09T06:30:36.168 INFO:tasks.workunit.client.1.smithi106.stdout:3/804: fdatasync d5/d1c/f2b 0 2024-05-09T06:30:36.168 INFO:tasks.workunit.client.0.smithi046.stdout:9/161: dread d2/f4 [0,4194304] 0 2024-05-09T06:30:36.168 INFO:tasks.workunit.client.0.smithi046.stdout:9/162: chown d2/d26/d2c 317 1 2024-05-09T06:30:36.169 INFO:tasks.workunit.client.0.smithi046.stdout:8/174: symlink d1/l2d 0 2024-05-09T06:30:36.170 INFO:tasks.workunit.client.1.smithi106.stdout:3/805: dread d5/d1c/d24/f59 [0,4194304] 0 2024-05-09T06:30:36.170 INFO:tasks.workunit.client.1.smithi106.stdout:3/806: creat d5/d4d/d7a/f100 x:0 0 0 2024-05-09T06:30:36.171 INFO:tasks.workunit.client.1.smithi106.stdout:1/971: rename d4/d76/d13/dbb/f55 to d4/d76/d65/d8d/db5/d10f/d139/d14b/f15a 0 2024-05-09T06:30:36.171 INFO:tasks.workunit.client.1.smithi106.stdout:1/972: truncate d4/d37/ffb 1626876 0 2024-05-09T06:30:36.172 INFO:tasks.workunit.client.1.smithi106.stdout:5/972: dread d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/f8c [0,4194304] 0 2024-05-09T06:30:36.175 INFO:tasks.workunit.client.0.smithi046.stdout:1/157: mkdir d7/d10/d28/d30 0 2024-05-09T06:30:36.176 INFO:tasks.workunit.client.0.smithi046.stdout:1/158: write d7/d10/f13 [524154,123594] 0 2024-05-09T06:30:36.178 INFO:tasks.workunit.client.1.smithi106.stdout:9/932: creat d4/d54/d69/d95/d23/d16/dd1/dbc/f126 x:0 0 0 2024-05-09T06:30:36.179 INFO:tasks.workunit.client.1.smithi106.stdout:9/933: truncate d4/d54/d69/d95/d23/d16/dd1/d47/f7c 587413 0 2024-05-09T06:30:36.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/123: unlink d0/d1b/l28 0 2024-05-09T06:30:36.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/124: write d0/f14 [116790,86352] 0 2024-05-09T06:30:36.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/125: creat d0/d1b/f31 x:0 0 0 2024-05-09T06:30:36.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/126: fdatasync d0/f29 0 2024-05-09T06:30:36.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/127: chown d0/f29 181154 1 2024-05-09T06:30:36.181 INFO:tasks.workunit.client.1.smithi106.stdout:7/889: mkdir d0/d115 0 2024-05-09T06:30:36.182 INFO:tasks.workunit.client.0.smithi046.stdout:3/146: rmdir d4/d20/d24/d29/d2b 39 2024-05-09T06:30:36.192 INFO:tasks.workunit.client.0.smithi046.stdout:5/128: dread d0/f1 [0,4194304] 0 2024-05-09T06:30:36.193 INFO:tasks.workunit.client.0.smithi046.stdout:2/165: link da/db/f2e da/dc/f33 0 2024-05-09T06:30:36.194 INFO:tasks.workunit.client.1.smithi106.stdout:5/973: creat d8/d45/d4c/d32/ded/f12f x:0 0 0 2024-05-09T06:30:36.195 INFO:tasks.workunit.client.0.smithi046.stdout:9/163: rmdir d2/d6/d7 39 2024-05-09T06:30:36.197 INFO:tasks.workunit.client.1.smithi106.stdout:9/934: symlink d4/d54/d91/dc7/da2/l127 0 2024-05-09T06:30:36.198 INFO:tasks.workunit.client.0.smithi046.stdout:8/175: creat d1/db/dd/d14/f2e x:0 0 0 2024-05-09T06:30:36.198 INFO:tasks.workunit.client.1.smithi106.stdout:6/930: sync 2024-05-09T06:30:36.200 INFO:tasks.workunit.client.1.smithi106.stdout:1/973: dwrite d4/d5b/d75/fb0 [0,4194304] 0 2024-05-09T06:30:36.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/974: chown d4/d76/d65/d8d/fed 53003 1 2024-05-09T06:30:36.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/975: read - d4/d76/d1d/f129 zero size 2024-05-09T06:30:36.201 INFO:tasks.workunit.client.1.smithi106.stdout:1/976: read - d4/dbd/f107 zero size 2024-05-09T06:30:36.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/231: dwrite d7/f1a [0,4194304] 0 2024-05-09T06:30:36.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/232: chown d7/df/d10/l14 5370645 1 2024-05-09T06:30:36.202 INFO:tasks.workunit.client.1.smithi106.stdout:0/966: dwrite d1/d11/d23/d13/d2c/d3d/dbe/f111 [0,4194304] 0 2024-05-09T06:30:36.202 INFO:tasks.workunit.client.1.smithi106.stdout:0/967: creat d1/d11/d23/d13/d2c/d3d/dbe/f14f x:0 0 0 2024-05-09T06:30:36.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/176: dread d1/db/dd/d14/f19 [0,4194304] 0 2024-05-09T06:30:36.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/159: unlink d7/d10/l29 0 2024-05-09T06:30:36.205 INFO:tasks.workunit.client.1.smithi106.stdout:3/807: getdents d5/d1c/d24 0 2024-05-09T06:30:36.206 INFO:tasks.workunit.client.1.smithi106.stdout:3/808: chown d5/d4d/d7a/da9/da8/de5/lca 3179 1 2024-05-09T06:30:36.211 INFO:tasks.workunit.client.1.smithi106.stdout:8/867: rename d3/d6b to d3/d5/d35/d61/dfc/d11a 0 2024-05-09T06:30:36.212 INFO:tasks.workunit.client.1.smithi106.stdout:8/868: read d3/d5/d35/d4e/fca [555400,95502] 0 2024-05-09T06:30:36.212 INFO:tasks.workunit.client.1.smithi106.stdout:8/869: write d3/d5/d7/d15/df4/dfd/da9/ff8 [734687,40530] 0 2024-05-09T06:30:36.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/147: truncate d4/d20/d24/f18 1421274 0 2024-05-09T06:30:36.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/148: dread - d4/d20/d24/d2a/f2d zero size 2024-05-09T06:30:36.216 INFO:tasks.workunit.client.1.smithi106.stdout:5/974: symlink d8/d5a/d60/df6/d101/d115/l130 0 2024-05-09T06:30:36.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/166: symlink da/dc/l34 0 2024-05-09T06:30:36.220 INFO:tasks.workunit.client.1.smithi106.stdout:9/935: truncate d4/d54/d69/d95/d23/d16/dd1/d31/f44 2275320 0 2024-05-09T06:30:36.220 INFO:tasks.workunit.client.1.smithi106.stdout:9/936: write d4/d54/d69/d99/d2a/d42/f97 [641010,48876] 0 2024-05-09T06:30:36.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/129: dwrite d0/f14 [0,4194304] 0 2024-05-09T06:30:36.221 INFO:tasks.workunit.client.1.smithi106.stdout:9/937: write d4/d54/d69/d95/d23/dc6/f8c [4335397,88583] 0 2024-05-09T06:30:36.222 INFO:tasks.workunit.client.1.smithi106.stdout:9/938: getdents d4/d54/d69/d95/d23/d16/dd1/d38/d68/df1 0 2024-05-09T06:30:36.223 INFO:tasks.workunit.client.1.smithi106.stdout:6/931: mknod d0/d66/d13b/dd0/df2/c13f 0 2024-05-09T06:30:36.224 INFO:tasks.workunit.client.0.smithi046.stdout:4/233: symlink d7/df/d3a/d25/l55 0 2024-05-09T06:30:36.225 INFO:tasks.workunit.client.1.smithi106.stdout:7/890: rmdir d0/da5/d108/d1a/d5a 39 2024-05-09T06:30:36.227 INFO:tasks.workunit.client.1.smithi106.stdout:1/977: dwrite d4/d37/ffb [0,4194304] 0 2024-05-09T06:30:36.228 INFO:tasks.workunit.client.0.smithi046.stdout:2/167: write f7 [936815,109500] 0 2024-05-09T06:30:36.228 INFO:tasks.workunit.client.0.smithi046.stdout:2/168: stat da 0 2024-05-09T06:30:36.228 INFO:tasks.workunit.client.0.smithi046.stdout:2/169: chown da/de/d14/f1b 11194906 1 2024-05-09T06:30:36.232 INFO:tasks.workunit.client.1.smithi106.stdout:3/809: dwrite d5/d8f/fd1 [0,4194304] 0 2024-05-09T06:30:36.234 INFO:tasks.workunit.client.1.smithi106.stdout:5/975: dwrite d8/feb [0,4194304] 0 2024-05-09T06:30:36.236 INFO:tasks.workunit.client.1.smithi106.stdout:1/978: dread d4/d76/f53 [0,4194304] 0 2024-05-09T06:30:36.239 INFO:tasks.workunit.client.0.smithi046.stdout:8/177: creat d1/d7/d2c/f2f x:0 0 0 2024-05-09T06:30:36.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/160: rename d7/l22 to d7/d10/l31 0 2024-05-09T06:30:36.251 INFO:tasks.workunit.client.1.smithi106.stdout:0/968: mknod d1/d11/d23/d13/d8a/dc1/c150 0 2024-05-09T06:30:36.253 INFO:tasks.workunit.client.0.smithi046.stdout:5/130: link d0/d1b/c2b d0/c32 0 2024-05-09T06:30:36.255 INFO:tasks.workunit.client.1.smithi106.stdout:8/870: symlink d3/d5/d35/d4e/d32/l11b 0 2024-05-09T06:30:36.255 INFO:tasks.workunit.client.1.smithi106.stdout:8/871: dread - d3/d5/dbc/fe8 zero size 2024-05-09T06:30:36.257 INFO:tasks.workunit.client.1.smithi106.stdout:9/939: creat d4/d54/d100/f128 x:0 0 0 2024-05-09T06:30:36.257 INFO:tasks.workunit.client.1.smithi106.stdout:9/940: fsync d4/f3d 0 2024-05-09T06:30:36.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/170: mknod da/de/d1c/c35 0 2024-05-09T06:30:36.260 INFO:tasks.workunit.client.1.smithi106.stdout:6/932: creat d0/d66/d13b/dd0/df2/f140 x:0 0 0 2024-05-09T06:30:36.262 INFO:tasks.workunit.client.0.smithi046.stdout:1/161: unlink d7/d10/l1a 0 2024-05-09T06:30:36.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/162: dread d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:36.264 INFO:tasks.workunit.client.1.smithi106.stdout:7/891: mknod d0/da5/d108/d45/da6/dc5/d106/c116 0 2024-05-09T06:30:36.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/149: getdents d4/d5 0 2024-05-09T06:30:36.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/150: read - d4/d20/d24/d2a/f2d zero size 2024-05-09T06:30:36.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/234: symlink d7/df/d10/d2f/l56 0 2024-05-09T06:30:36.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/235: chown d7/df/d10/d2f/f50 1626 1 2024-05-09T06:30:36.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/236: dread - d7/df/d3a/d25/f54 zero size 2024-05-09T06:30:36.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/237: fsync d7/df/d3a/f2c 0 2024-05-09T06:30:36.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/238: chown d7/df/d10/d1d/l23 410054047 1 2024-05-09T06:30:36.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/171: unlink da/l16 0 2024-05-09T06:30:36.271 INFO:tasks.workunit.client.1.smithi106.stdout:9/941: dread d4/d54/d69/d95/d23/d16/dd1/d38/f40 [0,4194304] 0 2024-05-09T06:30:36.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/178: dwrite d1/db/f16 [4194304,4194304] 0 2024-05-09T06:30:36.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/179: chown d1/db/dd/d14/f2e 1188042 1 2024-05-09T06:30:36.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/180: write d1/db/f16 [8727230,26092] 0 2024-05-09T06:30:36.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/181: fsync d1/db/dd/d11/f27 0 2024-05-09T06:30:36.276 INFO:tasks.workunit.client.0.smithi046.stdout:3/151: rename d4/d5/la to d4/d20/d24/l33 0 2024-05-09T06:30:36.276 INFO:tasks.workunit.client.1.smithi106.stdout:3/810: write d5/f7c [514492,31641] 0 2024-05-09T06:30:36.277 INFO:tasks.workunit.client.1.smithi106.stdout:4/844: sync 2024-05-09T06:30:36.280 INFO:tasks.workunit.client.1.smithi106.stdout:0/969: dwrite d1/d11/d23/d13/d2c/f134 [0,4194304] 0 2024-05-09T06:30:36.281 INFO:tasks.workunit.client.0.smithi046.stdout:3/152: dread d4/f2c [0,4194304] 0 2024-05-09T06:30:36.282 INFO:tasks.workunit.client.1.smithi106.stdout:5/976: dwrite d8/d33/f96 [0,4194304] 0 2024-05-09T06:30:36.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.301+0000 7fafa46f6700 1 -- 172.21.15.46:0/3217648710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fc720 msgr2=0x7faf9c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.301+0000 7fafa46f6700 1 --2- 172.21.15.46:0/3217648710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fc720 0x7faf9c0fcb90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faf8c004a50 tx=0x7faf8c00af40 comp rx=0 tx=0).stop 2024-05-09T06:30:36.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.301+0000 7fafa46f6700 1 -- 172.21.15.46:0/3217648710 shutdown_connections 2024-05-09T06:30:36.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.301+0000 7fafa46f6700 1 --2- 172.21.15.46:0/3217648710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fc720 0x7faf9c0fcb90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.301+0000 7fafa46f6700 1 --2- 172.21.15.46:0/3217648710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c0fb470 0x7faf9c0fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.301+0000 7fafa46f6700 1 -- 172.21.15.46:0/3217648710 >> 172.21.15.46:0/3217648710 conn(0x7faf9c0f6bb0 msgr2=0x7faf9c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:36.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.302+0000 7fafa46f6700 1 -- 172.21.15.46:0/3217648710 shutdown_connections 2024-05-09T06:30:36.285 INFO:tasks.workunit.client.0.smithi046.stdout:8/182: unlink d1/db/dd/d11/c18 0 2024-05-09T06:30:36.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.302+0000 7fafa46f6700 1 -- 172.21.15.46:0/3217648710 wait complete. 2024-05-09T06:30:36.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.303+0000 7fafa46f6700 1 Processor -- start 2024-05-09T06:30:36.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.304+0000 7fafa46f6700 1 -- start start 2024-05-09T06:30:36.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.304+0000 7fafa46f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 0x7faf9c10b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:36.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.304+0000 7fafa46f6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c0fc720 0x7faf9c10bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:36.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.304+0000 7fafa46f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c10c2a0 con 0x7faf9c0fb470 2024-05-09T06:30:36.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.304+0000 7fafa46f6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c10c410 con 0x7faf9c0fc720 2024-05-09T06:30:36.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa2492700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 0x7faf9c10b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:36.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa2492700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 0x7faf9c10b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50826/0 (socket says 172.21.15.46:50826) 2024-05-09T06:30:36.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa2492700 1 -- 172.21.15.46:0/4215869176 learned_addr learned my addr 172.21.15.46:0/4215869176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:36.288 INFO:tasks.workunit.client.1.smithi106.stdout:1/979: truncate d4/d37/d3d/f44 223811 0 2024-05-09T06:30:36.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa1c91700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c0fc720 0x7faf9c10bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:36.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa2492700 1 -- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c0fc720 msgr2=0x7faf9c10bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa2492700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c0fc720 0x7faf9c10bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.305+0000 7fafa2492700 1 -- 172.21.15.46:0/4215869176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c005040 con 0x7faf9c0fb470 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.306+0000 7fafa2492700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 0x7faf9c10b760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faf98004fa0 tx=0x7faf98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.306+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf98017b50 con 0x7faf9c0fb470 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.306+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf9801b070 con 0x7faf9c0fb470 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.306+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf9801f970 con 0x7faf9c0fb470 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.306+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c110e70 con 0x7faf9c0fb470 2024-05-09T06:30:36.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.306+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c1113a0 con 0x7faf9c0fb470 2024-05-09T06:30:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.309+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7faf9801d020 con 0x7faf9c0fb470 2024-05-09T06:30:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.309+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c04c710 con 0x7faf9c0fb470 2024-05-09T06:30:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.309+0000 7faf92ffd700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7faf88070bf0 0x7faf880730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:36.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.309+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7faf98065a40 con 0x7faf9c0fb470 2024-05-09T06:30:36.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/239: getdents d7/df/d3a 0 2024-05-09T06:30:36.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/240: chown f5 3888 1 2024-05-09T06:30:36.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.309+0000 7fafa1c91700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7faf88070bf0 0x7faf880730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:36.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.310+0000 7fafa1c91700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7faf88070bf0 0x7faf880730a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0049a0 tx=0x7faf8c00af40 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:36.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/131: dwrite d0/f24 [0,4194304] 0 2024-05-09T06:30:36.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/153: creat d4/d20/d24/d29/d2b/f34 x:0 0 0 2024-05-09T06:30:36.298 INFO:tasks.workunit.client.1.smithi106.stdout:6/933: creat d0/d66/d13b/d4e/d98/f141 x:0 0 0 2024-05-09T06:30:36.299 INFO:tasks.workunit.client.1.smithi106.stdout:7/892: getdents d0/da5/d108/d45/da6/dc5 0 2024-05-09T06:30:36.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.319+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7faf9805e9a0 con 0x7faf9c0fb470 2024-05-09T06:30:36.302 INFO:tasks.workunit.client.1.smithi106.stdout:4/845: mknod d7/c114 0 2024-05-09T06:30:36.303 INFO:tasks.workunit.client.1.smithi106.stdout:4/846: fdatasync d7/d10/d1a/d5a/d1c/f49 0 2024-05-09T06:30:36.303 INFO:tasks.workunit.client.1.smithi106.stdout:0/970: mknod d1/da1/d93/c151 0 2024-05-09T06:30:36.304 INFO:tasks.workunit.client.1.smithi106.stdout:1/980: dread d4/f14 [0,4194304] 0 2024-05-09T06:30:36.305 INFO:tasks.workunit.client.1.smithi106.stdout:1/981: truncate d4/d37/f136 1181770 0 2024-05-09T06:30:36.305 INFO:tasks.workunit.client.1.smithi106.stdout:6/934: write d0/d5c/fb9 [287782,78142] 0 2024-05-09T06:30:36.305 INFO:tasks.workunit.client.1.smithi106.stdout:5/977: creat d8/d5a/d60/d7e/dae/dd9/def/d99/df0/f131 x:0 0 0 2024-05-09T06:30:36.308 INFO:tasks.workunit.client.1.smithi106.stdout:7/893: creat d0/da5/d108/d1a/d36/d30/d44/f117 x:0 0 0 2024-05-09T06:30:36.308 INFO:tasks.workunit.client.1.smithi106.stdout:7/894: write d0/da5/d108/d1a/d5a/f97 [874056,75201] 0 2024-05-09T06:30:36.308 INFO:tasks.workunit.client.1.smithi106.stdout:7/895: readlink d0/da5/d108/d1a/d36/l37 0 2024-05-09T06:30:36.309 INFO:tasks.workunit.client.1.smithi106.stdout:0/971: chown d1/d11/d23/d13/d2c/f2d 4 1 2024-05-09T06:30:36.310 INFO:tasks.workunit.client.1.smithi106.stdout:1/982: unlink d4/d76/d13/d60/c63 0 2024-05-09T06:30:36.311 INFO:tasks.workunit.client.1.smithi106.stdout:1/983: chown d4/d76/d13/d60/d9c/de4/cf2 11842327 1 2024-05-09T06:30:36.313 INFO:tasks.workunit.client.1.smithi106.stdout:8/872: rename d3/d5/d35/d61/d6c/d83/d89/d9b to d3/d5/d35/d61/d11c 0 2024-05-09T06:30:36.316 INFO:tasks.workunit.client.1.smithi106.stdout:1/984: mkdir d4/d76/d13/d60/d124/d15b 0 2024-05-09T06:30:36.317 INFO:tasks.workunit.client.1.smithi106.stdout:9/942: dwrite d4/d54/d91/dbf/fdd [0,4194304] 0 2024-05-09T06:30:36.317 INFO:tasks.workunit.client.0.smithi046.stdout:1/163: dwrite d7/f2c [0,4194304] 0 2024-05-09T06:30:36.318 INFO:tasks.workunit.client.1.smithi106.stdout:5/978: rename d8/d5a/d60/d7e/dae/ld7 to d8/d33/d74/l132 0 2024-05-09T06:30:36.318 INFO:tasks.workunit.client.1.smithi106.stdout:0/972: dread d1/d11/d23/d22/f45 [0,4194304] 0 2024-05-09T06:30:36.319 INFO:tasks.workunit.client.1.smithi106.stdout:0/973: fdatasync d1/d11/d23/d22/f45 0 2024-05-09T06:30:36.319 INFO:tasks.workunit.client.1.smithi106.stdout:8/873: creat d3/d5/d35/d4e/d32/d92/dfb/f11d x:0 0 0 2024-05-09T06:30:36.319 INFO:tasks.workunit.client.1.smithi106.stdout:8/874: write d3/d5/d35/d4e/d32/f4a [3165752,27490] 0 2024-05-09T06:30:36.319 INFO:tasks.workunit.client.1.smithi106.stdout:6/935: dread d0/d17/f89 [0,4194304] 0 2024-05-09T06:30:36.324 INFO:tasks.workunit.client.1.smithi106.stdout:9/943: mkdir d4/d54/d91/d9c/df0/d129 0 2024-05-09T06:30:36.325 INFO:tasks.workunit.client.0.smithi046.stdout:1/164: symlink d7/d10/d28/d30/l32 0 2024-05-09T06:30:36.325 INFO:tasks.workunit.client.0.smithi046.stdout:1/165: readlink d7/la 0 2024-05-09T06:30:36.327 INFO:tasks.workunit.client.1.smithi106.stdout:0/974: dread d1/d11/d23/d13/d58/da8/dd6/d7e/fa5 [0,4194304] 0 2024-05-09T06:30:36.327 INFO:tasks.workunit.client.1.smithi106.stdout:0/975: write d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/de8/f13f [172034,71812] 0 2024-05-09T06:30:36.328 INFO:tasks.workunit.client.1.smithi106.stdout:1/985: rename d4/d76/d13/d60/d9c/feb to d4/d37/d3d/f15c 0 2024-05-09T06:30:36.328 INFO:tasks.workunit.client.1.smithi106.stdout:1/986: read d4/d76/d13/d2f/f42 [1186261,554] 0 2024-05-09T06:30:36.331 INFO:tasks.workunit.client.1.smithi106.stdout:9/944: getdents d4/d54/d69/d95/d23/d16/dd1/d31/dbd 0 2024-05-09T06:30:36.331 INFO:tasks.workunit.client.1.smithi106.stdout:9/945: fsync d4/d54/d69/d95/d23/d16/dd1/d31/fe2 0 2024-05-09T06:30:36.334 INFO:tasks.workunit.client.1.smithi106.stdout:8/875: dread d3/d5/d35/d61/d11c/fc4 [0,4194304] 0 2024-05-09T06:30:36.334 INFO:tasks.workunit.client.1.smithi106.stdout:9/946: mkdir d4/d54/d69/d99/d2a/d42/dfd/d12a 0 2024-05-09T06:30:36.334 INFO:tasks.workunit.client.1.smithi106.stdout:9/947: fdatasync d4/d54/d69/d95/f15 0 2024-05-09T06:30:36.337 INFO:tasks.workunit.client.1.smithi106.stdout:7/896: write d0/f13 [533532,116457] 0 2024-05-09T06:30:36.337 INFO:tasks.workunit.client.1.smithi106.stdout:7/897: fsync d0/da5/d108/d1a/d36/d30/d44/ded/fe4 0 2024-05-09T06:30:36.337 INFO:tasks.workunit.client.1.smithi106.stdout:7/898: truncate d0/da5/d108/d1a/d36/d1e/f21 405073 0 2024-05-09T06:30:36.337 INFO:tasks.workunit.client.1.smithi106.stdout:9/948: read d4/d54/d69/d95/d23/d16/f35 [978069,105641] 0 2024-05-09T06:30:36.338 INFO:tasks.workunit.client.1.smithi106.stdout:7/899: rmdir d0/da5/d108/d1a/d36/d30/d44/dc1/d111/d7a 39 2024-05-09T06:30:36.338 INFO:tasks.workunit.client.1.smithi106.stdout:7/900: readlink d0/da5/d108/le3 0 2024-05-09T06:30:36.340 INFO:tasks.workunit.client.1.smithi106.stdout:7/901: creat d0/da5/d108/d1a/d36/d30/d44/d6a/f118 x:0 0 0 2024-05-09T06:30:36.340 INFO:tasks.workunit.client.1.smithi106.stdout:7/902: fsync d0/da5/d108/d1a/f2f 0 2024-05-09T06:30:36.342 INFO:tasks.workunit.client.1.smithi106.stdout:5/979: read d8/d5a/d60/ff8 [1150431,51278] 0 2024-05-09T06:30:36.343 INFO:tasks.workunit.client.1.smithi106.stdout:7/903: creat d0/da5/d108/d1a/d36/d30/d44/df0/f119 x:0 0 0 2024-05-09T06:30:36.344 INFO:tasks.workunit.client.1.smithi106.stdout:0/976: dread d1/d11/d23/d13/d58/da8/dd6/d7e/d9f/ff3 [0,4194304] 0 2024-05-09T06:30:36.345 INFO:tasks.workunit.client.0.smithi046.stdout:8/183: dread d1/db/f16 [4194304,4194304] 0 2024-05-09T06:30:36.345 INFO:tasks.workunit.client.1.smithi106.stdout:5/980: symlink d8/d45/d4c/d85/d118/l133 0 2024-05-09T06:30:36.346 INFO:tasks.workunit.client.0.smithi046.stdout:8/184: dread d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:36.347 INFO:tasks.workunit.client.1.smithi106.stdout:7/904: creat d0/da5/f11a x:0 0 0 2024-05-09T06:30:36.348 INFO:tasks.workunit.client.1.smithi106.stdout:9/949: read d4/d54/f107 [1220611,87019] 0 2024-05-09T06:30:36.349 INFO:tasks.workunit.client.1.smithi106.stdout:0/977: creat d1/d11/d23/d13/d58/da8/f152 x:0 0 0 2024-05-09T06:30:36.349 INFO:tasks.workunit.client.1.smithi106.stdout:0/978: fsync d1/d11/d7f/f10b 0 2024-05-09T06:30:36.350 INFO:tasks.workunit.client.1.smithi106.stdout:5/981: mkdir d8/d5a/d60/d7e/d134 0 2024-05-09T06:30:36.350 INFO:tasks.workunit.client.1.smithi106.stdout:6/936: dread d0/fb5 [0,4194304] 0 2024-05-09T06:30:36.351 INFO:tasks.workunit.client.0.smithi046.stdout:8/185: dread d1/db/dd/d11/f27 [0,4194304] 0 2024-05-09T06:30:36.352 INFO:tasks.workunit.client.1.smithi106.stdout:3/811: dwrite d5/d4d/d5f/fcb [0,4194304] 0 2024-05-09T06:30:36.353 INFO:tasks.workunit.client.0.smithi046.stdout:2/172: dwrite da/db/f15 [0,4194304] 0 2024-05-09T06:30:36.353 INFO:tasks.workunit.client.0.smithi046.stdout:2/173: write da/de/f10 [5234906,40552] 0 2024-05-09T06:30:36.353 INFO:tasks.workunit.client.1.smithi106.stdout:7/905: unlink d0/da5/d108/d1a/d36/d30/d44/d80/f95 0 2024-05-09T06:30:36.354 INFO:tasks.workunit.client.1.smithi106.stdout:9/950: mkdir d4/d54/d91/d9c/d12b 0 2024-05-09T06:30:36.355 INFO:tasks.workunit.client.0.smithi046.stdout:8/186: mkdir d1/d7/d12/d1d/d30 0 2024-05-09T06:30:36.357 INFO:tasks.workunit.client.1.smithi106.stdout:0/979: symlink d1/d11/d23/d13/d2c/d6d/d10a/l153 0 2024-05-09T06:30:36.358 INFO:tasks.workunit.client.0.smithi046.stdout:8/187: dread d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:36.360 INFO:tasks.workunit.client.1.smithi106.stdout:6/937: read d0/d17/d76/f71 [4494944,124922] 0 2024-05-09T06:30:36.360 INFO:tasks.workunit.client.1.smithi106.stdout:6/938: chown d0 83277240 1 2024-05-09T06:30:36.361 INFO:tasks.workunit.client.0.smithi046.stdout:4/241: dwrite d7/df/d3a/d25/f4e [0,4194304] 0 2024-05-09T06:30:36.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/132: dwrite d0/f24 [4194304,4194304] 0 2024-05-09T06:30:36.361 INFO:tasks.workunit.client.0.smithi046.stdout:1/166: dwrite d7/f20 [0,4194304] 0 2024-05-09T06:30:36.362 INFO:tasks.workunit.client.1.smithi106.stdout:8/876: dwrite d3/d5/d35/d73/f10e [0,4194304] 0 2024-05-09T06:30:36.362 INFO:tasks.workunit.client.1.smithi106.stdout:8/877: truncate d3/d5/d35/d61/d6c/d83/fc9 1610339 0 2024-05-09T06:30:36.362 INFO:tasks.workunit.client.1.smithi106.stdout:5/982: unlink d8/d5a/d60/da8/daa/db4/fbe 0 2024-05-09T06:30:36.362 INFO:tasks.workunit.client.1.smithi106.stdout:4/847: dwrite d7/d10/d1a/fa2 [0,4194304] 0 2024-05-09T06:30:36.363 INFO:tasks.workunit.client.1.smithi106.stdout:4/848: chown d7/d10/f8f 25874028 1 2024-05-09T06:30:36.363 INFO:tasks.workunit.client.1.smithi106.stdout:1/987: dwrite d4/d76/d13/dbb/f87 [0,4194304] 0 2024-05-09T06:30:36.363 INFO:tasks.workunit.client.1.smithi106.stdout:1/988: stat d4/d37/d14c/l152 0 2024-05-09T06:30:36.363 INFO:tasks.workunit.client.1.smithi106.stdout:3/812: read d5/d1c/d24/f43 [3144279,23977] 0 2024-05-09T06:30:36.370 INFO:tasks.workunit.client.0.smithi046.stdout:2/174: symlink da/de/d14/l36 0 2024-05-09T06:30:36.371 INFO:tasks.workunit.client.1.smithi106.stdout:7/906: truncate d0/f5b 1374888 0 2024-05-09T06:30:36.373 INFO:tasks.workunit.client.1.smithi106.stdout:9/951: mknod d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/c12c 0 2024-05-09T06:30:36.373 INFO:tasks.workunit.client.1.smithi106.stdout:9/952: creat d4/d54/d69/d95/d23/d16/dd1/d39/f12d x:0 0 0 2024-05-09T06:30:36.374 INFO:tasks.workunit.client.0.smithi046.stdout:8/188: link d1/d7/d12/f1f d1/d7/f31 0 2024-05-09T06:30:36.375 INFO:tasks.workunit.client.1.smithi106.stdout:0/980: mknod d1/da1/dd8/d14e/c154 0 2024-05-09T06:30:36.376 INFO:tasks.workunit.client.1.smithi106.stdout:1/989: dread d4/f12 [0,4194304] 0 2024-05-09T06:30:36.378 INFO:tasks.workunit.client.0.smithi046.stdout:2/175: dread da/db/f2e [0,4194304] 0 2024-05-09T06:30:36.378 INFO:tasks.workunit.client.0.smithi046.stdout:2/176: chown da/de/d14/d1f/d20 748677710 1 2024-05-09T06:30:36.378 INFO:tasks.workunit.client.1.smithi106.stdout:6/939: getdents d0/d66/d7e/de5 0 2024-05-09T06:30:36.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/133: symlink d0/d1b/d21/l33 0 2024-05-09T06:30:36.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/134: write d0/d1b/f31 [741825,109695] 0 2024-05-09T06:30:36.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/135: truncate d0/f2a 784697 0 2024-05-09T06:30:36.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/136: stat d0/l12 0 2024-05-09T06:30:36.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/137: fsync d0/fa 0 2024-05-09T06:30:36.388 INFO:tasks.workunit.client.1.smithi106.stdout:5/983: creat d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/dde/de9/f135 x:0 0 0 2024-05-09T06:30:36.390 INFO:tasks.workunit.client.1.smithi106.stdout:4/849: link d7/d10/f1d d7/d10/d10f/f115 0 2024-05-09T06:30:36.390 INFO:tasks.workunit.client.1.smithi106.stdout:4/850: truncate d7/fc4 22945 0 2024-05-09T06:30:36.390 INFO:tasks.workunit.client.1.smithi106.stdout:4/851: write d7/d10/d1a/d5a/d7a/d7f/f103 [50168,47489] 0 2024-05-09T06:30:36.394 INFO:tasks.workunit.client.1.smithi106.stdout:6/940: dwrite d0/d66/d13b/fbf [0,4194304] 0 2024-05-09T06:30:36.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/177: dwrite da/dc/f24 [0,4194304] 0 2024-05-09T06:30:36.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/178: fsync da/db/f15 0 2024-05-09T06:30:36.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/179: stat da/de 0 2024-05-09T06:30:36.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/180: chown da/de/d14/d1f/c21 221229 1 2024-05-09T06:30:36.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/181: chown da 7 1 2024-05-09T06:30:36.396 INFO:tasks.workunit.client.0.smithi046.stdout:5/138: dread d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:36.397 INFO:tasks.workunit.client.1.smithi106.stdout:3/813: symlink d5/d1c/d24/d89/d8c/l101 0 2024-05-09T06:30:36.400 INFO:tasks.workunit.client.1.smithi106.stdout:7/907: truncate d0/da5/d108/d1a/d36/d30/fcf 3416394 0 2024-05-09T06:30:36.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/189: chown d1/db/cc 1602749 1 2024-05-09T06:30:36.403 INFO:tasks.workunit.client.1.smithi106.stdout:6/941: dread d0/d66/d13b/d4e/d98/da9/db1/d8/d50/d8f/fd1 [0,4194304] 0 2024-05-09T06:30:36.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/182: creat da/de/d14/d1f/d20/d26/f37 x:0 0 0 2024-05-09T06:30:36.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/139: mknod d0/d1b/d21/c34 0 2024-05-09T06:30:36.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/140: creat d0/d1b/f35 x:0 0 0 2024-05-09T06:30:36.411 INFO:tasks.workunit.client.0.smithi046.stdout:1/167: getdents d7/d10/d28 0 2024-05-09T06:30:36.411 INFO:tasks.workunit.client.0.smithi046.stdout:1/168: readlink d7/d10/l14 0 2024-05-09T06:30:36.417 INFO:tasks.workunit.client.1.smithi106.stdout:9/953: mknod d4/d54/d69/d95/d23/d78/c12e 0 2024-05-09T06:30:36.418 INFO:tasks.workunit.client.0.smithi046.stdout:2/183: symlink da/de/d1c/l38 0 2024-05-09T06:30:36.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/184: chown da/de/d14/f28 3 1 2024-05-09T06:30:36.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/190: write d1/db/dd/d14/f19 [7609705,58737] 0 2024-05-09T06:30:36.426 INFO:tasks.workunit.client.0.smithi046.stdout:5/141: link d0/d1b/c1d d0/c36 0 2024-05-09T06:30:36.426 INFO:tasks.workunit.client.0.smithi046.stdout:5/142: creat d0/d1b/f37 x:0 0 0 2024-05-09T06:30:36.426 INFO:tasks.workunit.client.0.smithi046.stdout:5/143: truncate d0/d1b/f1e 5023450 0 2024-05-09T06:30:36.426 INFO:tasks.workunit.client.0.smithi046.stdout:5/144: dread - d0/f1c zero size 2024-05-09T06:30:36.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/169: dwrite d7/d10/f11 [0,4194304] 0 2024-05-09T06:30:36.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/170: write d7/d10/f12 [5297514,60213] 0 2024-05-09T06:30:36.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/185: rename da/de/d14/c1a to da/de/d14/d1f/c39 0 2024-05-09T06:30:36.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/186: chown da/db/f15 8265901 1 2024-05-09T06:30:36.437 INFO:tasks.workunit.client.0.smithi046.stdout:6/425: sync 2024-05-09T06:30:36.437 INFO:tasks.workunit.client.0.smithi046.stdout:8/191: rmdir d1/db 39 2024-05-09T06:30:36.443 INFO:tasks.workunit.client.1.smithi106.stdout:5/984: rename d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d104/c5e to d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d95/d100/c136 0 2024-05-09T06:30:36.451 INFO:tasks.workunit.client.1.smithi106.stdout:4/852: mknod d7/d39/c116 0 2024-05-09T06:30:36.451 INFO:tasks.workunit.client.1.smithi106.stdout:4/853: creat d7/d10/d1a/d5a/d1c/da7/f117 x:0 0 0 2024-05-09T06:30:36.455 INFO:tasks.workunit.client.0.smithi046.stdout:8/192: dwrite d1/d7/f31 [0,4194304] 0 2024-05-09T06:30:36.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/145: rename d0/d1b/f1e to d0/d1b/d21/f38 0 2024-05-09T06:30:36.456 INFO:tasks.workunit.client.1.smithi106.stdout:7/908: mkdir d0/da5/d108/d1a/d36/d30/d44/d58/d65/d11b 0 2024-05-09T06:30:36.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/187: truncate da/de/d14/f28 294325 0 2024-05-09T06:30:36.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/188: write f7 [4029407,59885] 0 2024-05-09T06:30:36.460 INFO:tasks.workunit.client.1.smithi106.stdout:6/942: truncate d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3b/d62/d109/f91 5128086 0 2024-05-09T06:30:36.460 INFO:tasks.workunit.client.1.smithi106.stdout:0/981: write d1/da1/dd8/fdc [1382694,8413] 0 2024-05-09T06:30:36.460 INFO:tasks.workunit.client.1.smithi106.stdout:0/982: chown d1/d11/ccc 1005193 1 2024-05-09T06:30:36.460 INFO:tasks.workunit.client.1.smithi106.stdout:0/983: dread - d1/d11/d23/d13/d58/da8/ff0 zero size 2024-05-09T06:30:36.460 INFO:tasks.workunit.client.1.smithi106.stdout:0/984: fdatasync d1/d11/f9c 0 2024-05-09T06:30:36.460 INFO:tasks.workunit.client.1.smithi106.stdout:0/985: chown d1/d11/l105 220307832 1 2024-05-09T06:30:36.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/426: getdents db 0 2024-05-09T06:30:36.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/427: stat db/d10/d3f/d44/d5e/f84 0 2024-05-09T06:30:36.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/428: fsync db/d10/d3f/d4f/f60 0 2024-05-09T06:30:36.463 INFO:tasks.workunit.client.1.smithi106.stdout:4/854: dwrite d7/d39/d35/d6f/d9c/fbc [0,4194304] 0 2024-05-09T06:30:36.463 INFO:tasks.workunit.client.1.smithi106.stdout:4/855: truncate d7/d28/d2a/d80/f101 1144545 0 2024-05-09T06:30:36.468 INFO:tasks.workunit.client.1.smithi106.stdout:9/954: creat d4/d54/d69/d95/d23/d16/dd1/d38/d68/f12f x:0 0 0 2024-05-09T06:30:36.468 INFO:tasks.workunit.client.1.smithi106.stdout:9/955: creat d4/d54/d91/dc7/da2/f130 x:0 0 0 2024-05-09T06:30:36.469 INFO:tasks.workunit.client.1.smithi106.stdout:7/909: dread d0/da5/d108/fea [0,4194304] 0 2024-05-09T06:30:36.469 INFO:tasks.workunit.client.1.smithi106.stdout:7/910: truncate d0/da5/d108/d1a/d36/d30/d44/d58/d65/fec 384849 0 2024-05-09T06:30:36.469 INFO:tasks.workunit.client.1.smithi106.stdout:7/911: getdents d0/da5/d108/d1a/d36/d30/d44/d6a/d72/ddd 0 2024-05-09T06:30:36.469 INFO:tasks.workunit.client.0.smithi046.stdout:5/146: mkdir d0/d1b/d39 0 2024-05-09T06:30:36.471 INFO:tasks.workunit.client.0.smithi046.stdout:2/189: mkdir da/de/d11/d3a 0 2024-05-09T06:30:36.473 INFO:tasks.workunit.client.1.smithi106.stdout:1/990: getdents d4/d76/d13/d60 0 2024-05-09T06:30:36.479 INFO:tasks.workunit.client.1.smithi106.stdout:5/985: symlink d8/d33/l137 0 2024-05-09T06:30:36.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/190: write da/dc/f24 [291314,57645] 0 2024-05-09T06:30:36.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/429: dwrite db/d10/d3f/f32 [0,4194304] 0 2024-05-09T06:30:36.489 INFO:tasks.workunit.client.1.smithi106.stdout:6/943: creat d0/d66/d13b/d4e/d98/da9/db1/d8/d13e/f142 x:0 0 0 2024-05-09T06:30:36.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/147: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:36.491 INFO:tasks.workunit.client.1.smithi106.stdout:0/986: stat d1/d11/d23/d13/l116 0 2024-05-09T06:30:36.499 INFO:tasks.workunit.client.1.smithi106.stdout:4/856: symlink d7/d28/d2a/d80/l118 0 2024-05-09T06:30:36.499 INFO:tasks.workunit.client.1.smithi106.stdout:0/987: read d1/d11/d23/d13/d58/f98 [6719505,22267] 0 2024-05-09T06:30:36.500 INFO:tasks.workunit.client.1.smithi106.stdout:0/988: read - d1/d11/d23/d13/d58/da8/fb5 zero size 2024-05-09T06:30:36.501 INFO:tasks.workunit.client.1.smithi106.stdout:8/878: sync 2024-05-09T06:30:36.502 INFO:tasks.workunit.client.0.smithi046.stdout:8/193: truncate d1/d7/d12/f1f 114337 0 2024-05-09T06:30:36.502 INFO:tasks.workunit.client.0.smithi046.stdout:8/194: chown d1/db/dd 1943 1 2024-05-09T06:30:36.505 INFO:tasks.workunit.client.1.smithi106.stdout:9/956: unlink d4/d54/d69/d99/d2a/d42/d6c/l8e 0 2024-05-09T06:30:36.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/148: creat d0/d1b/d39/f3a x:0 0 0 2024-05-09T06:30:36.510 INFO:tasks.workunit.client.1.smithi106.stdout:3/814: rename d5/c16 to d5/d8f/c102 0 2024-05-09T06:30:36.511 INFO:tasks.workunit.client.0.smithi046.stdout:2/191: rename da/de/d14/d1f/d20/d26 to da/de/d14/d1f/d3b 0 2024-05-09T06:30:36.511 INFO:tasks.workunit.client.0.smithi046.stdout:8/195: rename d1 to d1/db/dd/d14/d32 22 2024-05-09T06:30:36.511 INFO:tasks.workunit.client.0.smithi046.stdout:8/196: fsync d1/d7/d2c/f15 0 2024-05-09T06:30:36.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/149: symlink d0/l3b 0 2024-05-09T06:30:36.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/192: creat da/de/d14/d1f/d20/f3c x:0 0 0 2024-05-09T06:30:36.518 INFO:tasks.workunit.client.0.smithi046.stdout:5/150: link d0/f16 d0/d1b/d39/f3c 0 2024-05-09T06:30:36.518 INFO:tasks.workunit.client.0.smithi046.stdout:5/151: readlink d0/l9 0 2024-05-09T06:30:36.518 INFO:tasks.workunit.client.0.smithi046.stdout:5/152: dread - d0/f19 zero size 2024-05-09T06:30:36.520 INFO:tasks.workunit.client.1.smithi106.stdout:0/989: dwrite d1/d11/d23/d13/d58/da8/dd6/dfc/f132 [0,4194304] 0 2024-05-09T06:30:36.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/193: mkdir da/de/d11/d3d 0 2024-05-09T06:30:36.521 INFO:tasks.workunit.client.1.smithi106.stdout:9/957: dwrite d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/f81 [4194304,4194304] 0 2024-05-09T06:30:36.521 INFO:tasks.workunit.client.1.smithi106.stdout:9/958: stat d4/d54/f5f 0 2024-05-09T06:30:36.523 INFO:tasks.workunit.client.1.smithi106.stdout:4/857: mkdir d7/d10/d1a/d5a/d119 0 2024-05-09T06:30:36.523 INFO:tasks.workunit.client.1.smithi106.stdout:4/858: fsync d7/d39/d35/f9b 0 2024-05-09T06:30:36.523 INFO:tasks.workunit.client.1.smithi106.stdout:4/859: fsync d7/d39/d47/d89/fb4 0 2024-05-09T06:30:36.524 INFO:tasks.workunit.client.0.smithi046.stdout:2/194: creat da/de/d1c/f3e x:0 0 0 2024-05-09T06:30:36.528 INFO:tasks.workunit.client.1.smithi106.stdout:8/879: truncate d3/d5/d35/d61/d6c/d83/fc9 960688 0 2024-05-09T06:30:36.530 INFO:tasks.workunit.client.1.smithi106.stdout:7/912: rename d0/da5/d108/d1a/d36/d30/f32 to d0/da5/d108/d1a/d36/d30/d44/df0/f11c 0 2024-05-09T06:30:36.531 INFO:tasks.workunit.client.1.smithi106.stdout:3/815: rmdir d5/d85/dc3/d65/ddc 39 2024-05-09T06:30:36.533 INFO:tasks.workunit.client.1.smithi106.stdout:8/880: dread d3/d5/d7/d98/ff6 [0,4194304] 0 2024-05-09T06:30:36.535 INFO:tasks.workunit.client.1.smithi106.stdout:9/959: mknod d4/d54/d69/c131 0 2024-05-09T06:30:36.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/153: dwrite d0/f29 [0,4194304] 0 2024-05-09T06:30:36.569 INFO:tasks.workunit.client.0.smithi046.stdout:8/197: dwrite d1/d7/f31 [0,4194304] 0 2024-05-09T06:30:36.571 INFO:tasks.workunit.client.1.smithi106.stdout:4/860: mkdir d7/d39/d35/d7c/dd1/d11a 0 2024-05-09T06:30:36.571 INFO:tasks.workunit.client.0.smithi046.stdout:2/195: dwrite da/de/f1e [0,4194304] 0 2024-05-09T06:30:36.571 INFO:tasks.workunit.client.0.smithi046.stdout:2/196: stat da/de/d14/d1f/d20/c30 0 2024-05-09T06:30:36.571 INFO:tasks.workunit.client.0.smithi046.stdout:2/197: stat da/dc/ld 0 2024-05-09T06:30:36.572 INFO:tasks.workunit.client.0.smithi046.stdout:2/198: read f1 [86942,111613] 0 2024-05-09T06:30:36.574 INFO:tasks.workunit.client.1.smithi106.stdout:5/986: rename d8/d5a/dc7 to d8/d5a/d60/d7e/dae/dd9/d138 0 2024-05-09T06:30:36.575 INFO:tasks.workunit.client.1.smithi106.stdout:3/816: mknod d5/d4d/d7a/dce/c103 0 2024-05-09T06:30:36.576 INFO:tasks.workunit.client.1.smithi106.stdout:3/817: stat d5/d1c/d24/cf2 0 2024-05-09T06:30:36.577 INFO:tasks.workunit.client.1.smithi106.stdout:9/960: dread d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/fb5 [0,4194304] 0 2024-05-09T06:30:36.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/198: unlink d1/db/dd/d14/f19 0 2024-05-09T06:30:36.579 INFO:tasks.workunit.client.1.smithi106.stdout:3/818: dread d5/ff6 [0,4194304] 0 2024-05-09T06:30:36.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/819: stat d5/d1c/d24/d89/fe7 0 2024-05-09T06:30:36.581 INFO:tasks.workunit.client.1.smithi106.stdout:4/861: rename d7/d39/d35/d7c/dd1/ff9 to d7/d10/f11b 0 2024-05-09T06:30:36.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/154: dwrite d0/f4 [0,4194304] 0 2024-05-09T06:30:36.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/155: creat d0/d1b/f3d x:0 0 0 2024-05-09T06:30:36.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/156: chown d0/d1b/d39 490504 1 2024-05-09T06:30:36.588 INFO:tasks.workunit.client.1.smithi106.stdout:8/881: dwrite d3/d5/d35/d61/d6c/d83/d89/fd2 [0,4194304] 0 2024-05-09T06:30:36.588 INFO:tasks.workunit.client.1.smithi106.stdout:8/882: chown d3/d5/d7/fe6 1795 1 2024-05-09T06:30:36.588 INFO:tasks.workunit.client.1.smithi106.stdout:8/883: dread - d3/d5/d35/d61/d6c/d83/dcc/de9/fd4 zero size 2024-05-09T06:30:36.588 INFO:tasks.workunit.client.1.smithi106.stdout:8/884: stat d3/d5/d13 0 2024-05-09T06:30:36.595 INFO:tasks.workunit.client.1.smithi106.stdout:6/944: dwrite d0/d66/d13b/d4e/d98/da9/db1/d8/f1d [0,4194304] 0 2024-05-09T06:30:36.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.658+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf9c1115e0 con 0x7faf88070bf0 2024-05-09T06:30:36.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.659+0000 7faf92ffd700 1 -- 172.21.15.46:0/4215869176 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7faf9c1115e0 con 0x7faf88070bf0 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.661+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7faf88070bf0 msgr2=0x7faf880730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.661+0000 7fafa46f6700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7faf88070bf0 0x7faf880730a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0049a0 tx=0x7faf8c00af40 comp rx=0 tx=0).stop 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 msgr2=0x7faf9c10b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 0x7faf9c10b760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faf98004fa0 tx=0x7faf98009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 shutdown_connections 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7faf88070bf0 0x7faf880730a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf9c0fb470 0x7faf9c10b760 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 --2- 172.21.15.46:0/4215869176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c0fc720 0x7faf9c10bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 >> 172.21.15.46:0/4215869176 conn(0x7faf9c0f6bb0 msgr2=0x7faf9c0f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 shutdown_connections 2024-05-09T06:30:36.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.662+0000 7fafa46f6700 1 -- 172.21.15.46:0/4215869176 wait complete. 2024-05-09T06:30:36.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/199: link da/de/d11/l2f da/de/d14/d1f/d20/l3f 0 2024-05-09T06:30:36.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/200: fsync da/db/f15 0 2024-05-09T06:30:36.687 INFO:tasks.workunit.client.1.smithi106.stdout:9/961: mkdir d4/d54/d69/d95/d23/d16/dd1/d132 0 2024-05-09T06:30:36.687 INFO:tasks.workunit.client.1.smithi106.stdout:9/962: chown d4/d54/d69/d95/d23/d16/fe7 16850315 1 2024-05-09T06:30:36.688 INFO:tasks.workunit.client.0.smithi046.stdout:8/199: creat d1/f33 x:0 0 0 2024-05-09T06:30:36.693 INFO:tasks.workunit.client.1.smithi106.stdout:9/963: write d4/d54/d91/dbf/fdd [2322137,87215] 0 2024-05-09T06:30:36.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/157: mkdir d0/d3e 0 2024-05-09T06:30:36.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/158: write d0/d1b/d21/f38 [4210129,111033] 0 2024-05-09T06:30:36.695 INFO:tasks.workunit.client.1.smithi106.stdout:4/862: truncate d7/d39/d35/d7c/fd6 3606942 0 2024-05-09T06:30:36.701 INFO:tasks.workunit.client.0.smithi046.stdout:2/201: rename da/dc/f24 to da/de/d11/d3d/f40 0 2024-05-09T06:30:36.701 INFO:tasks.workunit.client.0.smithi046.stdout:2/202: chown da/de/d14/d1f/c21 550 1 2024-05-09T06:30:36.703 INFO:tasks.workunit.client.1.smithi106.stdout:8/885: symlink d3/d5/d35/d4e/dee/l11e 0 2024-05-09T06:30:36.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/200: link d1/d7/d2c/f2f d1/d7/f34 0 2024-05-09T06:30:36.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/159: unlink d0/l3 0 2024-05-09T06:30:36.714 INFO:tasks.workunit.client.0.smithi046.stdout:2/203: dread f1 [0,4194304] 0 2024-05-09T06:30:36.714 INFO:tasks.workunit.client.0.smithi046.stdout:2/204: write da/de/d14/d1f/d20/f3c [980287,30223] 0 2024-05-09T06:30:36.714 INFO:tasks.workunit.client.0.smithi046.stdout:2/205: dread - da/de/d14/f32 zero size 2024-05-09T06:30:36.722 INFO:tasks.workunit.client.1.smithi106.stdout:8/886: dwrite d3/d5/f3c [0,4194304] 0 2024-05-09T06:30:36.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/945: rename d0/d66/d13b/d4e/d98/fed to d0/d66/d13b/d4e/d98/da9/f143 0 2024-05-09T06:30:36.722 INFO:tasks.workunit.client.1.smithi106.stdout:6/946: chown d0/d66/d13b/d4e/d98/da9/db1/d8/l7c 7 1 2024-05-09T06:30:36.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/201: fsync d1/f33 0 2024-05-09T06:30:36.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/202: write d1/d7/d2c/f15 [131143,81012] 0 2024-05-09T06:30:36.725 INFO:tasks.workunit.client.1.smithi106.stdout:3/820: write d5/d1c/d24/d5b/f66 [2141835,98168] 0 2024-05-09T06:30:36.730 INFO:tasks.workunit.client.0.smithi046.stdout:5/160: dwrite d0/d1b/f30 [0,4194304] 0 2024-05-09T06:30:36.731 INFO:tasks.workunit.client.1.smithi106.stdout:9/964: link d4/d54/d69/d95/c83 d4/d54/d69/d95/d10d/c133 0 2024-05-09T06:30:36.731 INFO:tasks.workunit.client.1.smithi106.stdout:4/863: creat d7/d10/d1a/d5a/d119/f11c x:0 0 0 2024-05-09T06:30:36.732 INFO:tasks.workunit.client.0.smithi046.stdout:8/203: mkdir d1/db/d35 0 2024-05-09T06:30:36.734 INFO:tasks.workunit.client.0.smithi046.stdout:2/206: rename da/de/d11/d3d/f40 to da/de/d14/d1f/f41 0 2024-05-09T06:30:36.736 INFO:tasks.workunit.client.1.smithi106.stdout:1/991: sync 2024-05-09T06:30:36.739 INFO:tasks.workunit.client.0.smithi046.stdout:5/161: creat d0/d3e/f3f x:0 0 0 2024-05-09T06:30:36.739 INFO:tasks.workunit.client.1.smithi106.stdout:8/887: readlink d3/l23 0 2024-05-09T06:30:36.740 INFO:tasks.workunit.client.1.smithi106.stdout:8/888: write d3/d5/d35/d4e/fca [698427,35365] 0 2024-05-09T06:30:36.741 INFO:tasks.workunit.client.1.smithi106.stdout:0/990: sync 2024-05-09T06:30:36.741 INFO:tasks.workunit.client.1.smithi106.stdout:7/913: sync 2024-05-09T06:30:36.741 INFO:tasks.workunit.client.1.smithi106.stdout:5/987: sync 2024-05-09T06:30:36.742 INFO:tasks.workunit.client.0.smithi046.stdout:8/204: rmdir d1/db/d35 0 2024-05-09T06:30:36.743 INFO:tasks.workunit.client.1.smithi106.stdout:6/947: mknod d0/d66/d13b/d4e/d98/c144 0 2024-05-09T06:30:36.745 INFO:tasks.workunit.client.0.smithi046.stdout:8/205: read d1/db/dd/d11/f27 [827189,60300] 0 2024-05-09T06:30:36.745 INFO:tasks.workunit.client.0.smithi046.stdout:2/207: creat da/d2d/f42 x:0 0 0 2024-05-09T06:30:36.748 INFO:tasks.workunit.client.1.smithi106.stdout:3/821: mknod d5/d1c/d24/d98/dc0/c104 0 2024-05-09T06:30:36.748 INFO:tasks.workunit.client.1.smithi106.stdout:3/822: truncate d5/d1c/d24/d52/fef 460032 0 2024-05-09T06:30:36.751 INFO:tasks.workunit.client.0.smithi046.stdout:8/206: dread d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:36.757 INFO:tasks.workunit.client.1.smithi106.stdout:9/965: mkdir d4/d54/d69/d95/d23/d134 0 2024-05-09T06:30:36.757 INFO:tasks.workunit.client.1.smithi106.stdout:9/966: chown d4/d54/d69/d99/ce8 6169248 1 2024-05-09T06:30:36.758 INFO:tasks.workunit.client.1.smithi106.stdout:9/967: creat d4/d54/d69/d95/d23/d16/dd1/dbc/f135 x:0 0 0 2024-05-09T06:30:36.758 INFO:tasks.workunit.client.0.smithi046.stdout:8/207: symlink d1/d7/d2c/l36 0 2024-05-09T06:30:36.760 INFO:tasks.workunit.client.1.smithi106.stdout:4/864: mknod d7/d10/d10f/c11d 0 2024-05-09T06:30:36.761 INFO:tasks.workunit.client.0.smithi046.stdout:5/162: dwrite d0/d1b/f20 [0,4194304] 0 2024-05-09T06:30:36.766 INFO:tasks.workunit.client.0.smithi046.stdout:2/208: dwrite da/de/d14/f28 [0,4194304] 0 2024-05-09T06:30:36.766 INFO:tasks.workunit.client.0.smithi046.stdout:2/209: dread - f8 zero size 2024-05-09T06:30:36.767 INFO:tasks.workunit.client.1.smithi106.stdout:4/865: dread d7/d10/d1a/d5a/fbe [0,4194304] 0 2024-05-09T06:30:36.767 INFO:tasks.workunit.client.1.smithi106.stdout:8/889: truncate d3/d5/d7/f7f 3328130 0 2024-05-09T06:30:36.767 INFO:tasks.workunit.client.1.smithi106.stdout:8/890: readlink d3/d5/d13/l21 0 2024-05-09T06:30:36.767 INFO:tasks.workunit.client.1.smithi106.stdout:8/891: write d3/d5/d7/d15/fff [100500,30391] 0 2024-05-09T06:30:36.768 INFO:tasks.workunit.client.1.smithi106.stdout:7/914: creat d0/da5/d108/d1a/d36/d30/d44/d6a/d72/f11d x:0 0 0 2024-05-09T06:30:36.772 INFO:tasks.workunit.client.1.smithi106.stdout:0/991: symlink d1/d11/d23/d13/d2c/d6d/d70/l155 0 2024-05-09T06:30:36.774 INFO:tasks.workunit.client.1.smithi106.stdout:5/988: symlink d8/d5a/d60/d7e/dae/l139 0 2024-05-09T06:30:36.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/154: sync 2024-05-09T06:30:36.776 INFO:tasks.workunit.client.0.smithi046.stdout:0/287: sync 2024-05-09T06:30:36.776 INFO:tasks.workunit.client.0.smithi046.stdout:9/164: sync 2024-05-09T06:30:36.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/208: dwrite d1/d7/f31 [0,4194304] 0 2024-05-09T06:30:36.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/209: fdatasync d1/d7/d2c/f15 0 2024-05-09T06:30:36.779 INFO:tasks.workunit.client.1.smithi106.stdout:6/948: creat d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3b/f145 x:0 0 0 2024-05-09T06:30:36.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/163: creat d0/d1b/f40 x:0 0 0 2024-05-09T06:30:36.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/164: chown d0 16 1 2024-05-09T06:30:36.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/237: sync 2024-05-09T06:30:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.804+0000 7f28878a3700 1 -- 172.21.15.46:0/2223075467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28800fcf70 msgr2=0x7f28800fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.804+0000 7f28878a3700 1 --2- 172.21.15.46:0/2223075467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28800fcf70 0x7f28800fd3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2870004940 tx=0x7f2870009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:36.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.804+0000 7f28878a3700 1 -- 172.21.15.46:0/2223075467 shutdown_connections 2024-05-09T06:30:36.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.804+0000 7f28878a3700 1 --2- 172.21.15.46:0/2223075467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28800fcf70 0x7f28800fd3e0 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2870004940 tx=0x7f2870009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:36.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.804+0000 7f28878a3700 1 --2- 172.21.15.46:0/2223075467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f28800fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.804+0000 7f28878a3700 1 -- 172.21.15.46:0/2223075467 >> 172.21.15.46:0/2223075467 conn(0x7f28800f7420 msgr2=0x7f28800f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:36.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.806+0000 7f28878a3700 1 -- 172.21.15.46:0/2223075467 shutdown_connections 2024-05-09T06:30:36.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.806+0000 7f28878a3700 1 -- 172.21.15.46:0/2223075467 wait complete. 2024-05-09T06:30:36.789 INFO:tasks.workunit.client.1.smithi106.stdout:9/968: creat d4/d54/d69/d99/d2a/d42/d6c/f136 x:0 0 0 2024-05-09T06:30:36.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.807+0000 7f28878a3700 1 Processor -- start 2024-05-09T06:30:36.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.807+0000 7f28878a3700 1 -- start start 2024-05-09T06:30:36.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.807+0000 7f28878a3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f288010e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:36.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.807+0000 7f28878a3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2880066aa0 0x7f2880110c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:36.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.807+0000 7f28878a3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2880111150 con 0x7f2880066aa0 2024-05-09T06:30:36.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.807+0000 7f28878a3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28801112c0 con 0x7f28800fbcc0 2024-05-09T06:30:36.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f2884e3e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2880066aa0 0x7f2880110c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:36.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/210: mkdir da/d2d/d43 0 2024-05-09T06:30:36.791 INFO:tasks.workunit.client.0.smithi046.stdout:2/211: readlink da/de/d14/l2a 0 2024-05-09T06:30:36.791 INFO:tasks.workunit.client.0.smithi046.stdout:2/212: chown da/dc/c19 122042 1 2024-05-09T06:30:36.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f288563f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f288010e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:36.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f288563f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f288010e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:37756/0 (socket says 172.21.15.46:37756) 2024-05-09T06:30:36.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f288563f700 1 -- 172.21.15.46:0/2613856335 learned_addr learned my addr 172.21.15.46:0/2613856335 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:36.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f288563f700 1 -- 172.21.15.46:0/2613856335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2880066aa0 msgr2=0x7f2880110c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:36.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f288563f700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2880066aa0 0x7f2880110c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:36.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f288563f700 1 -- 172.21.15.46:0/2613856335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870005040 con 0x7f28800fbcc0 2024-05-09T06:30:36.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.808+0000 7f2884e3e700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2880066aa0 0x7f2880110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:30:36.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.809+0000 7f288563f700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f288010e6c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f287c002a50 tx=0x7f287c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:36.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.809+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f287c007cc0 con 0x7f28800fbcc0 2024-05-09T06:30:36.792 INFO:tasks.workunit.client.1.smithi106.stdout:1/992: getdents d4/dbd 0 2024-05-09T06:30:36.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/288: creat d11/f62 x:0 0 0 2024-05-09T06:30:36.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.809+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f287c00f040 con 0x7f28800fbcc0 2024-05-09T06:30:36.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.809+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28801115a0 con 0x7f28800fbcc0 2024-05-09T06:30:36.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.809+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f287c009640 con 0x7f28800fbcc0 2024-05-09T06:30:36.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.809+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2880111b30 con 0x7f28800fbcc0 2024-05-09T06:30:36.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/289: write d11/d18/d1c/f1d [4443561,128820] 0 2024-05-09T06:30:36.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.811+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288005f5c0 con 0x7f28800fbcc0 2024-05-09T06:30:36.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.811+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f287c0097a0 con 0x7f28800fbcc0 2024-05-09T06:30:36.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.812+0000 7f2875ffb700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f286c070bb0 0x7f286c073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:36.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.812+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f287c0907b0 con 0x7f28800fbcc0 2024-05-09T06:30:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.812+0000 7f2884e3e700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f286c070bb0 0x7f286c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:36.795 INFO:tasks.workunit.client.1.smithi106.stdout:8/892: link d3/d5/d13/d3a/dbe/ccb d3/d5/d111/c11f 0 2024-05-09T06:30:36.795 INFO:tasks.workunit.client.1.smithi106.stdout:8/893: dread - d3/d5/d35/fea zero size 2024-05-09T06:30:36.796 INFO:tasks.workunit.client.1.smithi106.stdout:8/894: getdents d3/d5/d35/d73/d10b 0 2024-05-09T06:30:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.814+0000 7f2884e3e700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f286c070bb0 0x7f286c073060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f287000b970 tx=0x7f2870009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:36.797 INFO:tasks.workunit.client.1.smithi106.stdout:7/915: mkdir d0/da5/d108/d1a/d36/d30/d44/dc1/d111/d7a/d11e 0 2024-05-09T06:30:36.797 INFO:tasks.workunit.client.1.smithi106.stdout:7/916: chown d0/da5/d108/d1a/d36/d30/fb8 0 1 2024-05-09T06:30:36.798 INFO:tasks.workunit.client.0.smithi046.stdout:8/210: creat d1/d7/f37 x:0 0 0 2024-05-09T06:30:36.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/213: dread f6 [4194304,4194304] 0 2024-05-09T06:30:36.803 INFO:tasks.workunit.client.0.smithi046.stdout:3/155: dwrite d4/d20/d24/d29/d2b/f34 [0,4194304] 0 2024-05-09T06:30:36.804 INFO:tasks.workunit.client.0.smithi046.stdout:9/165: dwrite d2/d6/d7/d1a/d27/f34 [0,4194304] 0 2024-05-09T06:30:36.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/238: getdents d3/d7/d4c 0 2024-05-09T06:30:36.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/239: write d3/d7/d28/d29/d3b/f4a [455310,53604] 0 2024-05-09T06:30:36.804 INFO:tasks.workunit.client.1.smithi106.stdout:0/992: mkdir d1/d11/d23/d13/d2c/d57/d156 0 2024-05-09T06:30:36.804 INFO:tasks.workunit.client.1.smithi106.stdout:3/823: dwrite d5/d1c/d24/d98/dc0/d32/f6e [0,4194304] 0 2024-05-09T06:30:36.804 INFO:tasks.workunit.client.1.smithi106.stdout:8/895: write d3/d5/d35/d4e/d32/f9a [3080935,115812] 0 2024-05-09T06:30:36.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:36.822+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f287c058c50 con 0x7f28800fbcc0 2024-05-09T06:30:36.805 INFO:tasks.workunit.client.0.smithi046.stdout:3/156: write d4/d20/f26 [65814,4031] 0 2024-05-09T06:30:36.805 INFO:tasks.workunit.client.1.smithi106.stdout:8/896: dread d3/d5/d7/d98/ff6 [0,4194304] 0 2024-05-09T06:30:36.806 INFO:tasks.workunit.client.1.smithi106.stdout:5/989: creat d8/d5a/d60/d7e/dae/dd9/d138/f13a x:0 0 0 2024-05-09T06:30:36.809 INFO:tasks.workunit.client.0.smithi046.stdout:2/214: symlink da/de/d11/l44 0 2024-05-09T06:30:36.810 INFO:tasks.workunit.client.0.smithi046.stdout:2/215: stat da/db/f15 0 2024-05-09T06:30:36.813 INFO:tasks.workunit.client.1.smithi106.stdout:6/949: creat d0/d66/d13b/d4e/d98/da9/db1/d8/d9c/d11f/f146 x:0 0 0 2024-05-09T06:30:36.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/165: rmdir d0/d1b/d39 39 2024-05-09T06:30:36.815 INFO:tasks.workunit.client.0.smithi046.stdout:0/290: dwrite d11/d18/f3a [0,4194304] 0 2024-05-09T06:30:36.815 INFO:tasks.workunit.client.1.smithi106.stdout:8/897: write d3/d5/d7/d15/d3e/d7d/f84 [2132233,39318] 0 2024-05-09T06:30:36.817 INFO:tasks.workunit.client.0.smithi046.stdout:2/216: write da/dc/f27 [1844047,111533] 0 2024-05-09T06:30:36.817 INFO:tasks.workunit.client.0.smithi046.stdout:2/217: fsync f3 0 2024-05-09T06:30:36.819 INFO:tasks.workunit.client.1.smithi106.stdout:9/969: rename d4/d54/f107 to d4/d54/d91/d9c/df0/d129/f137 0 2024-05-09T06:30:36.820 INFO:tasks.workunit.client.1.smithi106.stdout:6/950: dread d0/d66/d13b/d4e/d98/da9/db1/d8/d50/fca [0,4194304] 0 2024-05-09T06:30:36.824 INFO:tasks.workunit.client.1.smithi106.stdout:1/993: write d4/d76/d13/d60/d9c/dbe/fc0 [5216532,20627] 0 2024-05-09T06:30:36.828 INFO:tasks.workunit.client.1.smithi106.stdout:7/917: mkdir d0/da5/d108/d1a/d36/d11f 0 2024-05-09T06:30:36.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/166: truncate d2/d6/d7/fd 2581302 0 2024-05-09T06:30:36.832 INFO:tasks.workunit.client.1.smithi106.stdout:0/993: getdents d1/d11/d23/d13/d58 0 2024-05-09T06:30:36.833 INFO:tasks.workunit.client.1.smithi106.stdout:0/994: creat d1/d11/d23/d13/d2c/d3d/dbe/f157 x:0 0 0 2024-05-09T06:30:36.834 INFO:tasks.workunit.client.1.smithi106.stdout:3/824: creat d5/d1c/d24/f105 x:0 0 0 2024-05-09T06:30:36.835 INFO:tasks.workunit.client.1.smithi106.stdout:3/825: write d5/d1c/d24/d98/dc0/f7e [4668624,45390] 0 2024-05-09T06:30:36.835 INFO:tasks.workunit.client.1.smithi106.stdout:3/826: stat d5/d4d/d7a/fb2 0 2024-05-09T06:30:36.835 INFO:tasks.workunit.client.1.smithi106.stdout:3/827: chown d5/d85/dc3/d26/d90/f97 1506 1 2024-05-09T06:30:36.837 INFO:tasks.workunit.client.0.smithi046.stdout:7/240: dread d3/f6 [0,4194304] 0 2024-05-09T06:30:36.837 INFO:tasks.workunit.client.0.smithi046.stdout:3/157: mknod d4/d20/d24/c35 0 2024-05-09T06:30:36.838 INFO:tasks.workunit.client.1.smithi106.stdout:5/990: link d8/d45/c48 d8/d5a/d60/da8/c13b 0 2024-05-09T06:30:36.838 INFO:tasks.workunit.client.1.smithi106.stdout:5/991: stat d8/d45/d4c/ddd 0 2024-05-09T06:30:36.839 INFO:tasks.workunit.client.0.smithi046.stdout:5/166: fdatasync d0/f2a 0 2024-05-09T06:30:36.840 INFO:tasks.workunit.client.0.smithi046.stdout:8/211: dwrite d1/db/f28 [0,4194304] 0 2024-05-09T06:30:36.841 INFO:tasks.workunit.client.0.smithi046.stdout:8/212: fsync d1/f33 0 2024-05-09T06:30:36.841 INFO:tasks.workunit.client.0.smithi046.stdout:8/213: dread - d1/d7/f34 zero size 2024-05-09T06:30:36.841 INFO:tasks.workunit.client.0.smithi046.stdout:8/214: chown d1/d7/d2c/f2f 311086458 1 2024-05-09T06:30:36.842 INFO:tasks.workunit.client.0.smithi046.stdout:0/291: rename d11/d18/d27/d28/c46 to d11/d18/d1c/c63 0 2024-05-09T06:30:36.843 INFO:tasks.workunit.client.1.smithi106.stdout:8/898: dwrite d3/d5/d7/d15/f49 [0,4194304] 0 2024-05-09T06:30:36.843 INFO:tasks.workunit.client.1.smithi106.stdout:8/899: write d3/d5/d7/f20 [5114704,58410] 0 2024-05-09T06:30:36.845 INFO:tasks.workunit.client.0.smithi046.stdout:2/218: dwrite da/de/d14/d1f/d3b/f37 [0,4194304] 0 2024-05-09T06:30:36.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/167: write d2/d6/d7/ff [2526600,18384] 0 2024-05-09T06:30:36.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/168: fsync d2/d6/d7/d1a/f2e 0 2024-05-09T06:30:36.847 INFO:tasks.workunit.client.1.smithi106.stdout:5/992: read d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/dda/f8b [2692527,118441] 0 2024-05-09T06:30:36.847 INFO:tasks.workunit.client.1.smithi106.stdout:7/918: dwrite d0/da5/d108/d1a/d36/d1e/f46 [0,4194304] 0 2024-05-09T06:30:36.850 INFO:tasks.workunit.client.1.smithi106.stdout:6/951: mknod d0/d66/d13b/c147 0 2024-05-09T06:30:36.851 INFO:tasks.workunit.client.1.smithi106.stdout:1/994: mknod d4/d76/d13/d2f/df5/dfd/c15d 0 2024-05-09T06:30:36.852 INFO:tasks.workunit.client.0.smithi046.stdout:5/167: mknod d0/d1b/d39/c41 0 2024-05-09T06:30:36.857 INFO:tasks.workunit.client.1.smithi106.stdout:0/995: mkdir d1/d11/d23/d13/d8a/dc1/d144/d158 0 2024-05-09T06:30:36.857 INFO:tasks.workunit.client.1.smithi106.stdout:5/993: read d8/d5a/d60/da8/daa/db4/f9a [825592,65727] 0 2024-05-09T06:30:36.861 INFO:tasks.workunit.client.1.smithi106.stdout:3/828: rename d5/d1c/d24/c31 to d5/d85/dc3/d65/de3/c106 0 2024-05-09T06:30:36.862 INFO:tasks.workunit.client.1.smithi106.stdout:9/970: rmdir d4/d54/db3/db6 39 2024-05-09T06:30:36.862 INFO:tasks.workunit.client.1.smithi106.stdout:9/971: readlink d4/d54/d69/lac 0 2024-05-09T06:30:36.862 INFO:tasks.workunit.client.1.smithi106.stdout:9/972: fdatasync d4/d54/d69/d95/d23/d16/dd1/d38/d68/f6f 0 2024-05-09T06:30:36.862 INFO:tasks.workunit.client.1.smithi106.stdout:9/973: fsync d4/d54/d69/d95/d23/d16/dd1/d47/f114 0 2024-05-09T06:30:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/292: dwrite fc [0,4194304] 0 2024-05-09T06:30:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/293: write d11/d18/d1c/d53/f61 [841356,6638] 0 2024-05-09T06:30:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/294: dread - d11/d18/d27/d28/f50 zero size 2024-05-09T06:30:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/295: stat d11/d18/d27/d28/d36/d5a/c60 0 2024-05-09T06:30:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/296: write d11/d18/f32 [2905338,14940] 0 2024-05-09T06:30:36.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/297: stat d11/f35 0 2024-05-09T06:30:36.865 INFO:tasks.workunit.client.0.smithi046.stdout:8/215: mkdir d1/d7/d12/d1d/d30/d38 0 2024-05-09T06:30:36.868 INFO:tasks.workunit.client.0.smithi046.stdout:7/241: rename d3/d3d/l40 to d3/d7/d4c/l54 0 2024-05-09T06:30:36.874 INFO:tasks.workunit.client.1.smithi106.stdout:7/919: symlink d0/da5/d108/d1a/df6/d110/l120 0 2024-05-09T06:30:36.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/952: creat d0/d66/d13b/d72/f148 x:0 0 0 2024-05-09T06:30:36.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/953: dread - d0/d66/d13b/d72/f148 zero size 2024-05-09T06:30:36.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/954: chown d0/d66/d13b/dd0/l139 69 1 2024-05-09T06:30:36.878 INFO:tasks.workunit.client.1.smithi106.stdout:6/955: write d0/d66/d13b/d4e/d98/da9/db1/d8/d50/f81 [4472657,76271] 0 2024-05-09T06:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/169: unlink d2/d6/d7/d1a/d27/d2a/c31 0 2024-05-09T06:30:36.879 INFO:tasks.workunit.client.1.smithi106.stdout:1/995: write d4/d76/d13/d60/d9c/dbe/fde [1555022,124547] 0 2024-05-09T06:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/168: getdents d0/d1b/d21 0 2024-05-09T06:30:36.881 INFO:tasks.workunit.client.1.smithi106.stdout:0/996: getdents d1/da1/d93 0 2024-05-09T06:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout:8/216: dwrite d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout:8/217: chown d1 4512692 1 2024-05-09T06:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/298: symlink d11/d18/d27/d28/d36/l64 0 2024-05-09T06:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/299: chown d11/d18/d1c/d53 13 1 2024-05-09T06:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/300: fdatasync d11/d18/d27/d28/f50 0 2024-05-09T06:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout:4/242: sync 2024-05-09T06:30:36.883 INFO:tasks.workunit.client.1.smithi106.stdout:5/994: mkdir d8/d5a/d60/d7e/dae/dd9/def/dd1/dff/d69/dde/de9/d13c 0 2024-05-09T06:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout:3/158: rename d4/f2c to d4/d20/f36 0 2024-05-09T06:30:36.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/866: sync 2024-05-09T06:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout:5/169: chown d0/fd 21537122 1 2024-05-09T06:30:36.887 INFO:tasks.workunit.client.1.smithi106.stdout:3/829: creat d5/d3f/f107 x:0 0 0 2024-05-09T06:30:36.887 INFO:tasks.workunit.client.1.smithi106.stdout:3/830: fsync d5/d4d/d72/fba 0 2024-05-09T06:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/430: sync 2024-05-09T06:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout:1/171: sync 2024-05-09T06:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/431: chown db/d10/c34 7357 1 2024-05-09T06:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout:6/432: dread db/f25 [0,4194304] 0 2024-05-09T06:30:36.890 INFO:tasks.workunit.client.1.smithi106.stdout:9/974: mknod d4/d54/d91/d9c/df0/c138 0 2024-05-09T06:30:36.893 INFO:tasks.workunit.client.1.smithi106.stdout:7/920: truncate d0/da5/d108/d1a/d36/d30/d44/df0/f11c 1535243 0 2024-05-09T06:30:36.893 INFO:tasks.workunit.client.1.smithi106.stdout:7/921: truncate d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/f114 125113 0 2024-05-09T06:30:36.895 INFO:tasks.workunit.client.1.smithi106.stdout:6/956: creat d0/d66/d13b/d4e/d98/da9/db1/d125/f149 x:0 0 0 2024-05-09T06:30:36.897 INFO:tasks.workunit.client.1.smithi106.stdout:1/996: symlink d4/d76/d13/d60/l15e 0 2024-05-09T06:30:36.897 INFO:tasks.workunit.client.1.smithi106.stdout:1/997: write d4/d76/d13/d2f/df5/f13c [107625,11568] 0 2024-05-09T06:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/301: symlink d11/d18/d27/d28/d36/d5a/l65 0 2024-05-09T06:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout:9/170: rename d2/d6/f29 to d2/d6/d7/d1a/f35 0 2024-05-09T06:30:36.903 INFO:tasks.workunit.client.1.smithi106.stdout:0/997: rename d1/d11/d23/d13/d2c/f2f to d1/da1/d93/d114/f159 0 2024-05-09T06:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/242: dwrite d3/d7/d28/d29/d35/f43 [0,4194304] 0 2024-05-09T06:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/243: getdents d3/d7/dd 0 2024-05-09T06:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/244: creat d3/d7/d28/d29/d35/f55 x:0 0 0 2024-05-09T06:30:36.905 INFO:tasks.workunit.client.1.smithi106.stdout:4/867: mkdir d7/d39/d35/d7c/d11e 0 2024-05-09T06:30:36.906 INFO:tasks.workunit.client.1.smithi106.stdout:4/868: dread - d7/d10/d1a/d5a/d1c/fe4 zero size 2024-05-09T06:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout:0/302: dread fc [0,4194304] 0 2024-05-09T06:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout:0/303: creat d11/d18/d1c/d53/f66 x:0 0 0 2024-05-09T06:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout:3/159: creat d4/d5/f37 x:0 0 0 2024-05-09T06:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/170: chown d0/f4 21563 1 2024-05-09T06:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout:3/160: write d4/d20/d24/f2e [167072,76171] 0 2024-05-09T06:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/172: creat d7/d10/d28/f33 x:0 0 0 2024-05-09T06:30:36.913 INFO:tasks.workunit.client.1.smithi106.stdout:3/831: dwrite d5/d1c/d24/d52/f71 [4194304,4194304] 0 2024-05-09T06:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout:8/218: dwrite d1/db/dd/f13 [8388608,4194304] 0 2024-05-09T06:30:36.914 INFO:tasks.workunit.client.1.smithi106.stdout:0/998: read d1/d11/d23/d13/f54 [6881279,42550] 0 2024-05-09T06:30:36.914 INFO:tasks.workunit.client.1.smithi106.stdout:7/922: unlink d0/da5/d108/d1a/d36/d30/d44/ff9 0 2024-05-09T06:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/243: rename f3 to d7/df/d3a/d25/f57 0 2024-05-09T06:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/244: getdents d7/df/d53 0 2024-05-09T06:30:36.918 INFO:tasks.workunit.client.1.smithi106.stdout:6/957: creat d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3e/d47/f14a x:0 0 0 2024-05-09T06:30:36.918 INFO:tasks.workunit.client.1.smithi106.stdout:6/958: write d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3e/f87 [759572,121222] 0 2024-05-09T06:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout:9/171: mknod d2/c36 0 2024-05-09T06:30:36.920 INFO:tasks.workunit.client.1.smithi106.stdout:1/998: mkdir d4/dbd/de6/d15f 0 2024-05-09T06:30:36.920 INFO:tasks.workunit.client.1.smithi106.stdout:1/999: read d4/d5b/d75/fb9 [1747216,18609] 0 2024-05-09T06:30:36.926 INFO:tasks.workunit.client.1.smithi106.stdout:4/869: creat d7/d28/de7/f11f x:0 0 0 2024-05-09T06:30:36.926 INFO:tasks.workunit.client.1.smithi106.stdout:4/870: readlink d7/d39/l56 0 2024-05-09T06:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout:8/219: write d1/d7/d2c/f2a [2105053,32991] 0 2024-05-09T06:30:36.928 INFO:tasks.workunit.client.1.smithi106.stdout:3/832: rename d5/d4d/d7a/dce to d5/d4d/d7a/da9/da8/de5/d108 0 2024-05-09T06:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/304: mknod d11/d3f/c67 0 2024-05-09T06:30:36.930 INFO:tasks.workunit.client.1.smithi106.stdout:0/999: mkdir d1/d11/d23/d13/d58/da8/dd6/dfc/d15a 0 2024-05-09T06:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/171: stat d0/c11 0 2024-05-09T06:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout:4/245: dwrite d7/f46 [0,4194304] 0 2024-05-09T06:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/161: getdents d4/d20 0 2024-05-09T06:30:36.933 INFO:tasks.workunit.client.1.smithi106.stdout:6/959: unlink d0/d66/d7e/fa1 0 2024-05-09T06:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/173: mkdir d7/d10/d34 0 2024-05-09T06:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/174: fsync d7/d10/d28/f2d 0 2024-05-09T06:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/172: dread d2/d6/d7/d1a/f35 [4194304,4194304] 0 2024-05-09T06:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout:7/245: dwrite d3/d7/d28/d29/f3c [0,4194304] 0 2024-05-09T06:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout:7/246: stat d3/d7/c1f 0 2024-05-09T06:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/173: chown d2/d6/d7/d1a/d27/f34 133021 1 2024-05-09T06:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout:7/247: chown d3/d7/d28/d29/f3c 55767361 1 2024-05-09T06:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/174: write d2/f4 [1199066,104599] 0 2024-05-09T06:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/175: creat d2/d6/d7/d1a/d27/f37 x:0 0 0 2024-05-09T06:30:36.936 INFO:tasks.workunit.client.1.smithi106.stdout:6/960: dread d0/d66/d13b/f6d [4194304,4194304] 0 2024-05-09T06:30:36.936 INFO:tasks.workunit.client.1.smithi106.stdout:4/871: link d7/d10/d1a/d5a/d46/c10c d7/d39/d35/d4a/c120 0 2024-05-09T06:30:36.937 INFO:tasks.workunit.client.1.smithi106.stdout:4/872: stat d7/d39/d35/d7c 0 2024-05-09T06:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout:6/433: mkdir db/d93/d96 0 2024-05-09T06:30:36.939 INFO:tasks.workunit.client.1.smithi106.stdout:3/833: mkdir d5/d1c/d24/d89/d8c/d109 0 2024-05-09T06:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout:0/305: rename d11/d3f/f55 to d11/d18/d27/f68 0 2024-05-09T06:30:36.948 INFO:tasks.workunit.client.1.smithi106.stdout:3/834: unlink d5/d85/dc3/d26/f58 0 2024-05-09T06:30:36.950 INFO:tasks.workunit.client.1.smithi106.stdout:3/835: write d5/d1c/d24/d98/dc0/d32/fd4 [488749,44162] 0 2024-05-09T06:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout:1/175: write d7/f8 [3891463,105244] 0 2024-05-09T06:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout:1/176: fsync d7/f25 0 2024-05-09T06:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout:4/246: creat d7/df/d10/d2f/d30/f58 x:0 0 0 2024-05-09T06:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout:4/247: chown d7/df/d10/d2f 3 1 2024-05-09T06:30:36.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/836: rmdir d5/d1c/d24/d89/d8e 39 2024-05-09T06:30:36.957 INFO:tasks.workunit.client.1.smithi106.stdout:3/837: truncate d5/d85/dc3/d26/f9e 8413113 0 2024-05-09T06:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout:3/162: link d4/d20/f26 d4/d20/d24/f38 0 2024-05-09T06:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout:3/163: dread - d4/d5/f37 zero size 2024-05-09T06:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:8/220: dwrite d1/d7/d2c/f2f [0,4194304] 0 2024-05-09T06:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:8/221: write d1/db/dd/f13 [12827202,25858] 0 2024-05-09T06:30:36.963 INFO:tasks.workunit.client.1.smithi106.stdout:3/838: mknod d5/d1c/d24/d98/dc0/d32/c10a 0 2024-05-09T06:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/176: mkdir d2/d6/d38 0 2024-05-09T06:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout:6/434: mknod db/d10/d76/c97 0 2024-05-09T06:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout:6/435: chown db/d10/d3f/d4f/c90 110892071 1 2024-05-09T06:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/177: creat d7/d10/d34/f35 x:0 0 0 2024-05-09T06:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/164: mknod d4/d20/d24/d29/d2b/c39 0 2024-05-09T06:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/165: chown d4/d20/d24/f1b 19594570 1 2024-05-09T06:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout:8/222: getdents d1/db 0 2024-05-09T06:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/248: rename d3/d7/d28/d29/d35/f43 to d3/d7/d28/d29/d35/f56 0 2024-05-09T06:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/177: dread d2/d6/d7/d1a/d27/f34 [0,4194304] 0 2024-05-09T06:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/436: mkdir db/d10/d3c/d98 0 2024-05-09T06:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/437: chown db/d10/d3f/d4f 88 1 2024-05-09T06:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/438: write db/d10/d3f/d44/d74/f80 [794776,88885] 0 2024-05-09T06:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/248: mkdir d7/df/d10/d2f/d59 0 2024-05-09T06:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/178: dread d7/d10/f11 [0,4194304] 0 2024-05-09T06:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/179: stat d7 0 2024-05-09T06:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/223: mknod d1/d7/d12/c39 0 2024-05-09T06:30:36.977 INFO:tasks.workunit.client.1.smithi106.stdout:3/839: write d5/d1c/d24/d89/fc1 [1078507,51165] 0 2024-05-09T06:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/249: rename d3/d7/c1f to d3/d7/d4c/c57 0 2024-05-09T06:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/250: creat d3/d7/d28/f58 x:0 0 0 2024-05-09T06:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/251: truncate d3/d7/d28/d29/d3b/f4a 522998 0 2024-05-09T06:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/252: chown d3/f1b 50 1 2024-05-09T06:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout:6/439: mknod db/d10/d3f/d44/d46/c99 0 2024-05-09T06:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:4/249: stat d7/ld 0 2024-05-09T06:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:4/250: chown f1 1310270643 1 2024-05-09T06:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:4/251: creat d7/df/d10/d2f/d30/f5a x:0 0 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout:0/306: dwrite d11/f12 [0,4194304] 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/224: dread d1/db/dd/d11/f27 [0,4194304] 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout:1/180: creat d7/d10/d28/d30/f36 x:0 0 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/172: dwrite d0/f1c [0,4194304] 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.1.smithi106.stdout:6/961: dwrite d0/d66/d13b/d72/f93 [0,4194304] 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.1.smithi106.stdout:6/962: write d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3e/f87 [938301,60956] 0 2024-05-09T06:30:36.984 INFO:tasks.workunit.client.1.smithi106.stdout:6/963: fsync d0/d66/d13b/d95/ff3 0 2024-05-09T06:30:36.985 INFO:tasks.workunit.client.1.smithi106.stdout:6/964: truncate d0/d66/d13b/d4e/d98/da9/db1/d125/f149 259653 0 2024-05-09T06:30:36.985 INFO:tasks.workunit.client.1.smithi106.stdout:4/873: dwrite d7/d10/d1a/d5a/f63 [0,4194304] 0 2024-05-09T06:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout:7/253: creat d3/d7/dd/f59 x:0 0 0 2024-05-09T06:30:36.995 INFO:tasks.workunit.client.1.smithi106.stdout:4/874: read d7/d39/d35/d6f/fa4 [3253107,40565] 0 2024-05-09T06:30:36.996 INFO:tasks.workunit.client.1.smithi106.stdout:4/875: chown d7/d39/d35/d7c/da8/ld9 1 1 2024-05-09T06:30:36.996 INFO:tasks.workunit.client.1.smithi106.stdout:4/876: chown d7/d39/d47/d66/c6b 828031 1 2024-05-09T06:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout:3/166: dwrite d4/d5/f37 [0,4194304] 0 2024-05-09T06:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout:8/225: rmdir d1/d7/d12 39 2024-05-09T06:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/178: dwrite f0 [0,4194304] 0 2024-05-09T06:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/179: write d2/d6/f25 [817124,2687] 0 2024-05-09T06:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/180: truncate d2/d6/d7/f1d 900622 0 2024-05-09T06:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout:4/252: dwrite d7/df/d10/f41 [0,4194304] 0 2024-05-09T06:30:37.004 INFO:tasks.workunit.client.1.smithi106.stdout:6/965: symlink d0/d66/d13b/dd0/l14b 0 2024-05-09T06:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout:9/181: dread d2/d6/d7/f12 [0,4194304] 0 2024-05-09T06:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout:1/181: symlink d7/d10/d28/d30/l37 0 2024-05-09T06:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout:1/182: stat d7/f20 0 2024-05-09T06:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout:1/183: read d7/f8 [3773768,56278] 0 2024-05-09T06:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/173: dread d0/fa [0,4194304] 0 2024-05-09T06:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/174: dread - d0/fd zero size 2024-05-09T06:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout:9/182: dwrite d2/f4 [8388608,4194304] 0 2024-05-09T06:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout:7/254: mknod d3/d7/d28/c5a 0 2024-05-09T06:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout:7/255: write d3/d7/dd/f44 [1377159,20804] 0 2024-05-09T06:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/256: truncate d3/d7/d28/d29/d3b/f4a 809260 0 2024-05-09T06:30:37.023 INFO:tasks.workunit.client.1.smithi106.stdout:3/840: rmdir d5/d1c/d24/d98/dc0/d32 39 2024-05-09T06:30:37.023 INFO:tasks.workunit.client.1.smithi106.stdout:3/841: creat d5/d1c/d24/d5b/de0/f10b x:0 0 0 2024-05-09T06:30:37.028 INFO:tasks.workunit.client.1.smithi106.stdout:6/966: symlink d0/d66/d13b/d4e/d98/da9/db1/d8/d50/d8f/l14c 0 2024-05-09T06:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/175: write d0/d1b/f30 [2001126,19261] 0 2024-05-09T06:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/176: chown d0/d1b/f35 386 1 2024-05-09T06:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/167: chown l2 6 1 2024-05-09T06:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/307: rmdir d11 39 2024-05-09T06:30:37.037 INFO:tasks.workunit.client.1.smithi106.stdout:3/842: creat d5/d85/dc3/d65/d81/f10c x:0 0 0 2024-05-09T06:30:37.041 INFO:tasks.workunit.client.1.smithi106.stdout:4/877: rename d7/d39/d47/cb7 to d7/d39/d8c/da1/c121 0 2024-05-09T06:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/226: mknod d1/d7/c3a 0 2024-05-09T06:30:37.044 INFO:tasks.workunit.client.1.smithi106.stdout:6/967: mknod d0/d66/d13b/d4e/d98/da9/c14d 0 2024-05-09T06:30:37.050 INFO:tasks.workunit.client.1.smithi106.stdout:4/878: unlink d7/d39/d35/d6f/d9c/fbc 0 2024-05-09T06:30:37.052 INFO:tasks.workunit.client.1.smithi106.stdout:6/968: truncate d0/f6a 2498139 0 2024-05-09T06:30:37.056 INFO:tasks.workunit.client.1.smithi106.stdout:6/969: creat d0/d66/d13b/d95/f14e x:0 0 0 2024-05-09T06:30:37.057 INFO:tasks.workunit.client.1.smithi106.stdout:6/970: fsync d0/d66/d13b/d95/f13c 0 2024-05-09T06:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:1/184: unlink d7/f20 0 2024-05-09T06:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:1/185: creat d7/d10/d28/d30/f38 x:0 0 0 2024-05-09T06:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:1/186: chown d7/d10/l14 0 1 2024-05-09T06:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout:9/183: creat d2/d26/f39 x:0 0 0 2024-05-09T06:30:37.060 INFO:tasks.workunit.client.1.smithi106.stdout:6/971: symlink d0/d66/d13b/d4e/d98/da9/db1/d8/d9c/l14f 0 2024-05-09T06:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/257: mkdir d3/d3d/d5b 0 2024-05-09T06:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/258: write d3/d7/d28/d29/d3b/f3f [76989,42941] 0 2024-05-09T06:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/259: write d3/d7/d28/f50 [874772,123337] 0 2024-05-09T06:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/260: readlink d3/d7/d28/d29/d35/l4b 0 2024-05-09T06:30:37.064 INFO:tasks.workunit.client.1.smithi106.stdout:6/972: dread d0/d66/d7e/f77 [0,4194304] 0 2024-05-09T06:30:37.064 INFO:tasks.workunit.client.1.smithi106.stdout:7/923: sync 2024-05-09T06:30:37.064 INFO:tasks.workunit.client.1.smithi106.stdout:8/900: sync 2024-05-09T06:30:37.065 INFO:tasks.workunit.client.1.smithi106.stdout:5/995: sync 2024-05-09T06:30:37.065 INFO:tasks.workunit.client.1.smithi106.stdout:9/975: sync 2024-05-09T06:30:37.065 INFO:tasks.workunit.client.1.smithi106.stdout:5/996: chown d8/d45/l6a 32759 1 2024-05-09T06:30:37.065 INFO:tasks.workunit.client.1.smithi106.stdout:5/997: chown d8/d45/d4c/ddd 396782 1 2024-05-09T06:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/227: creat d1/d7/d12/f3b x:0 0 0 2024-05-09T06:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout:9/184: symlink d2/d6/d7/d1a/d27/l3a 0 2024-05-09T06:30:37.067 INFO:tasks.workunit.client.1.smithi106.stdout:4/879: write d7/d10/d1a/fa2 [2476894,66964] 0 2024-05-09T06:30:37.069 INFO:tasks.workunit.client.1.smithi106.stdout:3/843: dwrite d5/d1c/d24/d5b/f66 [0,4194304] 0 2024-05-09T06:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/177: dwrite d0/fd [0,4194304] 0 2024-05-09T06:30:37.074 INFO:tasks.workunit.client.0.smithi046.stdout:0/308: dwrite d11/d18/d27/d28/d2d/f3e [0,4194304] 0 2024-05-09T06:30:37.074 INFO:tasks.workunit.client.0.smithi046.stdout:5/178: chown d0/f2a 0 1 2024-05-09T06:30:37.074 INFO:tasks.workunit.client.1.smithi106.stdout:5/998: symlink d8/d45/d4c/l13d 0 2024-05-09T06:30:37.077 INFO:tasks.workunit.client.1.smithi106.stdout:9/976: creat d4/d54/d69/d95/d23/dc6/f139 x:0 0 0 2024-05-09T06:30:37.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/977: fdatasync d4/d54/d69/d95/d23/d16/dd1/dbc/f126 0 2024-05-09T06:30:37.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/978: truncate d4/d54/d69/d95/d23/d16/f4c 8878729 0 2024-05-09T06:30:37.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/979: write d4/d54/d69/d99/d2a/d42/f124 [727608,44006] 0 2024-05-09T06:30:37.078 INFO:tasks.workunit.client.1.smithi106.stdout:9/980: chown d4/c48 165079592 1 2024-05-09T06:30:37.079 INFO:tasks.workunit.client.0.smithi046.stdout:3/168: link d4/d20/d24/f1b d4/d5/f3a 0 2024-05-09T06:30:37.080 INFO:tasks.workunit.client.0.smithi046.stdout:3/169: chown d4/d20/f36 1008926 1 2024-05-09T06:30:37.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/228: creat d1/d7/d12/d1d/f3c x:0 0 0 2024-05-09T06:30:37.085 INFO:tasks.workunit.client.1.smithi106.stdout:8/901: creat d3/d5/d7/d15/d3e/d7d/f120 x:0 0 0 2024-05-09T06:30:37.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/309: dread d11/d18/f32 [0,4194304] 0 2024-05-09T06:30:37.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/310: write d11/d18/d27/d28/d36/f37 [459924,121456] 0 2024-05-09T06:30:37.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/311: write d11/f62 [805843,113446] 0 2024-05-09T06:30:37.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/312: dread - d11/d18/d27/d28/d2d/f4a zero size 2024-05-09T06:30:37.086 INFO:tasks.workunit.client.1.smithi106.stdout:3/844: dread d5/f63 [0,4194304] 0 2024-05-09T06:30:37.086 INFO:tasks.workunit.client.1.smithi106.stdout:3/845: fsync d5/d4d/d5f/ff9 0 2024-05-09T06:30:37.087 INFO:tasks.workunit.client.0.smithi046.stdout:9/185: getdents d2/dc 0 2024-05-09T06:30:37.088 INFO:tasks.workunit.client.1.smithi106.stdout:3/846: read d5/d3f/f4f [1710906,59561] 0 2024-05-09T06:30:37.088 INFO:tasks.workunit.client.1.smithi106.stdout:3/847: truncate d5/d1c/d24/d89/fe7 661356 0 2024-05-09T06:30:37.090 INFO:tasks.workunit.client.1.smithi106.stdout:4/880: creat d7/d10/d1a/d5a/d7a/d7f/dc8/f122 x:0 0 0 2024-05-09T06:30:37.090 INFO:tasks.workunit.client.1.smithi106.stdout:4/881: dread - d7/d10/d1a/d5a/d7a/d7f/dc8/f122 zero size 2024-05-09T06:30:37.093 INFO:tasks.workunit.client.1.smithi106.stdout:5/999: symlink d8/d45/l13e 0 2024-05-09T06:30:37.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/229: dread d1/db/dd/f1a [0,4194304] 0 2024-05-09T06:30:37.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/230: rename d1/d7 to d1/d7/d12/d1d/d30/d3d 22 2024-05-09T06:30:37.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/231: truncate d1/db/dd/d14/f2e 753138 0 2024-05-09T06:30:37.099 INFO:tasks.workunit.client.1.smithi106.stdout:9/981: unlink d4/d54/d69/d95/d23/d16/dd1/d47/f7c 0 2024-05-09T06:30:37.099 INFO:tasks.workunit.client.1.smithi106.stdout:9/982: creat d4/d54/d69/d95/d23/d16/dd1/d38/d68/f13a x:0 0 0 2024-05-09T06:30:37.100 INFO:tasks.workunit.client.1.smithi106.stdout:7/924: dwrite d0/da5/d108/d1a/d36/f74 [0,4194304] 0 2024-05-09T06:30:37.100 INFO:tasks.workunit.client.1.smithi106.stdout:7/925: fdatasync d0/f9 0 2024-05-09T06:30:37.100 INFO:tasks.workunit.client.1.smithi106.stdout:7/926: truncate d0/da5/d108/d1a/d36/d30/d44/d6a/f8e 1013999 0 2024-05-09T06:30:37.102 INFO:tasks.workunit.client.1.smithi106.stdout:8/902: link d3/d5/d7/c9 d3/d5/d7/d15/d3e/c121 0 2024-05-09T06:30:37.103 INFO:tasks.workunit.client.1.smithi106.stdout:8/903: write d3/d5/d35/d4e/d32/f9a [888511,36504] 0 2024-05-09T06:30:37.108 INFO:tasks.workunit.client.0.smithi046.stdout:0/313: creat d11/d18/d27/d28/d36/d5a/f69 x:0 0 0 2024-05-09T06:30:37.112 INFO:tasks.workunit.client.0.smithi046.stdout:9/186: creat d2/d26/d2c/f3b x:0 0 0 2024-05-09T06:30:37.112 INFO:tasks.workunit.client.0.smithi046.stdout:9/187: readlink d2/d6/l14 0 2024-05-09T06:30:37.112 INFO:tasks.workunit.client.0.smithi046.stdout:9/188: write d2/d6/d7/d1a/d27/f37 [710992,72076] 0 2024-05-09T06:30:37.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/983: symlink d4/d54/d69/d99/d2a/d61/l13b 0 2024-05-09T06:30:37.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/984: fdatasync d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/fd6 0 2024-05-09T06:30:37.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/985: write d4/d54/d69/d95/f34 [1803261,11703] 0 2024-05-09T06:30:37.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/986: dread - d4/d54/d69/d95/d23/d78/fe6 zero size 2024-05-09T06:30:37.114 INFO:tasks.workunit.client.1.smithi106.stdout:9/987: getdents d4/d54/d125 0 2024-05-09T06:30:37.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/314: creat d11/d18/d1c/d53/f6a x:0 0 0 2024-05-09T06:30:37.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/189: mknod d2/d6/d7/d1a/d27/d2a/c3c 0 2024-05-09T06:30:37.118 INFO:tasks.workunit.client.0.smithi046.stdout:7/261: dwrite d3/d7/d28/d29/f3c [0,4194304] 0 2024-05-09T06:30:37.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/315: mkdir d11/d18/d27/d28/d6b 0 2024-05-09T06:30:37.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/316: truncate d11/d18/d27/f68 950393 0 2024-05-09T06:30:37.120 INFO:tasks.workunit.client.0.smithi046.stdout:9/190: mkdir d2/d26/d2c/d3d 0 2024-05-09T06:30:37.121 INFO:tasks.workunit.client.1.smithi106.stdout:8/904: read d3/d5/d13/f14 [732951,78083] 0 2024-05-09T06:30:37.122 INFO:tasks.workunit.client.1.smithi106.stdout:8/905: read - d3/d5/d35/d73/fad zero size 2024-05-09T06:30:37.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/262: mkdir d3/d7/d28/d29/d35/d5c 0 2024-05-09T06:30:37.125 INFO:tasks.workunit.client.0.smithi046.stdout:0/317: unlink fe 0 2024-05-09T06:30:37.125 INFO:tasks.workunit.client.0.smithi046.stdout:0/318: write d11/f14 [1056629,12587] 0 2024-05-09T06:30:37.125 INFO:tasks.workunit.client.0.smithi046.stdout:0/319: read f0 [3197336,109592] 0 2024-05-09T06:30:37.126 INFO:tasks.workunit.client.1.smithi106.stdout:8/906: mkdir d3/d5/d7/d15/d3e/d7d/d122 0 2024-05-09T06:30:37.126 INFO:tasks.workunit.client.0.smithi046.stdout:7/263: mknod d3/d7/d28/d29/d35/c5d 0 2024-05-09T06:30:37.127 INFO:tasks.workunit.client.0.smithi046.stdout:0/320: symlink d11/d18/d27/d28/d36/d5a/l6c 0 2024-05-09T06:30:37.128 INFO:tasks.workunit.client.0.smithi046.stdout:7/264: symlink d3/d7/d28/d29/d35/d5c/l5e 0 2024-05-09T06:30:37.129 INFO:tasks.workunit.client.0.smithi046.stdout:9/191: write d2/d6/d7/f1b [3687350,6464] 0 2024-05-09T06:30:37.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/321: creat d11/d4f/d5b/d5f/f6d x:0 0 0 2024-05-09T06:30:37.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/322: chown d11/d18/d1c/d56/c5e 1924 1 2024-05-09T06:30:37.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/323: truncate d11/d3f/f51 953570 0 2024-05-09T06:30:37.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/324: dread - d11/d18/d27/d28/d2d/f4a zero size 2024-05-09T06:30:37.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/325: readlink d11/d18/l20 0 2024-05-09T06:30:37.131 INFO:tasks.workunit.client.0.smithi046.stdout:7/265: mknod d3/d7/d28/d29/d3b/c5f 0 2024-05-09T06:30:37.132 INFO:tasks.workunit.client.1.smithi106.stdout:6/973: dwrite d0/d66/d13b/f69 [0,4194304] 0 2024-05-09T06:30:37.134 INFO:tasks.workunit.client.1.smithi106.stdout:3/848: dwrite d5/d1c/d24/d5b/f95 [0,4194304] 0 2024-05-09T06:30:37.134 INFO:tasks.workunit.client.1.smithi106.stdout:4/882: dwrite d7/d28/faa [0,4194304] 0 2024-05-09T06:30:37.134 INFO:tasks.workunit.client.1.smithi106.stdout:9/988: dwrite d4/d54/d69/d95/d23/d16/dd1/d31/dbd/de9/d11c/f81 [0,4194304] 0 2024-05-09T06:30:37.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/192: rename d2/d6/c1f to d2/d26/c3e 0 2024-05-09T06:30:37.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/170: dwrite d4/d20/f26 [0,4194304] 0 2024-05-09T06:30:37.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/171: write d4/d5/f3a [2132659,88942] 0 2024-05-09T06:30:37.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/172: readlink d4/d20/d24/l33 0 2024-05-09T06:30:37.135 INFO:tasks.workunit.client.0.smithi046.stdout:5/179: dwrite d0/f1c [0,4194304] 0 2024-05-09T06:30:37.135 INFO:tasks.workunit.client.0.smithi046.stdout:8/232: dwrite d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:37.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/326: link d11/d18/f32 d11/d18/f6e 0 2024-05-09T06:30:37.140 INFO:tasks.workunit.client.1.smithi106.stdout:8/907: write d3/d5/d35/d73/f10e [2094409,20921] 0 2024-05-09T06:30:37.143 INFO:tasks.workunit.client.1.smithi106.stdout:6/974: truncate d0/d66/fa0 3927949 0 2024-05-09T06:30:37.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/327: fsync d11/f62 0 2024-05-09T06:30:37.147 INFO:tasks.workunit.client.0.smithi046.stdout:5/180: fsync d0/d3e/f3f 0 2024-05-09T06:30:37.147 INFO:tasks.workunit.client.0.smithi046.stdout:5/181: stat d0/d1b/f30 0 2024-05-09T06:30:37.147 INFO:tasks.workunit.client.0.smithi046.stdout:5/182: dread - d0/d1b/f40 zero size 2024-05-09T06:30:37.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/233: dread d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:37.149 INFO:tasks.workunit.client.0.smithi046.stdout:8/234: write d1/db/dd/d11/f27 [993991,117296] 0 2024-05-09T06:30:37.153 INFO:tasks.workunit.client.1.smithi106.stdout:3/849: mkdir d5/d85/dc3/d65/ddc/d10d 0 2024-05-09T06:30:37.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/173: dread d4/d20/d24/f1b [0,4194304] 0 2024-05-09T06:30:37.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/174: fsync d4/d20/d24/d2a/f2d 0 2024-05-09T06:30:37.158 INFO:tasks.workunit.client.0.smithi046.stdout:3/175: dread d4/d20/d24/f1b [0,4194304] 0 2024-05-09T06:30:37.159 INFO:tasks.workunit.client.1.smithi106.stdout:4/883: mknod d7/d10/d1a/d5a/d119/c123 0 2024-05-09T06:30:37.159 INFO:tasks.workunit.client.1.smithi106.stdout:4/884: write d7/d10/d1a/d5a/d7a/d7f/fc0 [664112,51946] 0 2024-05-09T06:30:37.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/235: unlink d1/d7/d2c/f2a 0 2024-05-09T06:30:37.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/236: chown d1/l6 22 1 2024-05-09T06:30:37.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/237: chown d1/l6 888661 1 2024-05-09T06:30:37.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/193: dwrite d2/d6/d7/f23 [8388608,4194304] 0 2024-05-09T06:30:37.165 INFO:tasks.workunit.client.0.smithi046.stdout:7/266: dwrite d3/d7/d28/f24 [0,4194304] 0 2024-05-09T06:30:37.165 INFO:tasks.workunit.client.0.smithi046.stdout:7/267: chown d3/d7/dd/fe 13590 1 2024-05-09T06:30:37.165 INFO:tasks.workunit.client.0.smithi046.stdout:5/183: unlink d0/f29 0 2024-05-09T06:30:37.165 INFO:tasks.workunit.client.0.smithi046.stdout:0/328: dwrite f0 [0,4194304] 0 2024-05-09T06:30:37.167 INFO:tasks.workunit.client.0.smithi046.stdout:0/329: read d11/d18/d1c/d53/f61 [114514,102968] 0 2024-05-09T06:30:37.168 INFO:tasks.workunit.client.0.smithi046.stdout:3/176: mknod d4/c3b 0 2024-05-09T06:30:37.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/194: symlink d2/d6/d38/l3f 0 2024-05-09T06:30:37.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/268: unlink d3/lc 0 2024-05-09T06:30:37.183 INFO:tasks.workunit.client.1.smithi106.stdout:8/908: mkdir d3/d5/d35/d61/dfc/d123 0 2024-05-09T06:30:37.183 INFO:tasks.workunit.client.1.smithi106.stdout:8/909: fdatasync d3/d5/d7/fb5 0 2024-05-09T06:30:37.183 INFO:tasks.workunit.client.1.smithi106.stdout:8/910: fdatasync d3/d5/f8a 0 2024-05-09T06:30:37.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/330: mkdir d11/d3f/d6f 0 2024-05-09T06:30:37.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.203+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2880101470 con 0x7f286c070bb0 2024-05-09T06:30:37.185 INFO:tasks.workunit.client.1.smithi106.stdout:6/975: mknod d0/d66/c150 0 2024-05-09T06:30:37.185 INFO:tasks.workunit.client.0.smithi046.stdout:0/331: dread d11/d18/d27/d28/d36/f37 [0,4194304] 0 2024-05-09T06:30:37.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/238: dwrite d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:37.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/184: dwrite d0/d1b/f40 [0,4194304] 0 2024-05-09T06:30:37.187 INFO:tasks.workunit.client.1.smithi106.stdout:8/911: dread d3/d5/d7/d15/df4/dfd/da9/fd6 [0,4194304] 0 2024-05-09T06:30:37.187 INFO:tasks.workunit.client.1.smithi106.stdout:8/912: readlink d3/d5/d7/d15/l93 0 2024-05-09T06:30:37.187 INFO:tasks.workunit.client.1.smithi106.stdout:8/913: write d3/d5/d7/f44 [1838657,24857] 0 2024-05-09T06:30:37.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/269: symlink d3/d7/d28/d29/d35/d5c/l60 0 2024-05-09T06:30:37.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/270: chown d3/d7/d28/d29/d35/l4b 214559 1 2024-05-09T06:30:37.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/271: write d3/d7/d28/f2a [4604462,21134] 0 2024-05-09T06:30:37.191 INFO:tasks.workunit.client.1.smithi106.stdout:4/885: creat d7/d28/d2a/f124 x:0 0 0 2024-05-09T06:30:37.192 INFO:tasks.workunit.client.0.smithi046.stdout:9/195: dread d2/d6/d7/f1b [0,4194304] 0 2024-05-09T06:30:37.192 INFO:tasks.workunit.client.0.smithi046.stdout:9/196: read d2/d6/d7/f12 [1794103,103191] 0 2024-05-09T06:30:37.194 INFO:tasks.workunit.client.1.smithi106.stdout:6/976: creat d0/d66/d13b/dd0/f151 x:0 0 0 2024-05-09T06:30:37.194 INFO:tasks.workunit.client.1.smithi106.stdout:6/977: truncate d0/d66/d13b/d4e/d98/ffc 900127 0 2024-05-09T06:30:37.197 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:30:37.197 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 starting - - - - 2024-05-09T06:30:37.197 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 29s ago 8m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:30:37.197 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (7m) 36s ago 7m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 29s ago 8m 84.0M - 9.4.7 954c08fa6188 9ac57528a8a2 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (3m) 29s ago 3m 11.2M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (2m) 29s ago 2m 154M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (3m) 36s ago 3m 15.4M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (2m) 36s ago 2m 13.0M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:9283 running (9m) 29s ago 9m 339M - 17.2.7-933-g4ba5a836 b96134859c76 8f6ac823d36e 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (54s) 36s ago 7m 504M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb1059f4aba5 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 29s ago 9m 46.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (7m) 36s ago 7m 36.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 starting - - - - 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (7m) 36s ago 7m 16.9M - 1.5.0 0da6a335fe13 c00aff5800c6 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 29s ago 6m 88.9M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 29s ago 6m 103M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 29s ago 5m 86.6M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:30:37.198 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (5m) 36s ago 5m 95.5M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:30:37.199 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (4m) 36s ago 4m 85.7M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:30:37.199 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (4m) 36s ago 4m 88.7M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:30:37.199 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 29s ago 7m 56.0M - 2.43.0 a07b618ecd1d 85a9e537bba1 2024-05-09T06:30:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.215+0000 7f2875ffb700 1 -- 172.21.15.46:0/2613856335 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2880101470 con 0x7f286c070bb0 2024-05-09T06:30:37.199 INFO:tasks.workunit.client.0.smithi046.stdout:0/332: mknod d11/d4f/c70 0 2024-05-09T06:30:37.200 INFO:tasks.workunit.client.0.smithi046.stdout:0/333: write d11/d18/f32 [3202472,34380] 0 2024-05-09T06:30:37.200 INFO:tasks.workunit.client.0.smithi046.stdout:0/334: dread - d11/d18/d27/d28/d2d/f4c zero size 2024-05-09T06:30:37.200 INFO:tasks.workunit.client.1.smithi106.stdout:8/914: mknod d3/d5/d111/c124 0 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f286c070bb0 msgr2=0x7f286c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f286c070bb0 0x7f286c073060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f287000b970 tx=0x7f2870009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 msgr2=0x7f288010e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f288010e6c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f287c002a50 tx=0x7f287c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 shutdown_connections 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f286c070bb0 0x7f286c073060 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28800fbcc0 0x7f288010e6c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 --2- 172.21.15.46:0/2613856335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2880066aa0 0x7f2880110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 >> 172.21.15.46:0/2613856335 conn(0x7f28800f7420 msgr2=0x7f28800f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 shutdown_connections 2024-05-09T06:30:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.218+0000 7f28878a3700 1 -- 172.21.15.46:0/2613856335 wait complete. 2024-05-09T06:30:37.202 INFO:tasks.workunit.client.1.smithi106.stdout:3/850: creat d5/d85/dc3/d26/d90/f10e x:0 0 0 2024-05-09T06:30:37.202 INFO:tasks.workunit.client.0.smithi046.stdout:3/177: dwrite d4/d20/d24/f38 [4194304,4194304] 0 2024-05-09T06:30:37.202 INFO:tasks.workunit.client.0.smithi046.stdout:8/239: symlink d1/d7/d12/d29/l3e 0 2024-05-09T06:30:37.204 INFO:tasks.workunit.client.1.smithi106.stdout:4/886: link d7/d10/f11b d7/d39/d47/d89/f125 0 2024-05-09T06:30:37.204 INFO:tasks.workunit.client.1.smithi106.stdout:4/887: truncate d7/d10/d1a/d5a/d1c/da7/fb5 4636965 0 2024-05-09T06:30:37.204 INFO:tasks.workunit.client.1.smithi106.stdout:4/888: truncate d7/d39/d35/fc2 891826 0 2024-05-09T06:30:37.204 INFO:tasks.workunit.client.1.smithi106.stdout:4/889: dread - d7/d10/d1a/d5a/d1c/da7/fd0 zero size 2024-05-09T06:30:37.215 INFO:tasks.workunit.client.1.smithi106.stdout:6/978: unlink d0/d66/d13b/cb0 0 2024-05-09T06:30:37.217 INFO:tasks.workunit.client.1.smithi106.stdout:8/915: mkdir d3/d5/d35/d61/d6c/d83/dcc/d125 0 2024-05-09T06:30:37.221 INFO:tasks.workunit.client.1.smithi106.stdout:3/851: unlink d5/d1c/d24/d5b/da4/fb3 0 2024-05-09T06:30:37.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/979: creat d0/d17/f152 x:0 0 0 2024-05-09T06:30:37.227 INFO:tasks.workunit.client.1.smithi106.stdout:6/980: write d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3e/f133 [83296,106847] 0 2024-05-09T06:30:37.228 INFO:tasks.workunit.client.1.smithi106.stdout:6/981: chown d0/d66/d13b/d4e/d98/dfa 5637 1 2024-05-09T06:30:37.229 INFO:tasks.workunit.client.1.smithi106.stdout:3/852: mknod d5/d4d/d5f/c10f 0 2024-05-09T06:30:37.230 INFO:tasks.workunit.client.1.smithi106.stdout:3/853: dread d5/d85/dc3/d65/d81/f94 [0,4194304] 0 2024-05-09T06:30:37.231 INFO:tasks.workunit.client.1.smithi106.stdout:3/854: dread d5/d85/dc3/d65/d81/f94 [0,4194304] 0 2024-05-09T06:30:37.231 INFO:tasks.workunit.client.1.smithi106.stdout:3/855: dread - d5/d1c/d24/d89/d8e/fa6 zero size 2024-05-09T06:30:37.232 INFO:tasks.workunit.client.1.smithi106.stdout:3/856: dread d5/d85/dc3/d65/d81/f94 [0,4194304] 0 2024-05-09T06:30:37.232 INFO:tasks.workunit.client.1.smithi106.stdout:3/857: write d5/d1c/d24/f43 [630716,89863] 0 2024-05-09T06:30:37.232 INFO:tasks.workunit.client.1.smithi106.stdout:6/982: symlink d0/d66/l153 0 2024-05-09T06:30:37.232 INFO:tasks.workunit.client.1.smithi106.stdout:6/983: read d0/d66/d13b/d4e/d98/da9/db1/d8/d50/d8f/fe8 [13363,11374] 0 2024-05-09T06:30:37.236 INFO:tasks.workunit.client.1.smithi106.stdout:3/858: link d5/d1c/d24/l36 d5/d4d/d7a/l110 0 2024-05-09T06:30:37.236 INFO:tasks.workunit.client.1.smithi106.stdout:3/859: read - d5/d1c/d24/d5b/de0/ffe zero size 2024-05-09T06:30:37.236 INFO:tasks.workunit.client.1.smithi106.stdout:3/860: chown d5/l9d 146 1 2024-05-09T06:30:37.236 INFO:tasks.workunit.client.1.smithi106.stdout:3/861: write d5/d3f/f4f [518650,102307] 0 2024-05-09T06:30:37.236 INFO:tasks.workunit.client.1.smithi106.stdout:8/916: dwrite d3/d5/d35/d4e/d32/d92/dfb/f104 [0,4194304] 0 2024-05-09T06:30:37.236 INFO:tasks.workunit.client.1.smithi106.stdout:8/917: fdatasync d3/d5/d35/d73/f54 0 2024-05-09T06:30:37.243 INFO:tasks.workunit.client.1.smithi106.stdout:3/862: rename d5/d4d/d7a/da9/da8/de5/cd5 to d5/d1c/d24/d5b/c111 0 2024-05-09T06:30:37.243 INFO:tasks.workunit.client.1.smithi106.stdout:3/863: readlink d5/d4d/d7a/da9/ld9 0 2024-05-09T06:30:37.248 INFO:tasks.workunit.client.1.smithi106.stdout:4/890: fsync d7/d39/d47/d89/f125 0 2024-05-09T06:30:37.249 INFO:tasks.workunit.client.1.smithi106.stdout:4/891: write d7/d28/d2a/f10d [783626,51477] 0 2024-05-09T06:30:37.250 INFO:tasks.workunit.client.1.smithi106.stdout:6/984: dwrite d0/d66/d13b/d4e/fda [4194304,4194304] 0 2024-05-09T06:30:37.252 INFO:tasks.workunit.client.1.smithi106.stdout:8/918: dwrite d3/d5/d35/d73/ff2 [0,4194304] 0 2024-05-09T06:30:37.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/272: creat d3/d7/d28/d29/d35/d5c/f61 x:0 0 0 2024-05-09T06:30:37.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/273: chown d3/f8 2412553 1 2024-05-09T06:30:37.253 INFO:tasks.workunit.client.1.smithi106.stdout:4/892: dread d7/d39/d8c/fbd [0,4194304] 0 2024-05-09T06:30:37.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/197: rename d2/dc/c28 to d2/d6/d38/c40 0 2024-05-09T06:30:37.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/198: write f0 [5053157,124210] 0 2024-05-09T06:30:37.255 INFO:tasks.workunit.client.1.smithi106.stdout:7/927: sync 2024-05-09T06:30:37.255 INFO:tasks.workunit.client.1.smithi106.stdout:9/989: sync 2024-05-09T06:30:37.256 INFO:tasks.workunit.client.1.smithi106.stdout:4/893: write d7/f18 [4337257,129125] 0 2024-05-09T06:30:37.257 INFO:tasks.workunit.client.1.smithi106.stdout:6/985: creat d0/d5c/f154 x:0 0 0 2024-05-09T06:30:37.257 INFO:tasks.workunit.client.1.smithi106.stdout:6/986: chown d0/d66/d13b/dd0 100 1 2024-05-09T06:30:37.262 INFO:tasks.workunit.client.1.smithi106.stdout:8/919: dread d3/d5/d7/d15/df4/dfd/da9/dbd/fd1 [0,4194304] 0 2024-05-09T06:30:37.262 INFO:tasks.workunit.client.1.smithi106.stdout:7/928: truncate d0/da5/d108/d1a/d36/d30/d44/fd5 1653409 0 2024-05-09T06:30:37.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/185: getdents d0/d3e 0 2024-05-09T06:30:37.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/186: chown d0/d1b/f40 8355519 1 2024-05-09T06:30:37.266 INFO:tasks.workunit.client.1.smithi106.stdout:4/894: creat d7/d39/d35/d7c/dfa/f126 x:0 0 0 2024-05-09T06:30:37.267 INFO:tasks.workunit.client.1.smithi106.stdout:4/895: fsync d7/d39/d47/d89/fb4 0 2024-05-09T06:30:37.267 INFO:tasks.workunit.client.0.smithi046.stdout:7/274: creat d3/d7/d28/d29/d35/f62 x:0 0 0 2024-05-09T06:30:37.269 INFO:tasks.workunit.client.1.smithi106.stdout:6/987: rmdir d0/d66/d13b/d4e 39 2024-05-09T06:30:37.269 INFO:tasks.workunit.client.1.smithi106.stdout:6/988: write d0/d17/d76/fcc [1197894,79510] 0 2024-05-09T06:30:37.272 INFO:tasks.workunit.client.0.smithi046.stdout:8/240: rename d1/d7/d2c/f2f to d1/d7/d12/d1d/d30/d38/f3f 0 2024-05-09T06:30:37.279 INFO:tasks.workunit.client.1.smithi106.stdout:9/990: getdents d4/d54/d69/d99/d2a/d42/d6c 0 2024-05-09T06:30:37.279 INFO:tasks.workunit.client.1.smithi106.stdout:9/991: write d4/d54/d69/d95/d23/d16/dd1/d31/fe2 [2736728,17195] 0 2024-05-09T06:30:37.279 INFO:tasks.workunit.client.1.smithi106.stdout:9/992: dread - d4/d54/d69/d95/d23/d16/fe7 zero size 2024-05-09T06:30:37.279 INFO:tasks.workunit.client.0.smithi046.stdout:8/241: write d1/db/dd/f1a [2718085,64021] 0 2024-05-09T06:30:37.280 INFO:tasks.workunit.client.1.smithi106.stdout:6/989: mknod d0/d66/d13b/d4e/deb/c155 0 2024-05-09T06:30:37.282 INFO:tasks.workunit.client.1.smithi106.stdout:8/920: dwrite d3/d5/f8a [0,4194304] 0 2024-05-09T06:30:37.284 INFO:tasks.workunit.client.1.smithi106.stdout:3/864: rename d5/d4d/d7a/da9/da8 to d5/d1c/d24/d98/d112 0 2024-05-09T06:30:37.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/335: getdents d11/d18/d27/d28/d36/d5a 0 2024-05-09T06:30:37.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/336: chown f9 1570039 1 2024-05-09T06:30:37.288 INFO:tasks.workunit.client.1.smithi106.stdout:6/990: creat d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3b/d62/f156 x:0 0 0 2024-05-09T06:30:37.289 INFO:tasks.workunit.client.0.smithi046.stdout:3/178: rmdir d4/d20/d24/d29/d2b 39 2024-05-09T06:30:37.289 INFO:tasks.workunit.client.0.smithi046.stdout:3/179: chown d4/d20/d24/c35 2305 1 2024-05-09T06:30:37.291 INFO:tasks.workunit.client.1.smithi106.stdout:3/865: symlink d5/d1c/d24/d5b/de0/l113 0 2024-05-09T06:30:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:8/242: read d1/d7/d12/d1d/d30/d38/f3f [366816,71707] 0 2024-05-09T06:30:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:8/243: write d1/d7/d12/d1d/f3c [595418,79239] 0 2024-05-09T06:30:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:5/187: creat d0/d1b/d21/f42 x:0 0 0 2024-05-09T06:30:37.293 INFO:tasks.workunit.client.1.smithi106.stdout:8/921: write d3/d5/d35/d61/dfc/d11a/fdf [3300555,42319] 0 2024-05-09T06:30:37.294 INFO:tasks.workunit.client.1.smithi106.stdout:6/991: rename d0/d5c/f154 to d0/d66/d7e/de5/f157 0 2024-05-09T06:30:37.294 INFO:tasks.workunit.client.1.smithi106.stdout:6/992: getdents d0/d66/d13b/d4e/d98/da9/db1/d8/d9c/d11f/d135 0 2024-05-09T06:30:37.294 INFO:tasks.workunit.client.1.smithi106.stdout:6/993: chown d0/d66/d13b/d4e/d98/da9/db1/d8/c12b 13 1 2024-05-09T06:30:37.294 INFO:tasks.workunit.client.1.smithi106.stdout:6/994: chown d0/d66/d13b/d4e/d98/da9/db1/d8/d50/l85 1722 1 2024-05-09T06:30:37.297 INFO:tasks.workunit.client.0.smithi046.stdout:7/275: mknod d3/d3d/c63 0 2024-05-09T06:30:37.300 INFO:tasks.workunit.client.1.smithi106.stdout:6/995: creat d0/d17/d76/f158 x:0 0 0 2024-05-09T06:30:37.300 INFO:tasks.workunit.client.1.smithi106.stdout:6/996: truncate d0/d66/d13b/d4e/d98/f141 298581 0 2024-05-09T06:30:37.300 INFO:tasks.workunit.client.1.smithi106.stdout:6/997: stat d0/d66/d13b/d72/l130 0 2024-05-09T06:30:37.302 INFO:tasks.workunit.client.1.smithi106.stdout:3/866: rename d5/c2f to d5/d1c/d24/d89/d8c/d109/c114 0 2024-05-09T06:30:37.303 INFO:tasks.workunit.client.0.smithi046.stdout:0/337: creat d11/d18/d27/d28/d2d/d5c/f71 x:0 0 0 2024-05-09T06:30:37.304 INFO:tasks.workunit.client.0.smithi046.stdout:0/338: creat d11/d18/d27/d28/d2d/d5c/f72 x:0 0 0 2024-05-09T06:30:37.304 INFO:tasks.workunit.client.0.smithi046.stdout:0/339: truncate d11/d3f/f51 972131 0 2024-05-09T06:30:37.304 INFO:tasks.workunit.client.0.smithi046.stdout:0/340: chown d11/d3f/f51 267 1 2024-05-09T06:30:37.305 INFO:tasks.workunit.client.1.smithi106.stdout:6/998: mknod d0/d66/d13b/d4e/d98/da9/db1/d8/d27/d3b/c159 0 2024-05-09T06:30:37.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/180: rename d4/d20/d24/c1e to d4/c3c 0 2024-05-09T06:30:37.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/244: truncate d1/d7/d12/d1d/d30/d38/f3f 1379288 0 2024-05-09T06:30:37.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/245: read d1/db/dd/f13 [6564501,110550] 0 2024-05-09T06:30:37.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/246: stat d1/d7/f31 0 2024-05-09T06:30:37.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/276: dread d3/d7/d28/f24 [0,4194304] 0 2024-05-09T06:30:37.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/277: stat d3/d7/f2d 0 2024-05-09T06:30:37.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/278: write d3/d7/d28/d29/d35/d5c/f61 [739799,25270] 0 2024-05-09T06:30:37.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/279: truncate d3/d7/d28/d29/d35/f55 190208 0 2024-05-09T06:30:37.313 INFO:tasks.workunit.client.0.smithi046.stdout:5/188: mknod d0/d1b/c43 0 2024-05-09T06:30:37.314 INFO:tasks.workunit.client.0.smithi046.stdout:0/341: symlink d11/d18/d1c/d53/l73 0 2024-05-09T06:30:37.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/181: read d4/d5/f9 [162342,29481] 0 2024-05-09T06:30:37.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/182: creat d4/f3d x:0 0 0 2024-05-09T06:30:37.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/183: readlink d4/lf 0 2024-05-09T06:30:37.316 INFO:tasks.workunit.client.1.smithi106.stdout:6/999: write d0/d17/f57 [5857712,37348] 0 2024-05-09T06:30:37.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/247: link d1/db/c25 d1/db/dd/d14/c40 0 2024-05-09T06:30:37.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/280: mknod d3/d7/d28/d29/d35/c64 0 2024-05-09T06:30:37.319 INFO:tasks.workunit.client.1.smithi106.stdout:9/993: dwrite d4/d54/d69/d95/f2e [4194304,4194304] 0 2024-05-09T06:30:37.320 INFO:tasks.workunit.client.0.smithi046.stdout:3/184: mkdir d4/d20/d24/d29/d2b/d3e 0 2024-05-09T06:30:37.320 INFO:tasks.workunit.client.0.smithi046.stdout:3/185: chown d4/d20/d24/d29/d2b/c30 0 1 2024-05-09T06:30:37.322 INFO:tasks.workunit.client.0.smithi046.stdout:8/248: mkdir d1/db/d41 0 2024-05-09T06:30:37.323 INFO:tasks.workunit.client.1.smithi106.stdout:8/922: dwrite d3/d5/d35/d73/f54 [0,4194304] 0 2024-05-09T06:30:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:37 smithi106 ceph-mon[34679]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 166 MiB/s rd, 217 MiB/s wr, 311 op/s 2024-05-09T06:30:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:37 smithi106 ceph-mon[34679]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:37 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:37.324 INFO:tasks.workunit.client.1.smithi106.stdout:7/929: dwrite d0/da5/d108/d1a/d36/d30/d44/d6a/d72/fc0 [0,4194304] 0 2024-05-09T06:30:37.324 INFO:tasks.workunit.client.1.smithi106.stdout:7/930: creat d0/da5/d108/d1a/d36/d30/d44/f121 x:0 0 0 2024-05-09T06:30:37.324 INFO:tasks.workunit.client.1.smithi106.stdout:7/931: readlink d0/da5/d108/d1a/d36/d1e/l107 0 2024-05-09T06:30:37.325 INFO:tasks.workunit.client.1.smithi106.stdout:7/932: fdatasync d0/da5/d108/d1a/d36/d30/d44/dc1/d111/deb/ff5 0 2024-05-09T06:30:37.325 INFO:tasks.workunit.client.1.smithi106.stdout:4/896: dwrite d7/d39/d35/dac/dd5/fdb [0,4194304] 0 2024-05-09T06:30:37.325 INFO:tasks.workunit.client.1.smithi106.stdout:4/897: readlink d7/d10/d1a/d5a/l110 0 2024-05-09T06:30:37.325 INFO:tasks.workunit.client.1.smithi106.stdout:9/994: creat d4/d54/d69/d95/d23/d16/dd1/d31/f13c x:0 0 0 2024-05-09T06:30:37.325 INFO:tasks.workunit.client.0.smithi046.stdout:3/186: creat d4/d20/d24/d29/d2b/d3e/f3f x:0 0 0 2024-05-09T06:30:37.325 INFO:tasks.workunit.client.1.smithi106.stdout:3/867: dwrite d5/d4d/d72/fd0 [0,4194304] 0 2024-05-09T06:30:37.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/281: getdents d3/d7/d28/d29/d35/d5c 0 2024-05-09T06:30:37.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/282: stat d3/d7/dd/c18 0 2024-05-09T06:30:37.331 INFO:tasks.workunit.client.1.smithi106.stdout:8/923: rename d3/d5/d7/d15/d3e/c121 to d3/d5/c126 0 2024-05-09T06:30:37.332 INFO:tasks.workunit.client.0.smithi046.stdout:3/187: creat d4/d20/d24/d2a/f40 x:0 0 0 2024-05-09T06:30:37.334 INFO:tasks.workunit.client.1.smithi106.stdout:7/933: write d0/da5/d108/d1a/d36/f74 [1097818,86855] 0 2024-05-09T06:30:37.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:37 smithi046 ceph-mon[26924]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 166 MiB/s rd, 217 MiB/s wr, 311 op/s 2024-05-09T06:30:37.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:37 smithi046 ceph-mon[26924]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:37.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:37 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:37.339 INFO:tasks.workunit.client.0.smithi046.stdout:7/283: rename d3/d7/d4c/c57 to d3/d7/d28/d29/d35/c65 0 2024-05-09T06:30:37.339 INFO:tasks.workunit.client.0.smithi046.stdout:7/284: readlink d3/d7/d4c/l54 0 2024-05-09T06:30:37.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/188: unlink d4/d20/d24/d29/d2b/d3e/f3f 0 2024-05-09T06:30:37.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/189: chown d4/d5/f9 13 1 2024-05-09T06:30:37.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/190: readlink d4/d20/d24/l33 0 2024-05-09T06:30:37.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/285: unlink d3/f51 0 2024-05-09T06:30:37.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/286: creat d3/d7/d28/f66 x:0 0 0 2024-05-09T06:30:37.345 INFO:tasks.workunit.client.1.smithi106.stdout:4/898: getdents d7/d10/d1a/d5a/d7a 0 2024-05-09T06:30:37.345 INFO:tasks.workunit.client.1.smithi106.stdout:4/899: fdatasync d7/d39/d35/d4a/f93 0 2024-05-09T06:30:37.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/191: mkdir d4/d20/d41 0 2024-05-09T06:30:37.348 INFO:tasks.workunit.client.1.smithi106.stdout:9/995: link d4/d54/d69/d95/l9 d4/d54/d69/l13d 0 2024-05-09T06:30:37.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/189: dwrite d0/f1a [0,4194304] 0 2024-05-09T06:30:37.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/190: creat d0/d1b/d21/f44 x:0 0 0 2024-05-09T06:30:37.352 INFO:tasks.workunit.client.1.smithi106.stdout:8/924: dwrite d3/d5/d35/d61/d6c/d83/d89/fdd [4194304,4194304] 0 2024-05-09T06:30:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/287: symlink d3/d7/dd/d3e/l67 0 2024-05-09T06:30:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/288: fsync d3/d7/f32 0 2024-05-09T06:30:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/289: creat d3/d7/dd/f68 x:0 0 0 2024-05-09T06:30:37.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/192: truncate d4/d20/d24/f18 1161994 0 2024-05-09T06:30:37.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/193: write d4/d5/f3a [1543839,71959] 0 2024-05-09T06:30:37.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/194: readlink d4/l10 0 2024-05-09T06:30:37.371 INFO:tasks.workunit.client.1.smithi106.stdout:7/934: mknod d0/da5/d108/d45/da6/dc5/d106/c122 0 2024-05-09T06:30:37.371 INFO:tasks.workunit.client.1.smithi106.stdout:7/935: stat d0/da5/d108/d1a 0 2024-05-09T06:30:37.373 INFO:tasks.workunit.client.1.smithi106.stdout:3/868: dread d5/d1c/d24/d98/dc0/d32/f49 [0,4194304] 0 2024-05-09T06:30:37.373 INFO:tasks.workunit.client.1.smithi106.stdout:3/869: chown d5/d85/dc3/d65/ce9 22470482 1 2024-05-09T06:30:37.373 INFO:tasks.workunit.client.1.smithi106.stdout:3/870: stat d5/d4d 0 2024-05-09T06:30:37.373 INFO:tasks.workunit.client.1.smithi106.stdout:3/871: chown d5/d85/dc3/d65/de3/c106 18275 1 2024-05-09T06:30:37.373 INFO:tasks.workunit.client.1.smithi106.stdout:3/872: stat d5/d4d/lea 0 2024-05-09T06:30:37.373 INFO:tasks.workunit.client.1.smithi106.stdout:4/900: getdents d7/d10/d106 0 2024-05-09T06:30:37.374 INFO:tasks.workunit.client.1.smithi106.stdout:4/901: write d7/d10/d1a/d5a/d7a/d7f/f84 [884814,7274] 0 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1264208929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fb460 msgr2=0x7fb0b40fb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1264208929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fb460 0x7fb0b40fb870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0004940 tx=0x7fb0b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1264208929 shutdown_connections 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1264208929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fc710 0x7fb0b40fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1264208929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fb460 0x7fb0b40fb870 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1264208929 >> 172.21.15.46:0/1264208929 conn(0x7fb0b40f6be0 msgr2=0x7fb0b40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.391+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1264208929 shutdown_connections 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.392+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1264208929 wait complete. 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0bbd9d700 1 Processor -- start 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0bbd9d700 1 -- start start 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0bbd9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fb460 0x7fb0b4108c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0bbd9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 0x7fb0b41091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0bbd9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41057c0 con 0x7fb0b40fc710 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0bbd9d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4105930 con 0x7fb0b40fb460 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0b9338700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 0x7fb0b41091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0b9338700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 0x7fb0b41091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50850/0 (socket says 172.21.15.46:50850) 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0b9338700 1 -- 172.21.15.46:0/1160518157 learned_addr learned my addr 172.21.15.46:0/1160518157 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0b9b39700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fb460 0x7fb0b4108c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0b9338700 1 -- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fb460 msgr2=0x7fb0b4108c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.393+0000 7fb0b9338700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fb460 0x7fb0b4108c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0b9338700 1 -- 172.21.15.46:0/1160518157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0005040 con 0x7fb0b40fc710 2024-05-09T06:30:37.378 INFO:tasks.workunit.client.0.smithi046.stdout:8/249: dwrite d1/d7/d12/d1d/d30/d38/f3f [0,4194304] 0 2024-05-09T06:30:37.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0b9b39700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fb460 0x7fb0b4108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:30:37.379 INFO:tasks.workunit.client.0.smithi046.stdout:8/250: chown d1/d7/d12/d29 72160 1 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0b9338700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 0x7fb0b41091d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b790 tx=0x7fb0a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a400f770 con 0x7fb0b40fc710 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4105bc0 con 0x7fb0b40fc710 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b4106180 con 0x7fb0b40fc710 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0a400fda0 con 0x7fb0b40fc710 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.394+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a400d310 con 0x7fb0b40fc710 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.396+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0980052e0 con 0x7fb0b40fc710 2024-05-09T06:30:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.397+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7fb0a400d5b0 con 0x7fb0b40fc710 2024-05-09T06:30:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.398+0000 7fb0aa7fc700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb0a0070bc0 0x7fb0a0073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.398+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb0a4090730 con 0x7fb0b40fc710 2024-05-09T06:30:37.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/290: symlink d3/d7/d4c/d4f/l69 0 2024-05-09T06:30:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.399+0000 7fb0b9b39700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb0a0070bc0 0x7fb0a0073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.400+0000 7fb0b9b39700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb0a0070bc0 0x7fb0a0073070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b7a0 tx=0x7fb0b0009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:37.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/195: symlink d4/d20/d24/l42 0 2024-05-09T06:30:37.383 INFO:tasks.workunit.client.1.smithi106.stdout:8/925: dwrite d3/d5/d13/f1b [0,4194304] 0 2024-05-09T06:30:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.404+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fb0a4058d30 con 0x7fb0b40fc710 2024-05-09T06:30:37.387 INFO:tasks.workunit.client.0.smithi046.stdout:5/191: rename d0/l2c to d0/d1b/d39/l45 0 2024-05-09T06:30:37.387 INFO:tasks.workunit.client.0.smithi046.stdout:5/192: fsync d0/f4 0 2024-05-09T06:30:37.388 INFO:tasks.workunit.client.1.smithi106.stdout:3/873: dwrite d5/d1c/d24/d52/fef [0,4194304] 0 2024-05-09T06:30:37.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/251: creat d1/d7/d12/d1d/d30/d38/f42 x:0 0 0 2024-05-09T06:30:37.398 INFO:tasks.workunit.client.1.smithi106.stdout:3/874: write d5/d1c/d24/d5b/f95 [2522089,64593] 0 2024-05-09T06:30:37.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/193: chown d0/l3b 82 1 2024-05-09T06:30:37.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/194: dread - d0/d1b/f37 zero size 2024-05-09T06:30:37.401 INFO:tasks.workunit.client.0.smithi046.stdout:5/195: chown d0/f4 152 1 2024-05-09T06:30:37.403 INFO:tasks.workunit.client.0.smithi046.stdout:3/196: dwrite d4/d20/d24/f2e [0,4194304] 0 2024-05-09T06:30:37.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/252: mkdir d1/db/dd/d11/d43 0 2024-05-09T06:30:37.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/291: getdents d3/d7 0 2024-05-09T06:30:37.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/292: stat d3/d7/dd/f68 0 2024-05-09T06:30:37.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/197: truncate d4/d5/f9 908329 0 2024-05-09T06:30:37.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/198: stat l2 0 2024-05-09T06:30:37.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/199: stat d4/d20/c28 0 2024-05-09T06:30:37.416 INFO:tasks.workunit.client.0.smithi046.stdout:3/200: dread d4/d5/f3a [0,4194304] 0 2024-05-09T06:30:37.421 INFO:tasks.workunit.client.1.smithi106.stdout:7/936: rename d0/da5/d108/d1a/d36/d30/d44/d58/d65/d84/d86/fa3 to d0/da5/d108/d1a/d36/d1e/f123 0 2024-05-09T06:30:37.423 INFO:tasks.workunit.client.1.smithi106.stdout:4/902: mkdir d7/d10/d1a/d5a/d119/d127 0 2024-05-09T06:30:37.423 INFO:tasks.workunit.client.1.smithi106.stdout:4/903: write d7/d39/d8c/f8d [1041766,39495] 0 2024-05-09T06:30:37.428 INFO:tasks.workunit.client.1.smithi106.stdout:8/926: link d3/d5/d35/d73/c65 d3/d5/d35/d4e/dee/c127 0 2024-05-09T06:30:37.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/201: dwrite d4/d20/d24/f18 [0,4194304] 0 2024-05-09T06:30:37.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/202: write d4/d20/d24/d2a/f40 [149586,7780] 0 2024-05-09T06:30:37.433 INFO:tasks.workunit.client.1.smithi106.stdout:3/875: mknod d5/d8f/c115 0 2024-05-09T06:30:37.436 INFO:tasks.workunit.client.1.smithi106.stdout:4/904: mkdir d7/d39/d128 0 2024-05-09T06:30:37.436 INFO:tasks.workunit.client.1.smithi106.stdout:4/905: stat d7/d39/d8c/fbd 0 2024-05-09T06:30:37.438 INFO:tasks.workunit.client.1.smithi106.stdout:8/927: truncate d3/d5/d7/f20 2547523 0 2024-05-09T06:30:37.438 INFO:tasks.workunit.client.1.smithi106.stdout:8/928: fdatasync d3/d5/d13/f29 0 2024-05-09T06:30:37.439 INFO:tasks.workunit.client.0.smithi046.stdout:8/253: rmdir d1 39 2024-05-09T06:30:37.442 INFO:tasks.workunit.client.1.smithi106.stdout:3/876: creat d5/d85/dc3/d65/f116 x:0 0 0 2024-05-09T06:30:37.444 INFO:tasks.workunit.client.1.smithi106.stdout:4/906: mknod d7/d10/d106/c129 0 2024-05-09T06:30:37.446 INFO:tasks.workunit.client.1.smithi106.stdout:8/929: mknod d3/d5/d7/d15/df4/c128 0 2024-05-09T06:30:37.448 INFO:tasks.workunit.client.1.smithi106.stdout:3/877: mkdir d5/d4d/d7a/da9/d117 0 2024-05-09T06:30:37.451 INFO:tasks.workunit.client.1.smithi106.stdout:9/996: sync 2024-05-09T06:30:37.451 INFO:tasks.workunit.client.1.smithi106.stdout:3/878: rmdir d5/d1c/d24/d98/dc0/d32 39 2024-05-09T06:30:37.451 INFO:tasks.workunit.client.0.smithi046.stdout:3/203: link d4/d5/f37 d4/d5/f43 0 2024-05-09T06:30:37.453 INFO:tasks.workunit.client.1.smithi106.stdout:9/997: creat d4/d54/d69/d99/d2a/d42/dc8/f13e x:0 0 0 2024-05-09T06:30:37.453 INFO:tasks.workunit.client.1.smithi106.stdout:9/998: readlink d4/d54/d91/dc7/d58/lcb 0 2024-05-09T06:30:37.456 INFO:tasks.workunit.client.1.smithi106.stdout:3/879: mkdir d5/d1c/d118 0 2024-05-09T06:30:37.465 INFO:tasks.workunit.client.1.smithi106.stdout:3/880: mkdir d5/d85/dc3/d65/d81/d92/d119 0 2024-05-09T06:30:37.470 INFO:tasks.workunit.client.1.smithi106.stdout:4/907: dwrite d7/d10/d1a/d5a/d1c/fb6 [0,4194304] 0 2024-05-09T06:30:37.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/254: dwrite d1/d7/d12/d1d/d30/d38/f3f [0,4194304] 0 2024-05-09T06:30:37.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/255: readlink d1/d7/d2c/l36 0 2024-05-09T06:30:37.473 INFO:tasks.workunit.client.1.smithi106.stdout:4/908: symlink d7/dcb/l12a 0 2024-05-09T06:30:37.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/256: symlink d1/d7/d12/d1d/d30/l44 0 2024-05-09T06:30:37.476 INFO:tasks.workunit.client.1.smithi106.stdout:8/930: dwrite d3/d5/d13/d3a/dbe/ff3 [0,4194304] 0 2024-05-09T06:30:37.491 INFO:tasks.workunit.client.1.smithi106.stdout:9/999: dwrite d4/d54/d100/f128 [0,4194304] 0 2024-05-09T06:30:37.491 INFO:tasks.workunit.client.1.smithi106.stdout:3/881: dwrite d5/d1c/d24/d5b/f66 [0,4194304] 0 2024-05-09T06:30:37.494 INFO:tasks.workunit.client.1.smithi106.stdout:4/909: dwrite d7/d39/d8c/fbd [0,4194304] 0 2024-05-09T06:30:37.494 INFO:tasks.workunit.client.1.smithi106.stdout:4/910: dread - d7/d39/d47/d89/f90 zero size 2024-05-09T06:30:37.494 INFO:tasks.workunit.client.1.smithi106.stdout:4/911: chown d7/lfe 168585015 1 2024-05-09T06:30:37.494 INFO:tasks.workunit.client.1.smithi106.stdout:4/912: write d7/dcb/fdd [12195,52346] 0 2024-05-09T06:30:37.494 INFO:tasks.workunit.client.1.smithi106.stdout:4/913: stat d7/f18 0 2024-05-09T06:30:37.494 INFO:tasks.workunit.client.1.smithi106.stdout:3/882: link d5/d1c/d24/f105 d5/d1c/d24/d98/dc0/f11a 0 2024-05-09T06:30:37.496 INFO:tasks.workunit.client.1.smithi106.stdout:4/914: mkdir d7/d28/d2a/d80/d12b 0 2024-05-09T06:30:37.496 INFO:tasks.workunit.client.1.smithi106.stdout:4/915: readlink d7/d39/d35/d7c/da8/ld9 0 2024-05-09T06:30:37.496 INFO:tasks.workunit.client.1.smithi106.stdout:4/916: chown d7/d10/d1a/f71 29276754 1 2024-05-09T06:30:37.497 INFO:tasks.workunit.client.1.smithi106.stdout:8/931: dwrite d3/d5/d35/d4e/d32/f9a [4194304,4194304] 0 2024-05-09T06:30:37.497 INFO:tasks.workunit.client.1.smithi106.stdout:8/932: write d3/d5/d7/fb7 [727520,29131] 0 2024-05-09T06:30:37.498 INFO:tasks.workunit.client.1.smithi106.stdout:4/917: rename d7/d28/d2a/f124 to d7/d39/d35/d6f/f12c 0 2024-05-09T06:30:37.499 INFO:tasks.workunit.client.1.smithi106.stdout:8/933: symlink d3/d5/d111/l129 0 2024-05-09T06:30:37.500 INFO:tasks.workunit.client.1.smithi106.stdout:3/883: getdents d5/d1c/d24/d5b/da4 0 2024-05-09T06:30:37.500 INFO:tasks.workunit.client.1.smithi106.stdout:3/884: readlink d5/d4d/d5f/lc9 0 2024-05-09T06:30:37.500 INFO:tasks.workunit.client.1.smithi106.stdout:3/885: readlink d5/l9d 0 2024-05-09T06:30:37.502 INFO:tasks.workunit.client.1.smithi106.stdout:8/934: symlink d3/d5/d35/d4e/d32/d92/dfb/l12a 0 2024-05-09T06:30:37.503 INFO:tasks.workunit.client.1.smithi106.stdout:3/886: mkdir d5/d1c/d24/d89/d8c/d11b 0 2024-05-09T06:30:37.504 INFO:tasks.workunit.client.1.smithi106.stdout:4/918: creat d7/d39/d8c/da1/df8/f12d x:0 0 0 2024-05-09T06:30:37.513 INFO:tasks.workunit.client.1.smithi106.stdout:8/935: write d3/d5/d35/d73/f4f [4545318,101336] 0 2024-05-09T06:30:37.515 INFO:tasks.workunit.client.1.smithi106.stdout:3/887: write d5/d4d/f70 [3654512,24289] 0 2024-05-09T06:30:37.515 INFO:tasks.workunit.client.1.smithi106.stdout:3/888: write d5/d1c/d24/d89/d8c/fcf [847424,123733] 0 2024-05-09T06:30:37.515 INFO:tasks.workunit.client.1.smithi106.stdout:7/937: sync 2024-05-09T06:30:37.515 INFO:tasks.workunit.client.1.smithi106.stdout:7/938: readlink d0/da5/d108/d1a/d5a/la4 0 2024-05-09T06:30:37.516 INFO:tasks.workunit.client.1.smithi106.stdout:8/936: rename d3/d5/d7/d15/d3e/d7d/f84 to d3/d5/d13/d3a/dbe/f12b 0 2024-05-09T06:30:37.516 INFO:tasks.workunit.client.1.smithi106.stdout:8/937: write d3/d5/d13/f14 [4455338,126673] 0 2024-05-09T06:30:37.516 INFO:tasks.workunit.client.1.smithi106.stdout:3/889: stat d5/d1c/d24/d89/d8c/d109/c114 0 2024-05-09T06:30:37.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/219: sync 2024-05-09T06:30:37.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/220: fdatasync f6 0 2024-05-09T06:30:37.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/221: write da/dc/f13 [1822117,44915] 0 2024-05-09T06:30:37.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/222: chown da/de/d14/d1f/c23 39199 1 2024-05-09T06:30:37.547 INFO:tasks.workunit.client.1.smithi106.stdout:7/939: link d0/da5/d108/d1a/d36/d30/d44/ded/fe4 d0/da5/d108/f124 0 2024-05-09T06:30:37.547 INFO:tasks.workunit.client.1.smithi106.stdout:7/940: chown d0/da5/d108/d1a/d36/d30/d44/ded/lf3 0 1 2024-05-09T06:30:37.548 INFO:tasks.workunit.client.1.smithi106.stdout:8/938: symlink d3/d5/d111/l12c 0 2024-05-09T06:30:37.549 INFO:tasks.workunit.client.1.smithi106.stdout:4/919: dwrite d7/d10/d1a/fa2 [0,4194304] 0 2024-05-09T06:30:37.549 INFO:tasks.workunit.client.1.smithi106.stdout:3/890: symlink d5/d85/dc3/d65/ddc/l11c 0 2024-05-09T06:30:37.551 INFO:tasks.workunit.client.1.smithi106.stdout:8/939: dread d3/d5/d7/d15/df4/dfd/da9/dbd/dd7/fe0 [0,4194304] 0 2024-05-09T06:30:37.552 INFO:tasks.workunit.client.1.smithi106.stdout:3/891: creat d5/d85/dc3/d65/d81/d92/f11d x:0 0 0 2024-05-09T06:30:37.559 INFO:tasks.workunit.client.1.smithi106.stdout:4/920: dread d7/d10/d1a/d5a/f97 [0,4194304] 0 2024-05-09T06:30:37.562 INFO:tasks.workunit.client.1.smithi106.stdout:3/892: dread d5/d4d/d72/f7b [0,4194304] 0 2024-05-09T06:30:37.562 INFO:tasks.workunit.client.1.smithi106.stdout:3/893: write d5/d1c/d24/d98/d112/de5/d108/fe1 [1020314,47644] 0 2024-05-09T06:30:37.562 INFO:tasks.workunit.client.1.smithi106.stdout:4/921: mknod d7/d39/d35/d6f/d9c/c12e 0 2024-05-09T06:30:37.562 INFO:tasks.workunit.client.1.smithi106.stdout:4/922: fdatasync d7/d28/f91 0 2024-05-09T06:30:37.562 INFO:tasks.workunit.client.1.smithi106.stdout:4/923: chown d7/d39/d35/d6f/d9d/cc3 10 1 2024-05-09T06:30:37.562 INFO:tasks.workunit.client.1.smithi106.stdout:4/924: write d7/d10/d1a/d5a/d1c/da7/f117 [1031466,53501] 0 2024-05-09T06:30:37.564 INFO:tasks.workunit.client.1.smithi106.stdout:4/925: rename d7/d28/f27 to d7/d39/d35/f12f 0 2024-05-09T06:30:37.564 INFO:tasks.workunit.client.1.smithi106.stdout:4/926: chown d7/d39/d35/d7c/da8/dd7 4 1 2024-05-09T06:30:37.565 INFO:tasks.workunit.client.1.smithi106.stdout:8/940: write d3/d5/d35/d4e/d32/d92/dfb/f104 [3672198,32549] 0 2024-05-09T06:30:37.566 INFO:tasks.workunit.client.1.smithi106.stdout:4/927: creat d7/d39/d35/d7c/dd1/d11a/f130 x:0 0 0 2024-05-09T06:30:37.566 INFO:tasks.workunit.client.0.smithi046.stdout:2/223: dwrite da/de/f10 [0,4194304] 0 2024-05-09T06:30:37.569 INFO:tasks.workunit.client.0.smithi046.stdout:2/224: link f3 da/f45 0 2024-05-09T06:30:37.570 INFO:tasks.workunit.client.1.smithi106.stdout:7/941: dwrite d0/da5/d108/d1a/d36/d1e/fd0 [0,4194304] 0 2024-05-09T06:30:37.570 INFO:tasks.workunit.client.1.smithi106.stdout:7/942: chown d0/da5/d108/d45/fae 1243685973 1 2024-05-09T06:30:37.572 INFO:tasks.workunit.client.1.smithi106.stdout:4/928: write d7/d10/d1a/d5a/d1c/da7/f117 [465028,77041] 0 2024-05-09T06:30:37.572 INFO:tasks.workunit.client.1.smithi106.stdout:4/929: write d7/d10/f8f [6450512,110076] 0 2024-05-09T06:30:37.577 INFO:tasks.workunit.client.1.smithi106.stdout:7/943: mknod d0/dfc/c125 0 2024-05-09T06:30:37.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/894: dwrite d5/d1c/d24/f105 [0,4194304] 0 2024-05-09T06:30:37.580 INFO:tasks.workunit.client.1.smithi106.stdout:3/895: read - d5/d1c/d24/d98/dc0/d32/fff zero size 2024-05-09T06:30:37.582 INFO:tasks.workunit.client.1.smithi106.stdout:4/930: rename d7/l3d to d7/d10/d1a/d5a/d119/l131 0 2024-05-09T06:30:37.582 INFO:tasks.workunit.client.1.smithi106.stdout:4/931: fsync d7/fda 0 2024-05-09T06:30:37.584 INFO:tasks.workunit.client.1.smithi106.stdout:7/944: creat d0/da5/d108/d1a/d36/d30/d44/dc1/f126 x:0 0 0 2024-05-09T06:30:37.584 INFO:tasks.workunit.client.1.smithi106.stdout:7/945: fdatasync d0/da5/d108/d1a/d36/d30/d44/df0/f6b 0 2024-05-09T06:30:37.587 INFO:tasks.workunit.client.1.smithi106.stdout:3/896: mkdir d5/d85/dc3/d26/d90/d11e 0 2024-05-09T06:30:37.589 INFO:tasks.workunit.client.1.smithi106.stdout:7/946: creat d0/da5/d108/d1a/d36/f127 x:0 0 0 2024-05-09T06:30:37.597 INFO:tasks.workunit.client.1.smithi106.stdout:4/932: dread d7/d39/f3f [0,4194304] 0 2024-05-09T06:30:37.597 INFO:tasks.workunit.client.1.smithi106.stdout:4/933: chown d7/d39/caf 6009900 1 2024-05-09T06:30:37.599 INFO:tasks.workunit.client.1.smithi106.stdout:4/934: rmdir d7/d39/d47/d89 39 2024-05-09T06:30:37.601 INFO:tasks.workunit.client.1.smithi106.stdout:4/935: mknod d7/c132 0 2024-05-09T06:30:37.617 INFO:tasks.workunit.client.0.smithi046.stdout:2/225: dwrite da/de/d14/f1b [0,4194304] 0 2024-05-09T06:30:37.617 INFO:tasks.workunit.client.0.smithi046.stdout:2/226: write da/dc/f27 [3680248,41304] 0 2024-05-09T06:30:37.618 INFO:tasks.workunit.client.1.smithi106.stdout:8/941: dwrite d3/d5/d7/d15/d47/f62 [4194304,4194304] 0 2024-05-09T06:30:37.618 INFO:tasks.workunit.client.1.smithi106.stdout:8/942: read - d3/d5/d35/fea zero size 2024-05-09T06:30:37.618 INFO:tasks.workunit.client.1.smithi106.stdout:8/943: fdatasync d3/d5/d13/d3a/dbe/f12b 0 2024-05-09T06:30:37.618 INFO:tasks.workunit.client.1.smithi106.stdout:7/947: dwrite d0/ff2 [0,4194304] 0 2024-05-09T06:30:37.618 INFO:tasks.workunit.client.1.smithi106.stdout:3/897: dwrite d5/d8f/fd1 [0,4194304] 0 2024-05-09T06:30:37.620 INFO:tasks.workunit.client.1.smithi106.stdout:8/944: creat d3/d5/d7/d15/f12d x:0 0 0 2024-05-09T06:30:37.626 INFO:tasks.workunit.client.1.smithi106.stdout:7/948: symlink d0/da5/d108/d1a/d36/d30/d44/d6a/dd4/l128 0 2024-05-09T06:30:37.627 INFO:tasks.workunit.client.1.smithi106.stdout:8/945: creat d3/d5/d13/d3a/f12e x:0 0 0 2024-05-09T06:30:37.629 INFO:tasks.workunit.client.0.smithi046.stdout:2/227: fsync da/dc/f27 0 2024-05-09T06:30:37.629 INFO:tasks.workunit.client.0.smithi046.stdout:2/228: creat da/de/f46 x:0 0 0 2024-05-09T06:30:37.629 INFO:tasks.workunit.client.1.smithi106.stdout:7/949: mkdir d0/da5/d108/d1a/d36/d30/d44/dc1/d111/deb/d129 0 2024-05-09T06:30:37.629 INFO:tasks.workunit.client.1.smithi106.stdout:4/936: dwrite d7/d10/d10f/f115 [0,4194304] 0 2024-05-09T06:30:37.629 INFO:tasks.workunit.client.1.smithi106.stdout:4/937: write d7/d10/d1a/f71 [1052840,2910] 0 2024-05-09T06:30:37.629 INFO:tasks.workunit.client.1.smithi106.stdout:8/946: symlink d3/d5/d35/d61/l12f 0 2024-05-09T06:30:37.633 INFO:tasks.workunit.client.0.smithi046.stdout:2/229: creat da/de/d11/d3d/f47 x:0 0 0 2024-05-09T06:30:37.637 INFO:tasks.workunit.client.1.smithi106.stdout:4/938: symlink d7/d10/d1a/l133 0 2024-05-09T06:30:37.637 INFO:tasks.workunit.client.1.smithi106.stdout:4/939: fdatasync d7/d10/d1a/f1e 0 2024-05-09T06:30:37.641 INFO:tasks.workunit.client.1.smithi106.stdout:4/940: dread d7/d39/f3f [0,4194304] 0 2024-05-09T06:30:37.645 INFO:tasks.workunit.client.1.smithi106.stdout:7/950: rename d0/da5/d108/d1a/d36/d30/d44/d58/d65 to d0/da5/d108/d45/da6/dc5/d106/d12a 0 2024-05-09T06:30:37.647 INFO:tasks.workunit.client.1.smithi106.stdout:4/941: mknod d7/d39/d35/dac/dd5/c134 0 2024-05-09T06:30:37.647 INFO:tasks.workunit.client.1.smithi106.stdout:4/942: chown d7/d39/d35/l79 463476259 1 2024-05-09T06:30:37.648 INFO:tasks.workunit.client.1.smithi106.stdout:8/947: rename d3/d5/d35/d61/lc1 to d3/d5/d35/d4e/d32/d92/dfb/l130 0 2024-05-09T06:30:37.650 INFO:tasks.workunit.client.0.smithi046.stdout:2/230: dwrite f3 [0,4194304] 0 2024-05-09T06:30:37.650 INFO:tasks.workunit.client.0.smithi046.stdout:2/231: stat da/de/d14/d1f/c23 0 2024-05-09T06:30:37.651 INFO:tasks.workunit.client.1.smithi106.stdout:7/951: unlink d0/da5/d108/d45/da6/dc5/d106/d12a/d84/d87/dce/f100 0 2024-05-09T06:30:37.651 INFO:tasks.workunit.client.1.smithi106.stdout:7/952: fdatasync d0/da5/d108/d1a/f3d 0 2024-05-09T06:30:37.651 INFO:tasks.workunit.client.1.smithi106.stdout:7/953: read - d0/da5/d108/d1a/d36/d30/d44/df0/f102 zero size 2024-05-09T06:30:37.651 INFO:tasks.workunit.client.1.smithi106.stdout:7/954: write d0/da5/d108/f43 [959681,106302] 0 2024-05-09T06:30:37.652 INFO:tasks.workunit.client.1.smithi106.stdout:8/948: mkdir d3/d5/d35/d61/d6c/d83/dcc/d131 0 2024-05-09T06:30:37.663 INFO:tasks.workunit.client.1.smithi106.stdout:4/943: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:37.666 INFO:tasks.workunit.client.1.smithi106.stdout:4/944: creat d7/d39/d35/d7c/f135 x:0 0 0 2024-05-09T06:30:37.671 INFO:tasks.workunit.client.1.smithi106.stdout:7/955: dwrite d0/da5/d108/d1a/d36/d30/d44/d6a/d72/dc4/fc8 [0,4194304] 0 2024-05-09T06:30:37.671 INFO:tasks.workunit.client.1.smithi106.stdout:7/956: write d0/da5/d108/d1a/d36/d30/d44/ded/fe4 [377555,63433] 0 2024-05-09T06:30:37.675 INFO:tasks.workunit.client.1.smithi106.stdout:7/957: unlink d0/da5/d108/d1a/d36/d30/d44/dc1/d111/fc3 0 2024-05-09T06:30:37.675 INFO:tasks.workunit.client.1.smithi106.stdout:7/958: chown d0/da5/d108/d1a/d36/d30/d44/df0 1102571458 1 2024-05-09T06:30:37.675 INFO:tasks.workunit.client.0.smithi046.stdout:2/232: dread da/de/d14/f1b [0,4194304] 0 2024-05-09T06:30:37.676 INFO:tasks.workunit.client.0.smithi046.stdout:2/233: chown da/de/d14/d1f/d20 99856 1 2024-05-09T06:30:37.676 INFO:tasks.workunit.client.1.smithi106.stdout:7/959: rename d0/da5/d108/d1a/d36/d30/d44/df0/f102 to d0/da5/d108/d45/da6/dc5/d106/d12a/d84/f12b 0 2024-05-09T06:30:37.678 INFO:tasks.workunit.client.0.smithi046.stdout:2/234: rename da/de/d14/f32 to da/de/d14/d1f/f48 0 2024-05-09T06:30:37.679 INFO:tasks.workunit.client.0.smithi046.stdout:2/235: getdents da/de/d1c 0 2024-05-09T06:30:37.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/236: fsync da/db/f15 0 2024-05-09T06:30:37.681 INFO:tasks.workunit.client.0.smithi046.stdout:2/237: symlink da/d2d/d43/l49 0 2024-05-09T06:30:37.681 INFO:tasks.workunit.client.0.smithi046.stdout:2/238: write da/de/d1c/f3e [275404,15336] 0 2024-05-09T06:30:37.681 INFO:tasks.workunit.client.0.smithi046.stdout:2/239: mknod da/c4a 0 2024-05-09T06:30:37.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/240: readlink da/dc/l12 0 2024-05-09T06:30:37.682 INFO:tasks.workunit.client.1.smithi106.stdout:4/945: dwrite d7/d28/d2a/f9f [0,4194304] 0 2024-05-09T06:30:37.682 INFO:tasks.workunit.client.1.smithi106.stdout:8/949: dwrite d3/d5/d35/d4e/d32/f97 [4194304,4194304] 0 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:8/950: chown d3/d5/d13/l10a 9866 1 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:7/960: write d0/da5/d108/d1a/d36/d30/d44/fd5 [1087583,87675] 0 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:8/951: write d3/d5/d13/f113 [3771476,43359] 0 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:8/952: fsync d3/d5/d7/d15/df4/dfd/da9/dbd/dd7/fe0 0 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:8/953: truncate d3/d5/d7/d15/d47/d50/fdb 229981 0 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:4/946: mknod d7/dcb/c136 0 2024-05-09T06:30:37.683 INFO:tasks.workunit.client.1.smithi106.stdout:4/947: stat d7/d39/d47/d89/f125 0 2024-05-09T06:30:37.686 INFO:tasks.workunit.client.0.smithi046.stdout:2/241: symlink da/de/d11/l4b 0 2024-05-09T06:30:37.686 INFO:tasks.workunit.client.0.smithi046.stdout:2/242: chown da/de/d11/d3d/f47 29556 1 2024-05-09T06:30:37.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/243: link da/db/f15 da/db/f4c 0 2024-05-09T06:30:37.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/244: write f8 [870971,91929] 0 2024-05-09T06:30:37.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/245: chown da/de/d14/d1f/d20/l3f 2478032 1 2024-05-09T06:30:37.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/246: creat da/de/f4d x:0 0 0 2024-05-09T06:30:37.697 INFO:tasks.workunit.client.1.smithi106.stdout:4/948: creat d7/d39/d47/f137 x:0 0 0 2024-05-09T06:30:37.698 INFO:tasks.workunit.client.0.smithi046.stdout:2/247: write da/de/d14/d1f/d3b/f37 [1578924,64605] 0 2024-05-09T06:30:37.698 INFO:tasks.workunit.client.1.smithi106.stdout:4/949: getdents d7/d39/d47/d89 0 2024-05-09T06:30:37.703 INFO:tasks.workunit.client.0.smithi046.stdout:2/248: fsync da/de/d14/d1f/d3b/f37 0 2024-05-09T06:30:37.703 INFO:tasks.workunit.client.1.smithi106.stdout:8/954: dwrite d3/d5/d35/d61/d6c/d83/dcc/de9/fb6 [0,4194304] 0 2024-05-09T06:30:37.704 INFO:tasks.workunit.client.1.smithi106.stdout:3/898: sync 2024-05-09T06:30:37.704 INFO:tasks.workunit.client.1.smithi106.stdout:3/899: chown d5/d85/dc3/d65/ce9 9324 1 2024-05-09T06:30:37.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/249: mkdir da/de/d14/d1f/d20/d4e 0 2024-05-09T06:30:37.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/250: dread - da/de/d14/d1f/f25 zero size 2024-05-09T06:30:37.708 INFO:tasks.workunit.client.1.smithi106.stdout:7/961: write d0/da5/d108/d1a/d36/d30/d44/df0/f11c [278743,58918] 0 2024-05-09T06:30:37.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/251: creat da/de/d14/d1f/d20/d4e/f4f x:0 0 0 2024-05-09T06:30:37.712 INFO:tasks.workunit.client.1.smithi106.stdout:3/900: unlink d5/d85/dc3/d65/d81/d92/f11d 0 2024-05-09T06:30:37.717 INFO:tasks.workunit.client.1.smithi106.stdout:4/950: dwrite d7/d10/d1a/d5a/f55 [0,4194304] 0 2024-05-09T06:30:37.719 INFO:tasks.workunit.client.1.smithi106.stdout:4/951: rename d7/d10/d1a/d5a/c6a to d7/d39/d35/d7c/dfa/c138 0 2024-05-09T06:30:37.719 INFO:tasks.workunit.client.1.smithi106.stdout:4/952: write d7/d10/d1a/d5a/d7a/f83 [871216,31479] 0 2024-05-09T06:30:37.719 INFO:tasks.workunit.client.1.smithi106.stdout:4/953: readlink d7/d28/l68 0 2024-05-09T06:30:37.724 INFO:tasks.workunit.client.0.smithi046.stdout:2/252: write da/f45 [2833572,95619] 0 2024-05-09T06:30:37.729 INFO:tasks.workunit.client.1.smithi106.stdout:7/962: dread d0/da5/d108/d1a/d36/d30/d44/df0/f11c [0,4194304] 0 2024-05-09T06:30:37.729 INFO:tasks.workunit.client.1.smithi106.stdout:3/901: dwrite d5/f7c [0,4194304] 0 2024-05-09T06:30:37.741 INFO:tasks.workunit.client.0.smithi046.stdout:2/253: dwrite f7 [4194304,4194304] 0 2024-05-09T06:30:37.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/254: write da/dc/f13 [7360154,128965] 0 2024-05-09T06:30:37.762 INFO:tasks.workunit.client.0.smithi046.stdout:6/440: sync 2024-05-09T06:30:37.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/441: dread db/d10/d3c/f5b [0,4194304] 0 2024-05-09T06:30:37.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/442: stat db/f2b 0 2024-05-09T06:30:37.772 INFO:tasks.workunit.client.0.smithi046.stdout:6/443: chown db/d10/d3f/d44/f48 28 1 2024-05-09T06:30:37.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/255: dwrite da/de/d14/f28 [0,4194304] 0 2024-05-09T06:30:37.774 INFO:tasks.workunit.client.0.smithi046.stdout:2/256: creat da/de/d11/d3a/f50 x:0 0 0 2024-05-09T06:30:37.774 INFO:tasks.workunit.client.0.smithi046.stdout:2/257: write da/de/f4d [529471,35589] 0 2024-05-09T06:30:37.780 INFO:tasks.workunit.client.0.smithi046.stdout:6/444: dread db/d10/d3c/f62 [0,4194304] 0 2024-05-09T06:30:37.780 INFO:tasks.workunit.client.0.smithi046.stdout:6/445: dread - db/d10/d3f/d44/d5e/f84 zero size 2024-05-09T06:30:37.781 INFO:tasks.workunit.client.0.smithi046.stdout:6/446: dread db/d10/d3f/d4f/f60 [0,4194304] 0 2024-05-09T06:30:37.782 INFO:tasks.workunit.client.0.smithi046.stdout:6/447: readlink db/d10/d30/l40 0 2024-05-09T06:30:37.782 INFO:tasks.workunit.client.0.smithi046.stdout:6/448: write db/fd [7580459,19733] 0 2024-05-09T06:30:37.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/258: write da/db/f15 [2331798,86971] 0 2024-05-09T06:30:37.783 INFO:tasks.workunit.client.0.smithi046.stdout:2/259: dread - da/de/d14/d1f/d20/d4e/f4f zero size 2024-05-09T06:30:37.783 INFO:tasks.workunit.client.0.smithi046.stdout:6/449: creat db/d10/d76/f9a x:0 0 0 2024-05-09T06:30:37.785 INFO:tasks.workunit.client.0.smithi046.stdout:2/260: link da/de/d1c/l38 da/d2d/d43/l51 0 2024-05-09T06:30:37.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/261: symlink da/de/d14/l52 0 2024-05-09T06:30:37.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/262: read - da/de/d11/d3d/f47 zero size 2024-05-09T06:30:37.787 INFO:tasks.workunit.client.0.smithi046.stdout:2/263: mknod da/dc/c53 0 2024-05-09T06:30:37.789 INFO:tasks.workunit.client.0.smithi046.stdout:2/264: mkdir da/de/d54 0 2024-05-09T06:30:37.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/265: link f8 da/de/d1c/f55 0 2024-05-09T06:30:37.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/450: dwrite db/d10/d3f/d4f/f63 [0,4194304] 0 2024-05-09T06:30:37.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/451: dread - db/d10/d3f/d44/d5e/f88 zero size 2024-05-09T06:30:37.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/253: sync 2024-05-09T06:30:37.809 INFO:tasks.workunit.client.0.smithi046.stdout:4/254: symlink d7/df/d10/d2f/d30/l5b 0 2024-05-09T06:30:37.811 INFO:tasks.workunit.client.0.smithi046.stdout:4/255: truncate d7/df/d10/f41 1655464 0 2024-05-09T06:30:37.811 INFO:tasks.workunit.client.0.smithi046.stdout:4/256: stat d7/df/d10/l14 0 2024-05-09T06:30:37.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/452: dwrite db/d10/d3f/d4f/f63 [4194304,4194304] 0 2024-05-09T06:30:37.832 INFO:tasks.workunit.client.1.smithi106.stdout:8/955: sync 2024-05-09T06:30:37.833 INFO:tasks.workunit.client.0.smithi046.stdout:4/257: dwrite d7/f9 [0,4194304] 0 2024-05-09T06:30:37.833 INFO:tasks.workunit.client.0.smithi046.stdout:4/258: write d7/df/d3a/d25/f43 [634322,107512] 0 2024-05-09T06:30:37.833 INFO:tasks.workunit.client.0.smithi046.stdout:4/259: truncate d7/df/d10/f40 468327 0 2024-05-09T06:30:37.834 INFO:tasks.workunit.client.1.smithi106.stdout:8/956: dread d3/d5/d7/f60 [4194304,4194304] 0 2024-05-09T06:30:37.834 INFO:tasks.workunit.client.1.smithi106.stdout:8/957: rename d3/d5/d13 to d3/d5/d13/d3a/dbe/d132 22 2024-05-09T06:30:37.834 INFO:tasks.workunit.client.1.smithi106.stdout:8/958: chown d3/d5/d35/d4e/d32/d92 471574 1 2024-05-09T06:30:37.835 INFO:tasks.workunit.client.0.smithi046.stdout:4/260: getdents d7/df/d10/d2f/d30 0 2024-05-09T06:30:37.835 INFO:tasks.workunit.client.0.smithi046.stdout:4/261: truncate d7/f46 287491 0 2024-05-09T06:30:37.836 INFO:tasks.workunit.client.1.smithi106.stdout:8/959: dread d3/d5/d35/d61/d6c/fa6 [4194304,4194304] 0 2024-05-09T06:30:37.837 INFO:tasks.workunit.client.0.smithi046.stdout:4/262: rename d7/df/d10/f40 to d7/df/d10/d2f/f5c 0 2024-05-09T06:30:37.837 INFO:tasks.workunit.client.0.smithi046.stdout:4/263: read - d7/df/d10/d2f/f50 zero size 2024-05-09T06:30:37.838 INFO:tasks.workunit.client.1.smithi106.stdout:8/960: mknod d3/d5/d35/d4e/d32/d92/c133 0 2024-05-09T06:30:37.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/453: read db/d10/d19/f54 [783636,92565] 0 2024-05-09T06:30:37.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/454: readlink db/d10/d3c/l81 0 2024-05-09T06:30:37.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/455: fdatasync db/d10/d30/f52 0 2024-05-09T06:30:37.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/456: stat db/d10/d19/f20 0 2024-05-09T06:30:37.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/457: symlink db/d10/d3f/d4f/d8a/l9b 0 2024-05-09T06:30:37.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/458: readlink db/d10/l8d 0 2024-05-09T06:30:37.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.865+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb098005860 con 0x7fb0b40fc710 2024-05-09T06:30:37.847 INFO:tasks.workunit.client.1.smithi106.stdout:8/961: write d3/d5/d35/d61/d6c/d83/dcc/de9/fb6 [2004672,6184] 0 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.866+0000 7fb0aa7fc700 1 -- 172.21.15.46:0/1160518157 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fb0a4020250 con 0x7fb0b40fc710 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:30:37.848 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 13, 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:30:37.849 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:30:37.850 INFO:tasks.workunit.client.0.smithi046.stdout:6/459: getdents db/d10/d3f/d4f/d8a 0 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb0a0070bc0 msgr2=0x7fb0a0073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb0a0070bc0 0x7fb0a0073070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b7a0 tx=0x7fb0b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 msgr2=0x7fb0b41091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 0x7fb0b41091d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b790 tx=0x7fb0a4009250 comp rx=0 tx=0).stop 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 shutdown_connections 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb0a0070bc0 0x7fb0a0073070 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b40fb460 0x7fb0b4108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 --2- 172.21.15.46:0/1160518157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40fc710 0x7fb0b41091d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:37.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 >> 172.21.15.46:0/1160518157 conn(0x7fb0b40f6be0 msgr2=0x7fb0b40f7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 shutdown_connections 2024-05-09T06:30:37.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:37.870+0000 7fb0bbd9d700 1 -- 172.21.15.46:0/1160518157 wait complete. 2024-05-09T06:30:37.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/264: dwrite d7/df/d10/d2f/f44 [0,4194304] 0 2024-05-09T06:30:37.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/265: getdents d7/df 0 2024-05-09T06:30:37.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/266: unlink d7/df/d10/f41 0 2024-05-09T06:30:37.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/267: write d7/df/d10/d2f/f5c [946181,62727] 0 2024-05-09T06:30:37.860 INFO:tasks.workunit.client.0.smithi046.stdout:4/268: mknod d7/df/d10/c5d 0 2024-05-09T06:30:37.861 INFO:tasks.workunit.client.0.smithi046.stdout:4/269: rmdir d7/df/d10/d2f/d59 0 2024-05-09T06:30:37.862 INFO:tasks.workunit.client.0.smithi046.stdout:4/270: creat d7/df/d10/d1d/f5e x:0 0 0 2024-05-09T06:30:37.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/954: sync 2024-05-09T06:30:37.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/955: write d7/d39/d35/f9a [1253445,24539] 0 2024-05-09T06:30:37.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/956: creat d7/d39/d35/dac/f139 x:0 0 0 2024-05-09T06:30:37.865 INFO:tasks.workunit.client.1.smithi106.stdout:4/957: dread - d7/d39/d35/dac/dd5/fd8 zero size 2024-05-09T06:30:37.866 INFO:tasks.workunit.client.1.smithi106.stdout:4/958: mknod d7/d10/c13a 0 2024-05-09T06:30:37.867 INFO:tasks.workunit.client.1.smithi106.stdout:4/959: rmdir d7/d39/d47/d89/dc1 39 2024-05-09T06:30:37.868 INFO:tasks.workunit.client.1.smithi106.stdout:4/960: mkdir d7/d10/d1a/d5a/d46/d13b 0 2024-05-09T06:30:37.871 INFO:tasks.workunit.client.1.smithi106.stdout:4/961: rename d7/d39/d35/d6f/d9d to d7/d10/d106/d13c 0 2024-05-09T06:30:37.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/271: write d7/fb [3376833,48243] 0 2024-05-09T06:30:37.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/272: chown d7/f46 25989296 1 2024-05-09T06:30:37.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/273: dread - d7/df/d10/d2f/d30/f58 zero size 2024-05-09T06:30:37.873 INFO:tasks.workunit.client.0.smithi046.stdout:4/274: rename d7/df/d3a/d25/f43 to d7/df/d3a/d25/f5f 0 2024-05-09T06:30:37.874 INFO:tasks.workunit.client.1.smithi106.stdout:4/962: symlink d7/d39/d8c/da1/l13d 0 2024-05-09T06:30:37.876 INFO:tasks.workunit.client.1.smithi106.stdout:4/963: mknod d7/d39/d47/d66/c13e 0 2024-05-09T06:30:37.876 INFO:tasks.workunit.client.1.smithi106.stdout:4/964: write d7/d39/d47/f137 [251440,95620] 0 2024-05-09T06:30:37.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/275: dread d7/df/d10/d2f/f5c [0,4194304] 0 2024-05-09T06:30:37.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/276: truncate d7/df/d10/d2f/f44 4229358 0 2024-05-09T06:30:37.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/277: stat d7/df/d10/d1d/c33 0 2024-05-09T06:30:37.883 INFO:tasks.workunit.client.1.smithi106.stdout:4/965: dread d7/d10/d1a/d5a/f55 [0,4194304] 0 2024-05-09T06:30:37.883 INFO:tasks.workunit.client.0.smithi046.stdout:4/278: unlink d7/df/d10/l11 0 2024-05-09T06:30:37.884 INFO:tasks.workunit.client.0.smithi046.stdout:4/279: mknod d7/df/d10/d1d/c60 0 2024-05-09T06:30:37.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/966: creat d7/d10/d1a/d5a/d1c/dfb/f13f x:0 0 0 2024-05-09T06:30:37.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/967: readlink d7/d10/d1a/l37 0 2024-05-09T06:30:37.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/968: write d7/fc4 [84802,104073] 0 2024-05-09T06:30:37.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/969: read - d7/d39/d35/d4a/fde zero size 2024-05-09T06:30:37.886 INFO:tasks.workunit.client.1.smithi106.stdout:4/970: creat d7/d39/d35/dac/dd5/f140 x:0 0 0 2024-05-09T06:30:37.892 INFO:tasks.workunit.client.0.smithi046.stdout:4/280: rename d7/df/d3a/d45/c4c to d7/df/d10/d1d/c61 0 2024-05-09T06:30:37.894 INFO:tasks.workunit.client.1.smithi106.stdout:4/971: mknod d7/d39/d35/dac/dd5/c141 0 2024-05-09T06:30:37.894 INFO:tasks.workunit.client.1.smithi106.stdout:4/972: creat d7/d28/d2a/f142 x:0 0 0 2024-05-09T06:30:37.894 INFO:tasks.workunit.client.0.smithi046.stdout:4/281: getdents d7/df/d10/d2f 0 2024-05-09T06:30:37.894 INFO:tasks.workunit.client.0.smithi046.stdout:4/282: getdents d7/df/d10/d2f/d30 0 2024-05-09T06:30:37.898 INFO:tasks.workunit.client.1.smithi106.stdout:4/973: link d7/d10/d1a/f85 d7/dcb/f143 0 2024-05-09T06:30:37.903 INFO:tasks.workunit.client.1.smithi106.stdout:4/974: truncate d7/d10/d1a/f1e 287475 0 2024-05-09T06:30:37.904 INFO:tasks.workunit.client.1.smithi106.stdout:4/975: creat d7/d39/d128/f144 x:0 0 0 2024-05-09T06:30:37.905 INFO:tasks.workunit.client.1.smithi106.stdout:4/976: symlink d7/d10/d106/d13c/l145 0 2024-05-09T06:30:37.908 INFO:tasks.workunit.client.1.smithi106.stdout:4/977: rename d7/d10/d1a/d5a/d46/d13b to d7/d39/d128/d146 0 2024-05-09T06:30:37.909 INFO:tasks.workunit.client.1.smithi106.stdout:4/978: chown d7/d39/l56 62010792 1 2024-05-09T06:30:37.910 INFO:tasks.workunit.client.0.smithi046.stdout:4/283: dwrite d7/df/f29 [0,4194304] 0 2024-05-09T06:30:37.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/284: creat d7/df/d10/d1d/f62 x:0 0 0 2024-05-09T06:30:37.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/285: creat d7/df/d3a/d45/f63 x:0 0 0 2024-05-09T06:30:37.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/286: dread - d7/df/d3a/d45/f63 zero size 2024-05-09T06:30:37.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/287: write d7/f2e [57630,89564] 0 2024-05-09T06:30:37.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/288: dread - d7/df/d10/d2f/f50 zero size 2024-05-09T06:30:37.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/289: getdents d7/df/d53 0 2024-05-09T06:30:37.912 INFO:tasks.workunit.client.1.smithi106.stdout:4/979: rename d7/d10/d1a/d5a/d1c/da7/fb5 to d7/d39/d8c/da1/f147 0 2024-05-09T06:30:37.914 INFO:tasks.workunit.client.1.smithi106.stdout:7/963: sync 2024-05-09T06:30:37.914 INFO:tasks.workunit.client.1.smithi106.stdout:3/902: sync 2024-05-09T06:30:37.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/290: rename d7/df/d10/l14 to d7/df/d3a/l64 0 2024-05-09T06:30:37.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/291: chown d7/df/d3a 131659806 1 2024-05-09T06:30:37.917 INFO:tasks.workunit.client.0.smithi046.stdout:0/342: sync 2024-05-09T06:30:37.918 INFO:tasks.workunit.client.0.smithi046.stdout:0/343: read - d11/d3f/f5d zero size 2024-05-09T06:30:37.918 INFO:tasks.workunit.client.0.smithi046.stdout:8/257: sync 2024-05-09T06:30:37.919 INFO:tasks.workunit.client.0.smithi046.stdout:3/204: sync 2024-05-09T06:30:37.919 INFO:tasks.workunit.client.0.smithi046.stdout:5/196: sync 2024-05-09T06:30:38.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/197: chown d0/l3b 87124404 1 2024-05-09T06:30:38.348 INFO:tasks.workunit.client.0.smithi046.stdout:1/187: sync 2024-05-09T06:30:38.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/198: fsync d0/f1a 0 2024-05-09T06:30:38.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/199: truncate d0/fa 990543 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:9/199: sync 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/293: sync 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/292: symlink d7/df/d10/l65 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/293: chown d7/df/d3a/d45/f49 242093114 1 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/344: getdents d11/d18/d1c/d56 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/345: fdatasync d11/d18/d27/d28/d36/d5a/f69 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/346: chown d11/d18/f3b 31414 1 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:5/200: symlink d0/d3e/l46 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:5/201: chown d0/d1b/d21/c25 0 1 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:8/258: truncate d1/db/dd/f1a 3845159 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/347: creat d11/d18/d1c/d56/f74 x:0 0 0 2024-05-09T06:30:38.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/348: fdatasync d11/d18/d27/d28/f50 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/349: mknod d11/d4f/d5b/d5f/c75 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/350: write d11/d18/d1c/f1d [3388604,102612] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/351: creat d11/d3f/d6f/f76 x:0 0 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/352: write d11/d18/d1c/d56/f74 [333476,60455] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/353: creat d11/d18/d27/d28/d6b/f77 x:0 0 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:5/202: write d0/f1a [2594520,57884] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/294: dread d7/df/f1b [4194304,4194304] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:9/200: dread d2/d6/f21 [0,4194304] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:5/203: dread d0/f4 [0,4194304] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:5/204: stat d0/d1b/c1d 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/295: dread d7/f2e [0,4194304] 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/296: stat d7/df/d10/d2f/d30 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/297: dread - d7/df/d3a/d45/f63 zero size 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/298: truncate d7/f15 1349924 0 2024-05-09T06:30:38.358 INFO:tasks.workunit.client.0.smithi046.stdout:7/294: dwrite d3/d7/d28/f66 [0,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/295: chown d3/d7/f9 0 1 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/188: dwrite d7/d10/d28/f33 [0,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/189: fsync d7/f1d 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/190: fsync d7/d10/d28/f33 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/296: read d3/f6 [64846,87970] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:8/259: dwrite d1/d7/d12/f3b [0,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:8/260: fdatasync d1/db/dd/d11/f27 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:3/205: dwrite d4/d5/f9 [0,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:0/354: dwrite d11/d18/d27/d28/d36/d5a/f69 [0,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:4/299: dwrite d7/df/d3a/d45/f51 [0,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:8/261: dwrite d1/db/dd/f13 [8388608,4194304] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:4/300: write d7/df/d10/d2f/f50 [969681,75012] 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/297: mkdir d3/d7/d4c/d6a 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/298: chown d3/d3d/d5b 132317206 1 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/299: fdatasync d3/d7/dd/f37 0 2024-05-09T06:30:38.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/300: fdatasync d3/d7/d28/f50 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/301: dread d7/fc [0,4194304] 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/301: write d3/f4 [3749202,33360] 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/302: write d3/d7/dd/f23 [5221193,48145] 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/303: dread d3/d7/dd/f37 [0,4194304] 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:0/355: mknod d11/d3f/d6f/c78 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:0/356: fsync d11/d18/d1c/f44 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/302: write d7/df/f29 [3530,56313] 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/303: dread - d7/f4b zero size 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/191: symlink d7/l39 0 2024-05-09T06:30:38.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/304: dread d7/df/d10/d2f/f50 [0,4194304] 0 2024-05-09T06:30:38.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.057+0000 7f59c159a700 1 -- 172.21.15.46:0/3421614082 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59b4013b70 con 0x7f59c40fbcb0 2024-05-09T06:30:38.362 INFO:tasks.workunit.client.0.smithi046.stdout:8/262: rename d1/d7/d12/d29 to d1/d7/d12/d45 0 2024-05-09T06:30:38.362 INFO:tasks.workunit.client.0.smithi046.stdout:8/263: write d1/d7/f31 [5180531,70265] 0 2024-05-09T06:30:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 -- 172.21.15.46:0/3421614082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 msgr2=0x7f59c40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 --2- 172.21.15.46:0/3421614082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c40fc0c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f59b4004940 tx=0x7f59b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 -- 172.21.15.46:0/3421614082 shutdown_connections 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 --2- 172.21.15.46:0/3421614082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 0x7f59c40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 --2- 172.21.15.46:0/3421614082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c40fc0c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 -- 172.21.15.46:0/3421614082 >> 172.21.15.46:0/3421614082 conn(0x7f59c40f7430 msgr2=0x7f59c40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 -- 172.21.15.46:0/3421614082 shutdown_connections 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.058+0000 7f59c8c85700 1 -- 172.21.15.46:0/3421614082 wait complete. 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.060+0000 7f59c8c85700 1 Processor -- start 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.060+0000 7f59c8c85700 1 -- start start 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.060+0000 7f59c8c85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c410d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c8c85700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 0x7f59c410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c410d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c8c85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c410e500 con 0x7f59c40fbcb0 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c8c85700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c410ed00 con 0x7f59c40fcf60 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c410d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50860/0 (socket says 172.21.15.46:50860) 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c1d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 0x7f59c410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c1d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 0x7f59c410df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:37790/0 (socket says 172.21.15.46:37790) 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c1d9b700 1 -- 172.21.15.46:0/1122259952 learned_addr learned my addr 172.21.15.46:0/1122259952 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c259c700 1 -- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 msgr2=0x7f59c410df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.061+0000 7f59c259c700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 0x7f59c410df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.062+0000 7f59c259c700 1 -- 172.21.15.46:0/1122259952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8005040 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.062+0000 7f59c259c700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c410d9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f59b4000c00 tx=0x7f59b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.063+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59b400e070 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.063+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59b401d660 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.063+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b4005040 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.063+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59b40255f0 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.064+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c410f350 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.065+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c405f5c0 con 0x7f59c40fbcb0 2024-05-09T06:30:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.067+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f59b4023020 con 0x7f59c40fbcb0 2024-05-09T06:30:38.369 INFO:tasks.workunit.client.0.smithi046.stdout:0/357: creat d11/d18/d27/f79 x:0 0 0 2024-05-09T06:30:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.068+0000 7f59b2ffd700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f59ac070c80 0x7f59ac073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:30:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.068+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f59b40957a0 con 0x7f59c40fbcb0 2024-05-09T06:30:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.069+0000 7f59c1d9b700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f59ac070c80 0x7f59ac073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:30:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.071+0000 7f59c1d9b700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f59ac070c80 0x7f59ac073130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f59b8007fd0 tx=0x7f59b800b040 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:30:38.370 INFO:tasks.workunit.client.0.smithi046.stdout:1/192: mkdir d7/d10/d28/d30/d3a 0 2024-05-09T06:30:38.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.076+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f59b405dec0 con 0x7f59c40fbcb0 2024-05-09T06:30:38.384 INFO:tasks.workunit.client.1.smithi106.stdout:3/903: creat d5/d1c/d24/d89/d8c/d11b/f11f x:0 0 0 2024-05-09T06:30:38.384 INFO:tasks.workunit.client.1.smithi106.stdout:3/904: link d5/d1c/d24/d98/d112/cb7 d5/d1c/d24/d89/d8c/c120 0 2024-05-09T06:30:38.384 INFO:tasks.workunit.client.1.smithi106.stdout:3/905: chown d5/d1c/d24/f59 13716 1 2024-05-09T06:30:38.384 INFO:tasks.workunit.client.1.smithi106.stdout:3/906: creat d5/d1c/d24/d98/d112/f121 x:0 0 0 2024-05-09T06:30:38.384 INFO:tasks.workunit.client.1.smithi106.stdout:3/907: symlink d5/d85/dc3/d65/de3/l122 0 2024-05-09T06:30:38.384 INFO:tasks.workunit.client.1.smithi106.stdout:4/980: dwrite d7/d39/d128/f144 [0,4194304] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/981: truncate d7/d10/d1a/f1e 433081 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/982: unlink d7/d28/d2a/c59 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/983: mkdir d7/d39/d35/dac/dd5/d148 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/984: dread d7/d39/d35/fc2 [0,4194304] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/985: rename d7/d39/d8c/fbd to d7/d39/f149 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:7/964: dwrite d0/f40 [0,4194304] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:7/965: link d0/da5/d108/d45/da6/dc5/d106/d12a/d84/f12b d0/da5/d108/d45/da6/dc5/f12c 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:3/908: dwrite d5/d85/dc3/d65/f116 [0,4194304] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:7/966: mknod d0/da5/d108/d1a/d36/d1e/c12d 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:3/909: write d5/d1c/d24/d98/dc0/fa2 [3049595,7008] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:3/910: dread - d5/d1c/d24/d89/d8e/fa6 zero size 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:3/911: read d5/d1c/f47 [148214,113575] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:3/912: stat d5/f63 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/986: dwrite d7/d10/d1a/d5a/f55 [0,4194304] 0 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:4/987: chown d7/d10/d106 14 1 2024-05-09T06:30:38.385 INFO:tasks.workunit.client.1.smithi106.stdout:3/913: truncate d5/d1c/d24/d52/f71 6728003 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:4/988: truncate d7/d10/f1d 3602388 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:4/989: readlink d7/d39/d47/l60 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:4/990: stat d7/d39/d35/d7c/dfa/f126 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/962: sync 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:3/914: unlink d5/d1c/d24/d98/d112/cb7 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:7/967: dwrite d0/da5/d108/d45/da6/dc5/d106/d12a/d84/d87/fd6 [0,4194304] 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:7/968: stat d0/da5/d108/d45/fae 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:7/969: chown d0/da5/d108/d1a/d36/d30/d44/d6a/d72/dc4/fc8 4 1 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/963: dread d3/d5/d35/d61/d6c/d83/dcc/de9/fef [0,4194304] 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:4/991: dwrite d7/d39/d35/d4a/f93 [4194304,4194304] 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:4/992: chown d7/d39/d35/d7c/fd6 55 1 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/964: mknod d3/d5/d35/d61/d6c/d83/d89/c134 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:3/915: dwrite d5/d4d/d7a/fb2 [0,4194304] 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:4/993: truncate d7/d28/d2a/f2b 1512566 0 2024-05-09T06:30:38.386 INFO:tasks.workunit.client.1.smithi106.stdout:8/965: rename d3/d5/d13/f1b to d3/d5/d35/d61/d6c/d83/dcc/de9/f135 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:8/966: chown d3/d5/d35/d4e/l39 5406038 1 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/994: symlink d7/d10/d1a/d5a/l14a 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:8/967: dwrite d3/d5/d35/d61/d11c/fc7 [4194304,4194304] 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:8/968: write d3/d5/d13/f14 [4862187,20507] 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:3/916: rename d5/d4d/d72/fd0 to d5/d3f/f123 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/995: mkdir d7/d28/d14b 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:8/969: symlink d3/d5/d35/d4e/l136 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:3/917: unlink d5/d85/fd2 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:7/970: dwrite d0/da5/d108/d1a/d36/d30/d44/d6a/f8e [0,4194304] 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:3/918: chown d5/d85/dc3/l82 79864188 1 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:3/919: truncate d5/d1c/d24/d52/dc6/fdd 575630 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/996: mkdir d7/d39/d8c/da1/d14c 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/997: creat d7/d39/d8c/da1/df8/f14d x:0 0 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:7/971: creat d0/da5/d108/d45/da6/dc5/d106/d12a/d84/f12e x:0 0 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/998: mkdir d7/d10/d1a/d5a/d1c/d107/d14e 0 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:4/999: chown d7/d39/d47/d66/c13e 167 1 2024-05-09T06:30:38.387 INFO:tasks.workunit.client.1.smithi106.stdout:7/972: mknod d0/da5/d108/d1a/df6/d110/c12f 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/970: dwrite d3/d5/d35/d61/d6c/d83/dcc/de9/f6d [0,4194304] 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:7/973: creat d0/da5/d108/d1a/d36/d30/f130 x:0 0 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:7/974: readlink d0/da5/d108/d1a/d36/d30/d44/df0/lb0 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:7/975: chown d0/da5/d108/d1a/d36/d30/d44/dc1/ld9 38 1 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:7/976: write d0/da5/d108/d1a/d36/d30/d44/d6a/f9e [4780770,20374] 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:7/977: chown d0/da5/d108/d45/da6/dc5/d106/d12a/d84/f114 55664394 1 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/971: link d3/d5/d35/d4e/d32/f75 d3/d5/d35/d61/d6c/d83/d89/deb/f137 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:3/920: dwrite d5/d1c/d24/d98/dc0/f7e [4194304,4194304] 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:3/921: mkdir d5/d1c/d24/d98/dc0/d124 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:3/922: mknod d5/d85/dc3/c125 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/972: dread d3/d5/d7/d15/d47/f62 [4194304,4194304] 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/973: dread - d3/d5/d7/fe6 zero size 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:3/923: mknod d5/d85/dc3/dc8/c126 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/974: dread d3/d5/d35/d4e/d32/f9a [4194304,4194304] 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:7/978: dwrite d0/da5/d108/d1a/d36/d1e/f123 [4194304,4194304] 0 2024-05-09T06:30:38.388 INFO:tasks.workunit.client.1.smithi106.stdout:8/975: chown d3/d5/d35/d61/dfc/d123 12958845 1 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/976: getdents d3/d5/d13 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/924: dwrite d5/d85/dc3/d26/d90/f97 [0,4194304] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/925: write d5/d3f/f107 [1033267,1524] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/926: write d5/d1c/d24/d98/dc0/f91 [913598,6037] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/927: read d5/d3f/f4f [894295,28171] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:7/979: link d0/da5/d108/d1a/df6/d110/c12f d0/da5/d108/d1a/d36/d30/d44/c131 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/977: mknod d3/d5/d13/c138 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/978: dread d3/d5/d35/d61/d6c/d83/dcc/de9/f6d [8388608,4194304] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/979: write d3/d5/d13/d3a/dbe/f12b [3489373,104697] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/928: creat d5/d1c/d24/d98/dc0/d32/f127 x:0 0 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:7/980: symlink d0/da5/l132 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:7/981: stat d0/da5/d108/d45/da6/dc5/d106/d12a 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/980: unlink d3/d5/d7/f60 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:7/982: dwrite d0/da5/d108/d1a/d36/d30/d44/dc1/d111/deb/ff5 [0,4194304] 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:8/981: rename d3/d5/l38 to d3/d5/d35/d73/d10b/l139 0 2024-05-09T06:30:38.389 INFO:tasks.workunit.client.1.smithi106.stdout:3/929: getdents d5/d1c/d24/d89/d8c/d11b 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/930: read d5/d1c/d24/d5b/f95 [1119837,2759] 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/931: write d5/d1c/d24/d89/d8c/d11b/f11f [650035,68754] 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/983: link d0/da5/d108/d1a/f2f d0/da5/d108/d45/da6/f133 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:8/982: unlink d3/d5/d7/f20 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/932: mknod d5/d1c/d24/d89/d8e/c128 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/933: getdents d5/d1c/d118 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/934: dread d5/d1c/f1e [0,4194304] 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:8/983: symlink d3/d5/d35/d61/dfc/d123/l13a 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/984: getdents d0/da5/d108/d1a/d36/d30/d44/dc1 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/985: dread - d0/da5/d108/d1a/d36/d1e/f9b zero size 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/986: fdatasync d0/da5/d108/d1a/d36/d30/fd3 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:3/935: mkdir d5/d85/dc3/d65/d81/d129 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:8/984: creat d3/d5/d111/f13b x:0 0 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:8/985: creat d3/d5/d35/f13c x:0 0 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/987: link d0/da5/d108/d1a/d36/d30/d44/ded/fe4 d0/da5/d108/d1a/d36/d30/d44/df0/f134 0 2024-05-09T06:30:38.390 INFO:tasks.workunit.client.1.smithi106.stdout:7/988: write d0/da5/d108/d1a/d36/d1e/f46 [563775,26965] 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:8/986: dread d3/d5/d13/d3a/f55 [0,4194304] 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/936: rename d5/d85/dc3/d65/ddc/d10d to d5/d1c/d24/d5b/d12a 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/989: dwrite d0/fff [0,4194304] 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/937: getdents d5/d1c/d24/d98/dc0 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/990: dread d0/da5/d108/d1a/d36/d30/fb8 [0,4194304] 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/938: creat d5/d1c/d24/d98/dc0/d32/f12b x:0 0 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/991: mkdir d0/da5/d108/d1a/d36/d135 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/939: mkdir d5/d1c/d24/d52/d12c 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/992: mknod d0/da5/d108/d1a/d36/d135/c136 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/940: symlink d5/d85/dc3/d65/d81/d129/l12d 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/941: creat d5/d85/dc3/d65/f12e x:0 0 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:3/942: fdatasync d5/d4d/faf 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/993: link d0/da5/d108/d1a/d36/f10c d0/da5/d108/d1a/d36/d135/f137 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/994: write d0/da5/d108/d1a/d36/f3f [4809368,25457] 0 2024-05-09T06:30:38.391 INFO:tasks.workunit.client.1.smithi106.stdout:7/995: write d0/da5/d108/d1a/d36/d1e/f9b [840728,6875] 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/943: rename d5/d1c/d24/d98/dc0/d32/c38 to d5/ddb/c12f 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/944: dread - d5/d4d/faf zero size 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/945: chown d5/d85/dc3/d65/d81/d92/ld8 2003796501 1 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/946: mknod d5/d85/c130 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/947: unlink d5/d1c/d24/d89/cad 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/948: read d5/d4d/d72/fba [229205,67031] 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/949: write d5/d3f/f4f [974083,121405] 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:7/996: dwrite d0/da5/d108/d1a/d36/d1e/f5d [0,4194304] 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/950: getdents d5/d4d 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:7/997: chown d0/da5/d108/d1a/d36/d30/d44/dc1/d111/lb1 11 1 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:7/998: readlink d0/da5/d108/d1a/d36/d30/d44/dc1/ld9 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:7/999: fsync d0/da5/d108/d1a/d36/d30/d44/d6a/d72/fc0 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/951: creat d5/d4d/d7a/da9/f131 x:0 0 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/952: truncate d5/d1c/d24/d89/d8c/fd3 363343 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/953: creat d5/d1c/d24/d52/d12c/f132 x:0 0 0 2024-05-09T06:30:38.392 INFO:tasks.workunit.client.1.smithi106.stdout:3/954: write d5/d85/dc3/f74 [1063429,96780] 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/955: link d5/d1c/d24/ff7 d5/d1c/d24/d98/d112/de5/d108/f133 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/956: dread d5/d1c/d24/d52/f71 [0,4194304] 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/957: chown d5/d85/dc3/dc8/ff8 15904 1 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/958: chown d5/d1c/d24/d89/d8e/lbd 63244162 1 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/959: write d5/f7c [294998,62893] 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/960: dwrite d5/d1c/d24/f43 [0,4194304] 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/961: creat d5/d3f/f134 x:0 0 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/962: mkdir d5/d3f/d135 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/963: mknod d5/d1c/d24/d89/d8c/d11b/c136 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/964: dread d5/d1c/d24/d98/dc0/d32/fd4 [0,4194304] 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/965: truncate d5/d1c/d24/d89/d8c/fd3 357723 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/966: dread - d5/d1c/d24/d98/d112/f121 zero size 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/967: readlink d5/d1c/d24/d98/dc0/le8 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:8/987: sync 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:8/988: fdatasync d3/d5/d35/f13c 0 2024-05-09T06:30:38.393 INFO:tasks.workunit.client.1.smithi106.stdout:3/968: link d5/d85/dc3/c1a d5/d1c/c137 0 2024-05-09T06:30:38.394 INFO:tasks.workunit.client.1.smithi106.stdout:3/969: fsync d5/d1c/d24/d52/fef 0 2024-05-09T06:30:38.394 INFO:tasks.workunit.client.1.smithi106.stdout:8/989: symlink d3/d5/d7/d15/df4/dfd/da9/dbd/dd7/l13d 0 2024-05-09T06:30:38.394 INFO:tasks.workunit.client.1.smithi106.stdout:8/990: fdatasync d3/d5/d7/fe6 0 2024-05-09T06:30:38.394 INFO:tasks.workunit.client.1.smithi106.stdout:8/991: fsync d3/d5/d7/d15/df4/dfd/da9/dbd/fd1 0 2024-05-09T06:30:38.394 INFO:tasks.workunit.client.1.smithi106.stdout:3/970: mknod d5/d1c/d24/d89/d8c/c138 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:4/305: rename d7/df/d3a/d25/l55 to d7/df/d3a/l66 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/264: dwrite d1/db/dd/f13 [8388608,4194304] 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/265: chown d1/d7/d2c 20 1 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/266: readlink d1/d7/d12/d1d/d30/l44 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/304: truncate d3/d7/d28/f2a 4667161 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/358: symlink d11/d18/d1c/d53/l7a 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/359: read - d11/d18/d27/d28/d2d/f57 zero size 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:1/193: creat d7/d10/d28/d30/d3a/f3b x:0 0 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:4/306: unlink d7/df/d10/f24 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/305: fdatasync d3/d7/d28/d29/d3b/f49 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/306: link d3/d7/dd/fe d3/d7/d4c/d4f/f6b 0 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/307: chown d3/d7/d28/d29/d35/f62 5218 1 2024-05-09T06:30:38.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/308: dread d3/d7/d28/d29/d3b/f3f [0,4194304] 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:8/267: dwrite d1/db/f28 [4194304,4194304] 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/194: write d7/d10/d28/f33 [2246579,110018] 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:0/360: dwrite d11/d18/d27/f68 [0,4194304] 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/309: dwrite d3/f1b [0,4194304] 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/310: dread - d3/d3d/f41 zero size 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/195: rename d7/d10/d28/f2d to d7/d10/d28/d30/d3a/f3c 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/196: dread - d7/d10/d28/d30/f36 zero size 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/197: write d7/f8 [3922512,3094] 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/307: getdents d7/df/d10 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:8/268: creat d1/d7/d12/d1d/d30/d38/f46 x:0 0 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:0/361: mknod d11/d18/c7b 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/198: unlink d7/f25 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/308: creat d7/df/d10/d2f/d30/f67 x:0 0 0 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/309: chown d7 1324020844 1 2024-05-09T06:30:38.398 INFO:tasks.workunit.client.0.smithi046.stdout:0/362: dwrite d11/f15 [0,4194304] 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:0/363: chown d11/d18/d1c/d53/l73 674 1 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/269: symlink d1/d7/d12/d1d/d30/d38/l47 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/270: truncate d1/d7/d12/d1d/d30/d38/f42 344857 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/271: chown d1/db/dd/d11 175 1 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/272: chown d1/d7/f34 227121 1 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/273: readlink d1/d7/d12/d45/l3e 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:1/199: symlink d7/d10/d28/l3d 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/310: mknod d7/df/d10/c68 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:1/200: dread f5 [0,4194304] 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:0/364: write d11/d18/f1a [4845658,96660] 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/274: dwrite d1/db/dd/d11/f27 [0,4194304] 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/311: rename d7/f46 to d7/df/d10/d1d/f69 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/312: dread d7/f1e [0,4194304] 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:0/365: creat d11/d18/d27/d28/f7c x:0 0 0 2024-05-09T06:30:38.399 INFO:tasks.workunit.client.0.smithi046.stdout:1/201: dread d7/fc [0,4194304] 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/313: creat d7/df/d53/f6a x:0 0 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/314: chown d7/df/f38 218611 1 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/315: getdents d7/df 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/366: write f9 [8023881,76964] 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/275: dwrite d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/202: link d7/d10/d28/d30/d3a/f3c d7/f3e 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/203: dread d7/fc [0,4194304] 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/316: dwrite d7/df/d10/d2f/d30/f58 [0,4194304] 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/276: dread d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/277: fsync d1/db/dd/f13 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/204: symlink d7/d10/d34/l3f 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/205: fsync d7/f2c 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/206: readlink d7/d10/l31 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/207: fdatasync d7/f1d 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/317: symlink d7/df/d3a/d25/l6b 0 2024-05-09T06:30:38.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/278: mknod d1/d7/d12/c48 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/279: truncate d1/f33 871112 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/318: unlink d7/df/d10/d1d/f5e 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/280: symlink d1/db/dd/d11/l49 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/319: symlink d7/df/d3a/d25/l6c 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/281: creat d1/db/dd/f4a x:0 0 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/282: rename d1/db/dd/d14/f2e to d1/db/dd/d11/d43/f4b 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/283: chown d1/db/cc 1 1 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/284: creat d1/d7/d12/d45/f4c x:0 0 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/285: dread d1/d7/d12/d1d/f3c [0,4194304] 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/286: creat d1/d7/d2c/f4d x:0 0 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:1/208: dwrite d7/d10/d28/d30/d3a/f3b [0,4194304] 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:1/209: truncate d7/d10/d28/d30/d3a/f3c 238753 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/320: dwrite d7/df/d53/f6a [0,4194304] 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/287: creat d1/d7/d12/d1d/d30/f4e x:0 0 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/321: dread d7/fc [0,4194304] 0 2024-05-09T06:30:38.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/322: chown d7/df/d10/d2f/d30/f58 182347 1 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:4/323: chown d7/df/f38 10470170 1 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/210: unlink d7/f3e 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/288: symlink d1/d7/d12/d1d/d30/d38/l4f 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/211: mknod d7/d10/d28/c40 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/212: creat d7/d10/d28/d30/d3a/f41 x:0 0 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/213: rename f5 to d7/f42 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/214: fsync d7/d10/f23 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/289: write d1/d7/f34 [2616211,26629] 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/290: rmdir d1/db/dd/d11/d43 39 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/291: rename d1/d7/d12/d1d/f3c to d1/db/dd/d14/f50 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/215: dwrite d7/d10/d28/d30/d3a/f41 [0,4194304] 0 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:5/205: sync 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:6/460: sync 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:3/206: sync 2024-05-09T06:30:38.402 INFO:tasks.workunit.client.0.smithi046.stdout:3/207: fsync d4/d20/f25 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/266: sync 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/201: sync 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/267: write f3 [3708048,70463] 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/216: getdents d7/d10/d34 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/217: write d7/f8 [4032947,31061] 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:5/206: dread d0/fa [0,4194304] 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:6/461: creat db/d10/d3f/d4f/d89/f9c x:0 0 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/202: creat d2/dc/f41 x:0 0 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/268: truncate da/de/d14/f1b 2137590 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/269: creat da/dc/f56 x:0 0 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/218: unlink d7/f8 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:5/207: creat d0/d1b/d39/f47 x:0 0 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/270: symlink da/de/d14/d1f/d3b/l57 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/292: dwrite d1/d7/f34 [4194304,4194304] 0 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/293: chown d1/l6 362 1 2024-05-09T06:30:38.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/294: creat d1/db/dd/f51 x:0 0 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/295: truncate d1/d7/d2c/f4d 171594 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/296: dread d1/db/dd/d11/d43/f4b [0,4194304] 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/297: readlink d1/d7/d12/d1d/d30/l44 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/298: write d1/f33 [1672339,19921] 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/299: chown d1/d7/d12/d1d/d30/d38/f46 5753572 1 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:5/208: write d0/fd [3178639,3874] 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/271: write da/de/f10 [42715,55485] 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:5/209: symlink d0/d1b/d39/l48 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/272: truncate da/de/d14/d1f/f41 284058 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/273: creat da/de/d14/f58 x:0 0 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:8/300: rmdir d1/d7/d12/d1d/d30 39 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/274: link da/de/f10 da/de/d14/d1f/d20/f59 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/275: write da/db/f15 [3896309,5189] 0 2024-05-09T06:30:38.404 INFO:tasks.workunit.client.0.smithi046.stdout:6/462: dwrite db/d10/d3f/f32 [0,4194304] 0 2024-05-09T06:30:38.405 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:38 smithi046 ceph-mon[26924]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:38.405 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:38 smithi046 ceph-mon[26924]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:38.405 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:38 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1160518157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:38.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/463: link db/d10/d30/f4a db/d10/d3f/d44/d46/d70/f9d 0 2024-05-09T06:30:38.408 INFO:tasks.workunit.client.0.smithi046.stdout:3/208: dwrite d4/d5/f37 [0,4194304] 0 2024-05-09T06:30:38.408 INFO:tasks.workunit.client.0.smithi046.stdout:3/209: rename d4/d20 to d4/d20/d24/d2a/d44 22 2024-05-09T06:30:38.408 INFO:tasks.workunit.client.0.smithi046.stdout:3/210: dread - d4/f3d zero size 2024-05-09T06:30:38.408 INFO:tasks.workunit.client.0.smithi046.stdout:3/211: chown d4/d20/d24/d2a/f40 127 1 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/212: write d4/d5/f3a [452841,115501] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/276: write da/de/f1e [196197,75803] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/277: truncate da/de/d11/d3a/f50 184978 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/213: write d4/d5/f3a [1635903,71105] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/219: dwrite d7/d10/d28/d30/f36 [0,4194304] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:9/203: dwrite d2/d6/f22 [0,4194304] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:9/204: readlink d2/d6/d38/l3f 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/214: dread d4/d20/f36 [0,4194304] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/215: chown d4/d20 20279 1 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/216: chown l2 1507 1 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/278: dread da/de/f4d [0,4194304] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/279: creat da/de/d14/d1f/d20/f5a x:0 0 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/210: read d0/f24 [3842590,58972] 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/211: fsync d0/f4 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/220: mknod d7/d10/d28/d30/d3a/c43 0 2024-05-09T06:30:38.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/221: fdatasync d7/d10/f12 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/217: link d4/lf d4/d20/d24/d29/l45 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/212: rmdir d0/d1b 39 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/213: write d0/f2a [664005,7117] 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/214: truncate d0/d1b/f35 559444 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:1/222: symlink d7/l44 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/218: getdents d4/d20/d24/d29/d2b/d3e 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/215: symlink d0/d1b/l49 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/216: write d0/d1b/f3d [815610,81356] 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:1/223: creat d7/d10/d34/f45 x:0 0 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/219: mkdir d4/d20/d24/d2a/d46 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/220: fdatasync d4/fc 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/217: getdents d0 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/218: chown d0/d1b/c2b 450 1 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/219: dread d0/f1 [0,4194304] 0 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/220: chown d0/d1b/c43 2535 1 2024-05-09T06:30:38.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/221: truncate d0/d1b/f20 145095 0 2024-05-09T06:30:38.411 INFO:tasks.workunit.client.0.smithi046.stdout:5/222: getdents d0 0 2024-05-09T06:30:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.455+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59c410f730 con 0x7f59ac070c80 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.457+0000 7f59b2ffd700 1 -- 172.21.15.46:0/1122259952 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f59c410f730 con 0x7f59ac070c80 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "1/2 daemons upgraded", 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:30:38.439 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:30:38.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f59ac070c80 msgr2=0x7f59ac073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:38.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f59ac070c80 0x7f59ac073130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f59b8007fd0 tx=0x7f59b800b040 comp rx=0 tx=0).stop 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 msgr2=0x7f59c410d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c410d9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f59b4000c00 tx=0x7f59b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 shutdown_connections 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f59ac070c80 0x7f59ac073130 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c40fbcb0 0x7f59c410d9c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 --2- 172.21.15.46:0/1122259952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59c40fcf60 0x7f59c410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 >> 172.21.15.46:0/1122259952 conn(0x7f59c40f7430 msgr2=0x7f59c40f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 shutdown_connections 2024-05-09T06:30:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:30:38.459+0000 7f59c8c85700 1 -- 172.21.15.46:0/1122259952 wait complete. 2024-05-09T06:30:38.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/223: dread d0/d1b/f35 [0,4194304] 0 2024-05-09T06:30:38.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/224: creat d0/d3e/f4a x:0 0 0 2024-05-09T06:30:38.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/225: chown d0/d1b/f31 756621265 1 2024-05-09T06:30:38.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/464: dwrite db/fc [0,4194304] 0 2024-05-09T06:30:38.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/465: fdatasync db/d10/d3c/f5b 0 2024-05-09T06:30:38.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/221: write d4/fc [8627277,106668] 0 2024-05-09T06:30:38.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/226: symlink d0/d1b/d21/l4b 0 2024-05-09T06:30:38.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/222: symlink d4/d20/d24/d2a/l47 0 2024-05-09T06:30:38.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/223: getdents d4/d20/d41 0 2024-05-09T06:30:38.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/224: fdatasync d4/d5/f3a 0 2024-05-09T06:30:38.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/225: mkdir d4/d48 0 2024-05-09T06:30:38.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/205: dwrite d2/d6/f21 [0,4194304] 0 2024-05-09T06:30:38.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/206: truncate f0 1856180 0 2024-05-09T06:30:38.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/207: read - d2/dc/f41 zero size 2024-05-09T06:30:38.470 INFO:tasks.workunit.client.1.smithi106.stdout:3/971: dread d5/d1c/d24/d89/d8c/fd3 [0,4194304] 0 2024-05-09T06:30:38.470 INFO:tasks.workunit.client.1.smithi106.stdout:3/972: dread - d5/d4d/d7a/f100 zero size 2024-05-09T06:30:38.471 INFO:tasks.workunit.client.1.smithi106.stdout:3/973: chown d5/d1c/d24/d89/d8c/d109/c114 4 1 2024-05-09T06:30:38.471 INFO:tasks.workunit.client.1.smithi106.stdout:3/974: chown d5/d1c/d24/d98/dc0/l4c 64509 1 2024-05-09T06:30:38.471 INFO:tasks.workunit.client.1.smithi106.stdout:8/992: dwrite d3/d5/d13/d3a/f55 [0,4194304] 0 2024-05-09T06:30:38.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/224: dwrite d7/d10/f23 [0,4194304] 0 2024-05-09T06:30:38.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/208: truncate d2/d6/d7/ff 1590511 0 2024-05-09T06:30:38.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/209: chown d2/d6/f25 46 1 2024-05-09T06:30:38.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/210: chown d2/d6/d7/f23 30773496 1 2024-05-09T06:30:38.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/227: getdents d0/d1b 0 2024-05-09T06:30:38.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/228: write d0/f2d [580142,80654] 0 2024-05-09T06:30:38.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/229: stat d0/d1b/f35 0 2024-05-09T06:30:38.477 INFO:tasks.workunit.client.0.smithi046.stdout:9/211: dread d2/d6/d7/d1a/d27/f34 [0,4194304] 0 2024-05-09T06:30:38.480 INFO:tasks.workunit.client.0.smithi046.stdout:5/230: truncate d0/f14 2306173 0 2024-05-09T06:30:38.482 INFO:tasks.workunit.client.1.smithi106.stdout:8/993: mknod d3/d5/d35/d61/dfc/c13e 0 2024-05-09T06:30:38.482 INFO:tasks.workunit.client.1.smithi106.stdout:8/994: dread - d3/d5/d35/d61/d11c/f106 zero size 2024-05-09T06:30:38.482 INFO:tasks.workunit.client.1.smithi106.stdout:8/995: creat d3/d5/d7/d15/d47/f13f x:0 0 0 2024-05-09T06:30:38.483 INFO:tasks.workunit.client.0.smithi046.stdout:1/225: write d7/fc [2250346,117099] 0 2024-05-09T06:30:38.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/212: mkdir d2/d6/d42 0 2024-05-09T06:30:38.485 INFO:tasks.workunit.client.1.smithi106.stdout:3/975: getdents d5/d1c/d24/d98/dc0/d32 0 2024-05-09T06:30:38.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/231: symlink d0/d3e/l4c 0 2024-05-09T06:30:38.491 INFO:tasks.workunit.client.0.smithi046.stdout:9/213: write d2/f4 [5094583,64556] 0 2024-05-09T06:30:38.492 INFO:tasks.workunit.client.0.smithi046.stdout:5/232: dread d0/f2d [0,4194304] 0 2024-05-09T06:30:38.492 INFO:tasks.workunit.client.1.smithi106.stdout:8/996: creat d3/d5/d35/d73/f140 x:0 0 0 2024-05-09T06:30:38.492 INFO:tasks.workunit.client.1.smithi106.stdout:8/997: fdatasync d3/d5/d7/d15/fff 0 2024-05-09T06:30:38.493 INFO:tasks.workunit.client.0.smithi046.stdout:1/226: mkdir d7/d10/d34/d46 0 2024-05-09T06:30:38.494 INFO:tasks.workunit.client.1.smithi106.stdout:3/976: stat d5/d85/dc3/cf4 0 2024-05-09T06:30:38.494 INFO:tasks.workunit.client.1.smithi106.stdout:3/977: creat d5/d1c/d24/d5b/f139 x:0 0 0 2024-05-09T06:30:38.495 INFO:tasks.workunit.client.0.smithi046.stdout:5/233: rename d0/cf to d0/c4d 0 2024-05-09T06:30:38.495 INFO:tasks.workunit.client.0.smithi046.stdout:5/234: stat d0/d1b/d39/l48 0 2024-05-09T06:30:38.495 INFO:tasks.workunit.client.0.smithi046.stdout:5/235: read - d0/d3e/f4a zero size 2024-05-09T06:30:38.497 INFO:tasks.workunit.client.1.smithi106.stdout:8/998: creat d3/d5/d35/d61/d11c/f141 x:0 0 0 2024-05-09T06:30:38.502 INFO:tasks.workunit.client.1.smithi106.stdout:8/999: dread d3/d5/d7/d15/d3e/f56 [0,4194304] 0 2024-05-09T06:30:38.503 INFO:tasks.workunit.client.1.smithi106.stdout:3/978: creat d5/d3f/d135/f13a x:0 0 0 2024-05-09T06:30:38.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/227: dwrite d7/d10/d34/f45 [0,4194304] 0 2024-05-09T06:30:38.542 INFO:tasks.workunit.client.0.smithi046.stdout:9/214: dwrite d2/d6/d7/ff [0,4194304] 0 2024-05-09T06:30:38.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/228: creat d7/d10/f47 x:0 0 0 2024-05-09T06:30:38.542 INFO:tasks.workunit.client.0.smithi046.stdout:5/236: dwrite d0/f24 [0,4194304] 0 2024-05-09T06:30:38.543 INFO:tasks.workunit.client.1.smithi106.stdout:3/979: dwrite d5/d1c/d24/d98/faa [0,4194304] 0 2024-05-09T06:30:38.547 INFO:tasks.workunit.client.1.smithi106.stdout:3/980: symlink d5/d1c/d24/d52/dc6/l13b 0 2024-05-09T06:30:38.554 INFO:tasks.workunit.client.0.smithi046.stdout:9/215: dread d2/d6/d7/f23 [4194304,4194304] 0 2024-05-09T06:30:38.556 INFO:tasks.workunit.client.1.smithi106.stdout:3/981: rename d5/d4d/d7a/da9 to d5/d85/dc3/d65/de3/d13c 0 2024-05-09T06:30:38.556 INFO:tasks.workunit.client.1.smithi106.stdout:3/982: chown d5/d1c/d24/d98/d112/de5/d108/c103 1661967211 1 2024-05-09T06:30:38.559 INFO:tasks.workunit.client.1.smithi106.stdout:3/983: mkdir d5/d85/dc3/d13d 0 2024-05-09T06:30:38.559 INFO:tasks.workunit.client.1.smithi106.stdout:3/984: chown d5/d8f/c115 70031301 1 2024-05-09T06:30:38.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/237: dwrite d0/fa [0,4194304] 0 2024-05-09T06:30:38.566 INFO:tasks.workunit.client.0.smithi046.stdout:1/229: dwrite d7/d10/d28/d30/d3a/f3b [0,4194304] 0 2024-05-09T06:30:38.566 INFO:tasks.workunit.client.0.smithi046.stdout:9/216: dread f0 [0,4194304] 0 2024-05-09T06:30:38.568 INFO:tasks.workunit.client.0.smithi046.stdout:1/230: mkdir d7/d10/d34/d46/d48 0 2024-05-09T06:30:38.571 INFO:tasks.workunit.client.0.smithi046.stdout:1/231: rename d7/l44 to d7/d10/d34/l49 0 2024-05-09T06:30:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:38 smithi106 ceph-mon[34679]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:38 smithi106 ceph-mon[34679]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:38 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1160518157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:30:38.576 INFO:tasks.workunit.client.0.smithi046.stdout:9/217: write d2/d6/f21 [1959174,103241] 0 2024-05-09T06:30:38.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/232: symlink d7/l4a 0 2024-05-09T06:30:38.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/233: chown d7/d10/d28/d30/l32 1798080 1 2024-05-09T06:30:38.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/234: write d7/f19 [232055,100946] 0 2024-05-09T06:30:38.577 INFO:tasks.workunit.client.0.smithi046.stdout:9/218: rename d2/d26/f39 to d2/d26/f43 0 2024-05-09T06:30:38.579 INFO:tasks.workunit.client.0.smithi046.stdout:9/219: link d2/d6/d7/d1a/d27/l3a d2/d26/d2c/d3d/l44 0 2024-05-09T06:30:38.579 INFO:tasks.workunit.client.0.smithi046.stdout:9/220: fdatasync d2/d6/f22 0 2024-05-09T06:30:38.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/311: sync 2024-05-09T06:30:38.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/221: rename d2/d6/d7/f23 to d2/d6/d7/f45 0 2024-05-09T06:30:38.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/222: rmdir d2/d6/d42 0 2024-05-09T06:30:38.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/223: mknod d2/d6/d33/c46 0 2024-05-09T06:30:38.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/224: creat d2/f47 x:0 0 0 2024-05-09T06:30:38.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/225: creat d2/d6/d38/f48 x:0 0 0 2024-05-09T06:30:38.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/226: readlink d2/dc/l13 0 2024-05-09T06:30:38.595 INFO:tasks.workunit.client.1.smithi106.stdout:3/985: dwrite d5/d1c/d24/d89/fc1 [4194304,4194304] 0 2024-05-09T06:30:38.595 INFO:tasks.workunit.client.1.smithi106.stdout:3/986: readlink d5/d4d/d7a/l110 0 2024-05-09T06:30:38.596 INFO:tasks.workunit.client.1.smithi106.stdout:3/987: rename d5/d1c/d24/d89/d8e/cfc to d5/d1c/c13e 0 2024-05-09T06:30:38.596 INFO:tasks.workunit.client.1.smithi106.stdout:3/988: symlink d5/d1c/d24/d5b/db1/l13f 0 2024-05-09T06:30:38.600 INFO:tasks.workunit.client.1.smithi106.stdout:3/989: dread d5/d1c/d24/d98/d112/de5/d108/fe1 [0,4194304] 0 2024-05-09T06:30:38.608 INFO:tasks.workunit.client.0.smithi046.stdout:7/312: dwrite d3/d7/d28/d29/d3b/f49 [4194304,4194304] 0 2024-05-09T06:30:38.608 INFO:tasks.workunit.client.0.smithi046.stdout:5/238: dwrite d0/f14 [0,4194304] 0 2024-05-09T06:30:38.608 INFO:tasks.workunit.client.0.smithi046.stdout:1/235: dwrite d7/f42 [0,4194304] 0 2024-05-09T06:30:38.612 INFO:tasks.workunit.client.0.smithi046.stdout:5/239: rename d0/d1b/d21/l33 to d0/d1b/d39/l4e 0 2024-05-09T06:30:38.614 INFO:tasks.workunit.client.1.smithi106.stdout:3/990: read d5/d1c/f2b [1488587,1589] 0 2024-05-09T06:30:38.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/236: mknod d7/c4b 0 2024-05-09T06:30:38.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/237: creat d7/d10/f4c x:0 0 0 2024-05-09T06:30:38.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/238: fsync d7/f42 0 2024-05-09T06:30:38.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/239: write d7/d10/f2b [740297,82042] 0 2024-05-09T06:30:38.617 INFO:tasks.workunit.client.1.smithi106.stdout:3/991: mknod d5/d1c/d24/d98/dc0/d32/c140 0 2024-05-09T06:30:38.617 INFO:tasks.workunit.client.1.smithi106.stdout:3/992: creat d5/d1c/d24/d5b/db1/f141 x:0 0 0 2024-05-09T06:30:38.622 INFO:tasks.workunit.client.1.smithi106.stdout:3/993: rename d5/l18 to d5/d1c/d24/d52/dc6/l142 0 2024-05-09T06:30:38.623 INFO:tasks.workunit.client.1.smithi106.stdout:3/994: getdents d5/d85/dc3/d65/de3/d13c 0 2024-05-09T06:30:38.624 INFO:tasks.workunit.client.0.smithi046.stdout:9/227: rmdir d2/d6/d38 39 2024-05-09T06:30:38.624 INFO:tasks.workunit.client.0.smithi046.stdout:9/228: chown d2/d26/d2c/d3d/l44 7 1 2024-05-09T06:30:38.625 INFO:tasks.workunit.client.1.smithi106.stdout:3/995: dread d5/d1c/d24/d89/d8c/fd3 [0,4194304] 0 2024-05-09T06:30:38.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/313: dwrite d3/d7/d28/d29/d3b/f4a [0,4194304] 0 2024-05-09T06:30:38.625 INFO:tasks.workunit.client.0.smithi046.stdout:9/229: symlink d2/d6/d7/d1a/d27/d2a/l49 0 2024-05-09T06:30:38.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/240: dread d7/d10/d34/f45 [0,4194304] 0 2024-05-09T06:30:38.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/241: read - d7/d10/f27 zero size 2024-05-09T06:30:38.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/242: chown d7/d10/l16 209268 1 2024-05-09T06:30:38.629 INFO:tasks.workunit.client.1.smithi106.stdout:3/996: getdents d5/d85 0 2024-05-09T06:30:38.631 INFO:tasks.workunit.client.1.smithi106.stdout:3/997: mkdir d5/d3f/d135/d143 0 2024-05-09T06:30:38.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/230: unlink d2/d6/d7/d1a/d27/d2a/l49 0 2024-05-09T06:30:38.634 INFO:tasks.workunit.client.0.smithi046.stdout:5/240: dwrite d0/f1a [0,4194304] 0 2024-05-09T06:30:38.634 INFO:tasks.workunit.client.0.smithi046.stdout:5/241: read - d0/d3e/f3f zero size 2024-05-09T06:30:38.635 INFO:tasks.workunit.client.0.smithi046.stdout:1/243: rename d7/c15 to d7/d10/d28/c4d 0 2024-05-09T06:30:38.635 INFO:tasks.workunit.client.0.smithi046.stdout:1/244: dread - d7/d10/d34/f35 zero size 2024-05-09T06:30:38.635 INFO:tasks.workunit.client.0.smithi046.stdout:1/245: truncate d7/d10/f27 51165 0 2024-05-09T06:30:38.635 INFO:tasks.workunit.client.0.smithi046.stdout:1/246: chown d7/d10/d28/d30/d3a/c43 12492470 1 2024-05-09T06:30:38.636 INFO:tasks.workunit.client.0.smithi046.stdout:7/314: truncate d3/d7/d28/d29/f3c 613464 0 2024-05-09T06:30:38.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/242: rename d0/d1b/d39/l4e to d0/d1b/d21/l4f 0 2024-05-09T06:30:38.646 INFO:tasks.workunit.client.0.smithi046.stdout:1/247: symlink d7/d10/d34/d46/l4e 0 2024-05-09T06:30:38.646 INFO:tasks.workunit.client.0.smithi046.stdout:7/315: getdents d3/d3d 0 2024-05-09T06:30:38.648 INFO:tasks.workunit.client.1.smithi106.stdout:3/998: dwrite d5/d1c/f2b [0,4194304] 0 2024-05-09T06:30:38.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/316: symlink d3/d7/d28/d29/d35/l6c 0 2024-05-09T06:30:38.650 INFO:tasks.workunit.client.0.smithi046.stdout:5/243: dread d0/f1 [0,4194304] 0 2024-05-09T06:30:38.650 INFO:tasks.workunit.client.0.smithi046.stdout:9/231: dwrite d2/d6/f22 [0,4194304] 0 2024-05-09T06:30:38.650 INFO:tasks.workunit.client.0.smithi046.stdout:9/232: stat d2/d6/l9 0 2024-05-09T06:30:38.650 INFO:tasks.workunit.client.0.smithi046.stdout:9/233: chown d2/d26/d2c/d3d 411221425 1 2024-05-09T06:30:38.650 INFO:tasks.workunit.client.0.smithi046.stdout:9/234: stat d2/d6/d7/d1a/d27/d2a/c3c 0 2024-05-09T06:30:38.651 INFO:tasks.workunit.client.1.smithi106.stdout:3/999: link d5/d1c/d24/d5b/da4/ff3 d5/d1c/d24/d89/d8c/d109/f144 0 2024-05-09T06:30:38.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/317: rename d3/d7/d28/d29/d35/f55 to d3/d7/d28/d29/d35/f6d 0 2024-05-09T06:30:38.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/318: chown d3/d3d 29 1 2024-05-09T06:30:38.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/319: getdents d3/d3d/d5b 0 2024-05-09T06:30:38.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/320: dread - d3/d7/dd/f59 zero size 2024-05-09T06:30:38.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/321: chown d3/d7/d28/d29 906 1 2024-05-09T06:30:38.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/322: creat d3/d7/d28/d29/d3b/f6e x:0 0 0 2024-05-09T06:30:38.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/244: truncate d0/d1b/d21/f38 941686 0 2024-05-09T06:30:38.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/245: readlink d0/d1b/d39/l48 0 2024-05-09T06:30:38.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/246: stat d0/d1b/l22 0 2024-05-09T06:30:38.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/247: fsync d0/d1b/d39/f3a 0 2024-05-09T06:30:38.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/248: truncate d0/d1b/d21/f44 469491 0 2024-05-09T06:30:38.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/249: write d0/d1b/d21/f42 [150128,120806] 0 2024-05-09T06:30:38.658 INFO:tasks.workunit.client.1.smithi106.stderr:+ rm -rf -- ./tmp.gU2TWJPUCA 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/280: sync 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:0/367: sync 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:3/226: sync 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:4/324: sync 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:6/466: sync 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/281: fdatasync da/de/f4d 0 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:4/325: truncate f4 627324 0 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/282: stat f7 0 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:0/368: write d11/d18/d27/d28/d2d/f4a [92838,28392] 0 2024-05-09T06:30:38.659 INFO:tasks.workunit.client.0.smithi046.stdout:8/301: sync 2024-05-09T06:30:38.660 INFO:tasks.workunit.client.0.smithi046.stdout:6/467: mkdir db/d10/d3f/d4f/d8a/d9e 0 2024-05-09T06:30:38.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/250: dread d0/f1 [0,4194304] 0 2024-05-09T06:30:38.662 INFO:tasks.workunit.client.0.smithi046.stdout:4/326: rename d7/df/f29 to d7/df/d10/d2f/f6d 0 2024-05-09T06:30:38.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/369: dread f9 [4194304,4194304] 0 2024-05-09T06:30:38.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/370: chown d11/f35 3016 1 2024-05-09T06:30:38.668 INFO:tasks.workunit.client.0.smithi046.stdout:8/302: mknod d1/d7/c52 0 2024-05-09T06:30:38.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/468: dread db/fc [0,4194304] 0 2024-05-09T06:30:38.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/469: dread db/d10/d3c/f6d [0,4194304] 0 2024-05-09T06:30:38.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/227: write d4/d5/f9 [128492,38558] 0 2024-05-09T06:30:38.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/327: rename d7/df/d3a/f4a to d7/df/d53/f6e 0 2024-05-09T06:30:38.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/328: creat d7/df/d53/f6f x:0 0 0 2024-05-09T06:30:38.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/235: dwrite f0 [0,4194304] 0 2024-05-09T06:30:38.676 INFO:tasks.workunit.client.0.smithi046.stdout:2/283: getdents da/de/d11/d3d 0 2024-05-09T06:30:38.676 INFO:tasks.workunit.client.0.smithi046.stdout:2/284: dread - da/de/d14/d1f/d20/d4e/f4f zero size 2024-05-09T06:30:38.676 INFO:tasks.workunit.client.0.smithi046.stdout:2/285: truncate da/de/d14/d1f/f25 923620 0 2024-05-09T06:30:38.679 INFO:tasks.workunit.client.0.smithi046.stdout:3/228: mkdir d4/d48/d49 0 2024-05-09T06:30:38.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/329: dread d7/f15 [0,4194304] 0 2024-05-09T06:30:38.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/330: fdatasync d7/f9 0 2024-05-09T06:30:38.681 INFO:tasks.workunit.client.0.smithi046.stdout:8/303: rename d1/db/cc to d1/d7/d12/d45/c53 0 2024-05-09T06:30:38.681 INFO:tasks.workunit.client.0.smithi046.stdout:8/304: truncate d1/db/dd/f4a 133020 0 2024-05-09T06:30:38.681 INFO:tasks.workunit.client.0.smithi046.stdout:3/229: dread d4/d20/f36 [0,4194304] 0 2024-05-09T06:30:38.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/286: dread da/dc/f27 [0,4194304] 0 2024-05-09T06:30:38.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/236: dread d2/d6/d7/f12 [0,4194304] 0 2024-05-09T06:30:38.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/237: read - d2/d6/d38/f48 zero size 2024-05-09T06:30:38.689 INFO:tasks.workunit.client.0.smithi046.stdout:6/470: rename db/d10/d3f/d44/f7f to db/d10/d3f/d4f/d8a/f9f 0 2024-05-09T06:30:38.691 INFO:tasks.workunit.client.0.smithi046.stdout:9/238: truncate d2/d6/f21 607061 0 2024-05-09T06:30:38.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/239: dread - d2/f47 zero size 2024-05-09T06:30:38.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/240: chown d2/d26/d2c/d3d 2 1 2024-05-09T06:30:38.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/251: dwrite d0/f2d [0,4194304] 0 2024-05-09T06:30:38.692 INFO:tasks.workunit.client.0.smithi046.stdout:0/371: dwrite d11/d18/d27/d28/f31 [4194304,4194304] 0 2024-05-09T06:30:38.693 INFO:tasks.workunit.client.0.smithi046.stdout:6/471: unlink db/d10/l2e 0 2024-05-09T06:30:38.693 INFO:tasks.workunit.client.0.smithi046.stdout:6/472: chown db/c2d 690 1 2024-05-09T06:30:38.693 INFO:tasks.workunit.client.0.smithi046.stdout:6/473: fsync db/d10/d3f/d44/d5e/f84 0 2024-05-09T06:30:38.698 INFO:tasks.workunit.client.0.smithi046.stdout:8/305: write d1/d7/f31 [2339349,65722] 0 2024-05-09T06:30:38.702 INFO:tasks.workunit.client.0.smithi046.stdout:0/372: getdents d11/d18/d1c 0 2024-05-09T06:30:38.702 INFO:tasks.workunit.client.0.smithi046.stdout:0/373: creat d11/d18/d1c/d53/f7d x:0 0 0 2024-05-09T06:30:38.703 INFO:tasks.workunit.client.0.smithi046.stdout:2/287: dwrite f1 [0,4194304] 0 2024-05-09T06:30:38.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/252: dread d0/d1b/f30 [0,4194304] 0 2024-05-09T06:30:38.709 INFO:tasks.workunit.client.0.smithi046.stdout:9/241: dwrite d2/f4 [8388608,4194304] 0 2024-05-09T06:30:38.729 INFO:tasks.workunit.client.0.smithi046.stdout:8/306: creat d1/d7/d12/d1d/d30/d38/f54 x:0 0 0 2024-05-09T06:30:38.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/374: mknod d11/d18/d27/d28/c7e 0 2024-05-09T06:30:38.737 INFO:tasks.workunit.client.0.smithi046.stdout:2/288: rename da/de/f4d to da/dc/f5b 0 2024-05-09T06:30:38.737 INFO:tasks.workunit.client.0.smithi046.stdout:2/289: readlink da/dc/l29 0 2024-05-09T06:30:38.740 INFO:tasks.workunit.client.0.smithi046.stdout:5/253: mkdir d0/d3e/d50 0 2024-05-09T06:30:38.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/474: rmdir db/d10/d3f/d44/d5e 39 2024-05-09T06:30:38.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/242: creat d2/d6/d7/d1e/f4a x:0 0 0 2024-05-09T06:30:38.743 INFO:tasks.workunit.client.0.smithi046.stdout:8/307: truncate d1/db/dd/f13 6170865 0 2024-05-09T06:30:38.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/290: mkdir da/de/d14/d1f/d20/d5c 0 2024-05-09T06:30:38.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/254: link d0/d1b/c2b d0/d3e/d50/c51 0 2024-05-09T06:30:38.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/255: readlink d0/d3e/l4c 0 2024-05-09T06:30:38.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/308: rename d1/d7/d12/c39 to d1/db/dd/c55 0 2024-05-09T06:30:38.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/309: fdatasync d1/db/dd/f1a 0 2024-05-09T06:30:38.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/310: fsync d1/d7/d2c/f15 0 2024-05-09T06:30:38.751 INFO:tasks.workunit.client.0.smithi046.stdout:8/311: write d1/d7/d2c/f4d [866696,127773] 0 2024-05-09T06:30:38.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/291: mknod da/de/d11/d3d/c5d 0 2024-05-09T06:30:38.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/292: fdatasync da/de/d11/d3d/f47 0 2024-05-09T06:30:38.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/243: write d2/d6/d7/d1a/f2e [3190673,1912] 0 2024-05-09T06:30:38.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/244: readlink d2/d6/d38/l3f 0 2024-05-09T06:30:38.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/293: read da/de/d1c/f3e [54520,120923] 0 2024-05-09T06:30:38.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/294: chown da/de/d11/d3a 105788188 1 2024-05-09T06:30:38.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/375: dwrite d11/d18/d27/d28/f50 [0,4194304] 0 2024-05-09T06:30:38.757 INFO:tasks.workunit.client.0.smithi046.stdout:6/475: rmdir db/d10 39 2024-05-09T06:30:38.757 INFO:tasks.workunit.client.0.smithi046.stdout:6/476: write db/d10/d30/d53/f8c [67472,31692] 0 2024-05-09T06:30:38.759 INFO:tasks.workunit.client.0.smithi046.stdout:8/312: rename d1/d7/d12/d1d/d30/f4e to d1/db/f56 0 2024-05-09T06:30:38.765 INFO:tasks.workunit.client.0.smithi046.stdout:2/295: mkdir da/d2d/d43/d5e 0 2024-05-09T06:30:38.769 INFO:tasks.workunit.client.0.smithi046.stdout:5/256: dwrite d0/d3e/f3f [0,4194304] 0 2024-05-09T06:30:38.769 INFO:tasks.workunit.client.0.smithi046.stdout:5/257: truncate d0/d1b/d39/f3a 568758 0 2024-05-09T06:30:38.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/477: unlink db/d10/l82 0 2024-05-09T06:30:38.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/313: creat d1/d7/d12/f57 x:0 0 0 2024-05-09T06:30:38.776 INFO:tasks.workunit.client.0.smithi046.stdout:0/376: dwrite d11/d18/d27/d28/d6b/f77 [0,4194304] 0 2024-05-09T06:30:38.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/314: write d1/d7/f31 [3790423,78021] 0 2024-05-09T06:30:38.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/315: write d1/d7/d12/d1d/d30/d38/f46 [125274,32022] 0 2024-05-09T06:30:38.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/316: truncate d1/db/dd/d14/f50 1475995 0 2024-05-09T06:30:38.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/317: readlink d1/l6 0 2024-05-09T06:30:38.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/245: getdents d2 0 2024-05-09T06:30:38.780 INFO:tasks.workunit.client.0.smithi046.stdout:2/296: link da/de/d14/f1b da/de/d11/d3d/f5f 0 2024-05-09T06:30:38.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/258: dwrite d0/d1b/d21/f44 [0,4194304] 0 2024-05-09T06:30:38.785 INFO:tasks.workunit.client.0.smithi046.stdout:6/478: rmdir db/d10/d19/d66 39 2024-05-09T06:30:38.791 INFO:tasks.workunit.client.0.smithi046.stdout:0/377: mknod d11/c7f 0 2024-05-09T06:30:38.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/318: truncate d1/d7/f37 1277166 0 2024-05-09T06:30:38.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/319: chown d1/ca 804334 1 2024-05-09T06:30:38.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/320: fdatasync d1/d7/d12/d45/f4c 0 2024-05-09T06:30:38.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/246: mknod d2/d6/d33/c4b 0 2024-05-09T06:30:38.800 INFO:tasks.workunit.client.0.smithi046.stdout:2/297: rename da/db/f2e to da/de/f60 0 2024-05-09T06:30:38.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/259: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:38.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/260: stat d0/d1b/f30 0 2024-05-09T06:30:38.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/261: creat d0/d3e/f52 x:0 0 0 2024-05-09T06:30:38.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/262: chown d0/d1b/d39/f3a 2824 1 2024-05-09T06:30:38.804 INFO:tasks.workunit.client.0.smithi046.stdout:5/263: write d0/d1b/d21/f38 [267292,26881] 0 2024-05-09T06:30:38.804 INFO:tasks.workunit.client.0.smithi046.stdout:5/264: truncate d0/d1b/d21/f38 1313366 0 2024-05-09T06:30:38.806 INFO:tasks.workunit.client.0.smithi046.stdout:6/479: creat db/d10/fa0 x:0 0 0 2024-05-09T06:30:38.809 INFO:tasks.workunit.client.0.smithi046.stdout:0/378: creat d11/d18/d27/d28/d36/d5a/f80 x:0 0 0 2024-05-09T06:30:38.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/247: truncate d2/d6/f25 692772 0 2024-05-09T06:30:38.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/248: dread - d2/f47 zero size 2024-05-09T06:30:38.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/298: creat da/de/d14/d1f/d20/d5c/f61 x:0 0 0 2024-05-09T06:30:38.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/299: write da/de/f60 [8933554,128763] 0 2024-05-09T06:30:38.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/300: write da/de/f46 [423528,96943] 0 2024-05-09T06:30:38.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/249: dwrite d2/d6/d38/f48 [0,4194304] 0 2024-05-09T06:30:38.830 INFO:tasks.workunit.client.0.smithi046.stdout:5/265: truncate d0/f14 3140282 0 2024-05-09T06:30:38.832 INFO:tasks.workunit.client.0.smithi046.stdout:6/480: getdents db/d10/d3f/d44/d5e 0 2024-05-09T06:30:38.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/301: mkdir da/de/d14/d1f/d3b/d62 0 2024-05-09T06:30:38.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/302: chown da/de/d11/l4b 114675237 1 2024-05-09T06:30:38.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/250: symlink d2/dc/l4c 0 2024-05-09T06:30:38.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/266: mkdir d0/d3e/d53 0 2024-05-09T06:30:38.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/481: mknod db/d10/d30/d53/ca1 0 2024-05-09T06:30:38.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/482: chown db/d10/d3f/d4f/d89/l95 417 1 2024-05-09T06:30:38.851 INFO:tasks.workunit.client.0.smithi046.stdout:5/267: dread d0/fd [0,4194304] 0 2024-05-09T06:30:38.853 INFO:tasks.workunit.client.0.smithi046.stdout:5/268: rename d0/c4d to d0/c54 0 2024-05-09T06:30:38.859 INFO:tasks.workunit.client.0.smithi046.stdout:2/303: dwrite da/de/f10 [0,4194304] 0 2024-05-09T06:30:38.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/251: dwrite d2/d6/f22 [0,4194304] 0 2024-05-09T06:30:38.860 INFO:tasks.workunit.client.0.smithi046.stdout:9/252: readlink d2/dc/l19 0 2024-05-09T06:30:38.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/304: dread da/de/d14/d1f/d20/f59 [0,4194304] 0 2024-05-09T06:30:38.871 INFO:tasks.workunit.client.0.smithi046.stdout:2/305: unlink da/d2d/d43/l51 0 2024-05-09T06:30:38.871 INFO:tasks.workunit.client.0.smithi046.stdout:2/306: write da/de/d1c/f55 [1166552,119831] 0 2024-05-09T06:30:38.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/307: write da/de/d14/d1f/d20/d4e/f4f [694044,109325] 0 2024-05-09T06:30:38.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/269: dwrite d0/d1b/f35 [0,4194304] 0 2024-05-09T06:30:38.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/270: fsync d0/fa 0 2024-05-09T06:30:38.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/308: rmdir da/de/d14 39 2024-05-09T06:30:38.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/309: chown da/d2d/d43 150 1 2024-05-09T06:30:38.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/271: creat d0/d1b/d21/f55 x:0 0 0 2024-05-09T06:30:38.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/272: dread - d0/d1b/d39/f47 zero size 2024-05-09T06:30:38.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/273: rename d0/d1b/c1d to d0/d1b/d21/c56 0 2024-05-09T06:30:38.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/274: rename d0/d1b/d21/l4b to d0/d1b/d21/l57 0 2024-05-09T06:30:38.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/275: mkdir d0/d58 0 2024-05-09T06:30:38.896 INFO:tasks.workunit.client.0.smithi046.stdout:2/310: dwrite da/dc/f13 [4194304,4194304] 0 2024-05-09T06:30:38.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/311: link da/dc/c53 da/dc/c63 0 2024-05-09T06:30:38.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/312: fdatasync da/de/d14/d1f/f41 0 2024-05-09T06:30:38.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/313: creat da/de/d11/d3a/f64 x:0 0 0 2024-05-09T06:30:38.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/314: read - da/de/d14/d1f/d20/f5a zero size 2024-05-09T06:30:38.899 INFO:tasks.workunit.client.0.smithi046.stdout:2/315: mkdir da/de/d54/d65 0 2024-05-09T06:30:38.900 INFO:tasks.workunit.client.0.smithi046.stdout:5/276: dread d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:38.901 INFO:tasks.workunit.client.0.smithi046.stdout:2/316: rename da/dc/c63 to da/dc/c66 0 2024-05-09T06:30:38.905 INFO:tasks.workunit.client.0.smithi046.stdout:5/277: creat d0/d3e/d53/f59 x:0 0 0 2024-05-09T06:30:38.912 INFO:tasks.workunit.client.0.smithi046.stdout:2/317: creat da/de/d54/f67 x:0 0 0 2024-05-09T06:30:38.912 INFO:tasks.workunit.client.0.smithi046.stdout:2/318: creat da/d2d/d43/f68 x:0 0 0 2024-05-09T06:30:38.912 INFO:tasks.workunit.client.0.smithi046.stdout:2/319: creat da/de/d11/f69 x:0 0 0 2024-05-09T06:30:38.912 INFO:tasks.workunit.client.0.smithi046.stdout:2/320: fsync da/de/f10 0 2024-05-09T06:30:38.913 INFO:tasks.workunit.client.0.smithi046.stdout:5/278: dread d0/f1a [0,4194304] 0 2024-05-09T06:30:38.913 INFO:tasks.workunit.client.0.smithi046.stdout:5/279: creat d0/d3e/d53/f5a x:0 0 0 2024-05-09T06:30:38.913 INFO:tasks.workunit.client.0.smithi046.stdout:2/321: creat da/de/d1c/f6a x:0 0 0 2024-05-09T06:30:38.920 INFO:tasks.workunit.client.0.smithi046.stdout:5/280: write d0/f24 [1652855,24413] 0 2024-05-09T06:30:38.921 INFO:tasks.workunit.client.0.smithi046.stdout:5/281: rename d0/d1b/f40 to d0/f5b 0 2024-05-09T06:30:38.923 INFO:tasks.workunit.client.0.smithi046.stdout:5/282: creat d0/d1b/d39/f5c x:0 0 0 2024-05-09T06:30:38.923 INFO:tasks.workunit.client.0.smithi046.stdout:5/283: creat d0/d1b/d21/f5d x:0 0 0 2024-05-09T06:30:38.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/322: dwrite da/db/f4c [4194304,4194304] 0 2024-05-09T06:30:38.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/323: chown da/de/d1c/f6a 3857 1 2024-05-09T06:30:38.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/324: fsync da/de/d14/d1f/d20/d5c/f61 0 2024-05-09T06:30:38.926 INFO:tasks.workunit.client.0.smithi046.stdout:2/325: write da/de/d1c/f55 [1074940,96219] 0 2024-05-09T06:30:38.926 INFO:tasks.workunit.client.0.smithi046.stdout:5/284: symlink d0/l5e 0 2024-05-09T06:30:38.926 INFO:tasks.workunit.client.0.smithi046.stdout:5/285: chown d0/l3b 3345436 1 2024-05-09T06:30:38.938 INFO:tasks.workunit.client.0.smithi046.stdout:2/326: dread da/f45 [0,4194304] 0 2024-05-09T06:30:38.938 INFO:tasks.workunit.client.0.smithi046.stdout:2/327: write da/de/d14/d1f/f25 [1845848,87264] 0 2024-05-09T06:30:38.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/328: rmdir da/d2d/d43/d5e 0 2024-05-09T06:30:38.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/329: truncate da/de/d11/d3a/f50 553996 0 2024-05-09T06:30:38.942 INFO:tasks.workunit.client.0.smithi046.stdout:2/330: symlink da/l6b 0 2024-05-09T06:30:38.942 INFO:tasks.workunit.client.0.smithi046.stdout:2/331: dread - da/de/d54/f67 zero size 2024-05-09T06:30:38.943 INFO:tasks.workunit.client.0.smithi046.stdout:2/332: write da/de/d14/d1f/d20/f3c [893129,124253] 0 2024-05-09T06:30:38.945 INFO:tasks.workunit.client.0.smithi046.stdout:2/333: mkdir da/de/d54/d65/d6c 0 2024-05-09T06:30:38.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/334: getdents da/de/d14/d1f/d3b 0 2024-05-09T06:30:38.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/335: mkdir da/de/d14/d1f/d3b/d62/d6d 0 2024-05-09T06:30:38.950 INFO:tasks.workunit.client.0.smithi046.stdout:5/286: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:38.953 INFO:tasks.workunit.client.0.smithi046.stdout:5/287: mknod d0/d58/c5f 0 2024-05-09T06:30:38.953 INFO:tasks.workunit.client.0.smithi046.stdout:5/288: creat d0/d1b/d39/f60 x:0 0 0 2024-05-09T06:30:38.953 INFO:tasks.workunit.client.0.smithi046.stdout:5/289: truncate d0/d1b/f3d 1049705 0 2024-05-09T06:30:38.975 INFO:tasks.workunit.client.0.smithi046.stdout:2/336: dwrite da/de/d11/d3a/f50 [0,4194304] 0 2024-05-09T06:30:38.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/290: dwrite d0/d1b/d39/f60 [0,4194304] 0 2024-05-09T06:30:38.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/291: chown d0/le 44100000 1 2024-05-09T06:30:38.980 INFO:tasks.workunit.client.0.smithi046.stdout:2/337: link da/dc/l34 da/de/d54/d65/d6c/l6e 0 2024-05-09T06:30:38.989 INFO:tasks.workunit.client.0.smithi046.stdout:2/338: creat da/db/f6f x:0 0 0 2024-05-09T06:30:38.990 INFO:tasks.workunit.client.0.smithi046.stdout:5/292: dwrite d0/d1b/f37 [0,4194304] 0 2024-05-09T06:30:38.994 INFO:tasks.workunit.client.0.smithi046.stdout:2/339: dread da/de/d14/d1f/d20/f59 [0,4194304] 0 2024-05-09T06:30:38.995 INFO:tasks.workunit.client.0.smithi046.stdout:2/340: chown da/de/d11/d3d/c5d 6560 1 2024-05-09T06:30:39.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/293: dwrite d0/d1b/d21/f5d [0,4194304] 0 2024-05-09T06:30:39.015 INFO:tasks.workunit.client.0.smithi046.stdout:2/341: dwrite da/de/d1c/f55 [0,4194304] 0 2024-05-09T06:30:39.015 INFO:tasks.workunit.client.0.smithi046.stdout:2/342: dread - da/de/d54/f67 zero size 2024-05-09T06:30:39.017 INFO:tasks.workunit.client.0.smithi046.stdout:2/343: mkdir da/de/d54/d65/d70 0 2024-05-09T06:30:39.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/344: fsync da/de/d14/d1f/f41 0 2024-05-09T06:30:39.021 INFO:tasks.workunit.client.0.smithi046.stdout:5/294: dread d0/f2d [0,4194304] 0 2024-05-09T06:30:39.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/345: link da/de/d54/d65/d6c/l6e da/de/d14/d1f/d3b/l71 0 2024-05-09T06:30:39.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/346: fsync da/db/f15 0 2024-05-09T06:30:39.024 INFO:tasks.workunit.client.0.smithi046.stdout:5/295: symlink d0/d1b/l61 0 2024-05-09T06:30:39.046 INFO:tasks.workunit.client.0.smithi046.stdout:5/296: dwrite d0/d1b/f20 [0,4194304] 0 2024-05-09T06:30:39.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/297: mknod d0/d1b/c62 0 2024-05-09T06:30:39.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/298: chown d0/c32 20536 1 2024-05-09T06:30:39.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/299: write d0/d3e/d53/f59 [176042,19198] 0 2024-05-09T06:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:1/248: sync 2024-05-09T06:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:1/249: creat d7/d10/d28/f4f x:0 0 0 2024-05-09T06:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:1/250: fsync d7/f19 0 2024-05-09T06:30:39.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/251: unlink d7/d10/c26 0 2024-05-09T06:30:39.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/252: creat d7/d10/d28/f50 x:0 0 0 2024-05-09T06:30:39.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/253: rename d7/d10/f11 to d7/d10/d34/f51 0 2024-05-09T06:30:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/254: rmdir d7/d10/d28/d30 39 2024-05-09T06:30:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/255: creat d7/d10/d34/f52 x:0 0 0 2024-05-09T06:30:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/256: chown d7/d10/f12 496063263 1 2024-05-09T06:30:39.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/257: mkdir d7/d10/d34/d46/d48/d53 0 2024-05-09T06:30:39.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/258: creat d7/d10/f54 x:0 0 0 2024-05-09T06:30:39.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/259: dread - d7/d10/d28/f4f zero size 2024-05-09T06:30:39.180 INFO:tasks.workunit.client.0.smithi046.stdout:1/260: dread d7/f18 [0,4194304] 0 2024-05-09T06:30:39.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/261: mkdir d7/d10/d28/d55 0 2024-05-09T06:30:39.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/262: truncate d7/f19 1766392 0 2024-05-09T06:30:39.331 INFO:tasks.workunit.client.0.smithi046.stdout:7/323: sync 2024-05-09T06:30:39.333 INFO:tasks.workunit.client.0.smithi046.stdout:7/324: mkdir d3/d6f 0 2024-05-09T06:30:39.333 INFO:tasks.workunit.client.0.smithi046.stdout:7/325: write d3/d7/d28/d29/d3b/f3f [1023603,102109] 0 2024-05-09T06:30:39.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:39 smithi046 ceph-mon[26924]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 196 MiB/s rd, 254 MiB/s wr, 344 op/s 2024-05-09T06:30:39.336 INFO:tasks.workunit.client.0.smithi046.stdout:7/326: rmdir d3/d7/dd 39 2024-05-09T06:30:39.337 INFO:tasks.workunit.client.0.smithi046.stdout:7/327: fsync d3/d7/d28/f24 0 2024-05-09T06:30:39.340 INFO:tasks.workunit.client.0.smithi046.stdout:7/328: rename d3/d7/d28/d29/d3b/f49 to d3/d7/d28/d29/d3b/f70 0 2024-05-09T06:30:39.340 INFO:tasks.workunit.client.0.smithi046.stdout:7/329: read - d3/d3d/f41 zero size 2024-05-09T06:30:39.340 INFO:tasks.workunit.client.0.smithi046.stdout:7/330: dread d3/d7/d28/d29/d35/f6d [0,4194304] 0 2024-05-09T06:30:39.352 INFO:tasks.workunit.client.0.smithi046.stdout:7/331: dwrite d3/d7/d28/d29/d35/f6d [0,4194304] 0 2024-05-09T06:30:39.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/332: chown d3/d7/dd/d3e 3984 1 2024-05-09T06:30:39.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/333: write d3/d7/dd/f44 [2292184,106555] 0 2024-05-09T06:30:39.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/334: fsync d3/f4 0 2024-05-09T06:30:39.361 INFO:tasks.workunit.client.0.smithi046.stdout:7/335: symlink d3/d7/d28/d29/d35/l71 0 2024-05-09T06:30:39.361 INFO:tasks.workunit.client.0.smithi046.stdout:7/336: write d3/d7/d28/d29/d35/f62 [583784,16777] 0 2024-05-09T06:30:39.361 INFO:tasks.workunit.client.0.smithi046.stdout:7/337: chown d3/d7/fa 520123 1 2024-05-09T06:30:39.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/338: readlink d3/d7/d28/d29/d35/l38 0 2024-05-09T06:30:39.363 INFO:tasks.workunit.client.0.smithi046.stdout:7/339: fsync d3/f1b 0 2024-05-09T06:30:39.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/331: sync 2024-05-09T06:30:39.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/332: stat d7/df/d10/c5d 0 2024-05-09T06:30:39.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/333: creat d7/df/d3a/d25/f70 x:0 0 0 2024-05-09T06:30:39.445 INFO:tasks.workunit.client.0.smithi046.stdout:4/334: rmdir d7 39 2024-05-09T06:30:39.450 INFO:tasks.workunit.client.0.smithi046.stdout:4/335: rename d7/f4b to d7/f71 0 2024-05-09T06:30:39.455 INFO:tasks.workunit.client.0.smithi046.stdout:4/336: dread d7/fa [0,4194304] 0 2024-05-09T06:30:39.471 INFO:tasks.workunit.client.0.smithi046.stdout:4/337: dwrite d7/df/d10/d2f/f6d [0,4194304] 0 2024-05-09T06:30:39.471 INFO:tasks.workunit.client.0.smithi046.stdout:4/338: write d7/df/d3a/d25/f54 [668929,2030] 0 2024-05-09T06:30:39.472 INFO:tasks.workunit.client.0.smithi046.stdout:4/339: rename f5 to d7/f72 0 2024-05-09T06:30:39.472 INFO:tasks.workunit.client.0.smithi046.stdout:4/340: chown d7/df/d10/d2f/c48 4930 1 2024-05-09T06:30:39.473 INFO:tasks.workunit.client.0.smithi046.stdout:4/341: stat d7/df/d3a/d45 0 2024-05-09T06:30:39.473 INFO:tasks.workunit.client.0.smithi046.stdout:4/342: creat d7/df/d10/f73 x:0 0 0 2024-05-09T06:30:39.474 INFO:tasks.workunit.client.0.smithi046.stdout:4/343: readlink d7/df/d3a/l64 0 2024-05-09T06:30:39.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/344: mknod d7/df/c74 0 2024-05-09T06:30:39.477 INFO:tasks.workunit.client.0.smithi046.stdout:4/345: symlink d7/df/d3a/l75 0 2024-05-09T06:30:39.477 INFO:tasks.workunit.client.0.smithi046.stdout:4/346: fdatasync d7/df/d3a/d25/f4e 0 2024-05-09T06:30:39.477 INFO:tasks.workunit.client.0.smithi046.stdout:4/347: chown d7/df/d10/d2f/f6d 90 1 2024-05-09T06:30:39.497 INFO:tasks.workunit.client.0.smithi046.stdout:4/348: dwrite d7/df/d3a/f2c [0,4194304] 0 2024-05-09T06:30:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:39 smithi106 ceph-mon[34679]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 196 MiB/s rd, 254 MiB/s wr, 344 op/s 2024-05-09T06:30:39.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/230: sync 2024-05-09T06:30:39.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/349: sync 2024-05-09T06:30:39.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/379: sync 2024-05-09T06:30:39.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/321: sync 2024-05-09T06:30:39.733 INFO:tasks.workunit.client.0.smithi046.stdout:9/253: sync 2024-05-09T06:30:39.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/300: sync 2024-05-09T06:30:39.733 INFO:tasks.workunit.client.0.smithi046.stdout:6/483: sync 2024-05-09T06:30:39.733 INFO:tasks.workunit.client.0.smithi046.stdout:7/340: sync 2024-05-09T06:30:39.734 INFO:tasks.workunit.client.0.smithi046.stdout:2/347: sync 2024-05-09T06:30:39.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/263: sync 2024-05-09T06:30:39.734 INFO:tasks.workunit.client.0.smithi046.stdout:7/341: write d3/d7/d28/d29/d35/f48 [251431,120376] 0 2024-05-09T06:30:39.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/264: read d7/d10/f2b [266003,107507] 0 2024-05-09T06:30:39.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/265: chown d7/f18 1470 1 2024-05-09T06:30:39.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/266: truncate d7/d10/f47 691873 0 2024-05-09T06:30:39.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/267: truncate d7/d10/f27 390451 0 2024-05-09T06:30:39.736 INFO:tasks.workunit.client.0.smithi046.stdout:2/348: dread da/de/d1c/f3e [0,4194304] 0 2024-05-09T06:30:39.736 INFO:tasks.workunit.client.0.smithi046.stdout:2/349: fdatasync da/de/d54/f67 0 2024-05-09T06:30:39.736 INFO:tasks.workunit.client.0.smithi046.stdout:3/231: mkdir d4/d20/d41/d4a 0 2024-05-09T06:30:39.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/232: write d4/d20/d24/f2e [4703703,89785] 0 2024-05-09T06:30:39.737 INFO:tasks.workunit.client.0.smithi046.stdout:0/380: mkdir d11/d18/d27/d28/d2d/d81 0 2024-05-09T06:30:39.737 INFO:tasks.workunit.client.0.smithi046.stdout:7/342: dread d3/d7/d4c/d4f/f6b [0,4194304] 0 2024-05-09T06:30:39.737 INFO:tasks.workunit.client.0.smithi046.stdout:7/343: fsync d3/d7/dd/f15 0 2024-05-09T06:30:39.738 INFO:tasks.workunit.client.0.smithi046.stdout:9/254: rename d2/d6/f21 to d2/dc/f4d 0 2024-05-09T06:30:39.740 INFO:tasks.workunit.client.0.smithi046.stdout:5/301: mknod d0/d3e/d53/c63 0 2024-05-09T06:30:39.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/484: creat db/d10/d3c/d91/fa2 x:0 0 0 2024-05-09T06:30:39.742 INFO:tasks.workunit.client.0.smithi046.stdout:6/485: write db/d10/d3c/f6d [1293097,88899] 0 2024-05-09T06:30:39.747 INFO:tasks.workunit.client.0.smithi046.stdout:2/350: link da/f45 da/de/d11/f72 0 2024-05-09T06:30:39.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/344: write d3/d7/d28/d29/d3b/f70 [3680269,80984] 0 2024-05-09T06:30:39.749 INFO:tasks.workunit.client.0.smithi046.stdout:3/233: mknod d4/d20/d41/c4b 0 2024-05-09T06:30:39.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/255: dread d2/d6/d38/f48 [0,4194304] 0 2024-05-09T06:30:39.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/381: mkdir d11/d18/d1c/d53/d82 0 2024-05-09T06:30:39.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/382: stat d11/d18/d1c/d53/f66 0 2024-05-09T06:30:39.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/383: dread - d11/d3f/d6f/f76 zero size 2024-05-09T06:30:39.754 INFO:tasks.workunit.client.0.smithi046.stdout:5/302: mknod d0/d3e/c64 0 2024-05-09T06:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/322: dwrite d1/db/dd/f13 [4194304,4194304] 0 2024-05-09T06:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/323: fdatasync d1/d7/f34 0 2024-05-09T06:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/324: write d1/d7/f31 [3958129,53696] 0 2024-05-09T06:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/325: fdatasync d1/d7/d12/d1d/d30/d38/f42 0 2024-05-09T06:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/326: chown d1/d7/d12/d45/f4c 942 1 2024-05-09T06:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/327: chown d1/d7/d12/d45/f4c 1642074 1 2024-05-09T06:30:39.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/350: dwrite d7/df/d3a/d25/f57 [0,4194304] 0 2024-05-09T06:30:39.763 INFO:tasks.workunit.client.0.smithi046.stdout:4/351: readlink d7/df/d3a/d25/l2a 0 2024-05-09T06:30:39.763 INFO:tasks.workunit.client.0.smithi046.stdout:6/486: rename db/d10/d30/l39 to db/la3 0 2024-05-09T06:30:39.764 INFO:tasks.workunit.client.0.smithi046.stdout:1/268: getdents d7/d10/d34 0 2024-05-09T06:30:39.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/345: mkdir d3/d3d/d72 0 2024-05-09T06:30:39.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/384: symlink d11/d18/d27/d28/d36/l83 0 2024-05-09T06:30:39.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/352: dread d7/f1a [0,4194304] 0 2024-05-09T06:30:39.774 INFO:tasks.workunit.client.0.smithi046.stdout:4/353: truncate d7/df/d10/d2f/d30/f67 849472 0 2024-05-09T06:30:39.774 INFO:tasks.workunit.client.0.smithi046.stdout:5/303: rename d0/c1f to d0/d1b/c65 0 2024-05-09T06:30:39.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/269: creat d7/d10/d28/d55/f56 x:0 0 0 2024-05-09T06:30:39.777 INFO:tasks.workunit.client.0.smithi046.stdout:7/346: mkdir d3/d7/d28/d73 0 2024-05-09T06:30:39.777 INFO:tasks.workunit.client.0.smithi046.stdout:7/347: stat d3/d7/d28/f2c 0 2024-05-09T06:30:39.777 INFO:tasks.workunit.client.0.smithi046.stdout:3/234: dwrite d4/d20/d24/d2a/f2d [0,4194304] 0 2024-05-09T06:30:39.779 INFO:tasks.workunit.client.0.smithi046.stdout:4/354: creat d7/df/d3a/f76 x:0 0 0 2024-05-09T06:30:39.779 INFO:tasks.workunit.client.0.smithi046.stdout:4/355: stat d7/df/d10/d2f/d30/f67 0 2024-05-09T06:30:39.779 INFO:tasks.workunit.client.0.smithi046.stdout:4/356: readlink d7/df/d10/l19 0 2024-05-09T06:30:39.779 INFO:tasks.workunit.client.0.smithi046.stdout:4/357: truncate d7/df/d53/f6e 113741 0 2024-05-09T06:30:39.779 INFO:tasks.workunit.client.0.smithi046.stdout:4/358: chown d7/df/d3a/f39 7 1 2024-05-09T06:30:39.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/256: dwrite d2/f5 [8388608,4194304] 0 2024-05-09T06:30:39.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/257: chown d2/d26/d2c 14919540 1 2024-05-09T06:30:39.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/348: dread d3/d7/d28/f2c [0,4194304] 0 2024-05-09T06:30:39.782 INFO:tasks.workunit.client.0.smithi046.stdout:6/487: rename db/d10/d3c/f62 to db/d10/d30/fa4 0 2024-05-09T06:30:39.784 INFO:tasks.workunit.client.0.smithi046.stdout:2/351: dwrite da/de/d11/f69 [0,4194304] 0 2024-05-09T06:30:39.784 INFO:tasks.workunit.client.0.smithi046.stdout:0/385: write d11/d18/d27/d28/d6b/f77 [2977544,110595] 0 2024-05-09T06:30:39.784 INFO:tasks.workunit.client.0.smithi046.stdout:8/328: dwrite d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:39.785 INFO:tasks.workunit.client.0.smithi046.stdout:5/304: truncate d0/f16 4125581 0 2024-05-09T06:30:39.788 INFO:tasks.workunit.client.0.smithi046.stdout:1/270: creat d7/d10/d34/d46/d48/f57 x:0 0 0 2024-05-09T06:30:39.788 INFO:tasks.workunit.client.0.smithi046.stdout:1/271: dread - d7/d10/f4c zero size 2024-05-09T06:30:39.792 INFO:tasks.workunit.client.0.smithi046.stdout:4/359: mkdir d7/df/d10/d1d/d77 0 2024-05-09T06:30:39.792 INFO:tasks.workunit.client.0.smithi046.stdout:3/235: dwrite d4/d20/d24/d2a/f2d [0,4194304] 0 2024-05-09T06:30:39.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/258: rename d2/f5 to d2/d6/d7/d1a/d27/d2a/f4e 0 2024-05-09T06:30:39.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/488: unlink db/d10/l43 0 2024-05-09T06:30:39.809 INFO:tasks.workunit.client.0.smithi046.stdout:0/386: dwrite d11/f12 [0,4194304] 0 2024-05-09T06:30:39.810 INFO:tasks.workunit.client.0.smithi046.stdout:2/352: symlink da/de/d11/l73 0 2024-05-09T06:30:39.812 INFO:tasks.workunit.client.0.smithi046.stdout:8/329: link d1/db/dd/d14/f50 d1/d7/d2c/f58 0 2024-05-09T06:30:39.812 INFO:tasks.workunit.client.0.smithi046.stdout:3/236: dwrite d4/d20/f25 [0,4194304] 0 2024-05-09T06:30:39.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/360: dwrite d7/df/d10/d1d/f62 [0,4194304] 0 2024-05-09T06:30:39.814 INFO:tasks.workunit.client.0.smithi046.stdout:5/305: link d0/d3e/d53/c63 d0/d1b/d39/c66 0 2024-05-09T06:30:39.814 INFO:tasks.workunit.client.0.smithi046.stdout:5/306: fdatasync d0/f16 0 2024-05-09T06:30:39.814 INFO:tasks.workunit.client.0.smithi046.stdout:5/307: stat d0/d1b/d21/f5d 0 2024-05-09T06:30:39.815 INFO:tasks.workunit.client.0.smithi046.stdout:5/308: chown d0/d1b/d21/f44 60266242 1 2024-05-09T06:30:39.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/272: creat d7/d10/d28/d30/d3a/f58 x:0 0 0 2024-05-09T06:30:39.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/273: creat d7/d10/d28/f59 x:0 0 0 2024-05-09T06:30:39.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/237: write d4/d20/f26 [5080343,66250] 0 2024-05-09T06:30:39.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/238: fsync d4/d20/d24/d29/d2b/f34 0 2024-05-09T06:30:39.828 INFO:tasks.workunit.client.0.smithi046.stdout:9/259: rename d2/c36 to d2/d6/d38/c4f 0 2024-05-09T06:30:39.828 INFO:tasks.workunit.client.0.smithi046.stdout:9/260: creat d2/d26/d2c/f50 x:0 0 0 2024-05-09T06:30:39.828 INFO:tasks.workunit.client.0.smithi046.stdout:9/261: write d2/f47 [676154,111] 0 2024-05-09T06:30:39.831 INFO:tasks.workunit.client.0.smithi046.stdout:6/489: link db/d10/d3c/d91/fa2 db/d10/d57/fa5 0 2024-05-09T06:30:39.832 INFO:tasks.workunit.client.0.smithi046.stdout:0/387: stat d11/c48 0 2024-05-09T06:30:39.834 INFO:tasks.workunit.client.0.smithi046.stdout:0/388: dread d11/d18/d27/d28/d36/f37 [0,4194304] 0 2024-05-09T06:30:39.834 INFO:tasks.workunit.client.0.smithi046.stdout:0/389: chown d11/d18/d1c/d53/f7d 181285919 1 2024-05-09T06:30:39.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/361: mknod d7/c78 0 2024-05-09T06:30:39.840 INFO:tasks.workunit.client.0.smithi046.stdout:5/309: truncate d0/d1b/f3d 191589 0 2024-05-09T06:30:39.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/274: rmdir d7/d10/d34 39 2024-05-09T06:30:39.845 INFO:tasks.workunit.client.0.smithi046.stdout:1/275: dread d7/d10/f47 [0,4194304] 0 2024-05-09T06:30:39.846 INFO:tasks.workunit.client.0.smithi046.stdout:3/239: creat d4/d20/d24/d29/d2b/f4c x:0 0 0 2024-05-09T06:30:39.848 INFO:tasks.workunit.client.0.smithi046.stdout:8/330: rename d1/db/dd/d11/l49 to d1/db/dd/d11/d43/l59 0 2024-05-09T06:30:39.848 INFO:tasks.workunit.client.0.smithi046.stdout:8/331: stat d1/d7/d12/f3b 0 2024-05-09T06:30:39.848 INFO:tasks.workunit.client.0.smithi046.stdout:8/332: write d1/db/f56 [612206,128305] 0 2024-05-09T06:30:39.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/262: truncate d2/d6/d7/fd 1230327 0 2024-05-09T06:30:39.853 INFO:tasks.workunit.client.0.smithi046.stdout:0/390: link d11/d18/d27/d28/f7c d11/d18/d1c/d53/d82/f84 0 2024-05-09T06:30:39.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/391: write d11/d18/d27/d28/d2d/d5c/f72 [709059,90919] 0 2024-05-09T06:30:39.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/392: creat d11/d18/d27/d28/f85 x:0 0 0 2024-05-09T06:30:39.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/362: getdents d7/df/d10/d2f 0 2024-05-09T06:30:39.859 INFO:tasks.workunit.client.0.smithi046.stdout:2/353: rmdir da/de/d1c 39 2024-05-09T06:30:39.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/363: dread - d7/df/d3a/d45/f63 zero size 2024-05-09T06:30:39.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/364: creat d7/df/d10/f79 x:0 0 0 2024-05-09T06:30:39.866 INFO:tasks.workunit.client.0.smithi046.stdout:1/276: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:39.866 INFO:tasks.workunit.client.0.smithi046.stdout:1/277: write d7/d10/d28/d30/f38 [566532,51311] 0 2024-05-09T06:30:39.867 INFO:tasks.workunit.client.0.smithi046.stdout:5/310: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:39.871 INFO:tasks.workunit.client.0.smithi046.stdout:6/490: rename db/fc to db/d10/d3f/d44/d5e/fa6 0 2024-05-09T06:30:39.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/333: dwrite d1/db/f56 [0,4194304] 0 2024-05-09T06:30:39.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/311: truncate d0/f1a 3858860 0 2024-05-09T06:30:39.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/312: creat d0/d1b/d39/f67 x:0 0 0 2024-05-09T06:30:39.885 INFO:tasks.workunit.client.0.smithi046.stdout:5/313: fsync d0/d1b/f31 0 2024-05-09T06:30:39.885 INFO:tasks.workunit.client.0.smithi046.stdout:5/314: read - d0/d1b/d39/f67 zero size 2024-05-09T06:30:39.886 INFO:tasks.workunit.client.0.smithi046.stdout:6/491: creat db/d10/d3f/d4f/d8a/d9e/fa7 x:0 0 0 2024-05-09T06:30:39.888 INFO:tasks.workunit.client.0.smithi046.stdout:9/263: rename d2/c10 to d2/d6/d38/c51 0 2024-05-09T06:30:39.888 INFO:tasks.workunit.client.0.smithi046.stdout:4/365: rmdir d7/df/d10/d1d 39 2024-05-09T06:30:39.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/334: rmdir d1/d7 39 2024-05-09T06:30:39.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/335: creat d1/d7/d12/f5a x:0 0 0 2024-05-09T06:30:39.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/336: creat d1/d7/d2c/f5b x:0 0 0 2024-05-09T06:30:39.891 INFO:tasks.workunit.client.0.smithi046.stdout:5/315: mknod d0/d1b/c68 0 2024-05-09T06:30:39.891 INFO:tasks.workunit.client.0.smithi046.stdout:5/316: creat d0/d3e/d53/f69 x:0 0 0 2024-05-09T06:30:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/354: dwrite da/db/f15 [0,4194304] 0 2024-05-09T06:30:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/355: truncate da/de/d14/d1f/f41 930103 0 2024-05-09T06:30:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/356: rename da/de/d54 to da/de/d54/d65/d70/d74 22 2024-05-09T06:30:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:9/264: creat d2/d6/d33/f52 x:0 0 0 2024-05-09T06:30:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/240: dwrite d4/d20/f25 [4194304,4194304] 0 2024-05-09T06:30:39.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/278: dwrite d7/d10/f13 [0,4194304] 0 2024-05-09T06:30:39.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/366: creat d7/df/d10/d1d/d77/f7a x:0 0 0 2024-05-09T06:30:39.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/367: write d7/df/d3a/d45/f49 [1387024,45454] 0 2024-05-09T06:30:39.896 INFO:tasks.workunit.client.0.smithi046.stdout:5/317: dread d0/f2d [0,4194304] 0 2024-05-09T06:30:39.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/492: dread db/d10/d3f/d44/d5e/fa6 [4194304,4194304] 0 2024-05-09T06:30:39.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/493: read db/f25 [3666,111623] 0 2024-05-09T06:30:39.900 INFO:tasks.workunit.client.0.smithi046.stdout:2/357: read da/de/d14/f28 [3005380,103889] 0 2024-05-09T06:30:39.900 INFO:tasks.workunit.client.0.smithi046.stdout:2/358: stat f8 0 2024-05-09T06:30:39.901 INFO:tasks.workunit.client.0.smithi046.stdout:8/337: unlink d1/db/f56 0 2024-05-09T06:30:39.905 INFO:tasks.workunit.client.0.smithi046.stdout:3/241: dread d4/d20/f25 [0,4194304] 0 2024-05-09T06:30:39.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/368: dwrite d7/f2e [0,4194304] 0 2024-05-09T06:30:39.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/494: dwrite db/d10/d3f/d4f/f60 [0,4194304] 0 2024-05-09T06:30:39.916 INFO:tasks.workunit.client.0.smithi046.stdout:9/265: creat d2/d26/d2c/d3d/f53 x:0 0 0 2024-05-09T06:30:39.916 INFO:tasks.workunit.client.0.smithi046.stdout:9/266: readlink d2/d6/l14 0 2024-05-09T06:30:39.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/279: symlink d7/d10/d28/d30/l5a 0 2024-05-09T06:30:39.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/280: chown d7/d10/d34 373754 1 2024-05-09T06:30:39.925 INFO:tasks.workunit.client.0.smithi046.stdout:4/369: dread d7/f72 [0,4194304] 0 2024-05-09T06:30:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/495: dwrite db/d10/d3f/d4f/d89/f9c [0,4194304] 0 2024-05-09T06:30:39.937 INFO:tasks.workunit.client.0.smithi046.stdout:6/496: read db/d10/d3f/d44/f48 [1822817,31031] 0 2024-05-09T06:30:39.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/497: dwrite db/d10/d6b/f8f [0,4194304] 0 2024-05-09T06:30:39.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/498: stat db/d10/d6b/f8f 0 2024-05-09T06:30:39.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/318: link d0/d1b/d39/f47 d0/f6a 0 2024-05-09T06:30:39.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/319: chown d0/d1b/d21/f44 498108 1 2024-05-09T06:30:39.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/320: fdatasync d0/d3e/d53/f69 0 2024-05-09T06:30:39.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/321: chown d0/d1b/d39/f5c 853623 1 2024-05-09T06:30:39.982 INFO:tasks.workunit.client.0.smithi046.stdout:2/359: link da/de/d14/d1f/d20/l3f da/de/d14/d1f/d20/d5c/l75 0 2024-05-09T06:30:39.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/338: creat d1/db/dd/d11/f5c x:0 0 0 2024-05-09T06:30:39.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/242: mknod d4/d20/d41/d4a/c4d 0 2024-05-09T06:30:39.994 INFO:tasks.workunit.client.0.smithi046.stdout:1/281: rename d7/d10/l16 to d7/d10/d34/d46/d48/l5b 0 2024-05-09T06:30:39.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/282: fsync d7/d10/d28/d30/f38 0 2024-05-09T06:30:39.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/283: dread - d7/d10/f4c zero size 2024-05-09T06:30:39.998 INFO:tasks.workunit.client.0.smithi046.stdout:4/370: stat d7/l27 0 2024-05-09T06:30:39.998 INFO:tasks.workunit.client.0.smithi046.stdout:4/371: readlink d7/df/d10/d1d/l23 0 2024-05-09T06:30:40.009 INFO:tasks.workunit.client.0.smithi046.stdout:5/322: rmdir d0/d1b 39 2024-05-09T06:30:40.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/360: symlink da/de/d14/d1f/d3b/l76 0 2024-05-09T06:30:40.013 INFO:tasks.workunit.client.0.smithi046.stdout:2/361: fsync da/db/f6f 0 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/284: dwrite d7/d10/f12 [0,4194304] 0 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/285: chown d7/d10/d28/d30/l32 106193 1 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/286: write d7/d10/d34/f52 [184296,82128] 0 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/287: chown d7/d10/f47 99165486 1 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/288: write d7/d10/f27 [252500,129248] 0 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/289: dread - d7/d10/f54 zero size 2024-05-09T06:30:40.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/339: mkdir d1/db/dd/d11/d5d 0 2024-05-09T06:30:40.017 INFO:tasks.workunit.client.0.smithi046.stdout:3/243: getdents d4/d20 0 2024-05-09T06:30:40.023 INFO:tasks.workunit.client.0.smithi046.stdout:4/372: rename d7/df/d10/d2f/c48 to d7/df/d10/d1d/c7b 0 2024-05-09T06:30:40.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/499: mknod db/d93/ca8 0 2024-05-09T06:30:40.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/244: dread d4/d20/d24/d2a/f2d [0,4194304] 0 2024-05-09T06:30:40.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/245: dread - d4/d20/d24/d29/d2b/f4c zero size 2024-05-09T06:30:40.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/246: stat d4/d20/d24 0 2024-05-09T06:30:40.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/373: dread d7/fc [0,4194304] 0 2024-05-09T06:30:40.032 INFO:tasks.workunit.client.0.smithi046.stdout:5/323: mknod d0/d3e/c6b 0 2024-05-09T06:30:40.033 INFO:tasks.workunit.client.0.smithi046.stdout:2/362: unlink da/de/d1c/c1d 0 2024-05-09T06:30:40.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/290: dwrite d7/d10/d34/f52 [0,4194304] 0 2024-05-09T06:30:40.038 INFO:tasks.workunit.client.0.smithi046.stdout:3/247: dread d4/fc [4194304,4194304] 0 2024-05-09T06:30:40.041 INFO:tasks.workunit.client.0.smithi046.stdout:8/340: rename d1/db/dd/d14/f50 to d1/d7/d12/f5e 0 2024-05-09T06:30:40.041 INFO:tasks.workunit.client.0.smithi046.stdout:6/500: dwrite db/d10/d3f/d44/d5e/f84 [0,4194304] 0 2024-05-09T06:30:40.041 INFO:tasks.workunit.client.0.smithi046.stdout:8/341: fsync d1/d7/f37 0 2024-05-09T06:30:40.041 INFO:tasks.workunit.client.0.smithi046.stdout:6/501: chown db/d10/d19/f20 0 1 2024-05-09T06:30:40.041 INFO:tasks.workunit.client.0.smithi046.stdout:8/342: fsync d1/d7/d12/f5a 0 2024-05-09T06:30:40.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/343: chown d1/db/dd/f4a 326 1 2024-05-09T06:30:40.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/344: fdatasync d1/db/dd/f13 0 2024-05-09T06:30:40.043 INFO:tasks.workunit.client.0.smithi046.stdout:4/374: mknod d7/df/d10/d1d/d77/c7c 0 2024-05-09T06:30:40.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/363: mknod da/dc/c77 0 2024-05-09T06:30:40.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/324: dwrite d0/d1b/d39/f60 [0,4194304] 0 2024-05-09T06:30:40.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/325: chown d0/d1b/d21/f42 38830226 1 2024-05-09T06:30:40.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/326: readlink d0/l12 0 2024-05-09T06:30:40.050 INFO:tasks.workunit.client.0.smithi046.stdout:4/375: dread d7/df/f1b [0,4194304] 0 2024-05-09T06:30:40.052 INFO:tasks.workunit.client.0.smithi046.stdout:1/291: unlink d7/d10/d34/l49 0 2024-05-09T06:30:40.053 INFO:tasks.workunit.client.0.smithi046.stdout:3/248: mkdir d4/d20/d24/d2a/d4e 0 2024-05-09T06:30:40.053 INFO:tasks.workunit.client.0.smithi046.stdout:3/249: readlink l2 0 2024-05-09T06:30:40.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/502: rmdir db/d10/d3f/d44/d74 39 2024-05-09T06:30:40.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/364: dwrite f7 [0,4194304] 0 2024-05-09T06:30:40.063 INFO:tasks.workunit.client.0.smithi046.stdout:8/345: link d1/d7/d12/d1d/d30/d38/f46 d1/d7/d12/d45/f5f 0 2024-05-09T06:30:40.065 INFO:tasks.workunit.client.0.smithi046.stdout:5/327: rmdir d0/d58 39 2024-05-09T06:30:40.065 INFO:tasks.workunit.client.0.smithi046.stdout:5/328: creat d0/d3e/d53/f6c x:0 0 0 2024-05-09T06:30:40.066 INFO:tasks.workunit.client.0.smithi046.stdout:1/292: mknod d7/d10/d28/d55/c5c 0 2024-05-09T06:30:40.070 INFO:tasks.workunit.client.0.smithi046.stdout:6/503: dread db/d10/f1e [0,4194304] 0 2024-05-09T06:30:40.070 INFO:tasks.workunit.client.0.smithi046.stdout:6/504: write db/d10/d3f/d44/d46/f64 [975380,109911] 0 2024-05-09T06:30:40.070 INFO:tasks.workunit.client.0.smithi046.stdout:6/505: stat db/d10/d3f/d4f/d8a/d9e 0 2024-05-09T06:30:40.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/250: rename d4/d20/d24/f2e to d4/d20/d24/f4f 0 2024-05-09T06:30:40.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/251: creat d4/d20/d24/d2a/f50 x:0 0 0 2024-05-09T06:30:40.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/329: dread d0/f2d [0,4194304] 0 2024-05-09T06:30:40.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/346: creat d1/d7/d12/d1d/f60 x:0 0 0 2024-05-09T06:30:40.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/347: chown d1/db/d41 3331435 1 2024-05-09T06:30:40.076 INFO:tasks.workunit.client.0.smithi046.stdout:1/293: rmdir d7/d10/d28/d30 39 2024-05-09T06:30:40.078 INFO:tasks.workunit.client.0.smithi046.stdout:3/252: stat d4/c27 0 2024-05-09T06:30:40.081 INFO:tasks.workunit.client.0.smithi046.stdout:5/330: rename d0/d1b/l22 to d0/d1b/d21/l6d 0 2024-05-09T06:30:40.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/294: unlink d7/d10/l2e 0 2024-05-09T06:30:40.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/331: link d0/c32 d0/d1b/c6e 0 2024-05-09T06:30:40.086 INFO:tasks.workunit.client.0.smithi046.stdout:1/295: rmdir d7/d10/d34/d46/d48/d53 0 2024-05-09T06:30:40.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/332: truncate d0/fd 97988 0 2024-05-09T06:30:40.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/333: creat d0/d3e/d53/f6f x:0 0 0 2024-05-09T06:30:40.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/296: write f6 [363807,105547] 0 2024-05-09T06:30:40.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/297: chown d7/d10/f54 121 1 2024-05-09T06:30:40.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/298: creat d7/d10/d28/d30/d3a/f5d x:0 0 0 2024-05-09T06:30:40.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/299: chown d7/d10/d28/d55 7929661 1 2024-05-09T06:30:40.092 INFO:tasks.workunit.client.0.smithi046.stdout:5/334: creat d0/d3e/d50/f70 x:0 0 0 2024-05-09T06:30:40.100 INFO:tasks.workunit.client.0.smithi046.stdout:5/335: dread d0/d1b/f35 [0,4194304] 0 2024-05-09T06:30:40.100 INFO:tasks.workunit.client.0.smithi046.stdout:5/336: chown d0/d1b/d21/l4f 446516 1 2024-05-09T06:30:40.116 INFO:tasks.workunit.client.0.smithi046.stdout:5/337: dread d0/d1b/d21/f5d [0,4194304] 0 2024-05-09T06:30:40.116 INFO:tasks.workunit.client.0.smithi046.stdout:8/348: dwrite d1/d7/d12/d1d/d30/d38/f3f [4194304,4194304] 0 2024-05-09T06:30:40.117 INFO:tasks.workunit.client.0.smithi046.stdout:6/506: dwrite f6 [4194304,4194304] 0 2024-05-09T06:30:40.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/253: dwrite d4/d20/d24/f1b [0,4194304] 0 2024-05-09T06:30:40.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/300: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:40.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/349: creat d1/db/dd/d11/d5d/f61 x:0 0 0 2024-05-09T06:30:40.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/350: write d1/d7/d12/f5a [865886,28643] 0 2024-05-09T06:30:40.119 INFO:tasks.workunit.client.0.smithi046.stdout:3/254: mknod d4/d20/d24/d2a/d46/c51 0 2024-05-09T06:30:40.120 INFO:tasks.workunit.client.0.smithi046.stdout:1/301: dread d7/d10/f27 [0,4194304] 0 2024-05-09T06:30:40.120 INFO:tasks.workunit.client.0.smithi046.stdout:3/255: fsync d4/d20/d24/d2a/f40 0 2024-05-09T06:30:40.120 INFO:tasks.workunit.client.0.smithi046.stdout:3/256: write d4/d20/d24/d29/d2b/f4c [740165,128054] 0 2024-05-09T06:30:40.120 INFO:tasks.workunit.client.0.smithi046.stdout:3/257: chown d4/c3c 4097 1 2024-05-09T06:30:40.122 INFO:tasks.workunit.client.0.smithi046.stdout:3/258: getdents d4/d20/d41/d4a 0 2024-05-09T06:30:40.122 INFO:tasks.workunit.client.0.smithi046.stdout:3/259: fsync d4/d20/d24/d2a/f2d 0 2024-05-09T06:30:40.123 INFO:tasks.workunit.client.0.smithi046.stdout:5/338: write d0/f2d [1117880,81519] 0 2024-05-09T06:30:40.123 INFO:tasks.workunit.client.0.smithi046.stdout:5/339: chown d0/d1b/d39/l48 10398709 1 2024-05-09T06:30:40.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/340: read d0/d1b/d39/f3c [2296246,72272] 0 2024-05-09T06:30:40.135 INFO:tasks.workunit.client.0.smithi046.stdout:8/351: dread d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:40.135 INFO:tasks.workunit.client.0.smithi046.stdout:5/341: dread d0/d1b/d21/f42 [0,4194304] 0 2024-05-09T06:30:40.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/342: dread d0/f1a [0,4194304] 0 2024-05-09T06:30:40.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/343: getdents d0 0 2024-05-09T06:30:40.148 INFO:tasks.workunit.client.0.smithi046.stdout:5/344: creat d0/d58/f71 x:0 0 0 2024-05-09T06:30:40.148 INFO:tasks.workunit.client.0.smithi046.stdout:5/345: fsync d0/d3e/d53/f6c 0 2024-05-09T06:30:40.148 INFO:tasks.workunit.client.0.smithi046.stdout:5/346: chown d0/c32 118 1 2024-05-09T06:30:40.151 INFO:tasks.workunit.client.0.smithi046.stdout:5/347: rename d0/f1a to d0/d3e/d53/f72 0 2024-05-09T06:30:40.151 INFO:tasks.workunit.client.0.smithi046.stdout:5/348: fsync d0/d1b/f3d 0 2024-05-09T06:30:40.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/349: rename d0/f2a to d0/d3e/d50/f73 0 2024-05-09T06:30:40.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/350: dread - d0/d1b/d21/f55 zero size 2024-05-09T06:30:40.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/351: fsync d0/d3e/d53/f59 0 2024-05-09T06:30:40.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/352: dread - d0/f6a zero size 2024-05-09T06:30:40.154 INFO:tasks.workunit.client.0.smithi046.stdout:5/353: rename d0/d3e/f52 to d0/f74 0 2024-05-09T06:30:40.154 INFO:tasks.workunit.client.0.smithi046.stdout:5/354: dread - d0/d58/f71 zero size 2024-05-09T06:30:40.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/302: dwrite d7/d10/d34/f45 [0,4194304] 0 2024-05-09T06:30:40.163 INFO:tasks.workunit.client.0.smithi046.stdout:1/303: creat d7/d10/d28/d30/f5e x:0 0 0 2024-05-09T06:30:40.165 INFO:tasks.workunit.client.0.smithi046.stdout:1/304: symlink d7/d10/d34/d46/l5f 0 2024-05-09T06:30:40.168 INFO:tasks.workunit.client.0.smithi046.stdout:3/260: dwrite d4/d20/d24/d29/d2b/f4c [0,4194304] 0 2024-05-09T06:30:40.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/352: dwrite d1/d7/d12/d1d/d30/d38/f3f [0,4194304] 0 2024-05-09T06:30:40.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/305: dread d7/d10/d34/f52 [0,4194304] 0 2024-05-09T06:30:40.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/261: dread d4/d5/f9 [0,4194304] 0 2024-05-09T06:30:40.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/262: read d4/d5/f3a [548166,102532] 0 2024-05-09T06:30:40.200 INFO:tasks.workunit.client.0.smithi046.stdout:3/263: dwrite d4/d20/d24/f1b [4194304,4194304] 0 2024-05-09T06:30:40.201 INFO:tasks.workunit.client.0.smithi046.stdout:3/264: stat d4 0 2024-05-09T06:30:40.201 INFO:tasks.workunit.client.0.smithi046.stdout:3/265: chown d4/fc 0 1 2024-05-09T06:30:40.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/353: truncate d1/db/f16 2353897 0 2024-05-09T06:30:40.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/354: chown d1/d7/d12/d1d/d30/d38/l4f 6 1 2024-05-09T06:30:40.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/306: symlink d7/d10/d34/d46/l60 0 2024-05-09T06:30:40.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/307: chown d7/d10/d28/c4d 50829540 1 2024-05-09T06:30:40.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/308: write d7/d10/d34/f45 [5234815,42899] 0 2024-05-09T06:30:40.207 INFO:tasks.workunit.client.0.smithi046.stdout:5/355: rename d0/f74 to d0/f75 0 2024-05-09T06:30:40.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/355: mknod d1/d7/d2c/c62 0 2024-05-09T06:30:40.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/309: rename d7/d10/l14 to d7/d10/d28/d30/l61 0 2024-05-09T06:30:40.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/356: symlink d0/d3e/l76 0 2024-05-09T06:30:40.214 INFO:tasks.workunit.client.0.smithi046.stdout:8/356: getdents d1/d7 0 2024-05-09T06:30:40.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/266: dwrite d4/d20/d24/f1b [4194304,4194304] 0 2024-05-09T06:30:40.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/357: dread d0/d1b/d39/f60 [0,4194304] 0 2024-05-09T06:30:40.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/358: stat d0/d1b/d39/l48 0 2024-05-09T06:30:40.229 INFO:tasks.workunit.client.0.smithi046.stdout:8/357: dwrite d1/d7/d2c/f4d [0,4194304] 0 2024-05-09T06:30:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/267: dwrite d4/d20/d24/d2a/f2d [0,4194304] 0 2024-05-09T06:30:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/268: stat d4/cb 0 2024-05-09T06:30:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:5/359: link d0/d1b/d39/l48 d0/d1b/d21/l77 0 2024-05-09T06:30:40.239 INFO:tasks.workunit.client.0.smithi046.stdout:8/358: mknod d1/d7/d12/c63 0 2024-05-09T06:30:40.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/359: readlink d1/l6 0 2024-05-09T06:30:40.242 INFO:tasks.workunit.client.0.smithi046.stdout:8/360: rename d1/db/dd/l2b to d1/d7/d12/d1d/d30/l64 0 2024-05-09T06:30:40.244 INFO:tasks.workunit.client.0.smithi046.stdout:8/361: creat d1/db/dd/d11/d43/f65 x:0 0 0 2024-05-09T06:30:40.244 INFO:tasks.workunit.client.0.smithi046.stdout:8/362: chown d1/d7/d12/d45/f4c 28 1 2024-05-09T06:30:40.247 INFO:tasks.workunit.client.0.smithi046.stdout:8/363: symlink d1/d7/d12/d45/l66 0 2024-05-09T06:30:40.247 INFO:tasks.workunit.client.0.smithi046.stdout:8/364: fdatasync d1/d7/d12/d1d/f60 0 2024-05-09T06:30:40.253 INFO:tasks.workunit.client.0.smithi046.stdout:7/349: sync 2024-05-09T06:30:40.253 INFO:tasks.workunit.client.0.smithi046.stdout:0/393: sync 2024-05-09T06:30:40.256 INFO:tasks.workunit.client.0.smithi046.stdout:7/350: getdents d3/d7/d28/d29 0 2024-05-09T06:30:40.259 INFO:tasks.workunit.client.0.smithi046.stdout:0/394: mknod d11/d18/d27/d28/d2d/d5c/c86 0 2024-05-09T06:30:40.259 INFO:tasks.workunit.client.0.smithi046.stdout:7/351: mknod d3/d6f/c74 0 2024-05-09T06:30:40.262 INFO:tasks.workunit.client.0.smithi046.stdout:1/310: rmdir d7/d10 39 2024-05-09T06:30:40.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/352: creat d3/d7/d28/d29/d35/d5c/f75 x:0 0 0 2024-05-09T06:30:40.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/353: creat d3/d7/d28/d29/d3b/f76 x:0 0 0 2024-05-09T06:30:40.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/269: dwrite d4/d5/f43 [4194304,4194304] 0 2024-05-09T06:30:40.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/270: fsync d4/d20/d24/f4f 0 2024-05-09T06:30:40.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/271: fsync d4/f3d 0 2024-05-09T06:30:40.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/272: chown d4/d20/d24/c21 49098272 1 2024-05-09T06:30:40.267 INFO:tasks.workunit.client.0.smithi046.stdout:8/365: dwrite d1/d7/d2c/f58 [0,4194304] 0 2024-05-09T06:30:40.267 INFO:tasks.workunit.client.0.smithi046.stdout:5/360: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:40.267 INFO:tasks.workunit.client.0.smithi046.stdout:5/361: fsync d0/d3e/d50/f73 0 2024-05-09T06:30:40.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/354: creat d3/d3d/d5b/f77 x:0 0 0 2024-05-09T06:30:40.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/362: write d0/fa [3218727,120516] 0 2024-05-09T06:30:40.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/363: chown d0/d1b/d39/f47 2059036 1 2024-05-09T06:30:40.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/364: creat d0/d3e/f78 x:0 0 0 2024-05-09T06:30:40.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/365: creat d0/d1b/d21/f79 x:0 0 0 2024-05-09T06:30:40.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/311: dwrite d7/f42 [0,4194304] 0 2024-05-09T06:30:40.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/312: truncate d7/d10/d28/f4f 80002 0 2024-05-09T06:30:40.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/313: stat d7/d10/d28/d30/f38 0 2024-05-09T06:30:40.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/366: write d1/db/f28 [6198410,104462] 0 2024-05-09T06:30:40.315 INFO:tasks.workunit.client.0.smithi046.stdout:7/355: dwrite d3/d3d/d5b/f77 [0,4194304] 0 2024-05-09T06:30:40.324 INFO:tasks.workunit.client.0.smithi046.stdout:7/356: write d3/f8 [1400644,65912] 0 2024-05-09T06:30:40.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/366: unlink d0/d58/f71 0 2024-05-09T06:30:40.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/367: write d0/d3e/d53/f6f [925047,10882] 0 2024-05-09T06:30:40.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/368: write d0/d1b/d21/f55 [574366,36140] 0 2024-05-09T06:30:40.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/369: dread d0/d1b/f3d [0,4194304] 0 2024-05-09T06:30:40.392 INFO:tasks.workunit.client.0.smithi046.stdout:8/367: getdents d1/d7/d12/d1d/d30 0 2024-05-09T06:30:40.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/368: dread d1/d7/d12/d1d/d30/d38/f46 [0,4194304] 0 2024-05-09T06:30:40.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/369: dread d1/db/dd/d11/f27 [0,4194304] 0 2024-05-09T06:30:40.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/357: getdents d3/d7/d28 0 2024-05-09T06:30:40.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/358: creat d3/d7/d28/d29/d35/f78 x:0 0 0 2024-05-09T06:30:40.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/359: dread d3/f6 [0,4194304] 0 2024-05-09T06:30:40.429 INFO:tasks.workunit.client.0.smithi046.stdout:5/370: mkdir d0/d58/d7a 0 2024-05-09T06:30:40.429 INFO:tasks.workunit.client.0.smithi046.stdout:5/371: fdatasync d0/d1b/f31 0 2024-05-09T06:30:40.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/372: dread - d0/d3e/d53/f6c zero size 2024-05-09T06:30:40.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/373: readlink d0/l2e 0 2024-05-09T06:30:40.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/374: chown d0/f1c 1391658 1 2024-05-09T06:30:40.452 INFO:tasks.workunit.client.0.smithi046.stdout:7/360: truncate d3/d7/d28/d29/f3c 599807 0 2024-05-09T06:30:40.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/375: creat d0/d58/d7a/f7b x:0 0 0 2024-05-09T06:30:40.454 INFO:tasks.workunit.client.0.smithi046.stdout:5/376: creat d0/d1b/d21/f7c x:0 0 0 2024-05-09T06:30:40.457 INFO:tasks.workunit.client.0.smithi046.stdout:7/361: dread d3/f1b [0,4194304] 0 2024-05-09T06:30:40.459 INFO:tasks.workunit.client.0.smithi046.stdout:7/362: unlink d3/d7/f11 0 2024-05-09T06:30:40.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/363: dwrite d3/d7/fa [4194304,4194304] 0 2024-05-09T06:30:40.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/364: fsync d3/d7/f9 0 2024-05-09T06:30:40.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/365: truncate d3/d7/dd/fe 533962 0 2024-05-09T06:30:40.477 INFO:tasks.workunit.client.0.smithi046.stdout:7/366: mkdir d3/d3d/d72/d79 0 2024-05-09T06:30:40.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/367: dwrite d3/d3d/f41 [0,4194304] 0 2024-05-09T06:30:40.498 INFO:tasks.workunit.client.0.smithi046.stdout:7/368: truncate d3/d7/d28/f58 243880 0 2024-05-09T06:30:40.504 INFO:tasks.workunit.client.0.smithi046.stdout:7/369: symlink d3/d7/dd/l7a 0 2024-05-09T06:30:40.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/370: truncate d3/d7/f32 3588252 0 2024-05-09T06:30:40.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/371: dread - d3/d7/f52 zero size 2024-05-09T06:30:40.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/372: chown d3/d7/d4c/d4f 260775 1 2024-05-09T06:30:40.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/373: write d3/d7/dd/f68 [690231,46274] 0 2024-05-09T06:30:40.508 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:40 smithi046 ceph-mon[26924]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:40.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:40 smithi106 ceph-mon[34679]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:30:40.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/377: symlink d0/d1b/l7d 0 2024-05-09T06:30:40.581 INFO:tasks.workunit.client.0.smithi046.stdout:3/273: rename d4/c3c to d4/d20/d24/d2a/d46/c52 0 2024-05-09T06:30:40.582 INFO:tasks.workunit.client.0.smithi046.stdout:5/378: dread d0/d1b/d21/f44 [0,4194304] 0 2024-05-09T06:30:40.582 INFO:tasks.workunit.client.0.smithi046.stdout:1/314: creat d7/f62 x:0 0 0 2024-05-09T06:30:40.584 INFO:tasks.workunit.client.0.smithi046.stdout:3/274: creat d4/d48/f53 x:0 0 0 2024-05-09T06:30:40.584 INFO:tasks.workunit.client.0.smithi046.stdout:3/275: write d4/d20/d24/d2a/f40 [196812,15464] 0 2024-05-09T06:30:40.584 INFO:tasks.workunit.client.0.smithi046.stdout:8/370: mkdir d1/db/d67 0 2024-05-09T06:30:40.584 INFO:tasks.workunit.client.0.smithi046.stdout:8/371: readlink d1/l6 0 2024-05-09T06:30:40.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/315: symlink d7/d10/l63 0 2024-05-09T06:30:40.586 INFO:tasks.workunit.client.0.smithi046.stdout:1/316: readlink d7/d10/d34/d46/l60 0 2024-05-09T06:30:40.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/374: symlink d3/d7/d28/l7b 0 2024-05-09T06:30:40.591 INFO:tasks.workunit.client.0.smithi046.stdout:3/276: write d4/d20/f26 [3819890,39268] 0 2024-05-09T06:30:40.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/372: write d1/db/dd/d11/f27 [4022016,103983] 0 2024-05-09T06:30:40.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/373: chown d1/d7/d2c/f4d 3466 1 2024-05-09T06:30:40.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/374: rename d1/d7/d12/d1d/f60 to d1/d7/f68 0 2024-05-09T06:30:40.602 INFO:tasks.workunit.client.0.smithi046.stdout:3/277: fdatasync d4/d20/f26 0 2024-05-09T06:30:40.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/375: rename d1/d7/c52 to d1/db/dd/d11/d5d/c69 0 2024-05-09T06:30:40.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/376: truncate d1/d7/d2c/f15 2630354 0 2024-05-09T06:30:40.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/377: chown d1/d7/d12 22 1 2024-05-09T06:30:40.609 INFO:tasks.workunit.client.0.smithi046.stdout:3/278: dread d4/d20/f25 [0,4194304] 0 2024-05-09T06:30:40.629 INFO:tasks.workunit.client.0.smithi046.stdout:3/279: dwrite d4/d20/d24/d29/d2b/f4c [0,4194304] 0 2024-05-09T06:30:40.694 INFO:tasks.workunit.client.0.smithi046.stdout:7/375: dwrite d3/d7/d28/d29/f45 [4194304,4194304] 0 2024-05-09T06:30:40.695 INFO:tasks.workunit.client.0.smithi046.stdout:8/378: creat d1/db/d67/f6a x:0 0 0 2024-05-09T06:30:40.696 INFO:tasks.workunit.client.0.smithi046.stdout:8/379: chown d1/db/d67 10 1 2024-05-09T06:30:40.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/280: creat d4/d48/d49/f54 x:0 0 0 2024-05-09T06:30:40.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/317: dwrite d7/d10/d28/d55/f56 [0,4194304] 0 2024-05-09T06:30:40.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/365: sync 2024-05-09T06:30:40.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/376: sync 2024-05-09T06:30:40.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/395: sync 2024-05-09T06:30:40.709 INFO:tasks.workunit.client.0.smithi046.stdout:6/507: sync 2024-05-09T06:30:40.709 INFO:tasks.workunit.client.0.smithi046.stdout:9/267: sync 2024-05-09T06:30:40.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/396: creat d11/d18/d27/d28/d36/d5a/f87 x:0 0 0 2024-05-09T06:30:40.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/281: mkdir d4/d20/d24/d2a/d55 0 2024-05-09T06:30:40.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/366: write f6 [1159509,94321] 0 2024-05-09T06:30:40.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/367: creat da/de/d11/f78 x:0 0 0 2024-05-09T06:30:40.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/318: symlink d7/d10/d34/d46/d48/l64 0 2024-05-09T06:30:40.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/319: fsync d7/d10/d28/d30/d3a/f3b 0 2024-05-09T06:30:40.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/380: getdents d1/d7/d12/d1d/d30/d38 0 2024-05-09T06:30:40.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/381: write d1/db/d67/f6a [498760,47950] 0 2024-05-09T06:30:40.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/382: chown d1/d7/f31 23 1 2024-05-09T06:30:40.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/383: write d1/db/dd/d11/d43/f4b [1145401,42263] 0 2024-05-09T06:30:40.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/384: creat d1/db/dd/d11/d5d/f6b x:0 0 0 2024-05-09T06:30:40.798 INFO:tasks.workunit.client.0.smithi046.stdout:4/377: symlink d7/df/d10/d1d/d77/l7d 0 2024-05-09T06:30:40.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/268: creat d2/d6/d7/f54 x:0 0 0 2024-05-09T06:30:40.802 INFO:tasks.workunit.client.0.smithi046.stdout:0/397: symlink d11/d18/d27/d28/l88 0 2024-05-09T06:30:40.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/398: fsync d11/d18/d27/d28/d2d/f4c 0 2024-05-09T06:30:40.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/368: unlink f3 0 2024-05-09T06:30:40.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/369: dread - da/de/d54/f67 zero size 2024-05-09T06:30:40.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/385: creat d1/db/d41/f6c x:0 0 0 2024-05-09T06:30:40.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/386: chown d1/d7/c21 3927971 1 2024-05-09T06:30:40.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/378: mknod d7/df/d10/d1d/d77/c7e 0 2024-05-09T06:30:40.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/379: write d7/df/d10/d1d/f69 [1256053,12726] 0 2024-05-09T06:30:40.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/370: link da/de/d14/d1f/f41 da/dc/f79 0 2024-05-09T06:30:40.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/371: fsync da/de/d11/f72 0 2024-05-09T06:30:40.812 INFO:tasks.workunit.client.0.smithi046.stdout:8/387: symlink d1/db/l6d 0 2024-05-09T06:30:40.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/372: dread da/dc/f5b [0,4194304] 0 2024-05-09T06:30:40.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/373: readlink da/dc/l18 0 2024-05-09T06:30:40.815 INFO:tasks.workunit.client.0.smithi046.stdout:4/380: symlink d7/df/d3a/d25/l7f 0 2024-05-09T06:30:40.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/381: fsync d7/df/d3a/d25/f5f 0 2024-05-09T06:30:40.817 INFO:tasks.workunit.client.0.smithi046.stdout:8/388: mkdir d1/db/d67/d6e 0 2024-05-09T06:30:40.818 INFO:tasks.workunit.client.0.smithi046.stdout:0/399: dread d11/d18/f32 [0,4194304] 0 2024-05-09T06:30:40.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/382: symlink d7/df/d10/d1d/d77/l80 0 2024-05-09T06:30:40.819 INFO:tasks.workunit.client.0.smithi046.stdout:8/389: mknod d1/db/dd/d11/d5d/c6f 0 2024-05-09T06:30:40.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/383: mkdir d7/df/d3a/d25/d81 0 2024-05-09T06:30:40.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/384: creat d7/df/d3a/d45/f82 x:0 0 0 2024-05-09T06:30:40.822 INFO:tasks.workunit.client.0.smithi046.stdout:8/390: rename d1/d7/d12/c22 to d1/db/c70 0 2024-05-09T06:30:40.822 INFO:tasks.workunit.client.0.smithi046.stdout:8/391: write d1/db/dd/d11/d5d/f61 [460914,56607] 0 2024-05-09T06:30:40.825 INFO:tasks.workunit.client.0.smithi046.stdout:3/282: dwrite d4/fc [0,4194304] 0 2024-05-09T06:30:40.825 INFO:tasks.workunit.client.0.smithi046.stdout:3/283: stat d4/d20/d24/d2a/d4e 0 2024-05-09T06:30:40.825 INFO:tasks.workunit.client.0.smithi046.stdout:4/385: rename d7/df/d3a/d45/f49 to d7/df/d3a/f83 0 2024-05-09T06:30:40.826 INFO:tasks.workunit.client.0.smithi046.stdout:4/386: dread d7/df/d53/f6e [0,4194304] 0 2024-05-09T06:30:40.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/284: creat d4/d5/f56 x:0 0 0 2024-05-09T06:30:40.832 INFO:tasks.workunit.client.0.smithi046.stdout:3/285: getdents d4/d20/d24 0 2024-05-09T06:30:40.834 INFO:tasks.workunit.client.0.smithi046.stdout:4/387: dread d7/fa [0,4194304] 0 2024-05-09T06:30:40.836 INFO:tasks.workunit.client.0.smithi046.stdout:3/286: symlink d4/d20/d24/d29/d2b/l57 0 2024-05-09T06:30:40.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/392: write d1/d7/f34 [2441840,128508] 0 2024-05-09T06:30:40.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/393: fdatasync d1/d7/d12/d1d/d30/d38/f42 0 2024-05-09T06:30:40.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/394: readlink d1/d7/d12/d45/l66 0 2024-05-09T06:30:40.837 INFO:tasks.workunit.client.0.smithi046.stdout:4/388: mkdir d7/df/d84 0 2024-05-09T06:30:40.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/287: mkdir d4/d20/d24/d2a/d4e/d58 0 2024-05-09T06:30:40.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/288: dread - d4/f3d zero size 2024-05-09T06:30:40.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/389: unlink d7/df/d53/f6a 0 2024-05-09T06:30:40.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/390: creat d7/df/d3a/d45/f85 x:0 0 0 2024-05-09T06:30:40.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/391: chown d7/df/d10/d2f/l56 3449 1 2024-05-09T06:30:40.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/392: getdents d7/df/d84 0 2024-05-09T06:30:40.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/393: fdatasync d7/df/d10/f73 0 2024-05-09T06:30:40.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/289: mkdir d4/d20/d24/d59 0 2024-05-09T06:30:40.842 INFO:tasks.workunit.client.0.smithi046.stdout:8/395: dread d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:40.843 INFO:tasks.workunit.client.0.smithi046.stdout:4/394: mkdir d7/df/d3a/d25/d86 0 2024-05-09T06:30:40.845 INFO:tasks.workunit.client.0.smithi046.stdout:3/290: symlink d4/d48/d49/l5a 0 2024-05-09T06:30:40.845 INFO:tasks.workunit.client.0.smithi046.stdout:1/320: dwrite d7/fc [4194304,4194304] 0 2024-05-09T06:30:40.846 INFO:tasks.workunit.client.0.smithi046.stdout:8/396: creat d1/db/f71 x:0 0 0 2024-05-09T06:30:40.846 INFO:tasks.workunit.client.0.smithi046.stdout:8/397: chown d1/db/dd/d14 96 1 2024-05-09T06:30:40.846 INFO:tasks.workunit.client.0.smithi046.stdout:8/398: stat d1/d7/d12 0 2024-05-09T06:30:40.846 INFO:tasks.workunit.client.0.smithi046.stdout:8/399: write d1/d7/d12/d1d/d30/d38/f42 [1011613,7312] 0 2024-05-09T06:30:40.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/269: dwrite d2/d26/f43 [0,4194304] 0 2024-05-09T06:30:40.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/376: dwrite d3/f6 [0,4194304] 0 2024-05-09T06:30:40.847 INFO:tasks.workunit.client.0.smithi046.stdout:4/395: mkdir d7/df/d10/d1d/d77/d87 0 2024-05-09T06:30:40.847 INFO:tasks.workunit.client.0.smithi046.stdout:2/374: dwrite da/de/d14/f58 [0,4194304] 0 2024-05-09T06:30:40.848 INFO:tasks.workunit.client.0.smithi046.stdout:1/321: getdents d7/d10/d28/d30/d3a 0 2024-05-09T06:30:40.850 INFO:tasks.workunit.client.0.smithi046.stdout:8/400: read d1/f33 [205241,92988] 0 2024-05-09T06:30:40.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/400: dwrite d11/d18/d27/d28/d2d/d5c/f72 [0,4194304] 0 2024-05-09T06:30:40.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/377: mknod d3/d3d/d72/d79/c7c 0 2024-05-09T06:30:40.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/378: write d3/d7/d28/f50 [1519173,123740] 0 2024-05-09T06:30:40.853 INFO:tasks.workunit.client.0.smithi046.stdout:7/379: dread - d3/d7/dd/f59 zero size 2024-05-09T06:30:40.854 INFO:tasks.workunit.client.0.smithi046.stdout:4/396: creat d7/df/d3a/d25/d86/f88 x:0 0 0 2024-05-09T06:30:40.854 INFO:tasks.workunit.client.0.smithi046.stdout:4/397: write d7/df/d10/f79 [874916,109750] 0 2024-05-09T06:30:40.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/291: write d4/d20/f25 [6304736,67369] 0 2024-05-09T06:30:40.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/292: write d4/d48/d49/f54 [219366,100706] 0 2024-05-09T06:30:40.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/293: chown d4/d5/f43 96 1 2024-05-09T06:30:40.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/294: write d4/d5/f3a [2610861,123692] 0 2024-05-09T06:30:40.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/401: truncate d1/d7/f31 478811 0 2024-05-09T06:30:40.865 INFO:tasks.workunit.client.0.smithi046.stdout:0/401: dread d11/d18/f1a [4194304,4194304] 0 2024-05-09T06:30:40.865 INFO:tasks.workunit.client.0.smithi046.stdout:7/380: truncate d3/f1d 1474260 0 2024-05-09T06:30:40.865 INFO:tasks.workunit.client.0.smithi046.stdout:7/381: dread - d3/d7/d28/d29/d35/f78 zero size 2024-05-09T06:30:40.870 INFO:tasks.workunit.client.0.smithi046.stdout:2/375: read da/db/f4c [1658973,10263] 0 2024-05-09T06:30:40.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/270: dwrite d2/d26/d2c/f3b [0,4194304] 0 2024-05-09T06:30:40.875 INFO:tasks.workunit.client.0.smithi046.stdout:3/295: creat d4/d20/d24/d2a/d46/f5b x:0 0 0 2024-05-09T06:30:40.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/402: dwrite fc [4194304,4194304] 0 2024-05-09T06:30:40.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/271: write d2/d6/f22 [1894843,99152] 0 2024-05-09T06:30:40.885 INFO:tasks.workunit.client.0.smithi046.stdout:7/382: link d3/d3d/f47 d3/d7/d28/d29/d3b/f7d 0 2024-05-09T06:30:40.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/296: dread d4/d20/d24/f1b [0,4194304] 0 2024-05-09T06:30:40.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/297: truncate d4/f3d 619680 0 2024-05-09T06:30:40.889 INFO:tasks.workunit.client.0.smithi046.stdout:2/376: symlink da/d2d/l7a 0 2024-05-09T06:30:40.890 INFO:tasks.workunit.client.0.smithi046.stdout:2/377: truncate da/d2d/f42 1003811 0 2024-05-09T06:30:40.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/398: rmdir d7/df/d53 39 2024-05-09T06:30:40.892 INFO:tasks.workunit.client.0.smithi046.stdout:7/383: dread d3/d7/f2d [0,4194304] 0 2024-05-09T06:30:40.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/402: rmdir d1/db/d67 39 2024-05-09T06:30:40.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/403: creat d1/db/dd/d11/f72 x:0 0 0 2024-05-09T06:30:40.899 INFO:tasks.workunit.client.0.smithi046.stdout:0/403: rmdir d11 39 2024-05-09T06:30:40.899 INFO:tasks.workunit.client.0.smithi046.stdout:0/404: chown d11/d18/d1c/d53/f61 14 1 2024-05-09T06:30:40.899 INFO:tasks.workunit.client.0.smithi046.stdout:0/405: write d11/d18/d27/d28/d2d/f4c [543980,83446] 0 2024-05-09T06:30:40.899 INFO:tasks.workunit.client.0.smithi046.stdout:0/406: fdatasync d11/d18/d27/d28/d2d/f4a 0 2024-05-09T06:30:40.903 INFO:tasks.workunit.client.0.smithi046.stdout:9/272: rename d2/d6/d7/d1a/f35 to d2/dc/f55 0 2024-05-09T06:30:40.906 INFO:tasks.workunit.client.0.smithi046.stdout:3/298: truncate d4/d20/d24/d2a/f2d 2643698 0 2024-05-09T06:30:40.907 INFO:tasks.workunit.client.0.smithi046.stdout:7/384: getdents d3/d7/d4c 0 2024-05-09T06:30:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:0/407: link d11/c19 d11/d4f/d5b/d5f/c89 0 2024-05-09T06:30:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/378: rename da/dc/l12 to da/de/d54/d65/d70/l7b 0 2024-05-09T06:30:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/379: fdatasync da/de/d54/f67 0 2024-05-09T06:30:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/380: write da/de/d14/d1f/d3b/f37 [2276005,56926] 0 2024-05-09T06:30:40.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/408: symlink d11/d18/d1c/d53/l8a 0 2024-05-09T06:30:40.920 INFO:tasks.workunit.client.0.smithi046.stdout:3/299: dread d4/d20/d24/f1b [4194304,4194304] 0 2024-05-09T06:30:40.923 INFO:tasks.workunit.client.0.smithi046.stdout:4/399: rename d7/df/d3a/d45/f63 to d7/df/d10/d2f/f89 0 2024-05-09T06:30:40.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/300: mkdir d4/d20/d24/d29/d2b/d3e/d5c 0 2024-05-09T06:30:40.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/404: dwrite d1/db/d67/f6a [0,4194304] 0 2024-05-09T06:30:40.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/301: dread d4/d20/d24/f1b [0,4194304] 0 2024-05-09T06:30:40.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/302: mkdir d4/d5d 0 2024-05-09T06:30:40.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/303: unlink d4/d20/d24/f1b 0 2024-05-09T06:30:40.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/304: creat d4/d20/d24/d2a/d46/f5e x:0 0 0 2024-05-09T06:30:40.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/305: getdents d4/d5d 0 2024-05-09T06:30:40.936 INFO:tasks.workunit.client.0.smithi046.stdout:8/405: dread d1/d7/d12/f5e [0,4194304] 0 2024-05-09T06:30:40.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/406: truncate d1/d7/d12/d1d/d30/d38/f42 1810178 0 2024-05-09T06:30:40.937 INFO:tasks.workunit.client.0.smithi046.stdout:2/381: dread f8 [0,4194304] 0 2024-05-09T06:30:40.937 INFO:tasks.workunit.client.0.smithi046.stdout:9/273: dwrite d2/d6/d7/d1a/d27/f37 [0,4194304] 0 2024-05-09T06:30:40.937 INFO:tasks.workunit.client.0.smithi046.stdout:9/274: chown d2/d6/f25 31387701 1 2024-05-09T06:30:40.939 INFO:tasks.workunit.client.0.smithi046.stdout:3/306: readlink d4/d5/l1f 0 2024-05-09T06:30:40.941 INFO:tasks.workunit.client.0.smithi046.stdout:0/409: dread d11/d18/d27/d28/d6b/f77 [0,4194304] 0 2024-05-09T06:30:40.941 INFO:tasks.workunit.client.0.smithi046.stdout:0/410: fdatasync d11/d18/f1a 0 2024-05-09T06:30:40.941 INFO:tasks.workunit.client.0.smithi046.stdout:8/407: symlink d1/d7/d12/d1d/d30/d38/l73 0 2024-05-09T06:30:40.941 INFO:tasks.workunit.client.0.smithi046.stdout:8/408: write d1/db/f71 [605591,47997] 0 2024-05-09T06:30:40.941 INFO:tasks.workunit.client.0.smithi046.stdout:8/409: fdatasync d1/d7/d12/d45/f5f 0 2024-05-09T06:30:40.947 INFO:tasks.workunit.client.0.smithi046.stdout:9/275: mkdir d2/d6/d7/d1a/d27/d56 0 2024-05-09T06:30:40.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/307: symlink d4/d20/d24/d2a/d46/l5f 0 2024-05-09T06:30:40.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/308: readlink l2 0 2024-05-09T06:30:40.952 INFO:tasks.workunit.client.0.smithi046.stdout:0/411: link d11/d3f/f5d d11/d18/d27/d28/d6b/f8b 0 2024-05-09T06:30:40.954 INFO:tasks.workunit.client.0.smithi046.stdout:7/385: dwrite d3/d7/d28/f50 [0,4194304] 0 2024-05-09T06:30:40.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/382: dwrite da/dc/f56 [0,4194304] 0 2024-05-09T06:30:40.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/383: fsync da/de/d14/d1f/d20/f3c 0 2024-05-09T06:30:40.959 INFO:tasks.workunit.client.0.smithi046.stdout:9/276: link d2/d6/d38/c40 d2/dc/d32/c57 0 2024-05-09T06:30:40.959 INFO:tasks.workunit.client.0.smithi046.stdout:9/277: write d2/dc/f41 [871615,61162] 0 2024-05-09T06:30:40.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/386: link d3/d7/d28/f33 d3/d7/d28/d29/d3b/f7e 0 2024-05-09T06:30:40.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/387: fsync d3/d7/d28/f66 0 2024-05-09T06:30:40.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/388: write d3/f1e [838743,77417] 0 2024-05-09T06:30:40.973 INFO:tasks.workunit.client.0.smithi046.stdout:2/384: mkdir da/de/d14/d1f/d20/d7c 0 2024-05-09T06:30:40.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/410: dwrite d1/d7/f68 [0,4194304] 0 2024-05-09T06:30:40.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/309: dwrite d4/d20/d24/f38 [0,4194304] 0 2024-05-09T06:30:40.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/310: getdents d4/d20/d24/d59 0 2024-05-09T06:30:40.977 INFO:tasks.workunit.client.0.smithi046.stdout:2/385: rename da/de/d14/d1f/d3b/d62 to da/db/d7d 0 2024-05-09T06:30:40.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/400: dwrite d7/df/d10/d2f/d30/f67 [0,4194304] 0 2024-05-09T06:30:40.980 INFO:tasks.workunit.client.0.smithi046.stdout:7/389: fdatasync d3/d7/dd/f44 0 2024-05-09T06:30:40.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/412: dwrite d11/d18/d1c/d53/f7d [0,4194304] 0 2024-05-09T06:30:40.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/278: dwrite d2/d6/d7/d1a/d27/f37 [0,4194304] 0 2024-05-09T06:30:40.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/279: fsync d2/d6/d7/d1a/d27/f34 0 2024-05-09T06:30:40.981 INFO:tasks.workunit.client.0.smithi046.stdout:7/390: write d3/d7/dd/f68 [103367,121859] 0 2024-05-09T06:30:40.983 INFO:tasks.workunit.client.0.smithi046.stdout:8/411: mknod d1/d7/d12/d45/c74 0 2024-05-09T06:30:40.986 INFO:tasks.workunit.client.0.smithi046.stdout:4/401: dread d7/df/f1b [0,4194304] 0 2024-05-09T06:30:40.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/412: dread d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:40.989 INFO:tasks.workunit.client.0.smithi046.stdout:3/311: mkdir d4/d5d/d60 0 2024-05-09T06:30:40.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/386: link da/de/d14/d1f/d20/d5c/f61 da/de/f7e 0 2024-05-09T06:30:40.995 INFO:tasks.workunit.client.0.smithi046.stdout:4/402: dread f1 [4194304,4194304] 0 2024-05-09T06:30:40.997 INFO:tasks.workunit.client.0.smithi046.stdout:0/413: dwrite d11/d18/d1c/f44 [0,4194304] 0 2024-05-09T06:30:41.008 INFO:tasks.workunit.client.0.smithi046.stdout:7/391: rename d3/d3d/c63 to d3/d7/d4c/d4f/c7f 0 2024-05-09T06:30:41.009 INFO:tasks.workunit.client.0.smithi046.stdout:7/392: write d3/d7/dd/f68 [372576,106575] 0 2024-05-09T06:30:41.009 INFO:tasks.workunit.client.0.smithi046.stdout:8/413: mknod d1/d7/c75 0 2024-05-09T06:30:41.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/387: mknod da/de/d14/d1f/d20/d5c/c7f 0 2024-05-09T06:30:41.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/388: chown da/de/d54 7312043 1 2024-05-09T06:30:41.012 INFO:tasks.workunit.client.0.smithi046.stdout:4/403: mknod d7/df/d10/d2f/c8a 0 2024-05-09T06:30:41.012 INFO:tasks.workunit.client.0.smithi046.stdout:8/414: dread d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:41.012 INFO:tasks.workunit.client.0.smithi046.stdout:8/415: chown d1/db/dd/d11/d5d/f6b 235 1 2024-05-09T06:30:41.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/416: write d1/db/dd/f1a [1183844,71448] 0 2024-05-09T06:30:41.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/417: fdatasync d1/d7/f34 0 2024-05-09T06:30:41.031 INFO:tasks.workunit.client.0.smithi046.stdout:0/414: creat d11/d18/f8c x:0 0 0 2024-05-09T06:30:41.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/415: write d11/d18/d1c/d53/f6a [123630,58238] 0 2024-05-09T06:30:41.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/416: fsync d11/f14 0 2024-05-09T06:30:41.043 INFO:tasks.workunit.client.0.smithi046.stdout:7/393: unlink d3/d7/f9 0 2024-05-09T06:30:41.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/389: symlink da/de/d14/d1f/l80 0 2024-05-09T06:30:41.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/390: creat da/dc/f81 x:0 0 0 2024-05-09T06:30:41.045 INFO:tasks.workunit.client.0.smithi046.stdout:4/404: getdents d7 0 2024-05-09T06:30:41.048 INFO:tasks.workunit.client.0.smithi046.stdout:0/417: dwrite d11/d18/f1b [0,4194304] 0 2024-05-09T06:30:41.049 INFO:tasks.workunit.client.0.smithi046.stdout:0/418: dread - d11/d18/d27/d28/f85 zero size 2024-05-09T06:30:41.049 INFO:tasks.workunit.client.0.smithi046.stdout:0/419: creat d11/d18/d27/d28/d36/d5a/f8d x:0 0 0 2024-05-09T06:30:41.049 INFO:tasks.workunit.client.0.smithi046.stdout:0/420: chown d11/d4f 63 1 2024-05-09T06:30:41.049 INFO:tasks.workunit.client.0.smithi046.stdout:8/418: link d1/d7/f31 d1/db/dd/f76 0 2024-05-09T06:30:41.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/394: symlink d3/d7/d28/d29/d3b/l80 0 2024-05-09T06:30:41.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/391: link da/de/d1c/f6a da/de/d1c/f82 0 2024-05-09T06:30:41.055 INFO:tasks.workunit.client.0.smithi046.stdout:8/419: write d1/d7/d2c/f58 [1307304,122176] 0 2024-05-09T06:30:41.056 INFO:tasks.workunit.client.0.smithi046.stdout:8/420: creat d1/db/dd/d11/d5d/f77 x:0 0 0 2024-05-09T06:30:41.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/405: write d7/df/d3a/d25/f4e [3556645,42436] 0 2024-05-09T06:30:41.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/406: fdatasync d7/fc 0 2024-05-09T06:30:41.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/407: write d7/df/d3a/d25/f4e [3296899,46072] 0 2024-05-09T06:30:41.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/421: mknod d11/d18/c8e 0 2024-05-09T06:30:41.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/422: fsync d11/d18/d1c/d53/f7d 0 2024-05-09T06:30:41.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/423: creat d11/d18/d27/d28/d2d/d5c/f8f x:0 0 0 2024-05-09T06:30:41.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/395: dread d3/d7/d28/f24 [0,4194304] 0 2024-05-09T06:30:41.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/396: stat d3/d7/dd/f34 0 2024-05-09T06:30:41.066 INFO:tasks.workunit.client.0.smithi046.stdout:8/421: link d1/d7/c3a d1/db/dd/d14/c78 0 2024-05-09T06:30:41.066 INFO:tasks.workunit.client.0.smithi046.stdout:8/422: chown d1/db/dd/f1a 1872 1 2024-05-09T06:30:41.068 INFO:tasks.workunit.client.0.smithi046.stdout:9/280: truncate d2/d6/d7/d1a/d27/f37 3524985 0 2024-05-09T06:30:41.069 INFO:tasks.workunit.client.0.smithi046.stdout:9/281: creat d2/d6/d7/d1e/f58 x:0 0 0 2024-05-09T06:30:41.069 INFO:tasks.workunit.client.0.smithi046.stdout:9/282: write d2/d6/f22 [3545844,36469] 0 2024-05-09T06:30:41.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/408: mknod d7/df/d3a/d25/d81/c8b 0 2024-05-09T06:30:41.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/409: readlink d7/df/d10/d2f/l3d 0 2024-05-09T06:30:41.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/397: mkdir d3/d3d/d72/d79/d81 0 2024-05-09T06:30:41.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/423: link d1/d7/d2c/f15 d1/d7/d12/f79 0 2024-05-09T06:30:41.077 INFO:tasks.workunit.client.0.smithi046.stdout:4/410: symlink d7/df/d3a/d25/l8c 0 2024-05-09T06:30:41.078 INFO:tasks.workunit.client.0.smithi046.stdout:8/424: dread d1/db/dd/d11/d43/f4b [0,4194304] 0 2024-05-09T06:30:41.078 INFO:tasks.workunit.client.0.smithi046.stdout:8/425: read - d1/db/dd/d11/f5c zero size 2024-05-09T06:30:41.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/398: mkdir d3/d7/d28/d29/d82 0 2024-05-09T06:30:41.080 INFO:tasks.workunit.client.0.smithi046.stdout:8/426: dread d1/d7/f31 [0,4194304] 0 2024-05-09T06:30:41.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/399: rmdir d3/d7/dd/d3e 39 2024-05-09T06:30:41.082 INFO:tasks.workunit.client.0.smithi046.stdout:7/400: symlink d3/d7/d28/d73/l83 0 2024-05-09T06:30:41.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/401: mkdir d3/d3d/d5b/d84 0 2024-05-09T06:30:41.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/402: dread - d3/d7/f52 zero size 2024-05-09T06:30:41.086 INFO:tasks.workunit.client.0.smithi046.stdout:7/403: creat d3/f85 x:0 0 0 2024-05-09T06:30:41.089 INFO:tasks.workunit.client.0.smithi046.stdout:7/404: unlink d3/c25 0 2024-05-09T06:30:41.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/405: symlink d3/d7/d28/d29/l86 0 2024-05-09T06:30:41.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/406: readlink d3/d7/l42 0 2024-05-09T06:30:41.109 INFO:tasks.workunit.client.0.smithi046.stdout:7/407: dwrite d3/d7/d28/d29/d3b/f7d [0,4194304] 0 2024-05-09T06:30:41.116 INFO:tasks.workunit.client.0.smithi046.stdout:7/408: read d3/f6 [1749283,42584] 0 2024-05-09T06:30:41.117 INFO:tasks.workunit.client.0.smithi046.stdout:7/409: mknod d3/c87 0 2024-05-09T06:30:41.157 INFO:tasks.workunit.client.0.smithi046.stdout:2/392: dwrite da/dc/f81 [0,4194304] 0 2024-05-09T06:30:41.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/410: getdents d3/d3d/d72/d79 0 2024-05-09T06:30:41.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/283: dwrite d2/d6/d38/f48 [4194304,4194304] 0 2024-05-09T06:30:41.163 INFO:tasks.workunit.client.0.smithi046.stdout:8/427: dwrite d1/d7/d12/d1d/d30/d38/f54 [0,4194304] 0 2024-05-09T06:30:41.165 INFO:tasks.workunit.client.0.smithi046.stdout:8/428: dread d1/d7/d12/d1d/d30/d38/f46 [0,4194304] 0 2024-05-09T06:30:41.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/393: dwrite da/dc/f13 [4194304,4194304] 0 2024-05-09T06:30:41.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/411: creat d3/d7/d28/d73/f88 x:0 0 0 2024-05-09T06:30:41.184 INFO:tasks.workunit.client.0.smithi046.stdout:9/284: truncate d2/dc/f55 4515561 0 2024-05-09T06:30:41.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/412: creat d3/d3d/d72/f89 x:0 0 0 2024-05-09T06:30:41.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/413: fdatasync d3/d7/d28/d29/f2e 0 2024-05-09T06:30:41.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/414: getdents d3/d3d/d72/d79 0 2024-05-09T06:30:41.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/415: write d3/d7/d28/d29/d35/d5c/f61 [741960,99287] 0 2024-05-09T06:30:41.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/416: rename d3/d3d/d5b to d3/d3d/d5b/d8a 22 2024-05-09T06:30:41.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/417: chown d3/d7/d28/d29/l39 8475911 1 2024-05-09T06:30:41.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/429: getdents d1/db/d41 0 2024-05-09T06:30:41.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/430: fdatasync d1/d7/d12/f5e 0 2024-05-09T06:30:41.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/431: read d1/db/f28 [5944869,111295] 0 2024-05-09T06:30:41.194 INFO:tasks.workunit.client.0.smithi046.stdout:7/418: creat d3/d6f/f8b x:0 0 0 2024-05-09T06:30:41.196 INFO:tasks.workunit.client.0.smithi046.stdout:8/432: creat d1/f7a x:0 0 0 2024-05-09T06:30:41.196 INFO:tasks.workunit.client.0.smithi046.stdout:8/433: write d1/db/dd/d11/d5d/f77 [49208,26691] 0 2024-05-09T06:30:41.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/434: unlink d1/db/d67/f6a 0 2024-05-09T06:30:41.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/435: fdatasync d1/db/f71 0 2024-05-09T06:30:41.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/436: link d1/d7/d12/d1d/d30/d38/l73 d1/d7/d12/d45/l7b 0 2024-05-09T06:30:41.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/437: fsync d1/d7/d12/f1f 0 2024-05-09T06:30:41.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/438: fsync d1/d7/f34 0 2024-05-09T06:30:41.201 INFO:tasks.workunit.client.0.smithi046.stdout:8/439: creat d1/db/dd/d14/f7c x:0 0 0 2024-05-09T06:30:41.201 INFO:tasks.workunit.client.0.smithi046.stdout:8/440: truncate d1/d7/d12/f5a 1680765 0 2024-05-09T06:30:41.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/441: creat d1/db/dd/f7d x:0 0 0 2024-05-09T06:30:41.205 INFO:tasks.workunit.client.0.smithi046.stdout:8/442: link d1/db/f71 d1/db/d67/f7e 0 2024-05-09T06:30:41.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/443: unlink d1/db/dd/d11/d5d/f61 0 2024-05-09T06:30:41.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/444: chown d1/d7/d12/d1d/d30/d38/l4f 456 1 2024-05-09T06:30:41.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/445: readlink d1/d7/d12/d1d/d30/l64 0 2024-05-09T06:30:41.210 INFO:tasks.workunit.client.0.smithi046.stdout:7/419: dwrite d3/d7/d28/d29/f45 [8388608,4194304] 0 2024-05-09T06:30:41.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/420: dread - d3/d7/d28/d73/f88 zero size 2024-05-09T06:30:41.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/421: write d3/d7/d28/d29/f53 [304039,20108] 0 2024-05-09T06:30:41.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/422: creat d3/d7/d28/d29/d35/d5c/f8c x:0 0 0 2024-05-09T06:30:41.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/423: creat d3/d6f/f8d x:0 0 0 2024-05-09T06:30:41.243 INFO:tasks.workunit.client.0.smithi046.stdout:7/424: dwrite d3/d7/d28/d29/d3b/f7e [4194304,4194304] 0 2024-05-09T06:30:41.246 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:41 smithi046 ceph-mon[26924]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 225 MiB/s rd, 290 MiB/s wr, 390 op/s 2024-05-09T06:30:41.248 INFO:tasks.workunit.client.0.smithi046.stdout:7/425: getdents d3/d3d/d5b 0 2024-05-09T06:30:41.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/426: rmdir d3/d7/dd/d3e 39 2024-05-09T06:30:41.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/427: mkdir d3/d7/d8e 0 2024-05-09T06:30:41.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/428: write d3/d7/f52 [530036,12083] 0 2024-05-09T06:30:41.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/429: chown d3/d7/d28/d29/d3b/f4a 96 1 2024-05-09T06:30:41.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/430: chown d3/d3d/c4e 35 1 2024-05-09T06:30:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/431: dread d3/d7/f52 [0,4194304] 0 2024-05-09T06:30:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/432: stat d3/d6f/f8b 0 2024-05-09T06:30:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/433: chown d3/d6f/c74 599272 1 2024-05-09T06:30:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/434: creat d3/f8f x:0 0 0 2024-05-09T06:30:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/435: write d3/d7/d28/d29/d3b/f7d [4555684,94873] 0 2024-05-09T06:30:41.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/436: readlink d3/l13 0 2024-05-09T06:30:41.262 INFO:tasks.workunit.client.0.smithi046.stdout:7/437: rmdir d3/d7/dd/d3e 39 2024-05-09T06:30:41.281 INFO:tasks.workunit.client.0.smithi046.stdout:7/438: dwrite d3/d7/d28/d29/d3b/f7d [0,4194304] 0 2024-05-09T06:30:41.284 INFO:tasks.workunit.client.0.smithi046.stdout:7/439: creat d3/d7/d28/d29/d82/f90 x:0 0 0 2024-05-09T06:30:41.286 INFO:tasks.workunit.client.0.smithi046.stdout:7/440: creat d3/d7/dd/d3e/f91 x:0 0 0 2024-05-09T06:30:41.289 INFO:tasks.workunit.client.0.smithi046.stdout:7/441: creat d3/d7/d4c/f92 x:0 0 0 2024-05-09T06:30:41.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/442: rename d3/d7/d28/f36 to d3/d7/d8e/f93 0 2024-05-09T06:30:41.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/443: fsync d3/d7/d28/f33 0 2024-05-09T06:30:41.298 INFO:tasks.workunit.client.0.smithi046.stdout:7/444: getdents d3/d7/dd 0 2024-05-09T06:30:41.301 INFO:tasks.workunit.client.0.smithi046.stdout:7/445: mkdir d3/d3d/d72/d94 0 2024-05-09T06:30:41.301 INFO:tasks.workunit.client.0.smithi046.stdout:7/446: stat d3/d7/d28/d29/d3b/f3f 0 2024-05-09T06:30:41.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/447: write d3/d7/d28/d29/d35/f6d [1071079,98077] 0 2024-05-09T06:30:41.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/448: write d3/d3d/f41 [4640610,2225] 0 2024-05-09T06:30:41.310 INFO:tasks.workunit.client.0.smithi046.stdout:7/449: write d3/d7/d4c/f92 [231409,43594] 0 2024-05-09T06:30:41.384 INFO:tasks.workunit.client.0.smithi046.stdout:7/450: symlink d3/d6f/l95 0 2024-05-09T06:30:41.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/451: rename d3/d7/d28/d29/d3b/f6e to d3/d7/f96 0 2024-05-09T06:30:41.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/452: mknod d3/d3d/d72/d79/d81/c97 0 2024-05-09T06:30:41.399 INFO:tasks.workunit.client.0.smithi046.stdout:7/453: write d3/d7/d28/d29/d3b/f7d [3140279,82459] 0 2024-05-09T06:30:41.400 INFO:tasks.workunit.client.0.smithi046.stdout:7/454: unlink d3/d7/d28/d29/f30 0 2024-05-09T06:30:41.420 INFO:tasks.workunit.client.0.smithi046.stdout:7/455: dwrite d3/d7/dd/f59 [0,4194304] 0 2024-05-09T06:30:41.422 INFO:tasks.workunit.client.0.smithi046.stdout:5/379: sync 2024-05-09T06:30:41.422 INFO:tasks.workunit.client.0.smithi046.stdout:6/508: sync 2024-05-09T06:30:41.434 INFO:tasks.workunit.client.0.smithi046.stdout:5/380: read d0/d3e/f3f [2613288,33098] 0 2024-05-09T06:30:41.440 INFO:tasks.workunit.client.0.smithi046.stdout:6/509: dwrite db/d10/d3f/d44/f5f [0,4194304] 0 2024-05-09T06:30:41.444 INFO:tasks.workunit.client.0.smithi046.stdout:6/510: rename db/d10/d30/d53/f8c to db/d10/d3f/d4f/fa9 0 2024-05-09T06:30:41.449 INFO:tasks.workunit.client.0.smithi046.stdout:5/381: dwrite d0/f6a [0,4194304] 0 2024-05-09T06:30:41.454 INFO:tasks.workunit.client.0.smithi046.stdout:5/382: mknod d0/d3e/c7e 0 2024-05-09T06:30:41.454 INFO:tasks.workunit.client.0.smithi046.stdout:5/383: readlink d0/d1b/l61 0 2024-05-09T06:30:41.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/384: mknod d0/d1b/c7f 0 2024-05-09T06:30:41.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/385: mknod d0/d1b/d21/c80 0 2024-05-09T06:30:41.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/511: dwrite db/d10/f16 [4194304,4194304] 0 2024-05-09T06:30:41.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/512: chown db/d10/d30/f77 8981 1 2024-05-09T06:30:41.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/386: mkdir d0/d1b/d21/d81 0 2024-05-09T06:30:41.485 INFO:tasks.workunit.client.0.smithi046.stdout:6/513: dwrite db/d10/d3f/d44/d5e/f88 [0,4194304] 0 2024-05-09T06:30:41.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/387: dwrite d0/d3e/f3f [0,4194304] 0 2024-05-09T06:30:41.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/388: write d0/f2d [1241903,117596] 0 2024-05-09T06:30:41.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/514: mknod db/d10/d19/d66/caa 0 2024-05-09T06:30:41.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/515: chown f6 2087577 1 2024-05-09T06:30:41.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/516: fsync db/d10/d3c/f69 0 2024-05-09T06:30:41.505 INFO:tasks.workunit.client.0.smithi046.stdout:5/389: link d0/f1 d0/d1b/f82 0 2024-05-09T06:30:41.505 INFO:tasks.workunit.client.0.smithi046.stdout:5/390: readlink d0/d1b/d39/l45 0 2024-05-09T06:30:41.507 INFO:tasks.workunit.client.0.smithi046.stdout:6/517: rmdir db/d10/d76 39 2024-05-09T06:30:41.511 INFO:tasks.workunit.client.0.smithi046.stdout:5/391: dread d0/f16 [0,4194304] 0 2024-05-09T06:30:41.522 INFO:tasks.workunit.client.0.smithi046.stdout:5/392: dread d0/f2d [0,4194304] 0 2024-05-09T06:30:41.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/393: mkdir d0/d3e/d83 0 2024-05-09T06:30:41.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/518: dwrite db/d10/d3f/d44/d46/f4d [0,4194304] 0 2024-05-09T06:30:41.528 INFO:tasks.workunit.client.0.smithi046.stdout:5/394: rename d0/d3e/f4a to d0/d1b/d21/f84 0 2024-05-09T06:30:41.528 INFO:tasks.workunit.client.0.smithi046.stdout:5/395: chown d0/d1b/d39/f60 425 1 2024-05-09T06:30:41.528 INFO:tasks.workunit.client.0.smithi046.stdout:5/396: readlink d0/l10 0 2024-05-09T06:30:41.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/519: dread db/d10/f1e [0,4194304] 0 2024-05-09T06:30:41.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/520: truncate db/d10/d3f/d44/d5e/f84 3934068 0 2024-05-09T06:30:41.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/521: dread db/f14 [4194304,4194304] 0 2024-05-09T06:30:41.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/397: dwrite d0/d3e/d53/f6f [0,4194304] 0 2024-05-09T06:30:41.557 INFO:tasks.workunit.client.0.smithi046.stdout:5/398: dwrite d0/d1b/d21/f79 [0,4194304] 0 2024-05-09T06:30:41.557 INFO:tasks.workunit.client.0.smithi046.stdout:5/399: truncate d0/d1b/f30 4677717 0 2024-05-09T06:30:41.561 INFO:tasks.workunit.client.0.smithi046.stdout:1/322: sync 2024-05-09T06:30:41.567 INFO:tasks.workunit.client.0.smithi046.stdout:5/400: rename d0/f75 to d0/d1b/d21/f85 0 2024-05-09T06:30:41.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:41 smithi106 ceph-mon[34679]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 225 MiB/s rd, 290 MiB/s wr, 390 op/s 2024-05-09T06:30:41.576 INFO:tasks.workunit.client.0.smithi046.stdout:5/401: read d0/f1 [428376,52201] 0 2024-05-09T06:30:41.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/323: dwrite d7/fc [0,4194304] 0 2024-05-09T06:30:41.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/402: dread d0/d1b/f35 [0,4194304] 0 2024-05-09T06:30:41.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/403: creat d0/d58/d7a/f86 x:0 0 0 2024-05-09T06:30:41.586 INFO:tasks.workunit.client.0.smithi046.stdout:1/324: creat d7/d10/d28/d30/f65 x:0 0 0 2024-05-09T06:30:41.588 INFO:tasks.workunit.client.0.smithi046.stdout:1/325: symlink d7/d10/d34/d46/l66 0 2024-05-09T06:30:41.590 INFO:tasks.workunit.client.0.smithi046.stdout:1/326: creat d7/d10/d28/d30/d3a/f67 x:0 0 0 2024-05-09T06:30:41.592 INFO:tasks.workunit.client.0.smithi046.stdout:1/327: rename d7/d10/f12 to d7/d10/d34/f68 0 2024-05-09T06:30:41.607 INFO:tasks.workunit.client.0.smithi046.stdout:1/328: dwrite d7/d10/d28/d30/d3a/f58 [0,4194304] 0 2024-05-09T06:30:41.607 INFO:tasks.workunit.client.0.smithi046.stdout:1/329: fdatasync d7/d10/d28/f50 0 2024-05-09T06:30:41.610 INFO:tasks.workunit.client.0.smithi046.stdout:1/330: symlink d7/d10/d34/d46/l69 0 2024-05-09T06:30:41.611 INFO:tasks.workunit.client.0.smithi046.stdout:1/331: creat d7/d10/d28/d55/f6a x:0 0 0 2024-05-09T06:30:41.611 INFO:tasks.workunit.client.0.smithi046.stdout:1/332: chown d7/d10/d28/d30/d3a 9 1 2024-05-09T06:30:41.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/333: dwrite d7/d10/f13 [0,4194304] 0 2024-05-09T06:30:41.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/334: dread d7/f42 [0,4194304] 0 2024-05-09T06:30:41.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/335: mknod d7/d10/d28/d30/d3a/c6b 0 2024-05-09T06:30:41.633 INFO:tasks.workunit.client.0.smithi046.stdout:1/336: chown d7/d10/d28/d30/f65 40231 1 2024-05-09T06:30:41.654 INFO:tasks.workunit.client.0.smithi046.stdout:1/337: dwrite d7/d10/d28/d55/f56 [0,4194304] 0 2024-05-09T06:30:41.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/338: creat d7/d10/f6c x:0 0 0 2024-05-09T06:30:41.658 INFO:tasks.workunit.client.0.smithi046.stdout:1/339: rmdir d7/d10/d34 39 2024-05-09T06:30:41.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/340: rmdir d7/d10/d28 39 2024-05-09T06:30:41.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/341: mkdir d7/d6d 0 2024-05-09T06:30:41.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/342: dread d7/f42 [0,4194304] 0 2024-05-09T06:30:41.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/343: truncate d7/d10/d28/d30/d3a/f5d 857933 0 2024-05-09T06:30:41.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/344: stat d7/d10/f6c 0 2024-05-09T06:30:41.682 INFO:tasks.workunit.client.0.smithi046.stdout:1/345: dwrite d7/d10/d28/f59 [0,4194304] 0 2024-05-09T06:30:41.704 INFO:tasks.workunit.client.0.smithi046.stdout:1/346: dwrite d7/d10/d28/f33 [0,4194304] 0 2024-05-09T06:30:41.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/347: creat d7/d10/d34/f6e x:0 0 0 2024-05-09T06:30:41.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/348: chown d7/d10/d34/d46/l5f 1481 1 2024-05-09T06:30:41.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/349: creat d7/d10/d28/d55/f6f x:0 0 0 2024-05-09T06:30:41.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/350: write d7/d10/f13 [1792408,13109] 0 2024-05-09T06:30:41.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/351: rename d7/d10/d34 to d7/d10/d34/d46/d48/d70 22 2024-05-09T06:30:41.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/352: dread - d7/d10/d28/f50 zero size 2024-05-09T06:30:41.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/353: fsync d7/d10/d28/f33 0 2024-05-09T06:30:41.718 INFO:tasks.workunit.client.0.smithi046.stdout:0/424: sync 2024-05-09T06:30:41.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/312: sync 2024-05-09T06:30:41.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/411: sync 2024-05-09T06:30:41.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/412: chown d7/df/d10/d2f/f89 5976138 1 2024-05-09T06:30:41.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/413: fsync d7/f72 0 2024-05-09T06:30:41.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/414: fdatasync d7/df/d3a/f76 0 2024-05-09T06:30:41.720 INFO:tasks.workunit.client.0.smithi046.stdout:3/313: mknod d4/d20/d24/d2a/d46/c61 0 2024-05-09T06:30:41.720 INFO:tasks.workunit.client.0.smithi046.stdout:3/314: getdents d4/d20/d24/d29/d2b/d3e/d5c 0 2024-05-09T06:30:41.722 INFO:tasks.workunit.client.0.smithi046.stdout:0/425: creat d11/d18/d27/d28/d2d/f90 x:0 0 0 2024-05-09T06:30:41.722 INFO:tasks.workunit.client.0.smithi046.stdout:0/426: truncate d11/d18/d27/d28/d36/d5a/f87 343041 0 2024-05-09T06:30:41.722 INFO:tasks.workunit.client.0.smithi046.stdout:1/354: write d7/d10/d34/f68 [7956556,80499] 0 2024-05-09T06:30:41.722 INFO:tasks.workunit.client.0.smithi046.stdout:1/355: write d7/d10/d28/d30/d3a/f67 [387307,87760] 0 2024-05-09T06:30:41.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/415: symlink d7/df/d3a/d45/l8d 0 2024-05-09T06:30:41.723 INFO:tasks.workunit.client.0.smithi046.stdout:3/315: chown d4/d5/f23 363179 1 2024-05-09T06:30:41.724 INFO:tasks.workunit.client.0.smithi046.stdout:0/427: mkdir d11/d18/d27/d28/d36/d91 0 2024-05-09T06:30:41.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/356: unlink d7/d10/d28/d30/d3a/f67 0 2024-05-09T06:30:41.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/357: chown d7/d10/d28/d55/f56 1714 1 2024-05-09T06:30:41.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/358: read - d7/d10/d28/d30/f5e zero size 2024-05-09T06:30:41.727 INFO:tasks.workunit.client.0.smithi046.stdout:0/428: dread d11/d18/d27/f3c [0,4194304] 0 2024-05-09T06:30:41.729 INFO:tasks.workunit.client.0.smithi046.stdout:1/359: symlink d7/d10/d28/l71 0 2024-05-09T06:30:41.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/416: read d7/df/d3a/f28 [223051,123694] 0 2024-05-09T06:30:41.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/417: getdents d7/df/d10/d1d/d77/d87 0 2024-05-09T06:30:41.734 INFO:tasks.workunit.client.0.smithi046.stdout:4/418: write d7/df/d10/d1d/f69 [1119882,3440] 0 2024-05-09T06:30:41.736 INFO:tasks.workunit.client.0.smithi046.stdout:3/316: dread d4/d5/f37 [0,4194304] 0 2024-05-09T06:30:41.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/419: creat d7/df/d10/d1d/f8e x:0 0 0 2024-05-09T06:30:41.764 INFO:tasks.workunit.client.0.smithi046.stdout:0/429: dwrite d11/d18/d27/d28/f31 [0,4194304] 0 2024-05-09T06:30:41.764 INFO:tasks.workunit.client.0.smithi046.stdout:3/317: dwrite d4/d20/d24/d29/d2b/f4c [4194304,4194304] 0 2024-05-09T06:30:41.770 INFO:tasks.workunit.client.0.smithi046.stdout:0/430: creat d11/d18/d27/d28/d36/d91/f92 x:0 0 0 2024-05-09T06:30:41.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/318: rename d4/l10 to d4/l62 0 2024-05-09T06:30:41.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/319: chown d4/l62 97204934 1 2024-05-09T06:30:41.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/320: write d4/d5/f56 [585201,102828] 0 2024-05-09T06:30:41.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/321: rename d4/d20/d24/d2a/f50 to d4/d20/d41/f63 0 2024-05-09T06:30:41.779 INFO:tasks.workunit.client.0.smithi046.stdout:3/322: truncate d4/d5/f43 71003 0 2024-05-09T06:30:41.782 INFO:tasks.workunit.client.0.smithi046.stdout:0/431: dwrite d11/d18/f39 [4194304,4194304] 0 2024-05-09T06:30:41.782 INFO:tasks.workunit.client.0.smithi046.stdout:0/432: chown d11/f15 668631309 1 2024-05-09T06:30:41.782 INFO:tasks.workunit.client.0.smithi046.stdout:0/433: readlink l6 0 2024-05-09T06:30:41.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/323: truncate d4/d20/f25 4950695 0 2024-05-09T06:30:41.795 INFO:tasks.workunit.client.0.smithi046.stdout:0/434: dwrite d11/d18/d1c/d53/f66 [0,4194304] 0 2024-05-09T06:30:41.805 INFO:tasks.workunit.client.0.smithi046.stdout:3/324: dwrite d4/d5/f23 [4194304,4194304] 0 2024-05-09T06:30:41.812 INFO:tasks.workunit.client.0.smithi046.stdout:3/325: unlink d4/d20/d24/l42 0 2024-05-09T06:30:41.812 INFO:tasks.workunit.client.0.smithi046.stdout:3/326: fsync d4/d20/d24/d2a/f40 0 2024-05-09T06:30:41.814 INFO:tasks.workunit.client.0.smithi046.stdout:0/435: rmdir d11/d3f/d6f 39 2024-05-09T06:30:41.816 INFO:tasks.workunit.client.0.smithi046.stdout:3/327: creat d4/d20/d24/d29/d2b/d3e/f64 x:0 0 0 2024-05-09T06:30:41.818 INFO:tasks.workunit.client.0.smithi046.stdout:0/436: rmdir d11/d18/d27/d28 39 2024-05-09T06:30:41.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/328: mknod d4/d48/d49/c65 0 2024-05-09T06:30:41.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/329: chown d4/d20/d24/d29/d2b/c39 3 1 2024-05-09T06:30:41.822 INFO:tasks.workunit.client.0.smithi046.stdout:3/330: creat d4/d20/d41/f66 x:0 0 0 2024-05-09T06:30:41.837 INFO:tasks.workunit.client.0.smithi046.stdout:3/331: dwrite d4/d20/d24/d2a/d46/f5b [0,4194304] 0 2024-05-09T06:30:41.837 INFO:tasks.workunit.client.0.smithi046.stdout:0/437: dwrite d11/d18/f8c [0,4194304] 0 2024-05-09T06:30:41.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/332: unlink d4/d5/f56 0 2024-05-09T06:30:41.846 INFO:tasks.workunit.client.0.smithi046.stdout:0/438: creat d11/f93 x:0 0 0 2024-05-09T06:30:41.846 INFO:tasks.workunit.client.0.smithi046.stdout:0/439: readlink d11/d18/d1c/d53/l58 0 2024-05-09T06:30:41.850 INFO:tasks.workunit.client.0.smithi046.stdout:3/333: creat d4/d20/d24/d29/d2b/d3e/d5c/f67 x:0 0 0 2024-05-09T06:30:41.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/440: symlink d11/d4f/d5b/d5f/l94 0 2024-05-09T06:30:41.852 INFO:tasks.workunit.client.0.smithi046.stdout:3/334: rename d4/d20/f25 to d4/d20/d41/f68 0 2024-05-09T06:30:41.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/441: rename f0 to d11/d18/d27/d28/d36/f95 0 2024-05-09T06:30:41.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/335: rmdir d4/d5 39 2024-05-09T06:30:41.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/336: write d4/d20/d24/d2a/f40 [319183,26071] 0 2024-05-09T06:30:41.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/337: read - d4/d20/d41/f63 zero size 2024-05-09T06:30:41.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/338: chown d4/d20/d24/d29/l45 59 1 2024-05-09T06:30:41.861 INFO:tasks.workunit.client.0.smithi046.stdout:0/442: rmdir d11/d18/d1c/d53 39 2024-05-09T06:30:41.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/339: creat d4/d20/d41/d4a/f69 x:0 0 0 2024-05-09T06:30:41.866 INFO:tasks.workunit.client.0.smithi046.stdout:0/443: symlink d11/d18/d1c/d53/l96 0 2024-05-09T06:30:41.867 INFO:tasks.workunit.client.0.smithi046.stdout:0/444: fdatasync d11/d3f/d6f/f76 0 2024-05-09T06:30:41.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/340: mkdir d4/d20/d24/d2a/d55/d6a 0 2024-05-09T06:30:41.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/341: chown d4/l62 478080551 1 2024-05-09T06:30:41.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/342: dread - d4/d20/d41/d4a/f69 zero size 2024-05-09T06:30:41.872 INFO:tasks.workunit.client.0.smithi046.stdout:0/445: link d11/l4b d11/d4f/d5b/l97 0 2024-05-09T06:30:41.874 INFO:tasks.workunit.client.0.smithi046.stdout:3/343: rename d4/d20/d24/d29/d2b/f4c to d4/d20/d24/d2a/f6b 0 2024-05-09T06:30:41.876 INFO:tasks.workunit.client.0.smithi046.stdout:3/344: mkdir d4/d20/d24/d29/d2b/d3e/d5c/d6c 0 2024-05-09T06:30:41.876 INFO:tasks.workunit.client.0.smithi046.stdout:3/345: write d4/d20/d24/f18 [4934530,44883] 0 2024-05-09T06:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/346: mknod d4/d48/d49/c6d 0 2024-05-09T06:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/347: creat d4/d48/d49/f6e x:0 0 0 2024-05-09T06:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/348: creat d4/d20/d24/d2a/d46/f6f x:0 0 0 2024-05-09T06:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/349: chown d4/d20/d24/d2a/d46/f6f 4889424 1 2024-05-09T06:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/350: creat d4/d20/d24/d29/d2b/f70 x:0 0 0 2024-05-09T06:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:2/394: sync 2024-05-09T06:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/285: sync 2024-05-09T06:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/446: sync 2024-05-09T06:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:0/446: dread d11/f15 [0,4194304] 0 2024-05-09T06:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:2/395: readlink da/dc/l34 0 2024-05-09T06:30:41.887 INFO:tasks.workunit.client.0.smithi046.stdout:3/351: unlink d4/d20/d24/d2a/f2d 0 2024-05-09T06:30:41.889 INFO:tasks.workunit.client.0.smithi046.stdout:9/286: read d2/d26/d2c/f3b [1757407,17789] 0 2024-05-09T06:30:41.890 INFO:tasks.workunit.client.0.smithi046.stdout:2/396: dwrite da/de/d1c/f3e [0,4194304] 0 2024-05-09T06:30:41.890 INFO:tasks.workunit.client.0.smithi046.stdout:2/397: write da/de/d14/d1f/d20/f3c [1576143,83776] 0 2024-05-09T06:30:41.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/447: unlink d11/d18/d27/d28/d2d/d5c/f71 0 2024-05-09T06:30:41.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/352: creat d4/d20/d24/d2a/d4e/f71 x:0 0 0 2024-05-09T06:30:41.900 INFO:tasks.workunit.client.0.smithi046.stdout:9/287: creat d2/d6/d7/d1a/f59 x:0 0 0 2024-05-09T06:30:41.903 INFO:tasks.workunit.client.0.smithi046.stdout:8/447: rmdir d1/d7/d12 39 2024-05-09T06:30:41.904 INFO:tasks.workunit.client.0.smithi046.stdout:8/448: creat d1/db/f7f x:0 0 0 2024-05-09T06:30:41.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/398: creat da/de/d11/f83 x:0 0 0 2024-05-09T06:30:41.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/399: chown da/dc/c66 0 1 2024-05-09T06:30:41.909 INFO:tasks.workunit.client.0.smithi046.stdout:9/288: dread d2/dc/f55 [0,4194304] 0 2024-05-09T06:30:41.910 INFO:tasks.workunit.client.0.smithi046.stdout:0/448: mkdir d11/d18/d27/d28/d36/d91/d98 0 2024-05-09T06:30:41.911 INFO:tasks.workunit.client.0.smithi046.stdout:3/353: link d4/d20/d24/c21 d4/c72 0 2024-05-09T06:30:41.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/449: creat d1/d7/d12/f80 x:0 0 0 2024-05-09T06:30:41.918 INFO:tasks.workunit.client.0.smithi046.stdout:9/289: mknod d2/d26/d2c/c5a 0 2024-05-09T06:30:41.918 INFO:tasks.workunit.client.0.smithi046.stdout:9/290: creat d2/d26/d2c/d3d/f5b x:0 0 0 2024-05-09T06:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:0/449: mknod d11/d18/d27/d28/d6b/c99 0 2024-05-09T06:30:41.920 INFO:tasks.workunit.client.0.smithi046.stdout:0/450: write d11/d18/d27/f33 [860637,112658] 0 2024-05-09T06:30:41.928 INFO:tasks.workunit.client.0.smithi046.stdout:0/451: creat d11/d18/d1c/d53/d82/f9a x:0 0 0 2024-05-09T06:30:41.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/291: dread d2/d6/d7/d1a/d27/f37 [0,4194304] 0 2024-05-09T06:30:41.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/292: write d2/d6/d33/f52 [673905,18473] 0 2024-05-09T06:30:41.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/354: dwrite d4/d48/f53 [0,4194304] 0 2024-05-09T06:30:41.949 INFO:tasks.workunit.client.0.smithi046.stdout:3/355: symlink d4/d20/d24/d29/d2b/l73 0 2024-05-09T06:30:41.949 INFO:tasks.workunit.client.0.smithi046.stdout:3/356: truncate d4/d20/d24/f38 7688971 0 2024-05-09T06:30:41.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/357: write d4/d20/d24/d2a/d46/f5e [331971,7494] 0 2024-05-09T06:30:41.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/358: fdatasync d4/d20/d24/f4f 0 2024-05-09T06:30:41.957 INFO:tasks.workunit.client.0.smithi046.stdout:8/450: dwrite d1/d7/d12/f3b [0,4194304] 0 2024-05-09T06:30:41.959 INFO:tasks.workunit.client.0.smithi046.stdout:8/451: unlink d1/f7a 0 2024-05-09T06:30:41.959 INFO:tasks.workunit.client.0.smithi046.stdout:8/452: write d1/d7/d12/f79 [3120032,16861] 0 2024-05-09T06:30:41.959 INFO:tasks.workunit.client.0.smithi046.stdout:0/452: dwrite d11/d18/d27/d28/d2d/f30 [0,4194304] 0 2024-05-09T06:30:41.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/453: truncate d11/d18/d27/d28/d6b/f8b 621457 0 2024-05-09T06:30:41.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/454: stat d11/d4f/d5b/d5f/f6d 0 2024-05-09T06:30:41.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/293: dwrite d2/d6/d7/f45 [0,4194304] 0 2024-05-09T06:30:41.960 INFO:tasks.workunit.client.0.smithi046.stdout:8/453: mkdir d1/db/dd/d11/d43/d81 0 2024-05-09T06:30:41.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/455: dread d11/d18/d27/d28/f50 [0,4194304] 0 2024-05-09T06:30:41.989 INFO:tasks.workunit.client.0.smithi046.stdout:9/294: link d2/d6/d33/c46 d2/d6/d7/d1a/d27/d2a/c5c 0 2024-05-09T06:30:41.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/456: unlink d11/d18/d1c/c42 0 2024-05-09T06:30:41.993 INFO:tasks.workunit.client.0.smithi046.stdout:0/457: write d11/d18/d27/d28/d2d/f57 [552702,12779] 0 2024-05-09T06:30:41.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/295: creat d2/dc/d32/f5d x:0 0 0 2024-05-09T06:30:41.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/296: readlink d2/d6/l9 0 2024-05-09T06:30:42.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/359: write d4/d20/d24/f38 [4720817,106669] 0 2024-05-09T06:30:42.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/360: readlink d4/d48/d49/l5a 0 2024-05-09T06:30:42.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/454: rmdir d1 39 2024-05-09T06:30:42.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/455: write d1/d7/d12/d1d/d30/d38/f42 [2075874,122473] 0 2024-05-09T06:30:42.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/458: symlink d11/d18/d27/d28/d36/d91/d98/l9b 0 2024-05-09T06:30:42.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/459: write d11/d4f/d5b/d5f/f6d [996102,17623] 0 2024-05-09T06:30:42.013 INFO:tasks.workunit.client.0.smithi046.stdout:9/297: rename d2/dc/f55 to d2/f5e 0 2024-05-09T06:30:42.016 INFO:tasks.workunit.client.0.smithi046.stdout:3/361: mkdir d4/d20/d24/d2a/d55/d74 0 2024-05-09T06:30:42.020 INFO:tasks.workunit.client.0.smithi046.stdout:8/456: link d1/d7/d2c/f58 d1/db/d67/f82 0 2024-05-09T06:30:42.020 INFO:tasks.workunit.client.0.smithi046.stdout:8/457: fsync d1/db/dd/d11/d43/f4b 0 2024-05-09T06:30:42.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/298: stat d2/c24 0 2024-05-09T06:30:42.023 INFO:tasks.workunit.client.0.smithi046.stdout:3/362: mknod d4/d20/d24/d29/d2b/d3e/c75 0 2024-05-09T06:30:42.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/458: rename d1/db/f7f to d1/d7/d12/d45/f83 0 2024-05-09T06:30:42.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/459: stat d1/db/dd/f76 0 2024-05-09T06:30:42.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/460: chown d1/d7/d12 113299 1 2024-05-09T06:30:42.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/363: creat d4/d20/d24/d2a/d55/d74/f76 x:0 0 0 2024-05-09T06:30:42.027 INFO:tasks.workunit.client.0.smithi046.stdout:0/460: dwrite d11/d18/d27/f79 [0,4194304] 0 2024-05-09T06:30:42.027 INFO:tasks.workunit.client.0.smithi046.stdout:8/461: symlink d1/db/d41/l84 0 2024-05-09T06:30:42.032 INFO:tasks.workunit.client.0.smithi046.stdout:9/299: write d2/d6/d7/f12 [463643,9834] 0 2024-05-09T06:30:42.033 INFO:tasks.workunit.client.0.smithi046.stdout:0/461: mknod d11/d4f/d5b/d5f/c9c 0 2024-05-09T06:30:42.036 INFO:tasks.workunit.client.0.smithi046.stdout:8/462: link d1/db/c70 d1/d7/d12/c85 0 2024-05-09T06:30:42.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/364: link d4/d20/d24/d29/d2b/f34 d4/d5/f77 0 2024-05-09T06:30:42.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/365: write d4/d20/d24/d2a/d55/d74/f76 [633068,94712] 0 2024-05-09T06:30:42.044 INFO:tasks.workunit.client.0.smithi046.stdout:9/300: unlink d2/d6/d38/l3f 0 2024-05-09T06:30:42.044 INFO:tasks.workunit.client.0.smithi046.stdout:9/301: chown d2/d6/d33/c46 4840 1 2024-05-09T06:30:42.044 INFO:tasks.workunit.client.0.smithi046.stdout:9/302: write d2/dc/f4d [342203,127614] 0 2024-05-09T06:30:42.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/462: mknod d11/d3f/d6f/c9d 0 2024-05-09T06:30:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/522: sync 2024-05-09T06:30:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/404: sync 2024-05-09T06:30:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/456: sync 2024-05-09T06:30:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/523: chown db/d10/d19/f83 25046 1 2024-05-09T06:30:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/457: write d3/f4 [3209042,60056] 0 2024-05-09T06:30:42.051 INFO:tasks.workunit.client.0.smithi046.stdout:3/366: unlink d4/d20/d24/f4f 0 2024-05-09T06:30:42.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/303: creat d2/d6/d7/d1a/d27/f5f x:0 0 0 2024-05-09T06:30:42.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/304: truncate d2/d6/d7/d1a/d27/f5f 127898 0 2024-05-09T06:30:42.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/305: creat d2/d6/d7/f60 x:0 0 0 2024-05-09T06:30:42.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/306: fsync d2/d6/d7/d1e/f4a 0 2024-05-09T06:30:42.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/307: truncate d2/f47 1689270 0 2024-05-09T06:30:42.057 INFO:tasks.workunit.client.0.smithi046.stdout:5/405: unlink d0/c27 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/463: dread d11/d18/f39 [0,4194304] 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/464: read - d11/d18/d27/d28/d2d/f90 zero size 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/465: write d11/d18/d27/d28/f2e [583544,100426] 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/466: write d11/d18/d27/f3c [1476219,38477] 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/458: write d3/d7/d28/d29/d35/f62 [515395,91174] 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/524: creat db/d10/d19/fab x:0 0 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/525: chown db/d10/d30/f4a 3872 1 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/526: fdatasync db/d10/d3f/d4f/d8a/d9e/fa7 0 2024-05-09T06:30:42.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/527: chown db/d10/d3f/d4f/d8a 10991 1 2024-05-09T06:30:42.061 INFO:tasks.workunit.client.0.smithi046.stdout:8/463: dwrite d1/d7/f68 [0,4194304] 0 2024-05-09T06:30:42.062 INFO:tasks.workunit.client.0.smithi046.stdout:3/367: mknod d4/d20/d24/d29/d2b/d3e/c78 0 2024-05-09T06:30:42.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/464: dread d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:42.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/406: truncate d0/d1b/d39/f60 1916537 0 2024-05-09T06:30:42.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/407: chown d0/d3e 9 1 2024-05-09T06:30:42.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/408: chown d0/f4 12 1 2024-05-09T06:30:42.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/528: unlink db/d10/fa0 0 2024-05-09T06:30:42.075 INFO:tasks.workunit.client.0.smithi046.stdout:6/529: chown db/d10/d3f/d4f/d8a/l9b 74 1 2024-05-09T06:30:42.075 INFO:tasks.workunit.client.0.smithi046.stdout:6/530: fdatasync db/d10/d3f/d44/d5e/f88 0 2024-05-09T06:30:42.075 INFO:tasks.workunit.client.0.smithi046.stdout:6/531: truncate db/d10/d3f/d44/d46/f4d 4415719 0 2024-05-09T06:30:42.075 INFO:tasks.workunit.client.0.smithi046.stdout:5/409: write d0/d1b/d21/f44 [1140875,105406] 0 2024-05-09T06:30:42.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/467: dwrite d11/d18/d27/d28/d2d/f30 [4194304,4194304] 0 2024-05-09T06:30:42.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/459: dwrite d3/d7/d28/d29/f2e [4194304,4194304] 0 2024-05-09T06:30:42.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/460: chown d3/d7/d28/d29/l39 7645370 1 2024-05-09T06:30:42.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/468: dread f4 [0,4194304] 0 2024-05-09T06:30:42.095 INFO:tasks.workunit.client.0.smithi046.stdout:8/465: symlink d1/d7/d2c/l86 0 2024-05-09T06:30:42.098 INFO:tasks.workunit.client.0.smithi046.stdout:6/532: dwrite db/d10/d30/f77 [0,4194304] 0 2024-05-09T06:30:42.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/533: truncate db/d10/d3f/d4f/fa9 784794 0 2024-05-09T06:30:42.099 INFO:tasks.workunit.client.0.smithi046.stdout:7/461: dread d3/d7/d28/d29/d3b/f4a [0,4194304] 0 2024-05-09T06:30:42.099 INFO:tasks.workunit.client.0.smithi046.stdout:3/368: rmdir d4/d20/d41/d4a 39 2024-05-09T06:30:42.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/469: getdents d11/d18/d1c/d53 0 2024-05-09T06:30:42.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/470: write d11/d18/d27/d28/d36/d91/f92 [1034034,27740] 0 2024-05-09T06:30:42.107 INFO:tasks.workunit.client.0.smithi046.stdout:8/466: symlink d1/db/dd/d11/d5d/l87 0 2024-05-09T06:30:42.107 INFO:tasks.workunit.client.0.smithi046.stdout:8/467: fdatasync d1/d7/d2c/f15 0 2024-05-09T06:30:42.107 INFO:tasks.workunit.client.0.smithi046.stdout:5/410: getdents d0/d3e/d50 0 2024-05-09T06:30:42.110 INFO:tasks.workunit.client.0.smithi046.stdout:3/369: mknod d4/d20/d24/c79 0 2024-05-09T06:30:42.110 INFO:tasks.workunit.client.0.smithi046.stdout:3/370: read - d4/d20/d24/d29/d2b/f70 zero size 2024-05-09T06:30:42.111 INFO:tasks.workunit.client.0.smithi046.stdout:7/462: dread d3/d7/dd/f59 [0,4194304] 0 2024-05-09T06:30:42.112 INFO:tasks.workunit.client.0.smithi046.stdout:6/534: dwrite db/d93/f7e [0,4194304] 0 2024-05-09T06:30:42.112 INFO:tasks.workunit.client.0.smithi046.stdout:6/535: write db/d10/f1e [1607018,47156] 0 2024-05-09T06:30:42.113 INFO:tasks.workunit.client.0.smithi046.stdout:8/468: rmdir d1/db/dd 39 2024-05-09T06:30:42.113 INFO:tasks.workunit.client.0.smithi046.stdout:7/463: dread d3/d7/d28/d29/d3b/f3f [0,4194304] 0 2024-05-09T06:30:42.115 INFO:tasks.workunit.client.0.smithi046.stdout:5/411: rename d0/l2e to d0/d1b/d39/l87 0 2024-05-09T06:30:42.115 INFO:tasks.workunit.client.0.smithi046.stdout:5/412: chown d0/d3e/l76 196467829 1 2024-05-09T06:30:42.115 INFO:tasks.workunit.client.0.smithi046.stdout:5/413: truncate d0/d1b/d21/f38 1603413 0 2024-05-09T06:30:42.116 INFO:tasks.workunit.client.0.smithi046.stdout:3/371: mkdir d4/d20/d24/d29/d7a 0 2024-05-09T06:30:42.116 INFO:tasks.workunit.client.0.smithi046.stdout:3/372: chown d4/d20/c28 252 1 2024-05-09T06:30:42.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/469: write d1/db/f28 [1822600,37354] 0 2024-05-09T06:30:42.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/536: creat db/d10/d3f/d44/fac x:0 0 0 2024-05-09T06:30:42.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/537: write db/d10/d3c/f69 [746897,32921] 0 2024-05-09T06:30:42.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/538: write db/d10/f16 [8577402,71981] 0 2024-05-09T06:30:42.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/539: rename db to db/d10/d3c/d91/dad 22 2024-05-09T06:30:42.132 INFO:tasks.workunit.client.0.smithi046.stdout:3/373: dwrite d4/d20/d24/d29/d2b/d3e/d5c/f67 [0,4194304] 0 2024-05-09T06:30:42.133 INFO:tasks.workunit.client.0.smithi046.stdout:7/464: creat d3/d7/d28/d29/f98 x:0 0 0 2024-05-09T06:30:42.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/414: mknod d0/d1b/d39/c88 0 2024-05-09T06:30:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:1/360: sync 2024-05-09T06:30:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:1/361: chown d7/c4b 4500 1 2024-05-09T06:30:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:1/362: fsync d7/d10/d34/f45 0 2024-05-09T06:30:42.142 INFO:tasks.workunit.client.0.smithi046.stdout:8/470: creat d1/d7/f88 x:0 0 0 2024-05-09T06:30:42.146 INFO:tasks.workunit.client.0.smithi046.stdout:6/540: link db/d10/d30/c51 db/d10/d19/d66/cae 0 2024-05-09T06:30:42.153 INFO:tasks.workunit.client.0.smithi046.stdout:3/374: symlink d4/d20/d24/d29/d2b/d3e/l7b 0 2024-05-09T06:30:42.154 INFO:tasks.workunit.client.0.smithi046.stdout:7/465: mkdir d3/d7/d4c/d99 0 2024-05-09T06:30:42.158 INFO:tasks.workunit.client.0.smithi046.stdout:8/471: dwrite d1/db/dd/f51 [0,4194304] 0 2024-05-09T06:30:42.159 INFO:tasks.workunit.client.0.smithi046.stdout:8/472: read d1/d7/d12/d45/f5f [68499,113266] 0 2024-05-09T06:30:42.162 INFO:tasks.workunit.client.0.smithi046.stdout:5/415: symlink d0/d1b/d39/l89 0 2024-05-09T06:30:42.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/363: rename d7/la to d7/d10/d28/d30/l72 0 2024-05-09T06:30:42.167 INFO:tasks.workunit.client.0.smithi046.stdout:6/541: truncate db/d10/d30/fa4 3742376 0 2024-05-09T06:30:42.167 INFO:tasks.workunit.client.0.smithi046.stdout:6/542: truncate db/d10/f37 778036 0 2024-05-09T06:30:42.170 INFO:tasks.workunit.client.0.smithi046.stdout:3/375: unlink d4/d20/d24/d29/d2b/d3e/l7b 0 2024-05-09T06:30:42.170 INFO:tasks.workunit.client.0.smithi046.stdout:8/473: write d1/d7/d12/f3b [921244,116962] 0 2024-05-09T06:30:42.172 INFO:tasks.workunit.client.0.smithi046.stdout:7/466: link d3/d3d/d72/d79/d81/c97 d3/d6f/c9a 0 2024-05-09T06:30:42.178 INFO:tasks.workunit.client.0.smithi046.stdout:5/416: mkdir d0/d1b/d39/d8a 0 2024-05-09T06:30:42.179 INFO:tasks.workunit.client.0.smithi046.stdout:1/364: symlink d7/d10/d28/d55/l73 0 2024-05-09T06:30:42.179 INFO:tasks.workunit.client.0.smithi046.stdout:1/365: write d7/d10/f54 [706509,91311] 0 2024-05-09T06:30:42.182 INFO:tasks.workunit.client.0.smithi046.stdout:8/474: unlink d1/d7/d12/f3b 0 2024-05-09T06:30:42.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/467: mkdir d3/d7/d28/d29/d35/d5c/d9b 0 2024-05-09T06:30:42.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/366: dread d7/fc [0,4194304] 0 2024-05-09T06:30:42.185 INFO:tasks.workunit.client.0.smithi046.stdout:5/417: mkdir d0/d1b/d39/d8b 0 2024-05-09T06:30:42.187 INFO:tasks.workunit.client.0.smithi046.stdout:3/376: rmdir d4/d20/d24/d2a/d46 39 2024-05-09T06:30:42.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/475: creat d1/d7/d12/f89 x:0 0 0 2024-05-09T06:30:42.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/476: dread d1/d7/f68 [0,4194304] 0 2024-05-09T06:30:42.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/477: fdatasync d1/db/dd/f51 0 2024-05-09T06:30:42.209 INFO:tasks.workunit.client.0.smithi046.stdout:3/377: truncate d4/d20/d24/d29/d2b/f34 2330210 0 2024-05-09T06:30:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:7/468: getdents d3/d7/d4c 0 2024-05-09T06:30:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:7/469: fsync d3/d7/d28/d29/f2e 0 2024-05-09T06:30:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:7/470: readlink d3/d6f/l95 0 2024-05-09T06:30:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:7/471: fdatasync d3/d7/d28/d29/d35/f6d 0 2024-05-09T06:30:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:7/472: write d3/d7/dd/d3e/f91 [210341,123606] 0 2024-05-09T06:30:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:7/473: fdatasync d3/d7/f52 0 2024-05-09T06:30:42.215 INFO:tasks.workunit.client.0.smithi046.stdout:5/418: rmdir d0/d1b/d21 39 2024-05-09T06:30:42.215 INFO:tasks.workunit.client.0.smithi046.stdout:5/419: getdents d0/d3e/d50 0 2024-05-09T06:30:42.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/478: link d1/db/dd/c55 d1/db/d41/c8a 0 2024-05-09T06:30:42.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/479: readlink d1/d7/d2c/l36 0 2024-05-09T06:30:42.218 INFO:tasks.workunit.client.0.smithi046.stdout:8/480: dread d1/db/dd/f4a [0,4194304] 0 2024-05-09T06:30:42.220 INFO:tasks.workunit.client.0.smithi046.stdout:3/378: mknod d4/d48/d49/c7c 0 2024-05-09T06:30:42.225 INFO:tasks.workunit.client.0.smithi046.stdout:8/481: creat d1/db/dd/d11/f8b x:0 0 0 2024-05-09T06:30:42.228 INFO:tasks.workunit.client.0.smithi046.stdout:7/474: getdents d3/d7/d28/d29/d35 0 2024-05-09T06:30:42.229 INFO:tasks.workunit.client.0.smithi046.stdout:5/420: rmdir d0/d1b/d39 39 2024-05-09T06:30:42.237 INFO:tasks.workunit.client.0.smithi046.stdout:7/475: write d3/d7/f2d [1217099,27788] 0 2024-05-09T06:30:42.237 INFO:tasks.workunit.client.0.smithi046.stdout:7/476: chown d3/d7/d28/d29/d3b/f3f 11720546 1 2024-05-09T06:30:42.238 INFO:tasks.workunit.client.0.smithi046.stdout:8/482: rmdir d1/d7/d12 39 2024-05-09T06:30:42.238 INFO:tasks.workunit.client.0.smithi046.stdout:8/483: fdatasync d1/d7/d12/f80 0 2024-05-09T06:30:42.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/379: dwrite d4/d20/d41/f68 [4194304,4194304] 0 2024-05-09T06:30:42.244 INFO:tasks.workunit.client.0.smithi046.stdout:8/484: creat d1/d7/d12/d1d/d30/d38/f8c x:0 0 0 2024-05-09T06:30:42.244 INFO:tasks.workunit.client.0.smithi046.stdout:8/485: dread - d1/db/d41/f6c zero size 2024-05-09T06:30:42.244 INFO:tasks.workunit.client.0.smithi046.stdout:8/486: truncate d1/db/dd/d14/f7c 694902 0 2024-05-09T06:30:42.247 INFO:tasks.workunit.client.0.smithi046.stdout:8/487: link d1/db/d67/f7e d1/db/d67/d6e/f8d 0 2024-05-09T06:30:42.250 INFO:tasks.workunit.client.0.smithi046.stdout:8/488: creat d1/d7/d12/f8e x:0 0 0 2024-05-09T06:30:42.250 INFO:tasks.workunit.client.0.smithi046.stdout:8/489: chown d1/db/dd/d11/f8b 3917 1 2024-05-09T06:30:42.250 INFO:tasks.workunit.client.0.smithi046.stdout:8/490: chown d1/db/dd/f7d 223 1 2024-05-09T06:30:42.251 INFO:tasks.workunit.client.0.smithi046.stdout:7/477: dread d3/f1d [0,4194304] 0 2024-05-09T06:30:42.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/491: symlink d1/d7/l8f 0 2024-05-09T06:30:42.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/492: creat d1/db/f90 x:0 0 0 2024-05-09T06:30:42.259 INFO:tasks.workunit.client.0.smithi046.stdout:5/421: dwrite d0/d1b/f3d [0,4194304] 0 2024-05-09T06:30:42.259 INFO:tasks.workunit.client.0.smithi046.stdout:3/380: dwrite d4/d48/d49/f6e [0,4194304] 0 2024-05-09T06:30:42.259 INFO:tasks.workunit.client.0.smithi046.stdout:3/381: write d4/d20/d24/d2a/d55/d74/f76 [1174179,52489] 0 2024-05-09T06:30:42.262 INFO:tasks.workunit.client.0.smithi046.stdout:8/493: dread d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:42.266 INFO:tasks.workunit.client.0.smithi046.stdout:5/422: rename d0/d1b/f30 to d0/d3e/d83/f8c 0 2024-05-09T06:30:42.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/478: dwrite d3/d7/d28/d29/d3b/f4a [0,4194304] 0 2024-05-09T06:30:42.279 INFO:tasks.workunit.client.0.smithi046.stdout:3/382: creat d4/d5d/f7d x:0 0 0 2024-05-09T06:30:42.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/494: symlink d1/db/dd/d11/d43/l91 0 2024-05-09T06:30:42.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/495: write d1/d7/d12/d45/f83 [943438,41307] 0 2024-05-09T06:30:42.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/496: truncate d1/d7/d12/d1d/d30/d38/f46 502689 0 2024-05-09T06:30:42.284 INFO:tasks.workunit.client.0.smithi046.stdout:5/423: rename d0/d3e/c64 to d0/d1b/d39/d8a/c8d 0 2024-05-09T06:30:42.288 INFO:tasks.workunit.client.0.smithi046.stdout:3/383: mknod d4/d20/d24/d59/c7e 0 2024-05-09T06:30:42.291 INFO:tasks.workunit.client.0.smithi046.stdout:8/497: symlink d1/d7/d12/d1d/d30/d38/l92 0 2024-05-09T06:30:42.291 INFO:tasks.workunit.client.0.smithi046.stdout:8/498: write d1/db/dd/d11/f5c [126245,90827] 0 2024-05-09T06:30:42.293 INFO:tasks.workunit.client.0.smithi046.stdout:5/424: link d0/d1b/d39/f67 d0/d58/d7a/f8e 0 2024-05-09T06:30:42.293 INFO:tasks.workunit.client.0.smithi046.stdout:5/425: read - d0/d1b/d21/f85 zero size 2024-05-09T06:30:42.294 INFO:tasks.workunit.client.0.smithi046.stdout:7/479: getdents d3/d6f 0 2024-05-09T06:30:42.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/480: dread d3/d7/d28/d29/d35/f62 [0,4194304] 0 2024-05-09T06:30:42.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/481: read d3/f8 [1330825,35607] 0 2024-05-09T06:30:42.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/482: truncate d3/d7/d28/d29/f2e 9141703 0 2024-05-09T06:30:42.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/483: readlink d3/l21 0 2024-05-09T06:30:42.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/384: link d4/lf d4/d5d/d60/l7f 0 2024-05-09T06:30:42.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/426: link d0/c36 d0/d1b/d39/c8f 0 2024-05-09T06:30:42.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/385: truncate d4/d20/d24/f18 4756361 0 2024-05-09T06:30:42.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/499: dwrite d1/db/dd/f4a [0,4194304] 0 2024-05-09T06:30:42.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/427: rename d0/d1b/d39/f67 to d0/d3e/d83/f90 0 2024-05-09T06:30:42.321 INFO:tasks.workunit.client.0.smithi046.stdout:8/500: symlink d1/db/dd/d11/d5d/l93 0 2024-05-09T06:30:42.323 INFO:tasks.workunit.client.0.smithi046.stdout:8/501: link d1/db/dd/d14/c78 d1/d7/c94 0 2024-05-09T06:30:42.323 INFO:tasks.workunit.client.0.smithi046.stdout:8/502: write d1/d7/d2c/f58 [1631093,96242] 0 2024-05-09T06:30:42.323 INFO:tasks.workunit.client.0.smithi046.stdout:4/420: sync 2024-05-09T06:30:42.324 INFO:tasks.workunit.client.0.smithi046.stdout:2/400: sync 2024-05-09T06:30:42.325 INFO:tasks.workunit.client.0.smithi046.stdout:3/386: dwrite d4/d48/d49/f6e [0,4194304] 0 2024-05-09T06:30:42.327 INFO:tasks.workunit.client.0.smithi046.stdout:2/401: creat da/de/d14/d1f/d20/f84 x:0 0 0 2024-05-09T06:30:42.330 INFO:tasks.workunit.client.0.smithi046.stdout:3/387: creat d4/d20/d24/d29/d2b/d3e/d5c/d6c/f80 x:0 0 0 2024-05-09T06:30:42.332 INFO:tasks.workunit.client.0.smithi046.stdout:3/388: creat d4/d20/d24/d2a/d4e/d58/f81 x:0 0 0 2024-05-09T06:30:42.336 INFO:tasks.workunit.client.0.smithi046.stdout:5/428: dwrite d0/d1b/d39/f60 [0,4194304] 0 2024-05-09T06:30:42.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/429: creat d0/d1b/d21/d81/f91 x:0 0 0 2024-05-09T06:30:42.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/402: dread da/f45 [0,4194304] 0 2024-05-09T06:30:42.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/389: dread d4/d5/f9 [0,4194304] 0 2024-05-09T06:30:42.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/390: fsync d4/fc 0 2024-05-09T06:30:42.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/391: chown d4/d20/d24/f38 7 1 2024-05-09T06:30:42.353 INFO:tasks.workunit.client.0.smithi046.stdout:2/403: creat da/db/d7d/f85 x:0 0 0 2024-05-09T06:30:42.355 INFO:tasks.workunit.client.0.smithi046.stdout:3/392: mknod d4/d5/c82 0 2024-05-09T06:30:42.355 INFO:tasks.workunit.client.0.smithi046.stdout:3/393: read - d4/d20/d24/d29/d2b/f70 zero size 2024-05-09T06:30:42.358 INFO:tasks.workunit.client.0.smithi046.stdout:3/394: unlink d4/d5/f23 0 2024-05-09T06:30:42.358 INFO:tasks.workunit.client.0.smithi046.stdout:3/395: dread - d4/d20/d41/f63 zero size 2024-05-09T06:30:42.364 INFO:tasks.workunit.client.0.smithi046.stdout:8/503: dwrite d1/d7/d12/f57 [0,4194304] 0 2024-05-09T06:30:42.366 INFO:tasks.workunit.client.0.smithi046.stdout:4/421: dwrite d7/f72 [4194304,4194304] 0 2024-05-09T06:30:42.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/430: dwrite d0/d58/d7a/f86 [0,4194304] 0 2024-05-09T06:30:42.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/431: stat d0/d3e/d83/f90 0 2024-05-09T06:30:42.374 INFO:tasks.workunit.client.0.smithi046.stdout:8/504: dread d1/d7/d12/d1d/d30/d38/f54 [0,4194304] 0 2024-05-09T06:30:42.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/396: dwrite d4/d20/d24/d2a/d46/f5b [0,4194304] 0 2024-05-09T06:30:42.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/397: chown d4/d20/d24/d2a/d46/f5b 0 1 2024-05-09T06:30:42.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/398: write d4/d20/d24/d29/d2b/d3e/f64 [110231,10422] 0 2024-05-09T06:30:42.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/422: creat d7/df/d10/d1d/d77/d87/f8f x:0 0 0 2024-05-09T06:30:42.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/423: write d7/df/f38 [951009,48200] 0 2024-05-09T06:30:42.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/424: stat d7/df/d10/d1d/d77/c7e 0 2024-05-09T06:30:42.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/432: unlink d0/d1b/d39/c41 0 2024-05-09T06:30:42.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/433: dread - d0/d58/d7a/f8e zero size 2024-05-09T06:30:42.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/505: mkdir d1/db/dd/d11/d5d/d95 0 2024-05-09T06:30:42.395 INFO:tasks.workunit.client.0.smithi046.stdout:4/425: getdents d7/df/d10/d1d/d77 0 2024-05-09T06:30:42.397 INFO:tasks.workunit.client.0.smithi046.stdout:5/434: write d0/f5b [57235,93933] 0 2024-05-09T06:30:42.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/506: getdents d1/d7 0 2024-05-09T06:30:42.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/507: fdatasync d1/db/dd/f76 0 2024-05-09T06:30:42.407 INFO:tasks.workunit.client.0.smithi046.stdout:4/426: creat d7/f90 x:0 0 0 2024-05-09T06:30:42.416 INFO:tasks.workunit.client.0.smithi046.stdout:4/427: dread d7/df/d10/d2f/d30/f58 [0,4194304] 0 2024-05-09T06:30:42.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/428: truncate d7/df/d3a/d25/f4e 3943964 0 2024-05-09T06:30:42.422 INFO:tasks.workunit.client.0.smithi046.stdout:4/429: mkdir d7/df/d53/d91 0 2024-05-09T06:30:42.423 INFO:tasks.workunit.client.0.smithi046.stdout:4/430: stat d7/df/c17 0 2024-05-09T06:30:42.423 INFO:tasks.workunit.client.0.smithi046.stdout:4/431: chown d7/df/d84 859 1 2024-05-09T06:30:42.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/435: dwrite d0/d3e/d83/f8c [4194304,4194304] 0 2024-05-09T06:30:42.425 INFO:tasks.workunit.client.0.smithi046.stdout:8/508: dwrite d1/d7/d12/f89 [0,4194304] 0 2024-05-09T06:30:42.432 INFO:tasks.workunit.client.0.smithi046.stdout:5/436: rename d0/c36 to d0/d1b/d21/c92 0 2024-05-09T06:30:42.432 INFO:tasks.workunit.client.0.smithi046.stdout:5/437: stat d0/fa 0 2024-05-09T06:30:42.437 INFO:tasks.workunit.client.0.smithi046.stdout:3/399: getdents d4/d5 0 2024-05-09T06:30:42.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/400: write d4/d20/d41/f68 [2373679,57652] 0 2024-05-09T06:30:42.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/401: write d4/d20/d24/d2a/d46/f5e [867812,85859] 0 2024-05-09T06:30:42.451 INFO:tasks.workunit.client.0.smithi046.stdout:4/432: getdents d7/df/d3a/d25 0 2024-05-09T06:30:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/438: symlink d0/d3e/d53/l93 0 2024-05-09T06:30:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/439: read d0/fd [61057,6909] 0 2024-05-09T06:30:42.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/509: dwrite d1/db/f90 [0,4194304] 0 2024-05-09T06:30:42.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/402: symlink d4/d20/d24/d29/d2b/d3e/d5c/d6c/l83 0 2024-05-09T06:30:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/433: unlink d7/df/d3a/c2b 0 2024-05-09T06:30:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/434: fsync d7/df/d10/d2f/d30/f67 0 2024-05-09T06:30:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/435: dread - d7/df/d3a/d25/f52 zero size 2024-05-09T06:30:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:5/440: mknod d0/d1b/d21/c94 0 2024-05-09T06:30:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:5/441: chown d0/fd 889 1 2024-05-09T06:30:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/442: truncate d0/f24 9297136 0 2024-05-09T06:30:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/443: readlink d0/d1b/d39/l48 0 2024-05-09T06:30:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/510: mknod d1/db/dd/d11/d5d/d95/c96 0 2024-05-09T06:30:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/511: creat d1/d7/d12/f97 x:0 0 0 2024-05-09T06:30:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/403: write d4/d48/f53 [2926490,94452] 0 2024-05-09T06:30:42.482 INFO:tasks.workunit.client.0.smithi046.stdout:4/436: mknod d7/df/d10/d2f/d30/c92 0 2024-05-09T06:30:42.482 INFO:tasks.workunit.client.0.smithi046.stdout:4/437: fdatasync d7/df/d3a/d25/f70 0 2024-05-09T06:30:42.482 INFO:tasks.workunit.client.0.smithi046.stdout:4/438: chown d7/fa 48513 1 2024-05-09T06:30:42.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/404: write d4/d20/d24/d2a/d55/d74/f76 [189247,77161] 0 2024-05-09T06:30:42.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/405: creat d4/d20/d24/d29/d2b/d3e/f84 x:0 0 0 2024-05-09T06:30:42.487 INFO:tasks.workunit.client.0.smithi046.stdout:4/439: write d7/f15 [304081,14452] 0 2024-05-09T06:30:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:5/444: dwrite d0/d3e/d53/f59 [0,4194304] 0 2024-05-09T06:30:42.510 INFO:tasks.workunit.client.0.smithi046.stdout:8/512: dwrite d1/d7/f68 [0,4194304] 0 2024-05-09T06:30:42.510 INFO:tasks.workunit.client.0.smithi046.stdout:0/471: sync 2024-05-09T06:30:42.511 INFO:tasks.workunit.client.0.smithi046.stdout:9/308: sync 2024-05-09T06:30:42.511 INFO:tasks.workunit.client.0.smithi046.stdout:9/309: write d2/f4 [3409405,102171] 0 2024-05-09T06:30:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/513: creat d1/d7/d2c/f98 x:0 0 0 2024-05-09T06:30:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/514: getdents d1/d7 0 2024-05-09T06:30:42.534 INFO:tasks.workunit.client.0.smithi046.stdout:0/472: creat d11/d18/d27/d28/f9e x:0 0 0 2024-05-09T06:30:42.534 INFO:tasks.workunit.client.0.smithi046.stdout:0/473: chown d11/f14 7200 1 2024-05-09T06:30:42.534 INFO:tasks.workunit.client.0.smithi046.stdout:0/474: chown d11/d18/l20 58961 1 2024-05-09T06:30:42.536 INFO:tasks.workunit.client.0.smithi046.stdout:5/445: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:42.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/515: mkdir d1/db/dd/d11/d5d/d99 0 2024-05-09T06:30:42.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/406: getdents d4/d20/d24/d29/d2b/d3e 0 2024-05-09T06:30:42.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/407: stat d4/d20/c32 0 2024-05-09T06:30:42.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/310: dwrite d2/d6/d38/f48 [4194304,4194304] 0 2024-05-09T06:30:42.540 INFO:tasks.workunit.client.0.smithi046.stdout:5/446: mknod d0/d58/d7a/c95 0 2024-05-09T06:30:42.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/447: write d0/d1b/d21/f7c [419386,119303] 0 2024-05-09T06:30:42.544 INFO:tasks.workunit.client.0.smithi046.stdout:8/516: creat d1/db/dd/d11/d5d/f9a x:0 0 0 2024-05-09T06:30:42.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/408: link d4/d20/d24/d2a/f40 d4/f85 0 2024-05-09T06:30:42.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/409: chown d4/d5/f43 2128074679 1 2024-05-09T06:30:42.548 INFO:tasks.workunit.client.0.smithi046.stdout:5/448: rename d0/d1b/d39/l45 to d0/d1b/d21/l96 0 2024-05-09T06:30:42.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/517: symlink d1/db/dd/d11/l9b 0 2024-05-09T06:30:42.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/518: write d1/db/dd/d11/f27 [1317099,16937] 0 2024-05-09T06:30:42.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/449: stat d0/l9 0 2024-05-09T06:30:42.552 INFO:tasks.workunit.client.0.smithi046.stdout:6/543: sync 2024-05-09T06:30:42.554 INFO:tasks.workunit.client.0.smithi046.stdout:0/475: dwrite d11/d18/f1b [4194304,4194304] 0 2024-05-09T06:30:42.555 INFO:tasks.workunit.client.0.smithi046.stdout:9/311: dread d2/d26/f43 [0,4194304] 0 2024-05-09T06:30:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:5/450: rename d0/d1b/f37 to d0/d3e/d53/f97 0 2024-05-09T06:30:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/484: sync 2024-05-09T06:30:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/404: sync 2024-05-09T06:30:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/367: sync 2024-05-09T06:30:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/485: creat d3/d7/d28/d29/d3b/f9c x:0 0 0 2024-05-09T06:30:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/486: write d3/d7/d28/d29/d35/f56 [4674711,92725] 0 2024-05-09T06:30:42.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/544: creat db/d10/d30/faf x:0 0 0 2024-05-09T06:30:42.563 INFO:tasks.workunit.client.0.smithi046.stdout:2/405: write da/de/d14/d1f/f25 [281427,68132] 0 2024-05-09T06:30:42.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/406: dread - da/de/d14/d1f/d20/f84 zero size 2024-05-09T06:30:42.564 INFO:tasks.workunit.client.0.smithi046.stdout:0/476: mkdir d11/d18/d27/d28/d2d/d9f 0 2024-05-09T06:30:42.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/545: link db/d10/d3f/d44/d5e/fa6 db/d10/d3f/d44/d5e/fb0 0 2024-05-09T06:30:42.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/546: fsync db/d10/d3f/d44/d74/f80 0 2024-05-09T06:30:42.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/547: fdatasync db/d10/d3c/d91/fa2 0 2024-05-09T06:30:42.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/548: chown db/d10/d3c/d91 38 1 2024-05-09T06:30:42.572 INFO:tasks.workunit.client.0.smithi046.stdout:1/368: write d7/d10/f1e [3369405,126490] 0 2024-05-09T06:30:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/451: dread d0/d3e/d53/f59 [0,4194304] 0 2024-05-09T06:30:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/452: truncate d0/d1b/d21/f85 973697 0 2024-05-09T06:30:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/453: fdatasync d0/f6a 0 2024-05-09T06:30:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/454: truncate d0/f5b 5183643 0 2024-05-09T06:30:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/455: dread - d0/d3e/f78 zero size 2024-05-09T06:30:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:3/410: dwrite d4/d20/d24/f38 [4194304,4194304] 0 2024-05-09T06:30:42.575 INFO:tasks.workunit.client.0.smithi046.stdout:7/487: read d3/d7/f32 [2983885,112488] 0 2024-05-09T06:30:42.577 INFO:tasks.workunit.client.0.smithi046.stdout:9/312: dwrite d2/d6/d33/f52 [0,4194304] 0 2024-05-09T06:30:42.577 INFO:tasks.workunit.client.0.smithi046.stdout:9/313: truncate d2/d6/d7/d1e/f58 826363 0 2024-05-09T06:30:42.577 INFO:tasks.workunit.client.0.smithi046.stdout:0/477: mknod d11/d18/d27/d28/ca0 0 2024-05-09T06:30:42.578 INFO:tasks.workunit.client.0.smithi046.stdout:6/549: symlink db/d10/d19/d66/d87/lb1 0 2024-05-09T06:30:42.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/519: rmdir d1/db/dd/d11/d5d 39 2024-05-09T06:30:42.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/520: readlink d1/l2d 0 2024-05-09T06:30:42.582 INFO:tasks.workunit.client.0.smithi046.stdout:1/369: mknod d7/d10/d28/d55/c74 0 2024-05-09T06:30:42.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/456: unlink d0/d3e/d53/c63 0 2024-05-09T06:30:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/457: fsync d0/d3e/d53/f72 0 2024-05-09T06:30:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/458: write d0/d58/d7a/f7b [88489,77496] 0 2024-05-09T06:30:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/314: dread d2/d26/d2c/f3b [0,4194304] 0 2024-05-09T06:30:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/315: chown d2/d6/l9 3879 1 2024-05-09T06:30:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:7/488: mkdir d3/d7/d4c/d4f/d9d 0 2024-05-09T06:30:42.590 INFO:tasks.workunit.client.0.smithi046.stdout:2/407: dread da/de/d11/f69 [0,4194304] 0 2024-05-09T06:30:42.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/478: mknod d11/d4f/d5b/ca1 0 2024-05-09T06:30:42.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/479: dread d11/d18/d27/d28/d6b/f8b [0,4194304] 0 2024-05-09T06:30:42.594 INFO:tasks.workunit.client.0.smithi046.stdout:6/550: link db/d10/d6b/c7d db/d10/d19/d66/d87/cb2 0 2024-05-09T06:30:42.597 INFO:tasks.workunit.client.0.smithi046.stdout:5/459: truncate d0/d1b/d21/f79 2992849 0 2024-05-09T06:30:42.597 INFO:tasks.workunit.client.0.smithi046.stdout:5/460: readlink d0/d3e/l4c 0 2024-05-09T06:30:42.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/461: write d0/d3e/d53/f6c [890528,83723] 0 2024-05-09T06:30:42.599 INFO:tasks.workunit.client.0.smithi046.stdout:9/316: rename d2/d6/d38/c51 to d2/d6/d7/d1a/d27/d2a/c61 0 2024-05-09T06:30:42.599 INFO:tasks.workunit.client.0.smithi046.stdout:9/317: write d2/d6/d7/d1a/f2e [2364974,124242] 0 2024-05-09T06:30:42.602 INFO:tasks.workunit.client.0.smithi046.stdout:7/489: unlink d3/d7/dd/l7a 0 2024-05-09T06:30:42.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/551: creat db/d10/d3f/d4f/d8a/fb3 x:0 0 0 2024-05-09T06:30:42.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/552: chown db/d10/d3f/d44/d46/d70/f9d 1498 1 2024-05-09T06:30:42.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/553: write db/d10/d3f/d44/d74/f80 [915825,87436] 0 2024-05-09T06:30:42.607 INFO:tasks.workunit.client.0.smithi046.stdout:5/462: creat d0/d1b/d39/d8a/f98 x:0 0 0 2024-05-09T06:30:42.609 INFO:tasks.workunit.client.0.smithi046.stdout:7/490: rename d3/d7/d28/d29/d35/c65 to d3/d3d/d72/d79/d81/c9e 0 2024-05-09T06:30:42.613 INFO:tasks.workunit.client.0.smithi046.stdout:6/554: rename db/d10/d3c/f45 to db/d10/d3c/fb4 0 2024-05-09T06:30:42.614 INFO:tasks.workunit.client.0.smithi046.stdout:5/463: mknod d0/d58/c99 0 2024-05-09T06:30:42.614 INFO:tasks.workunit.client.0.smithi046.stdout:5/464: chown d0/f19 237 1 2024-05-09T06:30:42.615 INFO:tasks.workunit.client.0.smithi046.stdout:7/491: creat d3/d7/d8e/f9f x:0 0 0 2024-05-09T06:30:42.617 INFO:tasks.workunit.client.0.smithi046.stdout:6/555: creat db/d10/d3f/fb5 x:0 0 0 2024-05-09T06:30:42.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/556: chown db/d10/d3f 0 1 2024-05-09T06:30:42.618 INFO:tasks.workunit.client.0.smithi046.stdout:6/557: write db/d10/d3f/d4f/d8a/d9e/fa7 [309877,98311] 0 2024-05-09T06:30:42.619 INFO:tasks.workunit.client.0.smithi046.stdout:5/465: link d0/d1b/d39/d8a/f98 d0/d1b/f9a 0 2024-05-09T06:30:42.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/558: write db/d10/d3f/d44/d5e/f86 [4809528,62225] 0 2024-05-09T06:30:42.633 INFO:tasks.workunit.client.0.smithi046.stdout:7/492: dread d3/d7/dd/d3e/f91 [0,4194304] 0 2024-05-09T06:30:42.634 INFO:tasks.workunit.client.0.smithi046.stdout:7/493: symlink d3/d7/d28/d29/d3b/la0 0 2024-05-09T06:30:42.635 INFO:tasks.workunit.client.0.smithi046.stdout:6/559: dread db/d10/d3c/f69 [0,4194304] 0 2024-05-09T06:30:42.640 INFO:tasks.workunit.client.0.smithi046.stdout:7/494: dread d3/d7/d28/f66 [0,4194304] 0 2024-05-09T06:30:42.640 INFO:tasks.workunit.client.0.smithi046.stdout:7/495: chown d3/d7/d28/d29/d3b 9131 1 2024-05-09T06:30:42.642 INFO:tasks.workunit.client.0.smithi046.stdout:7/496: truncate d3/d7/dd/f23 5854470 0 2024-05-09T06:30:42.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/497: rename d3/d7/d28/d29/d35/d5c/f75 to d3/d7/dd/d3e/fa1 0 2024-05-09T06:30:42.646 INFO:tasks.workunit.client.0.smithi046.stdout:7/498: dread d3/d7/d28/d29/d3b/f3f [0,4194304] 0 2024-05-09T06:30:42.676 INFO:tasks.workunit.client.0.smithi046.stdout:6/560: dread db/d10/d3f/d44/f5f [0,4194304] 0 2024-05-09T06:30:42.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/561: write db/d10/d3f/d44/d5e/f84 [1845873,91897] 0 2024-05-09T06:30:42.693 INFO:tasks.workunit.client.0.smithi046.stdout:6/562: fdatasync db/d10/d19/f20 0 2024-05-09T06:30:42.696 INFO:tasks.workunit.client.0.smithi046.stdout:8/521: dwrite d1/d7/d12/d45/f5f [0,4194304] 0 2024-05-09T06:30:42.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/318: dwrite d2/dc/f41 [0,4194304] 0 2024-05-09T06:30:42.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/319: chown d2/d6/d7/d1e/l2f 99868 1 2024-05-09T06:30:42.698 INFO:tasks.workunit.client.0.smithi046.stdout:9/320: fdatasync f0 0 2024-05-09T06:30:42.698 INFO:tasks.workunit.client.0.smithi046.stdout:9/321: write d2/d6/d7/f60 [54883,23062] 0 2024-05-09T06:30:42.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/370: dwrite d7/d10/d28/d30/f65 [0,4194304] 0 2024-05-09T06:30:42.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/371: fsync d7/d10/f24 0 2024-05-09T06:30:42.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/372: write d7/d10/d34/f51 [4406815,118437] 0 2024-05-09T06:30:42.702 INFO:tasks.workunit.client.0.smithi046.stdout:7/499: dwrite d3/d7/d28/d29/d35/d5c/f8c [0,4194304] 0 2024-05-09T06:30:42.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/522: creat d1/d7/d12/d1d/d30/f9c x:0 0 0 2024-05-09T06:30:42.702 INFO:tasks.workunit.client.0.smithi046.stdout:3/411: dwrite d4/d5/f3a [0,4194304] 0 2024-05-09T06:30:42.702 INFO:tasks.workunit.client.0.smithi046.stdout:3/412: write d4/d20/d24/d29/d2b/d3e/f64 [248117,33824] 0 2024-05-09T06:30:42.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/466: dwrite d0/fd [0,4194304] 0 2024-05-09T06:30:42.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/467: creat d0/d58/d7a/f9b x:0 0 0 2024-05-09T06:30:42.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/468: chown d0/d1b/d39/f5c 925943476 1 2024-05-09T06:30:42.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/322: creat d2/d6/d7/d1a/d27/d2a/f62 x:0 0 0 2024-05-09T06:30:42.707 INFO:tasks.workunit.client.0.smithi046.stdout:2/408: dwrite f7 [0,4194304] 0 2024-05-09T06:30:42.713 INFO:tasks.workunit.client.0.smithi046.stdout:0/480: rmdir d11/d18/d27/d28/d2d 39 2024-05-09T06:30:42.713 INFO:tasks.workunit.client.0.smithi046.stdout:7/500: dread d3/d7/dd/f44 [0,4194304] 0 2024-05-09T06:30:42.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/523: truncate d1/d7/d12/d1d/d30/d38/f3f 2033014 0 2024-05-09T06:30:42.716 INFO:tasks.workunit.client.0.smithi046.stdout:3/413: dread d4/d20/f26 [4194304,4194304] 0 2024-05-09T06:30:42.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/414: dread d4/d5/f43 [0,4194304] 0 2024-05-09T06:30:42.718 INFO:tasks.workunit.client.0.smithi046.stdout:5/469: write d0/d1b/f20 [480850,87845] 0 2024-05-09T06:30:42.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/470: fdatasync d0/d1b/d21/f7c 0 2024-05-09T06:30:42.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/563: rmdir db/d10/d3f/d44 39 2024-05-09T06:30:42.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/323: mknod d2/c63 0 2024-05-09T06:30:42.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/324: readlink d2/d6/l14 0 2024-05-09T06:30:42.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/481: write d11/f12 [2790268,123870] 0 2024-05-09T06:30:42.754 INFO:tasks.workunit.client.0.smithi046.stdout:8/524: rmdir d1/db/d67 39 2024-05-09T06:30:42.756 INFO:tasks.workunit.client.0.smithi046.stdout:6/564: mkdir db/d10/d3f/d44/d74/db6 0 2024-05-09T06:30:42.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/325: mknod d2/d6/d7/d1a/c64 0 2024-05-09T06:30:42.766 INFO:tasks.workunit.client.0.smithi046.stdout:1/373: dwrite d7/d10/d28/f4f [0,4194304] 0 2024-05-09T06:30:42.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/501: dwrite d3/d7/dd/d3e/fa1 [0,4194304] 0 2024-05-09T06:30:42.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/502: chown d3/d7/d28/d29/d3b/f70 23833998 1 2024-05-09T06:30:42.767 INFO:tasks.workunit.client.0.smithi046.stdout:7/503: write d3/d7/d28/d29/d35/f48 [712198,9362] 0 2024-05-09T06:30:42.767 INFO:tasks.workunit.client.0.smithi046.stdout:3/415: dwrite d4/d20/d41/f66 [0,4194304] 0 2024-05-09T06:30:42.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/326: mkdir d2/d6/d7/d1a/d27/d65 0 2024-05-09T06:30:42.768 INFO:tasks.workunit.client.0.smithi046.stdout:9/327: dread d2/d6/d7/d1a/d27/f5f [0,4194304] 0 2024-05-09T06:30:42.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/409: rename da/de/d11 to da/de/d14/d1f/d3b/d86 0 2024-05-09T06:30:42.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/482: dwrite f9 [0,4194304] 0 2024-05-09T06:30:42.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/525: getdents d1/db/dd/d11 0 2024-05-09T06:30:42.783 INFO:tasks.workunit.client.0.smithi046.stdout:1/374: dread d7/d10/d28/f33 [0,4194304] 0 2024-05-09T06:30:42.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/504: dwrite d3/d7/dd/f37 [0,4194304] 0 2024-05-09T06:30:42.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/505: readlink d3/d7/d28/l20 0 2024-05-09T06:30:42.794 INFO:tasks.workunit.client.0.smithi046.stdout:5/471: rename d0/l12 to d0/d1b/d21/l9c 0 2024-05-09T06:30:42.794 INFO:tasks.workunit.client.0.smithi046.stdout:5/472: write d0/d58/d7a/f7b [106430,116883] 0 2024-05-09T06:30:42.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/473: readlink d0/l5e 0 2024-05-09T06:30:42.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/474: chown d0/d1b/d21/c2f 3 1 2024-05-09T06:30:42.796 INFO:tasks.workunit.client.0.smithi046.stdout:2/410: link da/de/d14/l2b da/d2d/d43/l87 0 2024-05-09T06:30:42.797 INFO:tasks.workunit.client.0.smithi046.stdout:0/483: symlink d11/d3f/d6f/la2 0 2024-05-09T06:30:42.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/526: symlink d1/db/l9d 0 2024-05-09T06:30:42.798 INFO:tasks.workunit.client.0.smithi046.stdout:1/375: mkdir d7/d10/d28/d30/d3a/d75 0 2024-05-09T06:30:42.801 INFO:tasks.workunit.client.0.smithi046.stdout:6/565: dwrite db/d10/d3f/d44/fac [0,4194304] 0 2024-05-09T06:30:42.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/475: rename d0/d3e/f78 to d0/d58/f9d 0 2024-05-09T06:30:42.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/484: symlink d11/d4f/d5b/la3 0 2024-05-09T06:30:42.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/527: rmdir d1/db/dd 39 2024-05-09T06:30:42.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/528: chown d1/d7/d12/d1d/d30/d38/f54 65 1 2024-05-09T06:30:42.806 INFO:tasks.workunit.client.0.smithi046.stdout:1/376: mkdir d7/d10/d28/d30/d3a/d76 0 2024-05-09T06:30:42.807 INFO:tasks.workunit.client.0.smithi046.stdout:1/377: write d7/d10/f13 [1116252,20382] 0 2024-05-09T06:30:42.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/328: dread d2/d6/d7/f60 [0,4194304] 0 2024-05-09T06:30:42.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/416: dwrite d4/d5/f77 [0,4194304] 0 2024-05-09T06:30:42.812 INFO:tasks.workunit.client.0.smithi046.stdout:2/411: rename da/dc/f33 to da/db/f88 0 2024-05-09T06:30:42.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/506: dwrite d3/d7/d28/d29/d3b/f9c [0,4194304] 0 2024-05-09T06:30:42.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/507: fdatasync d3/d6f/f8d 0 2024-05-09T06:30:42.815 INFO:tasks.workunit.client.0.smithi046.stdout:5/476: creat d0/d3e/d83/f9e x:0 0 0 2024-05-09T06:30:42.815 INFO:tasks.workunit.client.0.smithi046.stdout:5/477: chown d0/c54 3 1 2024-05-09T06:30:42.815 INFO:tasks.workunit.client.0.smithi046.stdout:5/478: chown d0/c54 5066 1 2024-05-09T06:30:42.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/329: unlink d2/d6/d7/f12 0 2024-05-09T06:30:42.821 INFO:tasks.workunit.client.0.smithi046.stdout:0/485: dread d11/d18/f6e [0,4194304] 0 2024-05-09T06:30:42.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/378: dread d7/d10/f13 [0,4194304] 0 2024-05-09T06:30:42.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/379: write d7/d10/f27 [989727,94587] 0 2024-05-09T06:30:42.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/380: creat d7/d10/d28/d30/f77 x:0 0 0 2024-05-09T06:30:42.823 INFO:tasks.workunit.client.0.smithi046.stdout:1/381: write d7/d10/f13 [715682,72062] 0 2024-05-09T06:30:42.824 INFO:tasks.workunit.client.0.smithi046.stdout:2/412: rename da/dc/l29 to da/de/d54/d65/l89 0 2024-05-09T06:30:42.830 INFO:tasks.workunit.client.0.smithi046.stdout:7/508: truncate d3/d7/d28/d29/f45 6039507 0 2024-05-09T06:30:42.830 INFO:tasks.workunit.client.0.smithi046.stdout:7/509: chown d3/d7/d28/d29/d35/d5c/f61 2808211 1 2024-05-09T06:30:42.830 INFO:tasks.workunit.client.0.smithi046.stdout:3/417: write d4/d20/d24/d29/d2b/d3e/d5c/f67 [2845088,21519] 0 2024-05-09T06:30:42.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/510: dread d3/d7/d28/d29/d35/f62 [0,4194304] 0 2024-05-09T06:30:42.832 INFO:tasks.workunit.client.0.smithi046.stdout:9/330: mkdir d2/d6/d7/d1a/d66 0 2024-05-09T06:30:42.833 INFO:tasks.workunit.client.0.smithi046.stdout:9/331: read d2/f4 [2786125,128148] 0 2024-05-09T06:30:42.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/486: dread d11/d18/d27/d28/f31 [0,4194304] 0 2024-05-09T06:30:42.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/487: write d11/d18/d1c/d53/f61 [839639,68342] 0 2024-05-09T06:30:42.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/413: creat da/de/d14/f8a x:0 0 0 2024-05-09T06:30:42.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/418: mknod d4/d5d/c86 0 2024-05-09T06:30:42.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/511: truncate d3/d7/f52 403841 0 2024-05-09T06:30:42.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/332: dread d2/f5e [4194304,4194304] 0 2024-05-09T06:30:42.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/488: rename d11/d3f/d6f/f76 to d11/d4f/fa4 0 2024-05-09T06:30:42.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/489: fsync d11/f15 0 2024-05-09T06:30:42.846 INFO:tasks.workunit.client.0.smithi046.stdout:2/414: mkdir da/de/d14/d1f/d20/d7c/d8b 0 2024-05-09T06:30:42.846 INFO:tasks.workunit.client.0.smithi046.stdout:3/419: symlink d4/d20/d24/l87 0 2024-05-09T06:30:42.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/333: link d2/d26/d2c/f3b d2/d6/d7/d1a/d66/f67 0 2024-05-09T06:30:42.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/334: chown d2/d6/d7 19049932 1 2024-05-09T06:30:42.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/335: chown d2/d26/d2c/f3b 294 1 2024-05-09T06:30:42.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/490: rmdir d11/d18/d27/d28/d2d/d9f 0 2024-05-09T06:30:42.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/415: stat da/dc/c53 0 2024-05-09T06:30:42.855 INFO:tasks.workunit.client.0.smithi046.stdout:3/420: dread d4/d20/d24/d2a/d55/d74/f76 [0,4194304] 0 2024-05-09T06:30:42.856 INFO:tasks.workunit.client.0.smithi046.stdout:3/421: creat d4/d20/d24/d2a/d4e/f88 x:0 0 0 2024-05-09T06:30:42.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/336: link d2/d6/f25 d2/d26/f68 0 2024-05-09T06:30:42.861 INFO:tasks.workunit.client.0.smithi046.stdout:0/491: rename d11/d18/d1c/f1d to d11/d18/d1c/d53/fa5 0 2024-05-09T06:30:42.861 INFO:tasks.workunit.client.0.smithi046.stdout:0/492: fsync d11/d18/d27/d28/d2d/d5c/f8f 0 2024-05-09T06:30:42.862 INFO:tasks.workunit.client.0.smithi046.stdout:4/440: sync 2024-05-09T06:30:42.865 INFO:tasks.workunit.client.0.smithi046.stdout:8/529: dwrite d1/d7/d12/f80 [0,4194304] 0 2024-05-09T06:30:42.865 INFO:tasks.workunit.client.0.smithi046.stdout:8/530: read - d1/db/dd/d11/d5d/f6b zero size 2024-05-09T06:30:42.865 INFO:tasks.workunit.client.0.smithi046.stdout:8/531: chown d1/db/dd/d11/d5d/l87 5 1 2024-05-09T06:30:42.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/493: truncate d11/d3f/f47 600717 0 2024-05-09T06:30:42.875 INFO:tasks.workunit.client.0.smithi046.stdout:4/441: unlink d7/f1a 0 2024-05-09T06:30:42.881 INFO:tasks.workunit.client.0.smithi046.stdout:8/532: write d1/d7/d12/f57 [2041458,102166] 0 2024-05-09T06:30:42.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/494: unlink d11/d18/d1c/d53/d82/f84 0 2024-05-09T06:30:42.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/495: rename d11/d3f to d11/d3f/d6f/da6 22 2024-05-09T06:30:42.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/496: write d11/d18/d1c/d53/f61 [1061358,23144] 0 2024-05-09T06:30:42.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/497: stat d11/d18/d27/d28/d36/f37 0 2024-05-09T06:30:42.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/498: creat d11/d18/d1c/d53/d82/fa7 x:0 0 0 2024-05-09T06:30:42.886 INFO:tasks.workunit.client.0.smithi046.stdout:4/442: getdents d7/df/d10/d2f 0 2024-05-09T06:30:42.887 INFO:tasks.workunit.client.0.smithi046.stdout:6/566: dwrite db/d10/d3f/d44/d74/f80 [0,4194304] 0 2024-05-09T06:30:42.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/567: fsync db/d10/d30/f4a 0 2024-05-09T06:30:42.889 INFO:tasks.workunit.client.0.smithi046.stdout:7/512: dwrite d3/d6f/f8b [0,4194304] 0 2024-05-09T06:30:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/443: dread d7/df/d53/f6e [0,4194304] 0 2024-05-09T06:30:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:5/479: dwrite d0/d58/f9d [0,4194304] 0 2024-05-09T06:30:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:5/480: chown d0/d3e/c6b 98814871 1 2024-05-09T06:30:42.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/337: dwrite d2/d6/d38/f48 [4194304,4194304] 0 2024-05-09T06:30:42.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/416: dwrite f8 [0,4194304] 0 2024-05-09T06:30:42.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/417: write da/de/f7e [264979,7754] 0 2024-05-09T06:30:42.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/533: mknod d1/db/d41/c9e 0 2024-05-09T06:30:42.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/534: readlink d1/db/dd/d11/d43/l91 0 2024-05-09T06:30:42.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/535: write d1/d7/d2c/f58 [4114532,84756] 0 2024-05-09T06:30:42.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/536: write d1/d7/d2c/f4d [4819587,57453] 0 2024-05-09T06:30:42.899 INFO:tasks.workunit.client.0.smithi046.stdout:6/568: dread db/d10/d3f/d4f/d89/f9c [0,4194304] 0 2024-05-09T06:30:42.901 INFO:tasks.workunit.client.0.smithi046.stdout:7/513: write d3/d7/dd/f23 [2889079,109309] 0 2024-05-09T06:30:42.909 INFO:tasks.workunit.client.0.smithi046.stdout:4/444: dwrite d7/df/d3a/d45/f85 [0,4194304] 0 2024-05-09T06:30:42.910 INFO:tasks.workunit.client.0.smithi046.stdout:0/499: dwrite d11/d18/f39 [0,4194304] 0 2024-05-09T06:30:42.919 INFO:tasks.workunit.client.0.smithi046.stdout:9/338: creat d2/f69 x:0 0 0 2024-05-09T06:30:42.930 INFO:tasks.workunit.client.0.smithi046.stdout:8/537: mkdir d1/db/d67/d9f 0 2024-05-09T06:30:42.930 INFO:tasks.workunit.client.0.smithi046.stdout:8/538: fdatasync d1/d7/d2c/f15 0 2024-05-09T06:30:42.930 INFO:tasks.workunit.client.0.smithi046.stdout:8/539: fsync d1/d7/d12/d1d/d30/d38/f8c 0 2024-05-09T06:30:42.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/569: getdents db/d10/d19/d66/d87 0 2024-05-09T06:30:42.932 INFO:tasks.workunit.client.0.smithi046.stdout:4/445: dwrite d7/df/d3a/d25/f4e [0,4194304] 0 2024-05-09T06:30:42.932 INFO:tasks.workunit.client.0.smithi046.stdout:4/446: creat d7/df/d10/d1d/d77/d87/f93 x:0 0 0 2024-05-09T06:30:42.932 INFO:tasks.workunit.client.0.smithi046.stdout:4/447: write d7/df/d10/d1d/d77/d87/f8f [640937,95422] 0 2024-05-09T06:30:42.937 INFO:tasks.workunit.client.0.smithi046.stdout:7/514: symlink d3/d7/d4c/d99/la2 0 2024-05-09T06:30:42.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/422: rmdir d4/d20/d24/d2a 39 2024-05-09T06:30:42.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/423: write d4/d5/f37 [890086,120128] 0 2024-05-09T06:30:42.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/424: dread - d4/d20/d24/d29/d2b/d3e/d5c/d6c/f80 zero size 2024-05-09T06:30:42.940 INFO:tasks.workunit.client.0.smithi046.stdout:6/570: dread db/d10/d19/f83 [0,4194304] 0 2024-05-09T06:30:42.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/500: mknod d11/d3f/ca8 0 2024-05-09T06:30:42.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/501: stat d11/d18/d27/d28/f50 0 2024-05-09T06:30:42.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/502: creat d11/d18/d27/d28/fa9 x:0 0 0 2024-05-09T06:30:42.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/515: dread d3/d3d/f47 [0,4194304] 0 2024-05-09T06:30:42.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/516: write d3/d7/dd/f59 [4977352,33362] 0 2024-05-09T06:30:42.951 INFO:tasks.workunit.client.0.smithi046.stdout:4/448: dwrite d7/df/d10/d1d/d77/d87/f93 [0,4194304] 0 2024-05-09T06:30:42.951 INFO:tasks.workunit.client.0.smithi046.stdout:4/449: truncate d7/df/d3a/f76 630928 0 2024-05-09T06:30:42.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/481: creat d0/d1b/d39/d8b/f9f x:0 0 0 2024-05-09T06:30:42.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/482: chown d0/l3b 262737 1 2024-05-09T06:30:42.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/483: write d0/d3e/d50/f73 [1572522,68608] 0 2024-05-09T06:30:42.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/484: write d0/d3e/d50/f73 [1553371,35225] 0 2024-05-09T06:30:42.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/418: getdents da 0 2024-05-09T06:30:42.956 INFO:tasks.workunit.client.0.smithi046.stdout:6/571: read db/f2b [4103231,55942] 0 2024-05-09T06:30:42.956 INFO:tasks.workunit.client.0.smithi046.stdout:6/572: dread - db/d10/d3f/d44/d46/d70/f79 zero size 2024-05-09T06:30:42.958 INFO:tasks.workunit.client.0.smithi046.stdout:0/503: dwrite d11/d4f/d5b/d5f/f6d [0,4194304] 0 2024-05-09T06:30:42.960 INFO:tasks.workunit.client.0.smithi046.stdout:3/425: creat d4/d20/d24/d2a/d55/d74/f89 x:0 0 0 2024-05-09T06:30:42.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/419: dread da/de/d1c/f3e [0,4194304] 0 2024-05-09T06:30:42.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/420: write da/dc/f27 [2013637,95378] 0 2024-05-09T06:30:42.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/517: mkdir d3/d7/d28/d73/da3 0 2024-05-09T06:30:42.967 INFO:tasks.workunit.client.0.smithi046.stdout:7/518: read d3/f8 [466638,106894] 0 2024-05-09T06:30:42.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/450: dwrite d7/df/d3a/d45/f51 [0,4194304] 0 2024-05-09T06:30:42.970 INFO:tasks.workunit.client.0.smithi046.stdout:4/451: truncate d7/df/f1b 9010045 0 2024-05-09T06:30:42.970 INFO:tasks.workunit.client.0.smithi046.stdout:6/573: mkdir db/d10/d57/db7 0 2024-05-09T06:30:42.972 INFO:tasks.workunit.client.0.smithi046.stdout:2/421: dread da/dc/f81 [0,4194304] 0 2024-05-09T06:30:42.974 INFO:tasks.workunit.client.0.smithi046.stdout:7/519: dread d3/d7/d28/d29/d35/d5c/f8c [0,4194304] 0 2024-05-09T06:30:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:7/520: read d3/d7/d28/d29/f3c [278747,63624] 0 2024-05-09T06:30:42.980 INFO:tasks.workunit.client.0.smithi046.stdout:7/521: chown d3/d3d/d72/d79 162 1 2024-05-09T06:30:42.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/504: creat d11/d18/d27/d28/d36/faa x:0 0 0 2024-05-09T06:30:42.980 INFO:tasks.workunit.client.0.smithi046.stdout:6/574: dread db/d10/d3f/d44/d74/f80 [0,4194304] 0 2024-05-09T06:30:42.981 INFO:tasks.workunit.client.0.smithi046.stdout:0/505: write d11/d18/d1c/d53/f61 [757118,47525] 0 2024-05-09T06:30:42.981 INFO:tasks.workunit.client.0.smithi046.stdout:3/426: mknod d4/d20/d24/d2a/d4e/c8a 0 2024-05-09T06:30:42.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/485: rename d0/d1b/c2b to d0/d1b/d39/ca0 0 2024-05-09T06:30:42.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/486: creat d0/d58/d7a/fa1 x:0 0 0 2024-05-09T06:30:42.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/487: readlink d0/d3e/l76 0 2024-05-09T06:30:42.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/452: symlink d7/df/d3a/d25/l94 0 2024-05-09T06:30:42.989 INFO:tasks.workunit.client.0.smithi046.stdout:6/575: creat db/d10/d3f/d44/fb8 x:0 0 0 2024-05-09T06:30:42.990 INFO:tasks.workunit.client.0.smithi046.stdout:0/506: mkdir d11/d18/d1c/d53/dab 0 2024-05-09T06:30:42.995 INFO:tasks.workunit.client.0.smithi046.stdout:4/453: dread d7/fa [0,4194304] 0 2024-05-09T06:30:42.995 INFO:tasks.workunit.client.0.smithi046.stdout:5/488: mknod d0/d1b/d21/d81/ca2 0 2024-05-09T06:30:42.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/576: truncate db/d10/d3c/f5b 3077725 0 2024-05-09T06:30:42.995 INFO:tasks.workunit.client.0.smithi046.stdout:3/427: getdents d4/d20/d24/d29/d2b/d3e/d5c/d6c 0 2024-05-09T06:30:42.998 INFO:tasks.workunit.client.0.smithi046.stdout:7/522: dwrite d3/d6f/f8b [4194304,4194304] 0 2024-05-09T06:30:42.998 INFO:tasks.workunit.client.0.smithi046.stdout:5/489: link d0/d1b/d21/f5d d0/d1b/fa3 0 2024-05-09T06:30:42.998 INFO:tasks.workunit.client.0.smithi046.stdout:0/507: dread d11/f15 [0,4194304] 0 2024-05-09T06:30:43.002 INFO:tasks.workunit.client.0.smithi046.stdout:4/454: write d7/df/d3a/f2c [3926383,82872] 0 2024-05-09T06:30:43.004 INFO:tasks.workunit.client.0.smithi046.stdout:7/523: unlink d3/d7/d28/l20 0 2024-05-09T06:30:43.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/428: write d4/d20/d24/f38 [4521034,42528] 0 2024-05-09T06:30:43.008 INFO:tasks.workunit.client.0.smithi046.stdout:5/490: rename d0/d3e/d53/f69 to d0/d1b/d21/d81/fa4 0 2024-05-09T06:30:43.008 INFO:tasks.workunit.client.0.smithi046.stdout:5/491: stat d0/f24 0 2024-05-09T06:30:43.008 INFO:tasks.workunit.client.0.smithi046.stdout:5/492: write d0/f16 [1274153,112591] 0 2024-05-09T06:30:43.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/524: mknod d3/d7/d28/d29/d35/d5c/d9b/ca4 0 2024-05-09T06:30:43.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/525: write d3/d7/dd/fe [1483430,119534] 0 2024-05-09T06:30:43.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/455: dread d7/df/d3a/f2c [0,4194304] 0 2024-05-09T06:30:43.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/429: rename d4/d48/d49/l5a to d4/d20/l8b 0 2024-05-09T06:30:43.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/430: fdatasync d4/d5/f43 0 2024-05-09T06:30:43.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/493: symlink d0/d58/la5 0 2024-05-09T06:30:43.016 INFO:tasks.workunit.client.0.smithi046.stdout:4/456: getdents d7/df/d53 0 2024-05-09T06:30:43.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/457: write d7/df/d10/d1d/f8e [853426,42483] 0 2024-05-09T06:30:43.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/458: write d7/df/d3a/f76 [743629,23069] 0 2024-05-09T06:30:43.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/459: chown d7/f90 791793 1 2024-05-09T06:30:43.018 INFO:tasks.workunit.client.0.smithi046.stdout:7/526: rename d3/d7/d28/d29/d3b/f9c to d3/d7/d28/fa5 0 2024-05-09T06:30:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/527: unlink d3/d3d/d5b/f77 0 2024-05-09T06:30:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/528: fdatasync d3/d7/d28/f66 0 2024-05-09T06:30:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/529: truncate d3/d7/d4c/d4f/f6b 2182646 0 2024-05-09T06:30:43.038 INFO:tasks.workunit.client.0.smithi046.stdout:6/577: rmdir db/d10/d3f/d44 39 2024-05-09T06:30:43.040 INFO:tasks.workunit.client.0.smithi046.stdout:3/431: dwrite d4/d5/f3a [4194304,4194304] 0 2024-05-09T06:30:43.040 INFO:tasks.workunit.client.0.smithi046.stdout:3/432: readlink d4/d20/d24/l33 0 2024-05-09T06:30:43.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/578: write db/d10/d3f/d44/f5f [808087,29885] 0 2024-05-09T06:30:43.045 INFO:tasks.workunit.client.0.smithi046.stdout:3/433: mknod d4/d20/d24/d29/d2b/c8c 0 2024-05-09T06:30:43.046 INFO:tasks.workunit.client.0.smithi046.stdout:4/460: dwrite d7/f2e [0,4194304] 0 2024-05-09T06:30:43.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/494: dwrite d0/d1b/d21/f55 [0,4194304] 0 2024-05-09T06:30:43.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/495: getdents d0/d3e/d50 0 2024-05-09T06:30:43.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/496: write d0/d3e/d83/f90 [280532,97099] 0 2024-05-09T06:30:43.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/497: fdatasync d0/d1b/d21/f79 0 2024-05-09T06:30:43.048 INFO:tasks.workunit.client.0.smithi046.stdout:7/530: dwrite d3/d7/d28/d29/d35/d5c/f61 [0,4194304] 0 2024-05-09T06:30:43.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/498: creat d0/d1b/d21/d81/fa6 x:0 0 0 2024-05-09T06:30:43.048 INFO:tasks.workunit.client.0.smithi046.stdout:7/531: creat d3/d7/d28/d73/fa6 x:0 0 0 2024-05-09T06:30:43.049 INFO:tasks.workunit.client.0.smithi046.stdout:6/579: symlink db/d10/d3f/d4f/d8a/lb9 0 2024-05-09T06:30:43.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/461: creat d7/df/d53/d91/f95 x:0 0 0 2024-05-09T06:30:43.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/462: chown d7/df/d3a/d25/d86 6 1 2024-05-09T06:30:43.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/434: dwrite d4/d20/d41/f66 [0,4194304] 0 2024-05-09T06:30:43.071 INFO:tasks.workunit.client.0.smithi046.stdout:5/499: rename d0/d58/d7a/f9b to d0/d58/d7a/fa7 0 2024-05-09T06:30:43.073 INFO:tasks.workunit.client.0.smithi046.stdout:6/580: link db/d10/d30/l40 db/d10/d57/db7/lba 0 2024-05-09T06:30:43.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/532: dwrite d3/d7/dd/f59 [0,4194304] 0 2024-05-09T06:30:43.082 INFO:tasks.workunit.client.0.smithi046.stdout:5/500: truncate d0/f14 1865382 0 2024-05-09T06:30:43.089 INFO:tasks.workunit.client.0.smithi046.stdout:6/581: dread db/f28 [0,4194304] 0 2024-05-09T06:30:43.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/582: truncate db/d10/d3f/d44/d5e/f86 8873307 0 2024-05-09T06:30:43.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/583: chown db/d10/d76 750 1 2024-05-09T06:30:43.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/584: chown db/d10/d57/db7/lba 314 1 2024-05-09T06:30:43.093 INFO:tasks.workunit.client.0.smithi046.stdout:7/533: dwrite d3/d7/d28/f2c [0,4194304] 0 2024-05-09T06:30:43.107 INFO:tasks.workunit.client.0.smithi046.stdout:5/501: creat d0/d3e/d50/fa8 x:0 0 0 2024-05-09T06:30:43.107 INFO:tasks.workunit.client.0.smithi046.stdout:5/502: chown d0/d3e/d53 17322917 1 2024-05-09T06:30:43.107 INFO:tasks.workunit.client.0.smithi046.stdout:5/503: creat d0/d58/fa9 x:0 0 0 2024-05-09T06:30:43.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/585: mknod db/d10/d3f/d4f/d8a/cbb 0 2024-05-09T06:30:43.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/586: fdatasync db/d10/d3f/d44/d5e/f88 0 2024-05-09T06:30:43.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/463: rename d7/df/d10/d2f/d30 to d7/df/d3a/d45/d96 0 2024-05-09T06:30:43.115 INFO:tasks.workunit.client.0.smithi046.stdout:4/464: fdatasync d7/f2e 0 2024-05-09T06:30:43.119 INFO:tasks.workunit.client.0.smithi046.stdout:5/504: truncate d0/d3e/d53/f6c 464503 0 2024-05-09T06:30:43.120 INFO:tasks.workunit.client.0.smithi046.stdout:6/587: rmdir db/d10/d3f/d44/d46/d70 39 2024-05-09T06:30:43.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/435: rename d4/d20/d24/d59/c7e to d4/d20/d24/d29/d7a/c8d 0 2024-05-09T06:30:43.123 INFO:tasks.workunit.client.0.smithi046.stdout:3/436: dread - d4/d20/d24/d29/d2b/f70 zero size 2024-05-09T06:30:43.123 INFO:tasks.workunit.client.0.smithi046.stdout:3/437: fsync d4/d48/f53 0 2024-05-09T06:30:43.123 INFO:tasks.workunit.client.0.smithi046.stdout:3/438: write d4/d48/f53 [989139,50243] 0 2024-05-09T06:30:43.125 INFO:tasks.workunit.client.0.smithi046.stdout:4/465: unlink d7/df/d53/f6e 0 2024-05-09T06:30:43.126 INFO:tasks.workunit.client.0.smithi046.stdout:5/505: readlink d0/d1b/d39/l87 0 2024-05-09T06:30:43.126 INFO:tasks.workunit.client.0.smithi046.stdout:5/506: creat d0/d1b/d21/d81/faa x:0 0 0 2024-05-09T06:30:43.126 INFO:tasks.workunit.client.0.smithi046.stdout:4/466: dread d7/df/f38 [0,4194304] 0 2024-05-09T06:30:43.127 INFO:tasks.workunit.client.0.smithi046.stdout:6/588: link db/d10/d57/db7/lba db/d10/d3c/d98/lbc 0 2024-05-09T06:30:43.129 INFO:tasks.workunit.client.0.smithi046.stdout:3/439: rename d4/d20/d41/d4a/f69 to d4/d20/d24/d2a/d4e/f8e 0 2024-05-09T06:30:43.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/467: unlink d7/df/d10/c68 0 2024-05-09T06:30:43.139 INFO:tasks.workunit.client.0.smithi046.stdout:6/589: creat db/d10/d3f/d44/d46/fbd x:0 0 0 2024-05-09T06:30:43.147 INFO:tasks.workunit.client.0.smithi046.stdout:5/507: rmdir d0/d3e 39 2024-05-09T06:30:43.149 INFO:tasks.workunit.client.0.smithi046.stdout:6/590: mkdir db/d10/d3f/d44/d5e/dbe 0 2024-05-09T06:30:43.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/508: dwrite d0/d1b/d21/d81/fa4 [0,4194304] 0 2024-05-09T06:30:43.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/382: sync 2024-05-09T06:30:43.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/383: creat d7/d10/d28/d30/d3a/f78 x:0 0 0 2024-05-09T06:30:43.165 INFO:tasks.workunit.client.0.smithi046.stdout:5/509: symlink d0/d58/lab 0 2024-05-09T06:30:43.168 INFO:tasks.workunit.client.0.smithi046.stdout:1/384: unlink d7/d10/l31 0 2024-05-09T06:30:43.168 INFO:tasks.workunit.client.0.smithi046.stdout:1/385: chown d7/d10/d34/f6e 5511 1 2024-05-09T06:30:43.170 INFO:tasks.workunit.client.0.smithi046.stdout:1/386: dread d7/d10/f2b [0,4194304] 0 2024-05-09T06:30:43.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/387: mknod d7/d10/d28/d55/c79 0 2024-05-09T06:30:43.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/388: chown d7/d10/d28/d30/l32 11435765 1 2024-05-09T06:30:43.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/510: write d0/d1b/f35 [1770984,18399] 0 2024-05-09T06:30:43.173 INFO:tasks.workunit.client.0.smithi046.stdout:6/591: dwrite db/d10/d3f/d44/d5e/f88 [0,4194304] 0 2024-05-09T06:30:43.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/592: creat db/d10/d30/fbf x:0 0 0 2024-05-09T06:30:43.175 INFO:tasks.workunit.client.0.smithi046.stdout:5/511: rename d0/d1b/d21/c94 to d0/d1b/d21/d81/cac 0 2024-05-09T06:30:43.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/593: creat db/d10/d30/d53/fc0 x:0 0 0 2024-05-09T06:30:43.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/594: write db/d10/f1e [1321506,10353] 0 2024-05-09T06:30:43.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/595: fdatasync db/f2b 0 2024-05-09T06:30:43.182 INFO:tasks.workunit.client.0.smithi046.stdout:6/596: dread db/d10/d3f/d4f/d8a/d9e/fa7 [0,4194304] 0 2024-05-09T06:30:43.182 INFO:tasks.workunit.client.0.smithi046.stdout:5/512: write d0/f4 [1060808,127909] 0 2024-05-09T06:30:43.183 INFO:tasks.workunit.client.0.smithi046.stdout:6/597: creat db/d10/d3f/d44/d5e/dbe/fc1 x:0 0 0 2024-05-09T06:30:43.184 INFO:tasks.workunit.client.0.smithi046.stdout:6/598: getdents db/d10/d3c/d98 0 2024-05-09T06:30:43.190 INFO:tasks.workunit.client.0.smithi046.stdout:5/513: dread d0/d1b/d21/f79 [0,4194304] 0 2024-05-09T06:30:43.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/389: dwrite d7/f62 [0,4194304] 0 2024-05-09T06:30:43.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/514: truncate d0/f5b 2593522 0 2024-05-09T06:30:43.199 INFO:tasks.workunit.client.0.smithi046.stdout:5/515: mkdir d0/dad 0 2024-05-09T06:30:43.199 INFO:tasks.workunit.client.0.smithi046.stdout:1/390: rmdir d7/d10/d28/d55 39 2024-05-09T06:30:43.199 INFO:tasks.workunit.client.0.smithi046.stdout:6/599: dwrite db/d93/f7e [0,4194304] 0 2024-05-09T06:30:43.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/516: creat d0/d3e/d50/fae x:0 0 0 2024-05-09T06:30:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/600: read db/d10/d3f/d44/d46/d70/f9d [1195299,93276] 0 2024-05-09T06:30:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/601: creat db/d10/d76/fc2 x:0 0 0 2024-05-09T06:30:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:5/517: dread d0/d3e/f3f [0,4194304] 0 2024-05-09T06:30:43.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/391: dwrite d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:43.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/392: write d7/fc [6059320,66738] 0 2024-05-09T06:30:43.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/393: chown d7/d6d 3526686 1 2024-05-09T06:30:43.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/394: getdents d7/d10/d28/d30/d3a/d76 0 2024-05-09T06:30:43.213 INFO:tasks.workunit.client.0.smithi046.stdout:6/602: creat db/fc3 x:0 0 0 2024-05-09T06:30:43.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/395: dread d7/d10/d34/f45 [4194304,4194304] 0 2024-05-09T06:30:43.214 INFO:tasks.workunit.client.0.smithi046.stdout:5/518: link d0/d3e/d53/f97 d0/d58/faf 0 2024-05-09T06:30:43.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/603: rename db/fc3 to db/d10/d19/d66/fc4 0 2024-05-09T06:30:43.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/604: dwrite db/d10/d30/faf [0,4194304] 0 2024-05-09T06:30:43.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/605: creat db/d10/d3f/d44/d46/fc5 x:0 0 0 2024-05-09T06:30:43.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/606: truncate db/d10/d3f/d4f/d8a/fb3 443987 0 2024-05-09T06:30:43.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/396: unlink d7/c4b 0 2024-05-09T06:30:43.260 INFO:tasks.workunit.client.0.smithi046.stdout:5/519: truncate d0/d1b/d39/f60 4415275 0 2024-05-09T06:30:43.268 INFO:tasks.workunit.client.0.smithi046.stdout:5/520: dread d0/d3e/d53/f72 [0,4194304] 0 2024-05-09T06:30:43.272 INFO:tasks.workunit.client.0.smithi046.stdout:6/607: symlink db/d10/d3f/d44/d5e/lc6 0 2024-05-09T06:30:43.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/397: dwrite d7/f18 [0,4194304] 0 2024-05-09T06:30:43.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/521: dread d0/f5b [0,4194304] 0 2024-05-09T06:30:43.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/522: creat d0/d58/d7a/fb0 x:0 0 0 2024-05-09T06:30:43.278 INFO:tasks.workunit.client.0.smithi046.stdout:6/608: creat db/d10/d19/d66/d87/fc7 x:0 0 0 2024-05-09T06:30:43.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/398: creat d7/d10/d28/d30/d3a/d76/f7a x:0 0 0 2024-05-09T06:30:43.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/399: chown d7/d10/d28/d30/d3a/c6b 192 1 2024-05-09T06:30:43.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/523: rename d0/d1b/l61 to d0/d1b/d39/d8b/lb1 0 2024-05-09T06:30:43.292 INFO:tasks.workunit.client.0.smithi046.stdout:6/609: creat db/d10/d6b/fc8 x:0 0 0 2024-05-09T06:30:43.293 INFO:tasks.workunit.client.0.smithi046.stdout:5/524: creat d0/d3e/d53/fb2 x:0 0 0 2024-05-09T06:30:43.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/525: unlink d0/d1b/fa3 0 2024-05-09T06:30:43.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/526: write d0/d3e/d50/fa8 [598507,61085] 0 2024-05-09T06:30:43.302 INFO:tasks.workunit.client.0.smithi046.stdout:5/527: read d0/f14 [47897,118049] 0 2024-05-09T06:30:43.303 INFO:tasks.workunit.client.0.smithi046.stdout:6/610: symlink db/d93/lc9 0 2024-05-09T06:30:43.307 INFO:tasks.workunit.client.0.smithi046.stdout:5/528: dread d0/d1b/d21/f79 [0,4194304] 0 2024-05-09T06:30:43.311 INFO:tasks.workunit.client.0.smithi046.stdout:1/400: dwrite d7/d10/f23 [0,4194304] 0 2024-05-09T06:30:43.311 INFO:tasks.workunit.client.0.smithi046.stdout:5/529: getdents d0 0 2024-05-09T06:30:43.314 INFO:tasks.workunit.client.0.smithi046.stdout:1/401: rename d7/d10/f27 to d7/d10/d28/d55/f7b 0 2024-05-09T06:30:43.314 INFO:tasks.workunit.client.0.smithi046.stdout:1/402: write d7/d10/d34/f68 [5585947,58139] 0 2024-05-09T06:30:43.317 INFO:tasks.workunit.client.0.smithi046.stdout:1/403: creat d7/d10/d34/d46/d48/f7c x:0 0 0 2024-05-09T06:30:43.324 INFO:tasks.workunit.client.0.smithi046.stdout:9/339: sync 2024-05-09T06:30:43.327 INFO:tasks.workunit.client.0.smithi046.stdout:9/340: symlink d2/d6/l6a 0 2024-05-09T06:30:43.327 INFO:tasks.workunit.client.0.smithi046.stdout:9/341: write d2/d6/f25 [149661,90545] 0 2024-05-09T06:30:43.331 INFO:tasks.workunit.client.0.smithi046.stdout:1/404: write d7/d10/d28/f4f [2169077,40352] 0 2024-05-09T06:30:43.331 INFO:tasks.workunit.client.0.smithi046.stdout:1/405: creat d7/d10/d34/d46/d48/f7d x:0 0 0 2024-05-09T06:30:43.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/342: truncate d2/d6/d7/d1a/d27/f5f 1042050 0 2024-05-09T06:30:43.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/611: dwrite db/d10/d3c/f69 [0,4194304] 0 2024-05-09T06:30:43.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/612: fdatasync db/f28 0 2024-05-09T06:30:43.333 INFO:tasks.workunit.client.0.smithi046.stdout:5/530: dwrite d0/d3e/d53/f6f [0,4194304] 0 2024-05-09T06:30:43.341 INFO:tasks.workunit.client.0.smithi046.stdout:1/406: rename d7/c9 to d7/d10/c7e 0 2024-05-09T06:30:43.343 INFO:tasks.workunit.client.0.smithi046.stdout:9/343: mknod d2/d6/d7/d1a/d27/c6b 0 2024-05-09T06:30:43.345 INFO:tasks.workunit.client.0.smithi046.stdout:6/613: dwrite db/f14 [0,4194304] 0 2024-05-09T06:30:43.345 INFO:tasks.workunit.client.0.smithi046.stdout:6/614: fsync db/d10/d3c/f6d 0 2024-05-09T06:30:43.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/531: mkdir d0/db3 0 2024-05-09T06:30:43.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/407: getdents d7/d10/d34/d46 0 2024-05-09T06:30:43.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/532: mknod d0/d1b/cb4 0 2024-05-09T06:30:43.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/408: mkdir d7/d10/d28/d30/d3a/d7f 0 2024-05-09T06:30:43.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/615: link db/f25 db/d93/fca 0 2024-05-09T06:30:43.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/616: chown db/f14 173 1 2024-05-09T06:30:43.358 INFO:tasks.workunit.client.0.smithi046.stdout:9/344: dwrite d2/d6/f25 [0,4194304] 0 2024-05-09T06:30:43.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/533: creat d0/d3e/fb5 x:0 0 0 2024-05-09T06:30:43.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/534: chown d0/d3e/d53/l93 90 1 2024-05-09T06:30:43.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/617: rename db/le to db/d10/d3f/d44/d5e/dbe/lcb 0 2024-05-09T06:30:43.366 INFO:tasks.workunit.client.0.smithi046.stdout:9/345: truncate d2/d6/f22 2481307 0 2024-05-09T06:30:43.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/535: mknod d0/d1b/d21/cb6 0 2024-05-09T06:30:43.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/536: creat d0/d1b/d39/d8b/fb7 x:0 0 0 2024-05-09T06:30:43.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/409: rmdir d7/d10/d28/d30 39 2024-05-09T06:30:43.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/410: write d7/d10/f47 [1065269,73751] 0 2024-05-09T06:30:43.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/411: write d7/d10/d28/d30/d3a/f78 [369854,81385] 0 2024-05-09T06:30:43.372 INFO:tasks.workunit.client.0.smithi046.stdout:6/618: getdents db/d10/d3f/d4f/d89 0 2024-05-09T06:30:43.373 INFO:tasks.workunit.client.0.smithi046.stdout:6/619: stat db/d10/d76/fc2 0 2024-05-09T06:30:43.376 INFO:tasks.workunit.client.0.smithi046.stdout:5/537: symlink d0/d1b/d21/d81/lb8 0 2024-05-09T06:30:43.376 INFO:tasks.workunit.client.0.smithi046.stdout:5/538: read - d0/d1b/d21/d81/fa6 zero size 2024-05-09T06:30:43.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/620: mkdir db/d10/d57/db7/dcc 0 2024-05-09T06:30:43.380 INFO:tasks.workunit.client.0.smithi046.stdout:9/346: symlink d2/d6/d7/l6c 0 2024-05-09T06:30:43.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/412: dread d7/d10/d28/d30/d3a/f3b [0,4194304] 0 2024-05-09T06:30:43.380 INFO:tasks.workunit.client.0.smithi046.stdout:9/347: write d2/d6/d33/f52 [4943566,119892] 0 2024-05-09T06:30:43.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/539: dread d0/d3e/d83/f8c [0,4194304] 0 2024-05-09T06:30:43.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/540: readlink d0/d1b/d21/l4f 0 2024-05-09T06:30:43.386 INFO:tasks.workunit.client.0.smithi046.stdout:6/621: mknod db/d10/d3f/d44/d5e/ccd 0 2024-05-09T06:30:43.386 INFO:tasks.workunit.client.0.smithi046.stdout:1/413: rmdir d7/d10/d28/d55 39 2024-05-09T06:30:43.388 INFO:tasks.workunit.client.0.smithi046.stdout:9/348: dread d2/d6/f25 [0,4194304] 0 2024-05-09T06:30:43.388 INFO:tasks.workunit.client.0.smithi046.stdout:5/541: symlink d0/d1b/lb9 0 2024-05-09T06:30:43.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/622: rename db/d10/d3f/d44/d5e/f84 to db/d10/d19/d66/fce 0 2024-05-09T06:30:43.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/623: chown db/d10/d30/fbf 15 1 2024-05-09T06:30:43.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/624: truncate db/d10/d3f/d4f/d89/f9c 4450319 0 2024-05-09T06:30:43.392 INFO:tasks.workunit.client.0.smithi046.stdout:1/414: unlink d7/d10/d28/c4d 0 2024-05-09T06:30:43.394 INFO:tasks.workunit.client.0.smithi046.stdout:9/349: link d2/dc/l4c d2/d6/d7/d1a/l6d 0 2024-05-09T06:30:43.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/542: stat d0/d1b/d21/l4f 0 2024-05-09T06:30:43.396 INFO:tasks.workunit.client.0.smithi046.stdout:6/625: symlink db/d10/d3f/d44/d46/lcf 0 2024-05-09T06:30:43.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/626: rename db/d10/d19/d66/cae to db/d10/d3f/d44/d5e/cd0 0 2024-05-09T06:30:43.405 INFO:tasks.workunit.client.0.smithi046.stdout:5/543: dread d0/d3e/d83/f8c [0,4194304] 0 2024-05-09T06:30:43.406 INFO:tasks.workunit.client.0.smithi046.stdout:5/544: write d0/d1b/f20 [689375,106771] 0 2024-05-09T06:30:43.406 INFO:tasks.workunit.client.0.smithi046.stdout:1/415: dread d7/f62 [0,4194304] 0 2024-05-09T06:30:43.406 INFO:tasks.workunit.client.0.smithi046.stdout:1/416: write d7/d10/d34/f45 [5535202,105426] 0 2024-05-09T06:30:43.407 INFO:tasks.workunit.client.0.smithi046.stdout:1/417: write d7/d10/f1e [4540262,119001] 0 2024-05-09T06:30:43.407 INFO:tasks.workunit.client.0.smithi046.stdout:6/627: mkdir db/d93/d96/dd1 0 2024-05-09T06:30:43.407 INFO:tasks.workunit.client.0.smithi046.stdout:1/418: mknod d7/d10/d34/d46/c80 0 2024-05-09T06:30:43.409 INFO:tasks.workunit.client.0.smithi046.stdout:9/350: dwrite d2/f69 [0,4194304] 0 2024-05-09T06:30:43.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/419: mkdir d7/d10/d34/d46/d81 0 2024-05-09T06:30:43.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/351: truncate d2/d6/d7/d1a/d66/f67 4025007 0 2024-05-09T06:30:43.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/352: chown f0 440260 1 2024-05-09T06:30:43.414 INFO:tasks.workunit.client.0.smithi046.stdout:1/420: symlink d7/d10/d28/d30/d3a/d76/l82 0 2024-05-09T06:30:43.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/421: write d7/d10/d28/d30/d3a/f78 [333566,45397] 0 2024-05-09T06:30:43.416 INFO:tasks.workunit.client.0.smithi046.stdout:5/545: dwrite d0/d1b/f82 [4194304,4194304] 0 2024-05-09T06:30:43.417 INFO:tasks.workunit.client.0.smithi046.stdout:5/546: read - d0/d1b/d21/d81/f91 zero size 2024-05-09T06:30:43.417 INFO:tasks.workunit.client.0.smithi046.stdout:9/353: rename d2/d6/d7/d1a/c1c to d2/d6/d7/d1a/d27/d56/c6e 0 2024-05-09T06:30:43.420 INFO:tasks.workunit.client.0.smithi046.stdout:1/422: symlink d7/d10/d28/l83 0 2024-05-09T06:30:43.420 INFO:tasks.workunit.client.0.smithi046.stdout:6/628: dwrite db/d10/d3f/d4f/d8a/fb3 [0,4194304] 0 2024-05-09T06:30:43.425 INFO:tasks.workunit.client.0.smithi046.stdout:5/547: mkdir d0/dba 0 2024-05-09T06:30:43.436 INFO:tasks.workunit.client.0.smithi046.stdout:1/423: mkdir d7/d10/d84 0 2024-05-09T06:30:43.436 INFO:tasks.workunit.client.0.smithi046.stdout:1/424: write d7/d10/d34/f6e [451238,98493] 0 2024-05-09T06:30:43.437 INFO:tasks.workunit.client.0.smithi046.stdout:6/629: symlink db/d10/d3c/d91/ld2 0 2024-05-09T06:30:43.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/630: write db/d10/d3f/d44/d5e/fa6 [2005148,128642] 0 2024-05-09T06:30:43.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/548: rmdir d0/d3e/d83 39 2024-05-09T06:30:43.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/354: getdents d2/d6/d33 0 2024-05-09T06:30:43.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/355: dread - d2/dc/d32/f5d zero size 2024-05-09T06:30:43.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/356: stat d2/d6/d7/d1a/f2e 0 2024-05-09T06:30:43.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/357: fdatasync d2/d6/d7/d1a/f2e 0 2024-05-09T06:30:43.455 INFO:tasks.workunit.client.0.smithi046.stdout:1/425: mknod d7/d10/d34/c85 0 2024-05-09T06:30:43.456 INFO:tasks.workunit.client.0.smithi046.stdout:6/631: rename db/d10/d19/d66/caa to db/d10/d30/cd3 0 2024-05-09T06:30:43.462 INFO:tasks.workunit.client.0.smithi046.stdout:9/358: unlink d2/dc/l13 0 2024-05-09T06:30:43.465 INFO:tasks.workunit.client.0.smithi046.stdout:9/359: write d2/d6/d7/ff [2852991,28279] 0 2024-05-09T06:30:43.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/632: dwrite db/d10/d3f/d44/d46/d70/f79 [0,4194304] 0 2024-05-09T06:30:43.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/633: chown db/d10/d19/c26 11222 1 2024-05-09T06:30:43.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/634: write db/d10/f1e [24721,64191] 0 2024-05-09T06:30:43.469 INFO:tasks.workunit.client.0.smithi046.stdout:1/426: rename d7/d10/d34/d46/d48 to d7/d10/d34/d46/d86 0 2024-05-09T06:30:43.481 INFO:tasks.workunit.client.0.smithi046.stdout:9/360: rmdir d2/d6/d7/d1a/d27 39 2024-05-09T06:30:43.483 INFO:tasks.workunit.client.0.smithi046.stdout:6/635: rename db/d10/d19/d66 to db/d10/d3c/dd4 0 2024-05-09T06:30:43.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/427: rename d7/d10/d34/f52 to d7/d10/f87 0 2024-05-09T06:30:43.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/428: write d7/d10/d28/f50 [546138,99778] 0 2024-05-09T06:30:43.489 INFO:tasks.workunit.client.0.smithi046.stdout:6/636: creat db/d93/d96/dd1/fd5 x:0 0 0 2024-05-09T06:30:43.489 INFO:tasks.workunit.client.0.smithi046.stdout:6/637: creat db/d10/d3f/fd6 x:0 0 0 2024-05-09T06:30:43.489 INFO:tasks.workunit.client.0.smithi046.stdout:6/638: creat db/d93/d96/dd1/fd7 x:0 0 0 2024-05-09T06:30:43.492 INFO:tasks.workunit.client.0.smithi046.stdout:1/429: symlink d7/d10/d84/l88 0 2024-05-09T06:30:43.492 INFO:tasks.workunit.client.0.smithi046.stdout:1/430: fsync d7/d10/f1e 0 2024-05-09T06:30:43.499 INFO:tasks.workunit.client.0.smithi046.stdout:6/639: unlink db/d10/d3c/f69 0 2024-05-09T06:30:43.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/640: mknod db/d10/d6b/cd8 0 2024-05-09T06:30:43.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/641: symlink db/d10/d3f/d44/d46/ld9 0 2024-05-09T06:30:43.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/642: fdatasync db/d10/d19/fab 0 2024-05-09T06:30:43.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/643: chown db/d10/d3c/f6d 2115 1 2024-05-09T06:30:43.506 INFO:tasks.workunit.client.0.smithi046.stdout:6/644: unlink db/d10/d3f/d44/d46/l59 0 2024-05-09T06:30:43.506 INFO:tasks.workunit.client.0.smithi046.stdout:6/645: readlink db/l49 0 2024-05-09T06:30:43.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/646: mkdir db/d10/d3f/dda 0 2024-05-09T06:30:43.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/647: write db/d10/d3f/fb5 [617154,113400] 0 2024-05-09T06:30:43.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/648: chown db/d10/d3f/d44/d5e/cd0 4211520 1 2024-05-09T06:30:43.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/649: creat db/d93/d96/dd1/fdb x:0 0 0 2024-05-09T06:30:43.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/650: write db/d93/d96/dd1/fd7 [576503,83160] 0 2024-05-09T06:30:43.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/651: getdents db 0 2024-05-09T06:30:43.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/652: read - db/d10/d76/fc2 zero size 2024-05-09T06:30:43.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/653: symlink db/d10/ldc 0 2024-05-09T06:30:43.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/540: sync 2024-05-09T06:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/654: write db/d10/d19/f83 [853390,69493] 0 2024-05-09T06:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/541: unlink d1/db/dd/d11/d5d/c69 0 2024-05-09T06:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/542: write d1/db/dd/d11/d5d/f6b [858401,40455] 0 2024-05-09T06:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/655: mknod db/d10/d57/cdd 0 2024-05-09T06:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/543: rename d1/d7/d12/d1d/d30/f9c to d1/db/dd/d11/fa0 0 2024-05-09T06:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/544: creat d1/db/d67/d6e/fa1 x:0 0 0 2024-05-09T06:30:43.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/656: dwrite f6 [4194304,4194304] 0 2024-05-09T06:30:43.552 INFO:tasks.workunit.client.0.smithi046.stdout:6/657: write db/f42 [2072970,30805] 0 2024-05-09T06:30:43.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/545: dwrite d1/d7/d2c/f15 [0,4194304] 0 2024-05-09T06:30:43.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/546: stat d1/db/d67/d9f 0 2024-05-09T06:30:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:43 smithi106 ceph-mon[34679]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 188 MiB/s rd, 239 MiB/s wr, 352 op/s 2024-05-09T06:30:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:43 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:43 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:43 smithi106 ceph-mon[34679]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-05-09T06:30:43.577 INFO:tasks.workunit.client.0.smithi046.stdout:8/547: dread d1/d7/d12/d1d/d30/d38/f54 [0,4194304] 0 2024-05-09T06:30:43.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/548: mkdir d1/db/d67/da2 0 2024-05-09T06:30:43.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/549: symlink d1/db/d67/la3 0 2024-05-09T06:30:43.583 INFO:tasks.workunit.client.0.smithi046.stdout:8/550: dwrite d1/db/d67/f7e [0,4194304] 0 2024-05-09T06:30:43.584 INFO:tasks.workunit.client.0.smithi046.stdout:8/551: fdatasync d1/d7/d12/d1d/d30/d38/f46 0 2024-05-09T06:30:43.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:43 smithi046 ceph-mon[26924]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 188 MiB/s rd, 239 MiB/s wr, 352 op/s 2024-05-09T06:30:43.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:43 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:43.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:43 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:30:43.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:43 smithi046 ceph-mon[26924]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-05-09T06:30:43.591 INFO:tasks.workunit.client.0.smithi046.stdout:8/552: rmdir d1/db/dd/d11/d5d 39 2024-05-09T06:30:43.608 INFO:tasks.workunit.client.0.smithi046.stdout:8/553: creat d1/db/d41/fa4 x:0 0 0 2024-05-09T06:30:43.608 INFO:tasks.workunit.client.0.smithi046.stdout:8/554: getdents d1/d7/d12/d45 0 2024-05-09T06:30:43.608 INFO:tasks.workunit.client.0.smithi046.stdout:8/555: symlink d1/db/d67/la5 0 2024-05-09T06:30:43.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/556: rename d1/db/f16 to d1/db/dd/d11/fa6 0 2024-05-09T06:30:43.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/557: creat d1/db/dd/d14/fa7 x:0 0 0 2024-05-09T06:30:43.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/558: write d1/db/dd/d11/d43/f65 [734217,12661] 0 2024-05-09T06:30:43.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/559: mknod d1/db/dd/d14/ca8 0 2024-05-09T06:30:43.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/560: write d1/d7/d12/d45/f4c [956808,125208] 0 2024-05-09T06:30:43.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/561: fdatasync d1/d7/f31 0 2024-05-09T06:30:43.618 INFO:tasks.workunit.client.0.smithi046.stdout:8/562: dwrite d1/d7/d12/f8e [0,4194304] 0 2024-05-09T06:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout:8/563: dwrite d1/d7/d12/d1d/d30/d38/f8c [0,4194304] 0 2024-05-09T06:30:43.641 INFO:tasks.workunit.client.0.smithi046.stdout:8/564: symlink d1/db/dd/d11/d5d/la9 0 2024-05-09T06:30:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/422: sync 2024-05-09T06:30:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/423: write da/de/f1e [4229378,2264] 0 2024-05-09T06:30:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/565: dwrite d1/db/dd/f7d [0,4194304] 0 2024-05-09T06:30:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/566: chown d1 215 1 2024-05-09T06:30:43.674 INFO:tasks.workunit.client.0.smithi046.stdout:2/424: symlink da/de/d14/d1f/d20/l8c 0 2024-05-09T06:30:43.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/567: unlink d1/d7/d2c/l86 0 2024-05-09T06:30:43.680 INFO:tasks.workunit.client.0.smithi046.stdout:8/568: symlink d1/d7/d12/d1d/laa 0 2024-05-09T06:30:43.687 INFO:tasks.workunit.client.0.smithi046.stdout:8/569: rename d1/db/d67/d6e/f8d to d1/db/dd/d14/fab 0 2024-05-09T06:30:43.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/425: dwrite da/dc/f27 [0,4194304] 0 2024-05-09T06:30:43.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/426: chown da/de/d14/d1f/d3b/d86/f69 5410238 1 2024-05-09T06:30:43.691 INFO:tasks.workunit.client.0.smithi046.stdout:8/570: dread d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:43.692 INFO:tasks.workunit.client.0.smithi046.stdout:8/571: creat d1/db/dd/d11/d43/fac x:0 0 0 2024-05-09T06:30:43.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/572: write d1/d7/d12/f8e [192542,45567] 0 2024-05-09T06:30:43.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/573: readlink d1/d7/d12/d45/l3e 0 2024-05-09T06:30:43.705 INFO:tasks.workunit.client.0.smithi046.stdout:2/427: dwrite da/de/d54/f67 [0,4194304] 0 2024-05-09T06:30:43.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/428: creat da/db/d7d/d6d/f8d x:0 0 0 2024-05-09T06:30:43.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/574: dread d1/d7/d12/d1d/d30/d38/f8c [0,4194304] 0 2024-05-09T06:30:43.734 INFO:tasks.workunit.client.0.smithi046.stdout:2/429: dwrite da/de/d14/d1f/d20/f5a [0,4194304] 0 2024-05-09T06:30:43.735 INFO:tasks.workunit.client.0.smithi046.stdout:8/575: dwrite d1/db/dd/f76 [0,4194304] 0 2024-05-09T06:30:43.742 INFO:tasks.workunit.client.0.smithi046.stdout:2/430: symlink da/db/d7d/l8e 0 2024-05-09T06:30:43.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/431: rename da/de/d14/d1f/d20/d5c/f61 to da/de/d14/d1f/f8f 0 2024-05-09T06:30:43.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/432: write da/db/d7d/f85 [56464,129370] 0 2024-05-09T06:30:43.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/433: symlink da/de/d54/d65/d6c/l90 0 2024-05-09T06:30:43.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/434: fdatasync da/de/d14/d1f/d3b/d86/d3d/f47 0 2024-05-09T06:30:43.753 INFO:tasks.workunit.client.0.smithi046.stdout:2/435: link da/de/f1e da/de/d54/d65/d70/f91 0 2024-05-09T06:30:43.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/436: truncate da/f45 218179 0 2024-05-09T06:30:43.755 INFO:tasks.workunit.client.0.smithi046.stdout:2/437: dread - da/db/d7d/d6d/f8d zero size 2024-05-09T06:30:43.764 INFO:tasks.workunit.client.0.smithi046.stdout:2/438: write da/dc/f13 [5830694,124683] 0 2024-05-09T06:30:43.765 INFO:tasks.workunit.client.0.smithi046.stdout:2/439: readlink da/d2d/d43/l49 0 2024-05-09T06:30:43.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/440: symlink da/l92 0 2024-05-09T06:30:43.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/441: dwrite da/de/d54/d65/d70/f91 [0,4194304] 0 2024-05-09T06:30:43.785 INFO:tasks.workunit.client.0.smithi046.stdout:2/442: dread - da/de/d14/d1f/d3b/d86/f78 zero size 2024-05-09T06:30:43.785 INFO:tasks.workunit.client.0.smithi046.stdout:2/443: chown da/de/d14/d1f/d20/d4e/f4f 0 1 2024-05-09T06:30:43.788 INFO:tasks.workunit.client.0.smithi046.stdout:2/444: rename da/de/d54/f67 to da/d2d/f93 0 2024-05-09T06:30:43.788 INFO:tasks.workunit.client.0.smithi046.stdout:2/445: dread - da/db/f6f zero size 2024-05-09T06:30:43.791 INFO:tasks.workunit.client.0.smithi046.stdout:2/446: link da/de/f1e da/f94 0 2024-05-09T06:30:43.792 INFO:tasks.workunit.client.0.smithi046.stdout:2/447: stat da/de/d1c/f55 0 2024-05-09T06:30:43.792 INFO:tasks.workunit.client.0.smithi046.stdout:2/448: write f1 [5137628,91666] 0 2024-05-09T06:30:43.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/449: mkdir da/de/d14/d1f/d20/d7c/d8b/d95 0 2024-05-09T06:30:43.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/450: creat da/de/d14/f96 x:0 0 0 2024-05-09T06:30:43.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/451: chown da/de/d14/d1f/d3b/d86/d3d/f5f 2871939 1 2024-05-09T06:30:43.796 INFO:tasks.workunit.client.0.smithi046.stdout:2/452: getdents da/de/d14/d1f/d3b 0 2024-05-09T06:30:43.804 INFO:tasks.workunit.client.0.smithi046.stdout:2/453: write da/de/d14/d1f/d3b/d86/f69 [358306,37551] 0 2024-05-09T06:30:43.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/454: fdatasync da/de/f60 0 2024-05-09T06:30:43.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/455: mkdir da/de/d14/d1f/d97 0 2024-05-09T06:30:43.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/456: truncate da/de/d14/d1f/d3b/f37 588985 0 2024-05-09T06:30:43.812 INFO:tasks.workunit.client.0.smithi046.stdout:2/457: write da/de/d14/d1f/f41 [374647,16481] 0 2024-05-09T06:30:43.812 INFO:tasks.workunit.client.0.smithi046.stdout:2/458: creat da/de/d54/d65/d70/f98 x:0 0 0 2024-05-09T06:30:43.826 INFO:tasks.workunit.client.0.smithi046.stdout:2/459: dwrite da/de/d14/d1f/d20/f5a [0,4194304] 0 2024-05-09T06:30:43.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/460: dread f1 [0,4194304] 0 2024-05-09T06:30:43.843 INFO:tasks.workunit.client.0.smithi046.stdout:2/461: dread da/de/d1c/f3e [0,4194304] 0 2024-05-09T06:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/462: write da/dc/f56 [2141872,105406] 0 2024-05-09T06:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/463: write da/db/f6f [561883,68696] 0 2024-05-09T06:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/464: write da/de/d14/d1f/f25 [1048621,32245] 0 2024-05-09T06:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:2/465: symlink da/de/d14/d1f/d3b/d86/d3a/l99 0 2024-05-09T06:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:2/466: write da/de/d14/f8a [614290,12880] 0 2024-05-09T06:30:43.859 INFO:tasks.workunit.client.0.smithi046.stdout:2/467: read da/de/f60 [3738104,87055] 0 2024-05-09T06:30:43.860 INFO:tasks.workunit.client.0.smithi046.stdout:2/468: symlink da/db/d7d/l9a 0 2024-05-09T06:30:43.861 INFO:tasks.workunit.client.0.smithi046.stdout:2/469: rmdir da/de/d14/d1f/d20/d7c 39 2024-05-09T06:30:43.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/470: dwrite da/db/d7d/f85 [0,4194304] 0 2024-05-09T06:30:43.884 INFO:tasks.workunit.client.0.smithi046.stdout:2/471: creat da/de/d14/d1f/d3b/d86/f9b x:0 0 0 2024-05-09T06:30:43.885 INFO:tasks.workunit.client.0.smithi046.stdout:2/472: symlink da/db/d7d/l9c 0 2024-05-09T06:30:43.898 INFO:tasks.workunit.client.0.smithi046.stdout:2/473: dwrite da/de/d1c/f6a [0,4194304] 0 2024-05-09T06:30:43.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/474: chown da/de/d14/d1f/d3b/d86/l44 5934438 1 2024-05-09T06:30:43.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/475: fsync da/de/d14/f96 0 2024-05-09T06:30:43.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/476: write da/dc/f79 [1675380,119265] 0 2024-05-09T06:30:43.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/477: chown da/l6b 384 1 2024-05-09T06:30:43.910 INFO:tasks.workunit.client.0.smithi046.stdout:2/478: creat da/de/d14/d1f/d3b/d86/d3a/f9d x:0 0 0 2024-05-09T06:30:43.910 INFO:tasks.workunit.client.0.smithi046.stdout:2/479: dread - da/db/d7d/d6d/f8d zero size 2024-05-09T06:30:43.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/480: dread da/db/f4c [4194304,4194304] 0 2024-05-09T06:30:43.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/481: unlink da/db/f15 0 2024-05-09T06:30:43.919 INFO:tasks.workunit.client.0.smithi046.stdout:2/482: dread da/dc/f5b [0,4194304] 0 2024-05-09T06:30:43.919 INFO:tasks.workunit.client.0.smithi046.stdout:2/483: stat da/de/d1c/f82 0 2024-05-09T06:30:43.935 INFO:tasks.workunit.client.0.smithi046.stdout:2/484: dwrite da/de/d14/f96 [0,4194304] 0 2024-05-09T06:30:43.948 INFO:tasks.workunit.client.0.smithi046.stdout:2/485: dwrite da/dc/f27 [0,4194304] 0 2024-05-09T06:30:43.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/486: creat da/d2d/d43/f9e x:0 0 0 2024-05-09T06:30:43.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/487: read da/de/d14/d1f/d3b/d86/d3a/f50 [1773255,62276] 0 2024-05-09T06:30:43.957 INFO:tasks.workunit.client.0.smithi046.stdout:2/488: mkdir da/de/d14/d1f/d3b/d9f 0 2024-05-09T06:30:43.957 INFO:tasks.workunit.client.0.smithi046.stdout:2/489: chown da/de/d14/f58 136189 1 2024-05-09T06:30:43.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/490: readlink da/de/d14/d1f/d3b/l71 0 2024-05-09T06:30:43.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/491: readlink da/l6b 0 2024-05-09T06:30:43.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/492: creat da/de/d14/d1f/d20/d4e/fa0 x:0 0 0 2024-05-09T06:30:43.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/493: symlink da/la1 0 2024-05-09T06:30:43.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/494: mkdir da/de/d14/d1f/d3b/da2 0 2024-05-09T06:30:43.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/495: symlink da/de/d14/d1f/d3b/d86/d3a/la3 0 2024-05-09T06:30:43.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/496: mknod da/de/d14/d1f/d3b/da2/ca4 0 2024-05-09T06:30:43.967 INFO:tasks.workunit.client.0.smithi046.stdout:2/497: getdents da/de/d14 0 2024-05-09T06:30:43.983 INFO:tasks.workunit.client.0.smithi046.stdout:2/498: dwrite da/dc/f56 [0,4194304] 0 2024-05-09T06:30:43.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/499: mknod da/de/d14/ca5 0 2024-05-09T06:30:43.996 INFO:tasks.workunit.client.0.smithi046.stdout:2/500: dwrite da/de/d14/d1f/d20/f3c [0,4194304] 0 2024-05-09T06:30:44.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/501: dwrite da/de/d14/d1f/d20/f3c [0,4194304] 0 2024-05-09T06:30:44.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/502: dwrite da/de/d14/d1f/d20/f84 [0,4194304] 0 2024-05-09T06:30:44.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/503: unlink da/de/d54/d65/l89 0 2024-05-09T06:30:44.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/504: write da/de/d14/f28 [2760977,33618] 0 2024-05-09T06:30:44.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/505: creat da/de/d54/fa6 x:0 0 0 2024-05-09T06:30:44.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/506: chown da/d2d/d43 8 1 2024-05-09T06:30:44.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/507: getdents da/de/d54/d65/d70 0 2024-05-09T06:30:44.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/508: write da/de/d14/d1f/d3b/d86/f83 [808673,68919] 0 2024-05-09T06:30:44.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/509: fdatasync da/db/d7d/d6d/f8d 0 2024-05-09T06:30:44.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/510: readlink da/de/d14/l2a 0 2024-05-09T06:30:44.037 INFO:tasks.workunit.client.0.smithi046.stdout:2/511: dread da/de/d14/f96 [0,4194304] 0 2024-05-09T06:30:44.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/534: sync 2024-05-09T06:30:44.053 INFO:tasks.workunit.client.0.smithi046.stdout:0/508: sync 2024-05-09T06:30:44.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/535: truncate d3/d7/d28/f24 1395921 0 2024-05-09T06:30:44.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/536: chown d3/d6f/f8d 51 1 2024-05-09T06:30:44.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/509: write d11/d18/d1c/d53/f7d [4048679,74144] 0 2024-05-09T06:30:44.065 INFO:tasks.workunit.client.0.smithi046.stdout:7/537: write d3/d7/dd/d3e/fa1 [3975492,8950] 0 2024-05-09T06:30:44.065 INFO:tasks.workunit.client.0.smithi046.stdout:7/538: creat d3/fa7 x:0 0 0 2024-05-09T06:30:44.067 INFO:tasks.workunit.client.0.smithi046.stdout:0/510: truncate d11/d18/d27/d28/d2d/d5c/f72 3368071 0 2024-05-09T06:30:44.070 INFO:tasks.workunit.client.0.smithi046.stdout:0/511: mkdir d11/d18/d27/d28/d6b/dac 0 2024-05-09T06:30:44.129 INFO:tasks.workunit.client.0.smithi046.stdout:3/440: sync 2024-05-09T06:30:44.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/441: dread d4/d20/d24/f38 [4194304,4194304] 0 2024-05-09T06:30:44.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/442: symlink d4/d20/d24/d29/d2b/l8f 0 2024-05-09T06:30:44.138 INFO:tasks.workunit.client.0.smithi046.stdout:3/443: chown d4/d48/d49/f6e 22360643 1 2024-05-09T06:30:44.138 INFO:tasks.workunit.client.0.smithi046.stdout:3/444: chown d4/d48/d49/c6d 38988 1 2024-05-09T06:30:44.139 INFO:tasks.workunit.client.0.smithi046.stdout:3/445: rename d4/d20/d24/f38 to d4/d20/d24/d29/d2b/f90 0 2024-05-09T06:30:44.139 INFO:tasks.workunit.client.0.smithi046.stdout:3/446: creat d4/d20/d24/d2a/d55/d74/f91 x:0 0 0 2024-05-09T06:30:44.145 INFO:tasks.workunit.client.0.smithi046.stdout:3/447: write d4/d20/d24/f18 [20702,109741] 0 2024-05-09T06:30:44.146 INFO:tasks.workunit.client.0.smithi046.stdout:3/448: mkdir d4/d92 0 2024-05-09T06:30:44.147 INFO:tasks.workunit.client.0.smithi046.stdout:3/449: truncate d4/d20/f26 4758040 0 2024-05-09T06:30:44.307 INFO:tasks.workunit.client.0.smithi046.stdout:4/468: sync 2024-05-09T06:30:44.310 INFO:tasks.workunit.client.0.smithi046.stdout:4/469: dread d7/df/d10/d1d/f69 [0,4194304] 0 2024-05-09T06:30:44.332 INFO:tasks.workunit.client.0.smithi046.stdout:4/470: dwrite d7/df/d10/f73 [0,4194304] 0 2024-05-09T06:30:44.339 INFO:tasks.workunit.client.0.smithi046.stdout:4/471: rmdir d7/df/d10/d1d 39 2024-05-09T06:30:44.339 INFO:tasks.workunit.client.0.smithi046.stdout:4/472: write d7/df/f38 [1304808,1101] 0 2024-05-09T06:30:44.341 INFO:tasks.workunit.client.0.smithi046.stdout:4/473: dread d7/df/d10/d1d/f69 [0,4194304] 0 2024-05-09T06:30:44.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/474: rmdir d7/df/d3a 39 2024-05-09T06:30:44.349 INFO:tasks.workunit.client.0.smithi046.stdout:4/475: write d7/df/f38 [929456,29721] 0 2024-05-09T06:30:44.353 INFO:tasks.workunit.client.0.smithi046.stdout:4/476: rename d7/df/d3a/d25/f52 to d7/df/d3a/d45/f97 0 2024-05-09T06:30:44.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/477: mkdir d7/df/d3a/d25/d81/d98 0 2024-05-09T06:30:44.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/478: dwrite d7/df/d3a/f28 [0,4194304] 0 2024-05-09T06:30:44.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/479: readlink d7/df/d3a/l75 0 2024-05-09T06:30:44.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/480: mknod d7/df/d3a/d25/d81/c99 0 2024-05-09T06:30:44.387 INFO:tasks.workunit.client.0.smithi046.stdout:4/481: rename d7/df/l35 to d7/df/d3a/d25/d81/d98/l9a 0 2024-05-09T06:30:44.387 INFO:tasks.workunit.client.0.smithi046.stdout:4/482: chown d7/df/d3a/d45/d96/f67 250301 1 2024-05-09T06:30:44.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/483: creat d7/df/d10/d2f/f9b x:0 0 0 2024-05-09T06:30:44.391 INFO:tasks.workunit.client.0.smithi046.stdout:4/484: symlink d7/df/d3a/d25/d81/d98/l9c 0 2024-05-09T06:30:44.393 INFO:tasks.workunit.client.0.smithi046.stdout:4/485: link d7/df/d3a/d25/d81/d98/l9c d7/df/d3a/d45/l9d 0 2024-05-09T06:30:44.393 INFO:tasks.workunit.client.0.smithi046.stdout:4/486: chown d7/df/d3a/d45/d96 28332364 1 2024-05-09T06:30:44.393 INFO:tasks.workunit.client.0.smithi046.stdout:4/487: truncate d7/df/d3a/d45/f85 4419126 0 2024-05-09T06:30:44.394 INFO:tasks.workunit.client.0.smithi046.stdout:4/488: symlink d7/l9e 0 2024-05-09T06:30:44.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/489: rename d7/df/d10/f73 to d7/df/d10/f9f 0 2024-05-09T06:30:44.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/490: write d7/df/d10/d2f/f9b [224354,62609] 0 2024-05-09T06:30:44.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/491: chown d7/df/d10/d1d/f8e 59688525 1 2024-05-09T06:30:44.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/492: read d7/df/d3a/f2c [2009267,71931] 0 2024-05-09T06:30:44.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/493: write d7/f90 [218339,127290] 0 2024-05-09T06:30:44.494 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:44 smithi046 ceph-mon[26924]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-05-09T06:30:44.532 INFO:tasks.workunit.client.0.smithi046.stdout:7/539: sync 2024-05-09T06:30:44.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/658: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/512: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/361: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:3/450: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/540: fsync d3/d7/d4c/d4f/f6b 0 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/431: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/541: chown d3/d7/d28/d29/f53 628040 1 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/542: fsync d3/d7/d4c/d4f/f6b 0 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/432: write d7/d10/f1e [369790,44046] 0 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/576: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/549: sync 2024-05-09T06:30:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/512: sync 2024-05-09T06:30:44.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/451: rename d4/d48/d49/c6d to d4/d48/c93 0 2024-05-09T06:30:44.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/452: dread - d4/d20/d24/d2a/d55/d74/f91 zero size 2024-05-09T06:30:44.536 INFO:tasks.workunit.client.0.smithi046.stdout:9/362: symlink d2/l6f 0 2024-05-09T06:30:44.542 INFO:tasks.workunit.client.0.smithi046.stdout:7/543: dread d3/d7/d28/d29/d35/f56 [0,4194304] 0 2024-05-09T06:30:44.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/550: creat d0/d1b/d39/fbb x:0 0 0 2024-05-09T06:30:44.544 INFO:tasks.workunit.client.0.smithi046.stdout:8/577: truncate d1/d7/d12/d1d/d30/d38/f8c 1866151 0 2024-05-09T06:30:44.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/513: symlink da/de/d54/la7 0 2024-05-09T06:30:44.549 INFO:tasks.workunit.client.0.smithi046.stdout:1/433: rename d7/d10/l63 to d7/d6d/l89 0 2024-05-09T06:30:44.551 INFO:tasks.workunit.client.0.smithi046.stdout:9/363: mkdir d2/dc/d32/d70 0 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:1/434: truncate d7/f2c 1971765 0 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/551: truncate d0/d1b/f20 873490 0 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/552: chown d0/d1b/d21/f42 14679992 1 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/553: chown d0/d1b/d39/l87 53100238 1 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/554: write d0/d3e/d50/f70 [540818,90706] 0 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/555: chown d0/d1b/d21/d81/fa4 21139 1 2024-05-09T06:30:44.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/556: creat d0/d58/d7a/fbc x:0 0 0 2024-05-09T06:30:44.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/578: getdents d1/db/dd/d11/d43 0 2024-05-09T06:30:44.557 INFO:tasks.workunit.client.0.smithi046.stdout:2/514: dread da/de/d1c/f6a [0,4194304] 0 2024-05-09T06:30:44.557 INFO:tasks.workunit.client.0.smithi046.stdout:1/435: mknod d7/d10/d28/d30/d3a/d7f/c8a 0 2024-05-09T06:30:44.557 INFO:tasks.workunit.client.0.smithi046.stdout:1/436: fsync d7/d10/f13 0 2024-05-09T06:30:44.560 INFO:tasks.workunit.client.0.smithi046.stdout:5/557: unlink d0/d3e/l76 0 2024-05-09T06:30:44.560 INFO:tasks.workunit.client.0.smithi046.stdout:8/579: truncate d1/db/f71 2461773 0 2024-05-09T06:30:44.560 INFO:tasks.workunit.client.0.smithi046.stdout:8/580: chown d1/db/dd/d11/d5d/f9a 14865044 1 2024-05-09T06:30:44.563 INFO:tasks.workunit.client.0.smithi046.stdout:2/515: creat da/de/d14/d1f/d3b/d9f/fa8 x:0 0 0 2024-05-09T06:30:44.563 INFO:tasks.workunit.client.0.smithi046.stdout:2/516: creat da/de/d14/d1f/d3b/d86/d3a/fa9 x:0 0 0 2024-05-09T06:30:44.563 INFO:tasks.workunit.client.0.smithi046.stdout:2/517: readlink da/de/d54/d65/d6c/l6e 0 2024-05-09T06:30:44.564 INFO:tasks.workunit.client.0.smithi046.stdout:0/513: dwrite d11/d18/d1c/d53/f6a [0,4194304] 0 2024-05-09T06:30:44.564 INFO:tasks.workunit.client.0.smithi046.stdout:1/437: read d7/d10/d28/d30/d3a/f3c [205664,87798] 0 2024-05-09T06:30:44.566 INFO:tasks.workunit.client.0.smithi046.stdout:8/581: symlink d1/db/d41/lad 0 2024-05-09T06:30:44.566 INFO:tasks.workunit.client.0.smithi046.stdout:2/518: truncate da/de/d14/f1b 1637120 0 2024-05-09T06:30:44.566 INFO:tasks.workunit.client.0.smithi046.stdout:3/453: dwrite d4/d5/f37 [0,4194304] 0 2024-05-09T06:30:44.567 INFO:tasks.workunit.client.0.smithi046.stdout:7/544: dwrite d3/fa7 [0,4194304] 0 2024-05-09T06:30:44.567 INFO:tasks.workunit.client.0.smithi046.stdout:7/545: chown d3/d7/d28/d29/d35/d5c/l5e 1326 1 2024-05-09T06:30:44.567 INFO:tasks.workunit.client.0.smithi046.stdout:6/659: dwrite db/d10/d3f/d4f/d8a/f9f [8388608,4194304] 0 2024-05-09T06:30:44.569 INFO:tasks.workunit.client.0.smithi046.stdout:0/514: truncate d11/d18/f1b 2197578 0 2024-05-09T06:30:44.571 INFO:tasks.workunit.client.0.smithi046.stdout:5/558: rmdir d0/d3e/d50 39 2024-05-09T06:30:44.571 INFO:tasks.workunit.client.0.smithi046.stdout:5/559: dread - d0/d1b/d21/d81/f91 zero size 2024-05-09T06:30:44.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/438: mknod d7/d10/d34/d46/d86/c8b 0 2024-05-09T06:30:44.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/439: readlink d7/d10/d34/d46/l66 0 2024-05-09T06:30:44.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:44 smithi106 ceph-mon[34679]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-05-09T06:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout:9/364: dwrite d2/d6/d33/f52 [0,4194304] 0 2024-05-09T06:30:44.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/365: write d2/f69 [3445016,106262] 0 2024-05-09T06:30:44.585 INFO:tasks.workunit.client.0.smithi046.stdout:8/582: dwrite d1/db/dd/d11/f5c [0,4194304] 0 2024-05-09T06:30:44.587 INFO:tasks.workunit.client.0.smithi046.stdout:7/546: dread d3/d7/d28/d29/d3b/f4a [0,4194304] 0 2024-05-09T06:30:44.588 INFO:tasks.workunit.client.0.smithi046.stdout:7/547: write d3/f85 [634494,124915] 0 2024-05-09T06:30:44.590 INFO:tasks.workunit.client.0.smithi046.stdout:6/660: symlink db/d10/d3f/d4f/d8a/d9e/lde 0 2024-05-09T06:30:44.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/661: chown db/d10/d19/f83 0 1 2024-05-09T06:30:44.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/662: fdatasync db/d10/d3f/f32 0 2024-05-09T06:30:44.591 INFO:tasks.workunit.client.0.smithi046.stdout:1/440: mknod d7/d6d/c8c 0 2024-05-09T06:30:44.593 INFO:tasks.workunit.client.0.smithi046.stdout:5/560: dwrite d0/d3e/d53/f6c [0,4194304] 0 2024-05-09T06:30:44.595 INFO:tasks.workunit.client.0.smithi046.stdout:3/454: rename d4/d20/d24/d29/d2b/d3e to d4/d20/d24/d29/d2b/d94 0 2024-05-09T06:30:44.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/366: unlink d2/d26/c3e 0 2024-05-09T06:30:44.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/583: mknod d1/db/dd/cae 0 2024-05-09T06:30:44.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/584: fdatasync d1/d7/f88 0 2024-05-09T06:30:44.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/585: chown d1/db/dd/f4a 0 1 2024-05-09T06:30:44.607 INFO:tasks.workunit.client.0.smithi046.stdout:7/548: mknod d3/d7/d4c/d99/ca8 0 2024-05-09T06:30:44.611 INFO:tasks.workunit.client.0.smithi046.stdout:6/663: rename db/d10/d3f/f6f to db/d10/d3f/d4f/d8a/fdf 0 2024-05-09T06:30:44.613 INFO:tasks.workunit.client.0.smithi046.stdout:1/441: link d7/d6d/c8c d7/d10/d34/d46/d81/c8d 0 2024-05-09T06:30:44.613 INFO:tasks.workunit.client.0.smithi046.stdout:1/442: readlink d7/l39 0 2024-05-09T06:30:44.614 INFO:tasks.workunit.client.0.smithi046.stdout:1/443: dread d7/d10/d28/d30/d3a/f3c [0,4194304] 0 2024-05-09T06:30:44.619 INFO:tasks.workunit.client.0.smithi046.stdout:6/664: dread db/d10/d3f/f56 [0,4194304] 0 2024-05-09T06:30:44.620 INFO:tasks.workunit.client.0.smithi046.stdout:5/561: mknod d0/d1b/d39/d8b/cbd 0 2024-05-09T06:30:44.625 INFO:tasks.workunit.client.0.smithi046.stdout:8/586: getdents d1/db/dd/d11/d5d 0 2024-05-09T06:30:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/455: dwrite d4/d20/d24/d2a/d4e/f8e [0,4194304] 0 2024-05-09T06:30:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/456: write d4/d20/d24/d2a/d55/d74/f91 [614827,3991] 0 2024-05-09T06:30:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/457: chown d4/l13 4100495 1 2024-05-09T06:30:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/367: dwrite d2/d6/d7/d1a/d27/f37 [0,4194304] 0 2024-05-09T06:30:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:7/549: creat d3/d3d/d72/d79/fa9 x:0 0 0 2024-05-09T06:30:44.632 INFO:tasks.workunit.client.0.smithi046.stdout:7/550: dread - d3/d7/d28/d29/d82/f90 zero size 2024-05-09T06:30:44.635 INFO:tasks.workunit.client.0.smithi046.stdout:1/444: symlink d7/d10/d28/l8e 0 2024-05-09T06:30:44.641 INFO:tasks.workunit.client.0.smithi046.stdout:5/562: symlink d0/d3e/d83/lbe 0 2024-05-09T06:30:44.644 INFO:tasks.workunit.client.0.smithi046.stdout:8/587: symlink d1/d7/laf 0 2024-05-09T06:30:44.644 INFO:tasks.workunit.client.0.smithi046.stdout:8/588: write d1/db/dd/d11/f27 [1962776,59411] 0 2024-05-09T06:30:44.644 INFO:tasks.workunit.client.0.smithi046.stdout:8/589: readlink d1/d7/d12/d1d/d30/d38/l73 0 2024-05-09T06:30:44.646 INFO:tasks.workunit.client.0.smithi046.stdout:3/458: getdents d4/d20/d24/d29 0 2024-05-09T06:30:44.647 INFO:tasks.workunit.client.0.smithi046.stdout:1/445: dwrite d7/f19 [0,4194304] 0 2024-05-09T06:30:44.648 INFO:tasks.workunit.client.0.smithi046.stdout:1/446: write d7/d10/d28/d30/d3a/f58 [4255215,66680] 0 2024-05-09T06:30:44.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/551: mknod d3/d3d/d72/d79/d81/caa 0 2024-05-09T06:30:44.650 INFO:tasks.workunit.client.0.smithi046.stdout:6/665: rmdir db/d10/d3c/d91 39 2024-05-09T06:30:44.650 INFO:tasks.workunit.client.0.smithi046.stdout:6/666: dread - db/d10/d3f/d44/d74/f92 zero size 2024-05-09T06:30:44.650 INFO:tasks.workunit.client.0.smithi046.stdout:6/667: fdatasync db/d10/d3f/d44/d74/f80 0 2024-05-09T06:30:44.652 INFO:tasks.workunit.client.0.smithi046.stdout:8/590: mkdir d1/d7/d12/d1d/d30/d38/db0 0 2024-05-09T06:30:44.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/459: mknod d4/d20/d24/d29/d7a/c95 0 2024-05-09T06:30:44.655 INFO:tasks.workunit.client.0.smithi046.stdout:3/460: write d4/d48/d49/f54 [105245,113667] 0 2024-05-09T06:30:44.656 INFO:tasks.workunit.client.0.smithi046.stdout:9/368: link d2/dc/l4c d2/d6/d7/l71 0 2024-05-09T06:30:44.661 INFO:tasks.workunit.client.0.smithi046.stdout:3/461: write d4/d20/d24/d29/d2b/f90 [1671533,36296] 0 2024-05-09T06:30:44.662 INFO:tasks.workunit.client.0.smithi046.stdout:1/447: symlink d7/d10/d28/d30/d3a/l8f 0 2024-05-09T06:30:44.664 INFO:tasks.workunit.client.0.smithi046.stdout:7/552: mkdir d3/d7/d4c/d4f/d9d/dab 0 2024-05-09T06:30:44.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/668: rename db/d10/d3f/fd6 to db/d10/d3f/dda/fe0 0 2024-05-09T06:30:44.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/669: stat db/d93/d96/dd1 0 2024-05-09T06:30:44.667 INFO:tasks.workunit.client.0.smithi046.stdout:8/591: creat d1/db/dd/d11/d5d/fb1 x:0 0 0 2024-05-09T06:30:44.667 INFO:tasks.workunit.client.0.smithi046.stdout:8/592: truncate d1/db/dd/d11/d5d/f77 399018 0 2024-05-09T06:30:44.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/369: chown d2/d6/d7/d1e/f4a 3290 1 2024-05-09T06:30:44.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/462: symlink d4/d20/d24/d29/d2b/d94/d5c/d6c/l96 0 2024-05-09T06:30:44.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/448: creat d7/d10/d28/d30/d3a/d7f/f90 x:0 0 0 2024-05-09T06:30:44.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/553: mkdir d3/d7/d4c/d99/dac 0 2024-05-09T06:30:44.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/670: link db/d10/d3f/d44/d46/d70/c72 db/d10/d3f/d44/d74/ce1 0 2024-05-09T06:30:44.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/671: write db/d10/f1e [704876,117613] 0 2024-05-09T06:30:44.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/370: rename d2/d6/d7/d1a/d27/f37 to d2/d6/d7/d1a/d27/d2a/f72 0 2024-05-09T06:30:44.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/371: chown d2/f69 462 1 2024-05-09T06:30:44.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/593: dwrite d1/d7/d12/d45/f83 [0,4194304] 0 2024-05-09T06:30:44.687 INFO:tasks.workunit.client.0.smithi046.stdout:7/554: unlink d3/d7/f32 0 2024-05-09T06:30:44.690 INFO:tasks.workunit.client.0.smithi046.stdout:8/594: dread d1/db/f71 [0,4194304] 0 2024-05-09T06:30:44.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/463: truncate d4/d20/d24/d2a/d4e/f8e 3945088 0 2024-05-09T06:30:44.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/464: stat d4/f3d 0 2024-05-09T06:30:44.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/672: dread db/d10/d30/faf [0,4194304] 0 2024-05-09T06:30:44.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/449: rmdir d7 39 2024-05-09T06:30:44.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/555: mkdir d3/d7/d28/d29/d35/d5c/dad 0 2024-05-09T06:30:44.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/595: rename d1/d7/d2c/f58 to d1/d7/fb2 0 2024-05-09T06:30:44.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/596: getdents d1/db/d67/d9f 0 2024-05-09T06:30:44.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/597: dread - d1/db/d67/d6e/fa1 zero size 2024-05-09T06:30:44.718 INFO:tasks.workunit.client.0.smithi046.stdout:1/450: dwrite d7/fc [4194304,4194304] 0 2024-05-09T06:30:44.718 INFO:tasks.workunit.client.0.smithi046.stdout:7/556: mknod d3/d7/d28/d29/d35/cae 0 2024-05-09T06:30:44.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/598: unlink d1/d7/d12/d1d/d30/d38/f54 0 2024-05-09T06:30:44.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/599: write d1/f33 [1143348,77909] 0 2024-05-09T06:30:44.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/600: getdents d1/db/d67/d9f 0 2024-05-09T06:30:44.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/601: chown d1/db/dd/d11/fa6 160 1 2024-05-09T06:30:44.728 INFO:tasks.workunit.client.0.smithi046.stdout:7/557: symlink d3/d7/d4c/d4f/d9d/laf 0 2024-05-09T06:30:44.730 INFO:tasks.workunit.client.0.smithi046.stdout:6/673: rename db/d10/d30/d53/fc0 to db/d10/d76/fe2 0 2024-05-09T06:30:44.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/451: dwrite d7/d10/f13 [0,4194304] 0 2024-05-09T06:30:44.731 INFO:tasks.workunit.client.0.smithi046.stdout:3/465: rmdir d4/d20/d24/d59 0 2024-05-09T06:30:44.732 INFO:tasks.workunit.client.0.smithi046.stdout:7/558: symlink d3/d7/d4c/d6a/lb0 0 2024-05-09T06:30:44.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/466: creat d4/f97 x:0 0 0 2024-05-09T06:30:44.739 INFO:tasks.workunit.client.0.smithi046.stdout:6/674: write db/d10/d3f/d4f/f63 [3427367,122938] 0 2024-05-09T06:30:44.740 INFO:tasks.workunit.client.0.smithi046.stdout:6/675: dread - db/d93/d96/dd1/fd5 zero size 2024-05-09T06:30:44.742 INFO:tasks.workunit.client.0.smithi046.stdout:8/602: rename d1/d7/fb2 to d1/db/d67/d9f/fb3 0 2024-05-09T06:30:44.745 INFO:tasks.workunit.client.0.smithi046.stdout:7/559: rename d3/d7/d28/d73/fa6 to d3/d7/d4c/d6a/fb1 0 2024-05-09T06:30:44.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/452: dwrite d7/d10/f54 [0,4194304] 0 2024-05-09T06:30:44.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/467: dread d4/d48/d49/f6e [0,4194304] 0 2024-05-09T06:30:44.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/603: mkdir d1/d7/d12/d1d/d30/d38/db4 0 2024-05-09T06:30:44.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/604: creat d1/d7/d2c/fb5 x:0 0 0 2024-05-09T06:30:44.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/605: dread d1/db/dd/d14/f7c [0,4194304] 0 2024-05-09T06:30:44.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/606: chown d1/db/dd/d11/d5d/d95/c96 167 1 2024-05-09T06:30:44.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/607: fdatasync d1/db/f71 0 2024-05-09T06:30:44.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/560: read d3/d7/dd/f59 [3412017,84890] 0 2024-05-09T06:30:44.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/561: readlink d3/d7/d4c/d4f/d9d/laf 0 2024-05-09T06:30:44.753 INFO:tasks.workunit.client.0.smithi046.stdout:8/608: dread d1/d7/d12/d1d/d30/d38/f8c [0,4194304] 0 2024-05-09T06:30:44.753 INFO:tasks.workunit.client.0.smithi046.stdout:8/609: creat d1/d7/d12/d1d/d30/d38/fb6 x:0 0 0 2024-05-09T06:30:44.758 INFO:tasks.workunit.client.0.smithi046.stdout:1/453: creat d7/d10/d34/d46/d81/f91 x:0 0 0 2024-05-09T06:30:44.759 INFO:tasks.workunit.client.0.smithi046.stdout:4/494: sync 2024-05-09T06:30:44.762 INFO:tasks.workunit.client.0.smithi046.stdout:3/468: mknod d4/d20/d41/c98 0 2024-05-09T06:30:44.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/495: dread d7/df/d3a/f83 [0,4194304] 0 2024-05-09T06:30:44.767 INFO:tasks.workunit.client.0.smithi046.stdout:7/562: creat d3/d7/d28/d73/da3/fb2 x:0 0 0 2024-05-09T06:30:44.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/610: mknod d1/db/dd/d11/d5d/d99/cb7 0 2024-05-09T06:30:44.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/611: write d1/d7/d2c/fb5 [903846,37329] 0 2024-05-09T06:30:44.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/469: mknod d4/d20/d24/d2a/d46/c99 0 2024-05-09T06:30:44.778 INFO:tasks.workunit.client.0.smithi046.stdout:1/454: link d7/d10/f54 d7/d6d/f92 0 2024-05-09T06:30:44.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/563: dwrite d3/d7/dd/f37 [0,4194304] 0 2024-05-09T06:30:44.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/564: creat d3/d7/dd/d3e/fb3 x:0 0 0 2024-05-09T06:30:44.781 INFO:tasks.workunit.client.0.smithi046.stdout:4/496: rmdir d7/df/d84 0 2024-05-09T06:30:44.787 INFO:tasks.workunit.client.0.smithi046.stdout:3/470: read d4/d20/d24/d2a/f6b [6287749,84950] 0 2024-05-09T06:30:44.788 INFO:tasks.workunit.client.0.smithi046.stdout:7/565: mknod d3/d3d/d5b/cb4 0 2024-05-09T06:30:44.789 INFO:tasks.workunit.client.0.smithi046.stdout:1/455: dread d7/d10/d28/d30/d3a/f41 [0,4194304] 0 2024-05-09T06:30:44.790 INFO:tasks.workunit.client.0.smithi046.stdout:1/456: write d7/d10/d28/d30/d3a/f78 [1454772,48366] 0 2024-05-09T06:30:44.790 INFO:tasks.workunit.client.0.smithi046.stdout:1/457: dread - d7/d10/d34/d46/d81/f91 zero size 2024-05-09T06:30:44.793 INFO:tasks.workunit.client.0.smithi046.stdout:8/612: dwrite d1/d7/d12/f79 [0,4194304] 0 2024-05-09T06:30:44.795 INFO:tasks.workunit.client.0.smithi046.stdout:1/458: mknod d7/d10/d34/d46/d86/c93 0 2024-05-09T06:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/613: truncate d1/d7/f68 1862938 0 2024-05-09T06:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout:8/614: write d1/db/dd/d14/f7c [169416,21167] 0 2024-05-09T06:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout:1/459: symlink d7/d10/d84/l94 0 2024-05-09T06:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout:1/460: readlink d7/d10/d84/l88 0 2024-05-09T06:30:44.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/615: unlink d1/db/dd/d11/f8b 0 2024-05-09T06:30:44.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/461: rmdir d7/d10/d28/d30/d3a 39 2024-05-09T06:30:44.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/616: rename d1/d7/c94 to d1/d7/cb8 0 2024-05-09T06:30:44.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/462: link d7/d10/d34/f68 d7/d10/d28/d30/f95 0 2024-05-09T06:30:44.813 INFO:tasks.workunit.client.0.smithi046.stdout:3/471: dwrite d4/d20/d24/d29/d2b/f90 [4194304,4194304] 0 2024-05-09T06:30:44.813 INFO:tasks.workunit.client.0.smithi046.stdout:4/497: dwrite d7/fc [0,4194304] 0 2024-05-09T06:30:44.814 INFO:tasks.workunit.client.0.smithi046.stdout:8/617: creat d1/d7/d12/d45/fb9 x:0 0 0 2024-05-09T06:30:44.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/463: creat d7/d10/d28/d30/d3a/d7f/f96 x:0 0 0 2024-05-09T06:30:44.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/472: creat d4/d20/d24/d2a/f9a x:0 0 0 2024-05-09T06:30:44.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/473: write d4/d20/d24/d2a/d4e/f88 [120137,57362] 0 2024-05-09T06:30:44.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/474: fdatasync d4/d5/f9 0 2024-05-09T06:30:44.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/464: write d7/f62 [1862721,47613] 0 2024-05-09T06:30:44.826 INFO:tasks.workunit.client.0.smithi046.stdout:8/618: creat d1/db/dd/d11/fba x:0 0 0 2024-05-09T06:30:44.826 INFO:tasks.workunit.client.0.smithi046.stdout:8/619: truncate d1/d7/d12/d45/f83 4905870 0 2024-05-09T06:30:44.826 INFO:tasks.workunit.client.0.smithi046.stdout:3/475: mkdir d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b 0 2024-05-09T06:30:44.827 INFO:tasks.workunit.client.0.smithi046.stdout:1/465: rename d7/d10/d34/d46/l5f to d7/d10/d34/d46/d86/l97 0 2024-05-09T06:30:44.828 INFO:tasks.workunit.client.0.smithi046.stdout:8/620: unlink d1/db/dd/d11/d5d/d95/c96 0 2024-05-09T06:30:44.828 INFO:tasks.workunit.client.0.smithi046.stdout:3/476: rmdir d4/d20/d24/d29 39 2024-05-09T06:30:44.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/498: dwrite d7/df/d10/d2f/f89 [0,4194304] 0 2024-05-09T06:30:44.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/499: read - d7/df/d3a/f39 zero size 2024-05-09T06:30:44.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/466: rename d7/d10/d28/l8e to d7/d10/d28/d30/d3a/d7f/l98 0 2024-05-09T06:30:44.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/566: dwrite d3/f1d [0,4194304] 0 2024-05-09T06:30:44.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/567: creat d3/d7/d28/d29/fb5 x:0 0 0 2024-05-09T06:30:44.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/568: chown d3/d7/l42 11499 1 2024-05-09T06:30:44.851 INFO:tasks.workunit.client.0.smithi046.stdout:4/500: unlink d7/df/d10/d1d/d77/d87/f93 0 2024-05-09T06:30:44.853 INFO:tasks.workunit.client.0.smithi046.stdout:1/467: rename d7/d10/d34/f45 to d7/d10/d84/f99 0 2024-05-09T06:30:44.853 INFO:tasks.workunit.client.0.smithi046.stdout:1/468: creat d7/d10/d34/d46/d81/f9a x:0 0 0 2024-05-09T06:30:44.853 INFO:tasks.workunit.client.0.smithi046.stdout:1/469: readlink d7/d10/d34/d46/l60 0 2024-05-09T06:30:44.854 INFO:tasks.workunit.client.0.smithi046.stdout:8/621: dwrite d1/db/d67/d9f/fb3 [0,4194304] 0 2024-05-09T06:30:44.858 INFO:tasks.workunit.client.0.smithi046.stdout:4/501: mknod d7/df/d10/d1d/ca0 0 2024-05-09T06:30:44.861 INFO:tasks.workunit.client.0.smithi046.stdout:1/470: symlink d7/d10/d34/d46/d81/l9b 0 2024-05-09T06:30:44.866 INFO:tasks.workunit.client.0.smithi046.stdout:4/502: dread d7/df/d10/f9f [0,4194304] 0 2024-05-09T06:30:44.868 INFO:tasks.workunit.client.0.smithi046.stdout:8/622: rename d1/db/d67/da2 to d1/db/dd/d11/d5d/dbb 0 2024-05-09T06:30:44.870 INFO:tasks.workunit.client.0.smithi046.stdout:4/503: getdents d7/df/d3a 0 2024-05-09T06:30:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/623: creat d1/db/dd/d11/d5d/d95/fbc x:0 0 0 2024-05-09T06:30:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/624: dread - d1/db/dd/d11/fa0 zero size 2024-05-09T06:30:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/625: stat d1/d7/d2c/fb5 0 2024-05-09T06:30:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/626: dread - d1/db/dd/d11/d5d/fb1 zero size 2024-05-09T06:30:44.874 INFO:tasks.workunit.client.0.smithi046.stdout:4/504: symlink d7/df/d3a/d45/la1 0 2024-05-09T06:30:44.875 INFO:tasks.workunit.client.0.smithi046.stdout:1/471: dwrite d7/d10/d28/d30/d3a/d76/f7a [0,4194304] 0 2024-05-09T06:30:44.877 INFO:tasks.workunit.client.0.smithi046.stdout:4/505: rename d7/df/d10/d1d/f69 to d7/df/d10/d2f/fa2 0 2024-05-09T06:30:44.882 INFO:tasks.workunit.client.0.smithi046.stdout:1/472: symlink d7/d6d/l9c 0 2024-05-09T06:30:44.883 INFO:tasks.workunit.client.0.smithi046.stdout:4/506: creat d7/df/fa3 x:0 0 0 2024-05-09T06:30:44.884 INFO:tasks.workunit.client.0.smithi046.stdout:1/473: unlink d7/f18 0 2024-05-09T06:30:44.887 INFO:tasks.workunit.client.0.smithi046.stdout:1/474: rename d7/d10/d28/d30/l61 to d7/d10/d28/d30/l9d 0 2024-05-09T06:30:44.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/627: dwrite d1/d7/d12/d1d/d30/d38/f8c [0,4194304] 0 2024-05-09T06:30:44.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/628: chown d1/d7/d12/d1d/laa 38729 1 2024-05-09T06:30:44.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/629: rename d1/db/dd/d14 to d1/d7/d12/d1d/d30/dbd 0 2024-05-09T06:30:44.906 INFO:tasks.workunit.client.0.smithi046.stdout:8/630: dread d1/db/d67/d9f/fb3 [0,4194304] 0 2024-05-09T06:30:44.907 INFO:tasks.workunit.client.0.smithi046.stdout:8/631: creat d1/db/dd/fbe x:0 0 0 2024-05-09T06:30:44.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/632: write d1/db/dd/d11/d43/f4b [1711325,119868] 0 2024-05-09T06:30:44.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/507: dwrite d7/df/d10/f9f [0,4194304] 0 2024-05-09T06:30:44.911 INFO:tasks.workunit.client.0.smithi046.stdout:1/475: dwrite d7/d10/d34/d46/d86/f7c [0,4194304] 0 2024-05-09T06:30:44.913 INFO:tasks.workunit.client.0.smithi046.stdout:4/508: symlink d7/df/d10/d1d/d77/d87/la4 0 2024-05-09T06:30:44.913 INFO:tasks.workunit.client.0.smithi046.stdout:4/509: truncate d7/fc 4733471 0 2024-05-09T06:30:44.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/633: write d1/db/f71 [448073,40807] 0 2024-05-09T06:30:44.916 INFO:tasks.workunit.client.0.smithi046.stdout:3/477: dwrite d4/f97 [0,4194304] 0 2024-05-09T06:30:44.916 INFO:tasks.workunit.client.0.smithi046.stdout:3/478: chown d4/l13 13335716 1 2024-05-09T06:30:44.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/634: dread - d1/db/dd/d11/d5d/d95/fbc zero size 2024-05-09T06:30:44.917 INFO:tasks.workunit.client.0.smithi046.stdout:8/635: chown d1/d7/d12/d1d/d30/l44 0 1 2024-05-09T06:30:44.918 INFO:tasks.workunit.client.0.smithi046.stdout:1/476: unlink d7/d10/d28/l3d 0 2024-05-09T06:30:44.918 INFO:tasks.workunit.client.0.smithi046.stdout:1/477: creat d7/d10/d34/d46/d81/f9e x:0 0 0 2024-05-09T06:30:44.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/479: write d4/d5/f3a [3971165,114752] 0 2024-05-09T06:30:44.934 INFO:tasks.workunit.client.0.smithi046.stdout:3/480: rmdir d4/d20/d24/d2a/d46 39 2024-05-09T06:30:44.935 INFO:tasks.workunit.client.0.smithi046.stdout:3/481: write d4/d20/d24/d29/d2b/d94/d5c/d6c/f80 [745607,76276] 0 2024-05-09T06:30:44.939 INFO:tasks.workunit.client.0.smithi046.stdout:4/510: dwrite d7/df/fa3 [0,4194304] 0 2024-05-09T06:30:44.939 INFO:tasks.workunit.client.0.smithi046.stdout:4/511: getdents d7/df/d3a 0 2024-05-09T06:30:44.940 INFO:tasks.workunit.client.0.smithi046.stdout:1/478: dwrite d7/d10/f54 [0,4194304] 0 2024-05-09T06:30:44.940 INFO:tasks.workunit.client.0.smithi046.stdout:1/479: stat d7/d10/d28/f50 0 2024-05-09T06:30:44.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/636: rmdir d1/db/dd/d11/d5d 39 2024-05-09T06:30:44.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/637: chown d1/db/dd/d11/f5c 4032 1 2024-05-09T06:30:44.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/512: dread d7/df/d3a/d25/f54 [0,4194304] 0 2024-05-09T06:30:44.945 INFO:tasks.workunit.client.0.smithi046.stdout:1/480: rename d7/d10/d28/f50 to d7/d6d/f9f 0 2024-05-09T06:30:44.948 INFO:tasks.workunit.client.0.smithi046.stdout:4/513: rmdir d7/df/d10/d2f 39 2024-05-09T06:30:44.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/514: mkdir d7/df/d3a/d25/da5 0 2024-05-09T06:30:44.952 INFO:tasks.workunit.client.0.smithi046.stdout:4/515: creat d7/df/d3a/d25/d86/fa6 x:0 0 0 2024-05-09T06:30:44.961 INFO:tasks.workunit.client.0.smithi046.stdout:8/638: fsync d1/db/f71 0 2024-05-09T06:30:44.961 INFO:tasks.workunit.client.0.smithi046.stdout:8/639: readlink d1/d7/d12/d1d/d30/d38/l92 0 2024-05-09T06:30:44.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/481: dwrite d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:44.961 INFO:tasks.workunit.client.0.smithi046.stdout:3/482: dwrite d4/d20/d41/f63 [0,4194304] 0 2024-05-09T06:30:44.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/482: fsync d7/d10/d28/d55/f7b 0 2024-05-09T06:30:44.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/483: symlink d4/d20/d24/d2a/d55/l9c 0 2024-05-09T06:30:44.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/483: mkdir d7/d10/d28/d30/da0 0 2024-05-09T06:30:44.978 INFO:tasks.workunit.client.0.smithi046.stdout:8/640: rmdir d1/d7/d12 39 2024-05-09T06:30:44.980 INFO:tasks.workunit.client.0.smithi046.stdout:3/484: creat d4/d20/d24/d2a/d55/d6a/f9d x:0 0 0 2024-05-09T06:30:44.980 INFO:tasks.workunit.client.0.smithi046.stdout:3/485: fsync d4/d20/d24/d2a/f6b 0 2024-05-09T06:30:44.980 INFO:tasks.workunit.client.0.smithi046.stdout:3/486: truncate d4/d20/d24/d29/d2b/f70 629555 0 2024-05-09T06:30:44.980 INFO:tasks.workunit.client.0.smithi046.stdout:3/487: chown d4/d20/d41/c4b 18703115 1 2024-05-09T06:30:44.980 INFO:tasks.workunit.client.0.smithi046.stdout:3/488: truncate d4/d20/d24/d2a/d55/d74/f89 888354 0 2024-05-09T06:30:44.982 INFO:tasks.workunit.client.0.smithi046.stdout:1/484: creat d7/d10/d28/d30/fa1 x:0 0 0 2024-05-09T06:30:44.983 INFO:tasks.workunit.client.0.smithi046.stdout:8/641: mkdir d1/db/dd/d11/d5d/d99/dbf 0 2024-05-09T06:30:44.985 INFO:tasks.workunit.client.0.smithi046.stdout:3/489: mkdir d4/d9e 0 2024-05-09T06:30:44.985 INFO:tasks.workunit.client.0.smithi046.stdout:3/490: creat d4/d48/d49/f9f x:0 0 0 2024-05-09T06:30:44.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/642: dread d1/d7/d12/d1d/d30/dbd/fab [0,4194304] 0 2024-05-09T06:30:44.985 INFO:tasks.workunit.client.0.smithi046.stdout:1/485: rmdir d7/d10/d84 39 2024-05-09T06:30:44.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/643: mkdir d1/d7/d12/d1d/d30/d38/dc0 0 2024-05-09T06:30:44.993 INFO:tasks.workunit.client.0.smithi046.stdout:1/486: mkdir d7/d10/d28/d30/d3a/d75/da2 0 2024-05-09T06:30:44.996 INFO:tasks.workunit.client.0.smithi046.stdout:1/487: mkdir d7/da3 0 2024-05-09T06:30:44.997 INFO:tasks.workunit.client.0.smithi046.stdout:1/488: symlink d7/d10/d84/la4 0 2024-05-09T06:30:44.999 INFO:tasks.workunit.client.0.smithi046.stdout:1/489: symlink d7/d10/d28/d30/la5 0 2024-05-09T06:30:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:1/490: creat d7/fa6 x:0 0 0 2024-05-09T06:30:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:1/491: chown d7/d10/d28/d30/f77 486 1 2024-05-09T06:30:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:1/492: creat d7/d10/d84/fa7 x:0 0 0 2024-05-09T06:30:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:1/493: chown d7/d10/d28/d30/l5a 13135 1 2024-05-09T06:30:45.009 INFO:tasks.workunit.client.0.smithi046.stdout:3/491: dwrite d4/f97 [0,4194304] 0 2024-05-09T06:30:45.009 INFO:tasks.workunit.client.0.smithi046.stdout:8/644: dwrite d1/db/dd/d11/d43/fac [0,4194304] 0 2024-05-09T06:30:45.009 INFO:tasks.workunit.client.0.smithi046.stdout:8/645: chown d1/db/d41/f6c 311 1 2024-05-09T06:30:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/492: mkdir d4/d20/da0 0 2024-05-09T06:30:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/493: chown d4/d20/d24/d2a/d4e/f71 0 1 2024-05-09T06:30:45.011 INFO:tasks.workunit.client.0.smithi046.stdout:1/494: write d7/d10/f2b [3494212,49724] 0 2024-05-09T06:30:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/646: mkdir d1/db/dd/d11/d43/dc1 0 2024-05-09T06:30:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/647: write d1/d7/f34 [2609179,112312] 0 2024-05-09T06:30:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/494: creat d4/d20/d24/d29/d2b/d94/d5c/d6c/fa1 x:0 0 0 2024-05-09T06:30:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/648: truncate d1/db/d67/f7e 1330497 0 2024-05-09T06:30:45.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/649: rmdir d1/db/dd/d11/d43 39 2024-05-09T06:30:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:8/650: read d1/db/dd/f76 [4106566,4507] 0 2024-05-09T06:30:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:8/651: mknod d1/db/dd/d11/d5d/d99/dbf/cc2 0 2024-05-09T06:30:45.033 INFO:tasks.workunit.client.0.smithi046.stdout:8/652: rename d1/d7/d12/f80 to d1/db/fc3 0 2024-05-09T06:30:45.034 INFO:tasks.workunit.client.0.smithi046.stdout:8/653: truncate d1/d7/d12/d1d/d30/dbd/fa7 78013 0 2024-05-09T06:30:45.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/654: truncate d1/d7/d2c/f15 1971813 0 2024-05-09T06:30:45.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/495: dwrite d7/d10/d28/d30/d3a/d7f/f96 [0,4194304] 0 2024-05-09T06:30:45.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/495: dwrite d4/d20/f36 [0,4194304] 0 2024-05-09T06:30:45.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/496: dread - d4/d20/d24/d29/d2b/d94/d5c/d6c/fa1 zero size 2024-05-09T06:30:45.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/655: rename d1/db/fc3 to d1/db/dd/d11/d43/d81/fc4 0 2024-05-09T06:30:45.043 INFO:tasks.workunit.client.0.smithi046.stdout:1/496: mkdir d7/d10/d84/da8 0 2024-05-09T06:30:45.045 INFO:tasks.workunit.client.0.smithi046.stdout:1/497: dread d7/d10/d28/d30/f38 [0,4194304] 0 2024-05-09T06:30:45.050 INFO:tasks.workunit.client.0.smithi046.stdout:3/497: mkdir d4/d20/d24/d2a/da2 0 2024-05-09T06:30:45.053 INFO:tasks.workunit.client.0.smithi046.stdout:8/656: unlink d1/d7/d12/d45/c53 0 2024-05-09T06:30:45.056 INFO:tasks.workunit.client.0.smithi046.stdout:3/498: rename d4/d48/d49/c65 to d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/ca3 0 2024-05-09T06:30:45.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/499: truncate d4/d20/d24/d29/d2b/d94/d5c/d6c/f80 138018 0 2024-05-09T06:30:45.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/498: dwrite d7/d10/d28/d30/f38 [0,4194304] 0 2024-05-09T06:30:45.065 INFO:tasks.workunit.client.0.smithi046.stdout:1/499: creat d7/da3/fa9 x:0 0 0 2024-05-09T06:30:45.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/500: dread d4/d20/d41/f63 [0,4194304] 0 2024-05-09T06:30:45.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/500: mknod d7/d6d/caa 0 2024-05-09T06:30:45.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/501: write d7/d10/d28/d30/fa1 [115964,120090] 0 2024-05-09T06:30:45.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/501: dread d4/f97 [0,4194304] 0 2024-05-09T06:30:45.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/502: chown d4/d20/d24/f18 152038 1 2024-05-09T06:30:45.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/503: creat d4/d20/d24/d29/d7a/fa4 x:0 0 0 2024-05-09T06:30:45.088 INFO:tasks.workunit.client.0.smithi046.stdout:3/504: creat d4/d20/d24/d29/fa5 x:0 0 0 2024-05-09T06:30:45.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/502: dwrite d7/fa6 [0,4194304] 0 2024-05-09T06:30:45.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/505: dread d4/d48/f53 [0,4194304] 0 2024-05-09T06:30:45.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/506: fdatasync d4/d20/d24/d2a/d4e/f8e 0 2024-05-09T06:30:45.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/507: fsync d4/fc 0 2024-05-09T06:30:45.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/508: fdatasync d4/d5/f3a 0 2024-05-09T06:30:45.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/509: getdents d4/d20/d24/d2a/d4e/d58 0 2024-05-09T06:30:45.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/510: fdatasync d4/d20/d24/d2a/f6b 0 2024-05-09T06:30:45.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/503: dread d7/d10/f87 [0,4194304] 0 2024-05-09T06:30:45.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/504: creat d7/da3/fab x:0 0 0 2024-05-09T06:30:45.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/505: write d7/d10/d28/d30/d3a/f58 [1695396,97217] 0 2024-05-09T06:30:45.113 INFO:tasks.workunit.client.0.smithi046.stdout:3/511: dwrite d4/d20/d24/d2a/d46/f5e [0,4194304] 0 2024-05-09T06:30:45.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/512: mknod d4/d20/d24/d2a/d46/ca6 0 2024-05-09T06:30:45.120 INFO:tasks.workunit.client.0.smithi046.stdout:1/506: write d7/d10/f24 [42885,19483] 0 2024-05-09T06:30:45.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/513: symlink d4/d20/d24/d2a/d55/d6a/la7 0 2024-05-09T06:30:45.124 INFO:tasks.workunit.client.0.smithi046.stdout:3/514: rmdir d4/d5d/d60 39 2024-05-09T06:30:45.133 INFO:tasks.workunit.client.0.smithi046.stdout:1/507: dwrite d7/d6d/f92 [0,4194304] 0 2024-05-09T06:30:45.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/515: dwrite d4/fc [4194304,4194304] 0 2024-05-09T06:30:45.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/516: creat d4/d5d/fa8 x:0 0 0 2024-05-09T06:30:45.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/517: chown d4/d20/d24/d2a/d46/c61 47609555 1 2024-05-09T06:30:45.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/508: write d7/d10/d28/f33 [3458648,43776] 0 2024-05-09T06:30:45.146 INFO:tasks.workunit.client.0.smithi046.stdout:1/509: dread d7/fe [4194304,4194304] 0 2024-05-09T06:30:45.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/518: mknod d4/d5/ca9 0 2024-05-09T06:30:45.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/519: fdatasync d4/d5d/fa8 0 2024-05-09T06:30:45.152 INFO:tasks.workunit.client.0.smithi046.stdout:1/510: rename d7/d10/d28/d30/l72 to d7/da3/lac 0 2024-05-09T06:30:45.152 INFO:tasks.workunit.client.0.smithi046.stdout:0/515: sync 2024-05-09T06:30:45.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/519: sync 2024-05-09T06:30:45.152 INFO:tasks.workunit.client.0.smithi046.stdout:5/563: sync 2024-05-09T06:30:45.153 INFO:tasks.workunit.client.0.smithi046.stdout:3/520: symlink d4/d20/d24/d29/d2b/d94/laa 0 2024-05-09T06:30:45.154 INFO:tasks.workunit.client.0.smithi046.stdout:1/511: fsync d7/d10/f24 0 2024-05-09T06:30:45.154 INFO:tasks.workunit.client.0.smithi046.stdout:1/512: chown d7/d10/d28/d30/l9d 15328 1 2024-05-09T06:30:45.154 INFO:tasks.workunit.client.0.smithi046.stdout:1/513: stat d7/da3/fab 0 2024-05-09T06:30:45.156 INFO:tasks.workunit.client.0.smithi046.stdout:5/564: rename d0/d3e/d53/l93 to d0/lbf 0 2024-05-09T06:30:45.157 INFO:tasks.workunit.client.0.smithi046.stdout:0/516: truncate d11/d18/d1c/d53/fa5 2841147 0 2024-05-09T06:30:45.159 INFO:tasks.workunit.client.0.smithi046.stdout:1/514: mknod d7/da3/cad 0 2024-05-09T06:30:45.159 INFO:tasks.workunit.client.0.smithi046.stdout:1/515: stat d7/d10/d28/d55/c5c 0 2024-05-09T06:30:45.159 INFO:tasks.workunit.client.0.smithi046.stdout:1/516: creat d7/d10/d28/d30/fae x:0 0 0 2024-05-09T06:30:45.159 INFO:tasks.workunit.client.0.smithi046.stdout:5/565: stat d0/d1b/d21/c92 0 2024-05-09T06:30:45.162 INFO:tasks.workunit.client.0.smithi046.stdout:0/517: mknod d11/d18/d27/d28/d6b/cad 0 2024-05-09T06:30:45.167 INFO:tasks.workunit.client.0.smithi046.stdout:1/517: rmdir d7/d10/d28/d55 39 2024-05-09T06:30:45.167 INFO:tasks.workunit.client.0.smithi046.stdout:1/518: fdatasync d7/d10/f2b 0 2024-05-09T06:30:45.167 INFO:tasks.workunit.client.0.smithi046.stdout:0/518: truncate f4 1585863 0 2024-05-09T06:30:45.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/521: dwrite d4/d20/d24/f18 [0,4194304] 0 2024-05-09T06:30:45.178 INFO:tasks.workunit.client.0.smithi046.stdout:5/566: dwrite d0/d3e/f3f [0,4194304] 0 2024-05-09T06:30:45.227 INFO:tasks.workunit.client.0.smithi046.stdout:1/519: symlink d7/d10/d84/laf 0 2024-05-09T06:30:45.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/522: rename d4/d20/d24/d2a/d46/f5e to d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/fab 0 2024-05-09T06:30:45.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/523: fsync d4/d20/d24/d2a/d4e/f88 0 2024-05-09T06:30:45.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/567: mkdir d0/db3/dc0 0 2024-05-09T06:30:45.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/520: link d7/d10/f2b d7/d10/d34/d46/d86/fb0 0 2024-05-09T06:30:45.257 INFO:tasks.workunit.client.0.smithi046.stdout:1/521: creat d7/d10/d28/d30/d3a/d7f/fb1 x:0 0 0 2024-05-09T06:30:45.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/522: dread d7/d10/d28/d30/d3a/f78 [0,4194304] 0 2024-05-09T06:30:45.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/524: dwrite d4/d20/d24/d2a/d4e/f8e [0,4194304] 0 2024-05-09T06:30:45.273 INFO:tasks.workunit.client.0.smithi046.stdout:5/568: dwrite d0/f1c [0,4194304] 0 2024-05-09T06:30:45.273 INFO:tasks.workunit.client.0.smithi046.stdout:5/569: fdatasync d0/d1b/d21/f5d 0 2024-05-09T06:30:45.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/525: mkdir d4/d5/dac 0 2024-05-09T06:30:45.335 INFO:tasks.workunit.client.0.smithi046.stdout:5/570: stat d0/d1b/d39/c8f 0 2024-05-09T06:30:45.335 INFO:tasks.workunit.client.0.smithi046.stdout:5/571: chown d0/d1b/l7d 286388 1 2024-05-09T06:30:45.343 INFO:tasks.workunit.client.0.smithi046.stdout:3/526: dwrite d4/d20/d24/d2a/d55/d74/f91 [0,4194304] 0 2024-05-09T06:30:45.343 INFO:tasks.workunit.client.0.smithi046.stdout:3/527: readlink l2 0 2024-05-09T06:30:45.443 INFO:tasks.workunit.client.0.smithi046.stdout:3/528: creat d4/d20/fad x:0 0 0 2024-05-09T06:30:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/572: mknod d0/d1b/d39/d8a/cc1 0 2024-05-09T06:30:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/573: chown d0/d3e/d83/f8c 12613977 1 2024-05-09T06:30:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/574: write d0/d1b/d21/f85 [1743349,88386] 0 2024-05-09T06:30:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/575: creat d0/d3e/d53/fc2 x:0 0 0 2024-05-09T06:30:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:3/529: getdents d4/d20/d24/d29/d2b/d94 0 2024-05-09T06:30:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:3/530: getdents d4/d5/dac 0 2024-05-09T06:30:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/576: creat d0/dad/fc3 x:0 0 0 2024-05-09T06:30:45.454 INFO:tasks.workunit.client.0.smithi046.stdout:3/531: rmdir d4/d20/da0 0 2024-05-09T06:30:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/577: mknod d0/d1b/d39/d8a/cc4 0 2024-05-09T06:30:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/578: readlink d0/d3e/l4c 0 2024-05-09T06:30:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/579: chown d0/d1b/d39/d8a/c8d 11307 1 2024-05-09T06:30:45.458 INFO:tasks.workunit.client.0.smithi046.stdout:3/532: rmdir d4/d92 0 2024-05-09T06:30:45.458 INFO:tasks.workunit.client.0.smithi046.stdout:3/533: creat d4/d48/fae x:0 0 0 2024-05-09T06:30:45.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/580: creat d0/d3e/d50/fc5 x:0 0 0 2024-05-09T06:30:45.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/581: truncate d0/d1b/d39/d8a/f98 266458 0 2024-05-09T06:30:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/534: mknod d4/d20/d24/d2a/d55/d6a/caf 0 2024-05-09T06:30:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/535: stat d4/d20/d24/d29/d2b 0 2024-05-09T06:30:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/536: write d4/f97 [4204870,102324] 0 2024-05-09T06:30:45.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/582: mknod d0/cc6 0 2024-05-09T06:30:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:3/537: mkdir d4/d5/dac/db0 0 2024-05-09T06:30:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:3/538: truncate d4/d20/d24/d29/d2b/d94/f64 725568 0 2024-05-09T06:30:45.474 INFO:tasks.workunit.client.0.smithi046.stdout:3/539: rename d4/d20/d24/d2a/d4e/d58/f81 to d4/d20/d24/d29/d7a/fb1 0 2024-05-09T06:30:45.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:45 smithi106 ceph-mon[34679]: pgmap v29: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 248 MiB/s rd, 319 MiB/s wr, 485 op/s 2024-05-09T06:30:45.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/372: sync 2024-05-09T06:30:45.503 INFO:tasks.workunit.client.0.smithi046.stdout:9/373: unlink d2/d6/d7/l18 0 2024-05-09T06:30:45.503 INFO:tasks.workunit.client.0.smithi046.stdout:9/374: truncate d2/d26/d2c/d3d/f53 972760 0 2024-05-09T06:30:45.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/569: sync 2024-05-09T06:30:45.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/570: chown d3/d7/d28/f2c 16 1 2024-05-09T06:30:45.582 INFO:tasks.workunit.client.0.smithi046.stdout:6/676: sync 2024-05-09T06:30:45.584 INFO:tasks.workunit.client.0.smithi046.stdout:4/516: sync 2024-05-09T06:30:45.585 INFO:tasks.workunit.client.0.smithi046.stdout:4/517: dread - d7/df/d53/f6f zero size 2024-05-09T06:30:45.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:45 smithi046 ceph-mon[26924]: pgmap v29: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 248 MiB/s rd, 319 MiB/s wr, 485 op/s 2024-05-09T06:30:45.586 INFO:tasks.workunit.client.0.smithi046.stdout:4/518: mknod d7/df/d3a/d25/da5/ca7 0 2024-05-09T06:30:45.586 INFO:tasks.workunit.client.0.smithi046.stdout:4/519: chown d7/df/d3a/d45/d96/l3e 34 1 2024-05-09T06:30:45.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/520: write d7/df/d10/d2f/f5c [1006219,91494] 0 2024-05-09T06:30:45.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/571: dread d3/d7/f2d [0,4194304] 0 2024-05-09T06:30:45.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/540: rmdir d4/d48 39 2024-05-09T06:30:45.594 INFO:tasks.workunit.client.0.smithi046.stdout:3/541: stat d4/d20/d41/d4a 0 2024-05-09T06:30:45.596 INFO:tasks.workunit.client.0.smithi046.stdout:3/542: rmdir d4/d20/d41/d4a 39 2024-05-09T06:30:45.597 INFO:tasks.workunit.client.0.smithi046.stdout:4/521: write d7/df/d3a/d45/f51 [3706794,19812] 0 2024-05-09T06:30:45.597 INFO:tasks.workunit.client.0.smithi046.stdout:6/677: write db/d10/d3f/d4f/d89/f9c [804015,515] 0 2024-05-09T06:30:45.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/572: rmdir d3/d7/d28/d29 39 2024-05-09T06:30:45.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/573: readlink d3/d6f/l95 0 2024-05-09T06:30:45.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/543: mknod d4/d20/d24/d29/d2b/d94/d5c/cb2 0 2024-05-09T06:30:45.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/544: fsync d4/d20/d24/d2a/f6b 0 2024-05-09T06:30:45.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/545: chown d4/d20/d24/d2a/d46/c61 63821566 1 2024-05-09T06:30:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:7/574: dread d3/d7/dd/f68 [0,4194304] 0 2024-05-09T06:30:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:3/546: symlink d4/d20/d24/d2a/da2/lb3 0 2024-05-09T06:30:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:3/547: stat d4/d5d/c86 0 2024-05-09T06:30:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:3/548: chown d4/d20/d24/d29/d2b/d94/d5c/f67 139 1 2024-05-09T06:30:45.610 INFO:tasks.workunit.client.0.smithi046.stdout:3/549: mknod d4/d20/d24/d2a/da2/cb4 0 2024-05-09T06:30:45.610 INFO:tasks.workunit.client.0.smithi046.stdout:3/550: creat d4/d20/fb5 x:0 0 0 2024-05-09T06:30:45.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/551: creat d4/d20/d41/fb6 x:0 0 0 2024-05-09T06:30:45.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/552: readlink d4/d20/d24/d29/d2b/l57 0 2024-05-09T06:30:45.615 INFO:tasks.workunit.client.0.smithi046.stdout:7/575: dread d3/d7/d28/fa5 [0,4194304] 0 2024-05-09T06:30:45.617 INFO:tasks.workunit.client.0.smithi046.stdout:6/678: dwrite db/d10/d19/f20 [0,4194304] 0 2024-05-09T06:30:45.617 INFO:tasks.workunit.client.0.smithi046.stdout:6/679: truncate db/d10/d3f/d44/d74/f92 307695 0 2024-05-09T06:30:45.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/553: getdents d4/d20/d24/d2a/d46 0 2024-05-09T06:30:45.620 INFO:tasks.workunit.client.0.smithi046.stdout:6/680: getdents db/d10/d3c/dd4/d87 0 2024-05-09T06:30:45.620 INFO:tasks.workunit.client.0.smithi046.stdout:6/681: chown db/d10/f16 214005 1 2024-05-09T06:30:45.620 INFO:tasks.workunit.client.0.smithi046.stdout:6/682: write db/d10/d30/fbf [834422,67879] 0 2024-05-09T06:30:45.623 INFO:tasks.workunit.client.0.smithi046.stdout:6/683: truncate db/f2b 1931595 0 2024-05-09T06:30:45.623 INFO:tasks.workunit.client.0.smithi046.stdout:6/684: creat db/d10/d30/fe3 x:0 0 0 2024-05-09T06:30:45.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/685: creat db/d10/d3f/d44/d5e/dbe/fe4 x:0 0 0 2024-05-09T06:30:45.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/686: stat db/d10/d3c/l81 0 2024-05-09T06:30:45.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/687: chown db/d10/d76 46109154 1 2024-05-09T06:30:45.628 INFO:tasks.workunit.client.0.smithi046.stdout:6/688: creat db/d10/d3f/d44/d46/d70/fe5 x:0 0 0 2024-05-09T06:30:45.634 INFO:tasks.workunit.client.0.smithi046.stdout:6/689: link db/d10/d30/cd3 db/d10/d57/db7/ce6 0 2024-05-09T06:30:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/690: rmdir db/d10/d3f/d44/d5e 39 2024-05-09T06:30:45.638 INFO:tasks.workunit.client.0.smithi046.stdout:6/691: symlink db/d10/d3f/d44/d46/d70/le7 0 2024-05-09T06:30:45.642 INFO:tasks.workunit.client.0.smithi046.stdout:6/692: truncate db/d10/d3f/d4f/d8a/fb3 2847813 0 2024-05-09T06:30:45.642 INFO:tasks.workunit.client.0.smithi046.stdout:6/693: write db/d10/d3f/d44/fb8 [17813,113987] 0 2024-05-09T06:30:45.650 INFO:tasks.workunit.client.0.smithi046.stdout:6/694: dread db/d10/f1e [0,4194304] 0 2024-05-09T06:30:45.659 INFO:tasks.workunit.client.0.smithi046.stdout:9/375: rename d2/f4 to d2/d26/f73 0 2024-05-09T06:30:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:7/576: rename d3/d7/d4c/l54 to d3/d7/d28/d29/d35/d5c/lb6 0 2024-05-09T06:30:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:7/577: write d3/d7/dd/f44 [3101019,129330] 0 2024-05-09T06:30:45.661 INFO:tasks.workunit.client.0.smithi046.stdout:7/578: write d3/d7/d28/d29/f53 [907719,108629] 0 2024-05-09T06:30:45.664 INFO:tasks.workunit.client.0.smithi046.stdout:7/579: mkdir d3/d7/d4c/d99/dac/db7 0 2024-05-09T06:30:45.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/580: unlink d3/d7/d28/c5a 0 2024-05-09T06:30:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/583: mkdir d0/d3e/dc7 0 2024-05-09T06:30:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/584: fdatasync d0/d1b/d21/f5d 0 2024-05-09T06:30:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/376: dread d2/dc/f11 [0,4194304] 0 2024-05-09T06:30:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/377: fsync d2/d6/d7/d1e/f4a 0 2024-05-09T06:30:45.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/378: truncate d2/d6/f25 5196205 0 2024-05-09T06:30:45.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/581: symlink d3/d7/d28/d73/lb8 0 2024-05-09T06:30:45.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/582: write d3/d7/d28/d29/f3c [428086,49218] 0 2024-05-09T06:30:45.670 INFO:tasks.workunit.client.0.smithi046.stdout:5/585: symlink d0/d1b/d39/lc8 0 2024-05-09T06:30:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:5/586: write d0/d58/d7a/f7b [224986,106589] 0 2024-05-09T06:30:45.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/554: rename d4/d20/d24/d2a/f6b to d4/d5/fb7 0 2024-05-09T06:30:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/379: dread d2/d6/f25 [0,4194304] 0 2024-05-09T06:30:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/380: truncate d2/d26/d2c/d3d/f5b 402757 0 2024-05-09T06:30:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:6/695: rename db/d10/d3f/d4f/d8a/fdf to db/d10/d3f/d44/fe8 0 2024-05-09T06:30:45.677 INFO:tasks.workunit.client.0.smithi046.stdout:6/696: fdatasync db/f42 0 2024-05-09T06:30:45.678 INFO:tasks.workunit.client.0.smithi046.stdout:3/555: mknod d4/d20/d41/d4a/cb8 0 2024-05-09T06:30:45.679 INFO:tasks.workunit.client.0.smithi046.stdout:5/587: dread d0/d1b/d21/f85 [0,4194304] 0 2024-05-09T06:30:45.679 INFO:tasks.workunit.client.0.smithi046.stdout:5/588: chown d0/d1b/f3d 497281 1 2024-05-09T06:30:45.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/583: read d3/d7/dd/f34 [360887,117884] 0 2024-05-09T06:30:45.684 INFO:tasks.workunit.client.0.smithi046.stdout:9/381: unlink d2/d6/d7/d1a/d27/d56/c6e 0 2024-05-09T06:30:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/589: getdents d0/d1b/d21 0 2024-05-09T06:30:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/556: dread d4/d20/d24/d2a/d55/d74/f91 [0,4194304] 0 2024-05-09T06:30:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/557: fdatasync d4/d20/d24/d29/d2b/d94/d5c/f67 0 2024-05-09T06:30:45.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/558: write d4/d20/d24/f18 [4390566,56101] 0 2024-05-09T06:30:45.693 INFO:tasks.workunit.client.0.smithi046.stdout:9/382: rename d2/d6/d38/c40 to d2/dc/c74 0 2024-05-09T06:30:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:3/559: mknod d4/d5d/cb9 0 2024-05-09T06:30:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:3/560: chown d4/l62 822878543 1 2024-05-09T06:30:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:3/561: write d4/d20/d41/f66 [4842890,115046] 0 2024-05-09T06:30:45.701 INFO:tasks.workunit.client.0.smithi046.stdout:5/590: rename d0/d1b/d21/l6d to d0/d58/d7a/lc9 0 2024-05-09T06:30:45.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/383: creat d2/d26/d2c/f75 x:0 0 0 2024-05-09T06:30:45.705 INFO:tasks.workunit.client.0.smithi046.stdout:9/384: dread d2/d6/d7/d1e/f58 [0,4194304] 0 2024-05-09T06:30:45.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/591: symlink d0/dba/lca 0 2024-05-09T06:30:45.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/592: chown d0/f5b 256673020 1 2024-05-09T06:30:45.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/385: mkdir d2/d26/d76 0 2024-05-09T06:30:45.713 INFO:tasks.workunit.client.0.smithi046.stdout:3/562: dwrite d4/d20/d24/d2a/f40 [0,4194304] 0 2024-05-09T06:30:45.713 INFO:tasks.workunit.client.0.smithi046.stdout:9/386: mknod d2/c77 0 2024-05-09T06:30:45.714 INFO:tasks.workunit.client.0.smithi046.stdout:5/593: symlink d0/d1b/d39/lcb 0 2024-05-09T06:30:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:3/563: creat d4/d20/d24/d29/fba x:0 0 0 2024-05-09T06:30:45.722 INFO:tasks.workunit.client.0.smithi046.stdout:9/387: truncate d2/f69 67826 0 2024-05-09T06:30:45.723 INFO:tasks.workunit.client.0.smithi046.stdout:5/594: read d0/fd [4061751,105721] 0 2024-05-09T06:30:45.727 INFO:tasks.workunit.client.0.smithi046.stdout:3/564: symlink d4/d48/lbb 0 2024-05-09T06:30:45.729 INFO:tasks.workunit.client.0.smithi046.stdout:9/388: unlink d2/d6/d7/d1a/d27/d2a/c3c 0 2024-05-09T06:30:45.730 INFO:tasks.workunit.client.0.smithi046.stdout:5/595: symlink d0/d58/lcc 0 2024-05-09T06:30:45.730 INFO:tasks.workunit.client.0.smithi046.stdout:5/596: readlink d0/d1b/d39/lc8 0 2024-05-09T06:30:45.732 INFO:tasks.workunit.client.0.smithi046.stdout:5/597: dread d0/d1b/d21/f7c [0,4194304] 0 2024-05-09T06:30:45.734 INFO:tasks.workunit.client.0.smithi046.stdout:9/389: creat d2/d6/d7/d1e/f78 x:0 0 0 2024-05-09T06:30:45.735 INFO:tasks.workunit.client.0.smithi046.stdout:3/565: read d4/d20/d24/d2a/f40 [3894035,31867] 0 2024-05-09T06:30:45.736 INFO:tasks.workunit.client.0.smithi046.stdout:5/598: mknod d0/db3/ccd 0 2024-05-09T06:30:45.737 INFO:tasks.workunit.client.0.smithi046.stdout:5/599: chown d0/d3e/d83/lbe 1440470601 1 2024-05-09T06:30:45.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/566: creat d4/d5/dac/db0/fbc x:0 0 0 2024-05-09T06:30:45.739 INFO:tasks.workunit.client.0.smithi046.stdout:5/600: rmdir d0/d3e 39 2024-05-09T06:30:45.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/390: dread d2/d6/d7/d1a/d66/f67 [0,4194304] 0 2024-05-09T06:30:45.742 INFO:tasks.workunit.client.0.smithi046.stdout:3/567: rename d4/d20/d24/d29/d7a/fb1 to d4/d5d/d60/fbd 0 2024-05-09T06:30:45.747 INFO:tasks.workunit.client.0.smithi046.stdout:9/391: unlink d2/c63 0 2024-05-09T06:30:45.747 INFO:tasks.workunit.client.0.smithi046.stdout:9/392: readlink d2/d6/l6a 0 2024-05-09T06:30:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/568: dread d4/d5/f3a [4194304,4194304] 0 2024-05-09T06:30:45.766 INFO:tasks.workunit.client.0.smithi046.stdout:9/393: dread d2/f69 [0,4194304] 0 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:1/523: sync 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/519: sync 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:2/520: sync 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/657: sync 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:1/524: chown d7/d10/d28/f4f 6067 1 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:2/521: chown da/de/d14/d1f/d20/d5c/c7f 4277 1 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/520: dread - d11/d18/d27/d28/d36/d5a/f80 zero size 2024-05-09T06:30:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/658: creat d1/db/d41/fc5 x:0 0 0 2024-05-09T06:30:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/394: rename d2/d26/d2c/d3d/f53 to d2/d6/d33/f79 0 2024-05-09T06:30:45.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/525: unlink d7/fe 0 2024-05-09T06:30:45.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/526: dread - d7/d10/d28/d55/f6f zero size 2024-05-09T06:30:45.778 INFO:tasks.workunit.client.0.smithi046.stdout:0/521: truncate d11/d18/d1c/d53/f61 1023121 0 2024-05-09T06:30:45.778 INFO:tasks.workunit.client.0.smithi046.stdout:0/522: stat d11/d18/d1c/l38 0 2024-05-09T06:30:45.778 INFO:tasks.workunit.client.0.smithi046.stdout:8/659: mkdir d1/d7/d12/d1d/d30/dbd/dc6 0 2024-05-09T06:30:45.780 INFO:tasks.workunit.client.0.smithi046.stdout:2/522: read da/db/d7d/f85 [2905010,92671] 0 2024-05-09T06:30:45.784 INFO:tasks.workunit.client.0.smithi046.stdout:1/527: dread d7/d10/d28/d30/d3a/d7f/f96 [0,4194304] 0 2024-05-09T06:30:45.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/523: rename da/de/d14/d1f/f25 to da/de/d14/d1f/d3b/d9f/faa 0 2024-05-09T06:30:45.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/395: truncate d2/d6/d7/f1d 819198 0 2024-05-09T06:30:45.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/396: fdatasync d2/d6/d7/d1e/f58 0 2024-05-09T06:30:45.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/397: creat d2/d26/d2c/f7a x:0 0 0 2024-05-09T06:30:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:1/528: link d7/d10/d34/d46/d81/l9b d7/d10/d28/d30/d3a/lb2 0 2024-05-09T06:30:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:8/660: dread d1/d7/d12/f8e [0,4194304] 0 2024-05-09T06:30:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:0/523: write d11/d18/d27/f79 [694878,26754] 0 2024-05-09T06:30:45.795 INFO:tasks.workunit.client.0.smithi046.stdout:2/524: rename da/de/d14/f58 to da/de/d14/d1f/d20/d7c/d8b/d95/fab 0 2024-05-09T06:30:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/661: dread d1/d7/d12/d45/f83 [0,4194304] 0 2024-05-09T06:30:45.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/529: dread d7/d10/d28/d55/f56 [0,4194304] 0 2024-05-09T06:30:45.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/398: symlink d2/d6/d7/d1a/d27/d65/l7b 0 2024-05-09T06:30:45.802 INFO:tasks.workunit.client.0.smithi046.stdout:0/524: dread d11/d18/d27/d28/f50 [0,4194304] 0 2024-05-09T06:30:45.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/662: mkdir d1/d7/d12/d1d/d30/dbd/dc7 0 2024-05-09T06:30:45.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/663: creat d1/db/d67/d6e/fc8 x:0 0 0 2024-05-09T06:30:45.806 INFO:tasks.workunit.client.0.smithi046.stdout:1/530: creat d7/d10/d28/d30/d3a/d76/fb3 x:0 0 0 2024-05-09T06:30:45.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/399: truncate d2/d6/d7/d1a/d27/f5f 888382 0 2024-05-09T06:30:45.809 INFO:tasks.workunit.client.0.smithi046.stdout:2/525: mknod da/de/d14/d1f/d3b/d86/cac 0 2024-05-09T06:30:45.813 INFO:tasks.workunit.client.0.smithi046.stdout:8/664: rmdir d1/db/dd/d11/d5d/d95 39 2024-05-09T06:30:45.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/531: truncate d7/d10/d28/d30/d3a/f3b 1177107 0 2024-05-09T06:30:45.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/532: write d7/d10/d34/f35 [489341,91809] 0 2024-05-09T06:30:45.822 INFO:tasks.workunit.client.0.smithi046.stdout:0/525: dwrite d11/d18/d27/d28/d2d/f90 [0,4194304] 0 2024-05-09T06:30:45.828 INFO:tasks.workunit.client.0.smithi046.stdout:1/533: write d7/fa6 [4113800,7812] 0 2024-05-09T06:30:45.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/400: link d2/d6/d7/l6c d2/d6/d38/l7c 0 2024-05-09T06:30:45.833 INFO:tasks.workunit.client.0.smithi046.stdout:2/526: getdents da/de/d14/d1f/d20/d5c 0 2024-05-09T06:30:45.835 INFO:tasks.workunit.client.0.smithi046.stdout:8/665: creat d1/db/d67/fc9 x:0 0 0 2024-05-09T06:30:45.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/401: link d2/d6/d7/d1e/l2f d2/d6/d33/l7d 0 2024-05-09T06:30:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/526: dwrite d11/d18/d1c/d53/f7d [0,4194304] 0 2024-05-09T06:30:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/527: read - d11/f35 zero size 2024-05-09T06:30:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/528: creat d11/d18/d27/d28/d6b/fae x:0 0 0 2024-05-09T06:30:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/529: truncate d11/d18/d27/d28/f9e 811395 0 2024-05-09T06:30:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/534: dwrite d7/d10/d34/f6e [0,4194304] 0 2024-05-09T06:30:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/535: write d7/d10/f4c [309347,36293] 0 2024-05-09T06:30:45.846 INFO:tasks.workunit.client.0.smithi046.stdout:2/527: rename da/de/d14/d1f/d20/f84 to da/de/d54/d65/d6c/fad 0 2024-05-09T06:30:45.846 INFO:tasks.workunit.client.0.smithi046.stdout:2/528: write da/de/d14/d1f/d3b/d9f/fa8 [743028,48511] 0 2024-05-09T06:30:45.848 INFO:tasks.workunit.client.0.smithi046.stdout:2/529: write da/de/d14/d1f/d20/f59 [4353060,73601] 0 2024-05-09T06:30:45.848 INFO:tasks.workunit.client.0.smithi046.stdout:2/530: chown da/de/d14/f96 6 1 2024-05-09T06:30:45.853 INFO:tasks.workunit.client.0.smithi046.stdout:0/530: mknod d11/caf 0 2024-05-09T06:30:45.860 INFO:tasks.workunit.client.0.smithi046.stdout:1/536: getdents d7/d6d 0 2024-05-09T06:30:45.861 INFO:tasks.workunit.client.0.smithi046.stdout:1/537: getdents d7/d10/d28/d30/da0 0 2024-05-09T06:30:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:1/538: write d7/d10/d28/d30/d3a/f3b [693354,129780] 0 2024-05-09T06:30:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:1/539: truncate d7/d10/f87 4690909 0 2024-05-09T06:30:45.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/666: rmdir d1/db/dd 39 2024-05-09T06:30:45.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/531: mkdir da/de/d14/d1f/d97/dae 0 2024-05-09T06:30:45.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/531: truncate d11/d18/d27/f79 1043400 0 2024-05-09T06:30:45.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/532: chown d11/d18/d1c/d53/f7d 45911 1 2024-05-09T06:30:45.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/533: truncate d11/d18/d27/d28/d36/d5a/f80 878228 0 2024-05-09T06:30:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:0/534: write d11/d18/d27/d28/d2d/f57 [232703,127016] 0 2024-05-09T06:30:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:0/535: readlink d11/l17 0 2024-05-09T06:30:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:8/667: write d1/d7/d12/d1d/d30/d38/f8c [191783,92869] 0 2024-05-09T06:30:45.876 INFO:tasks.workunit.client.0.smithi046.stdout:1/540: rename d7/d10/d28/d30/d3a/d7f/fb1 to d7/da3/fb4 0 2024-05-09T06:30:45.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/532: stat l2 0 2024-05-09T06:30:45.882 INFO:tasks.workunit.client.0.smithi046.stdout:1/541: mknod d7/d10/d28/d30/d3a/cb5 0 2024-05-09T06:30:45.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/668: dwrite d1/db/dd/d11/fa6 [0,4194304] 0 2024-05-09T06:30:45.896 INFO:tasks.workunit.client.0.smithi046.stdout:0/536: dwrite d11/f22 [0,4194304] 0 2024-05-09T06:30:45.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/533: dwrite da/de/d54/fa6 [0,4194304] 0 2024-05-09T06:30:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/669: symlink d1/db/lca 0 2024-05-09T06:30:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/670: read - d1/db/d67/d6e/fa1 zero size 2024-05-09T06:30:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/671: fdatasync d1/db/dd/d11/f72 0 2024-05-09T06:30:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/672: write d1/db/d41/fc5 [112110,64458] 0 2024-05-09T06:30:45.906 INFO:tasks.workunit.client.0.smithi046.stdout:1/542: dwrite d7/d10/f4c [0,4194304] 0 2024-05-09T06:30:45.906 INFO:tasks.workunit.client.0.smithi046.stdout:1/543: stat d7/d10/d28/d30/la5 0 2024-05-09T06:30:45.906 INFO:tasks.workunit.client.0.smithi046.stdout:1/544: creat d7/d10/d34/d46/d81/fb6 x:0 0 0 2024-05-09T06:30:45.913 INFO:tasks.workunit.client.0.smithi046.stdout:0/537: unlink ff 0 2024-05-09T06:30:45.917 INFO:tasks.workunit.client.0.smithi046.stdout:8/673: dwrite d1/db/f90 [4194304,4194304] 0 2024-05-09T06:30:45.920 INFO:tasks.workunit.client.0.smithi046.stdout:2/534: chown da/de/d14/d1f/d3b/d86/l73 25 1 2024-05-09T06:30:45.931 INFO:tasks.workunit.client.0.smithi046.stdout:8/674: dwrite d1/d7/d12/f5e [0,4194304] 0 2024-05-09T06:30:45.939 INFO:tasks.workunit.client.0.smithi046.stdout:8/675: dread d1/d7/f34 [0,4194304] 0 2024-05-09T06:30:45.941 INFO:tasks.workunit.client.0.smithi046.stdout:0/538: mkdir d11/d18/d27/d28/d36/d91/d98/db0 0 2024-05-09T06:30:45.945 INFO:tasks.workunit.client.0.smithi046.stdout:2/535: creat da/de/d14/d1f/d3b/d86/d3d/faf x:0 0 0 2024-05-09T06:30:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:8/676: unlink d1/ce 0 2024-05-09T06:30:45.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/539: mkdir d11/d18/db1 0 2024-05-09T06:30:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:2/536: mknod da/de/d54/d65/d6c/cb0 0 2024-05-09T06:30:45.954 INFO:tasks.workunit.client.0.smithi046.stdout:0/540: mkdir d11/d18/db1/db2 0 2024-05-09T06:30:45.954 INFO:tasks.workunit.client.0.smithi046.stdout:0/541: chown d11/f35 15 1 2024-05-09T06:30:45.956 INFO:tasks.workunit.client.0.smithi046.stdout:0/542: creat d11/d18/d27/d28/d36/d91/d98/fb3 x:0 0 0 2024-05-09T06:30:45.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/543: creat d11/d18/d27/d28/d36/d5a/fb4 x:0 0 0 2024-05-09T06:30:45.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/544: getdents d11/d18/d1c/d53 0 2024-05-09T06:30:45.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/537: dread da/de/d1c/f82 [0,4194304] 0 2024-05-09T06:30:45.961 INFO:tasks.workunit.client.0.smithi046.stdout:0/545: mknod d11/d18/d27/d28/d6b/cb5 0 2024-05-09T06:30:45.961 INFO:tasks.workunit.client.0.smithi046.stdout:0/546: chown d11/d18/d1c/d53/d82 3152276 1 2024-05-09T06:30:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/538: mkdir da/de/d1c/db1 0 2024-05-09T06:30:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/539: chown da/de/d14/d1f/d3b/d86/f83 13111214 1 2024-05-09T06:30:45.963 INFO:tasks.workunit.client.0.smithi046.stdout:8/677: dwrite d1/d7/d2c/f5b [0,4194304] 0 2024-05-09T06:30:45.970 INFO:tasks.workunit.client.0.smithi046.stdout:8/678: read d1/db/d67/d9f/fb3 [1617241,50729] 0 2024-05-09T06:30:45.976 INFO:tasks.workunit.client.0.smithi046.stdout:2/540: write da/de/d1c/f55 [385784,64458] 0 2024-05-09T06:30:45.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/679: dwrite d1/db/dd/d11/d43/fac [4194304,4194304] 0 2024-05-09T06:30:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/547: dwrite d11/d18/d27/d28/d2d/f4a [0,4194304] 0 2024-05-09T06:30:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/548: fsync f9 0 2024-05-09T06:30:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/549: chown d11/d18/d27/d28/d36/d91/d98/l9b 97459809 1 2024-05-09T06:30:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/550: readlink d11/d18/d1c/d53/l7a 0 2024-05-09T06:30:45.987 INFO:tasks.workunit.client.0.smithi046.stdout:8/680: link d1/d7/d12/d1d/d30/d38/f42 d1/d7/d12/d1d/d30/fcb 0 2024-05-09T06:30:45.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/551: dread d11/f22 [0,4194304] 0 2024-05-09T06:30:45.992 INFO:tasks.workunit.client.0.smithi046.stdout:8/681: symlink d1/d7/d12/d1d/d30/d38/db4/lcc 0 2024-05-09T06:30:45.994 INFO:tasks.workunit.client.0.smithi046.stdout:0/552: creat d11/fb6 x:0 0 0 2024-05-09T06:30:45.995 INFO:tasks.workunit.client.0.smithi046.stdout:8/682: getdents d1/db/dd/d11/d5d/d99/dbf 0 2024-05-09T06:30:46.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/553: rename d11/d18/d27/d28/d2d/f4a to d11/d4f/d5b/fb7 0 2024-05-09T06:30:46.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/554: truncate d11/d18/d27/d28/d36/f95 5173098 0 2024-05-09T06:30:46.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/555: write d11/d18/d27/d28/d36/faa [383019,20307] 0 2024-05-09T06:30:46.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/556: dread d11/d18/d27/d28/d2d/f4c [0,4194304] 0 2024-05-09T06:30:46.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/557: chown d11/d18/d27/d28/d36/l64 9 1 2024-05-09T06:30:46.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/558: truncate d11/d18/d27/d28/f9e 1611282 0 2024-05-09T06:30:46.009 INFO:tasks.workunit.client.0.smithi046.stdout:0/559: read d11/f15 [1289399,97303] 0 2024-05-09T06:30:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:0/560: rename d11/d18/c8e to d11/d18/d27/d28/d2d/d81/cb8 0 2024-05-09T06:30:46.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/561: rmdir d11/d4f/d5b/d5f 39 2024-05-09T06:30:46.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/562: fdatasync d11/f52 0 2024-05-09T06:30:46.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/563: readlink d11/d18/l20 0 2024-05-09T06:30:46.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/683: dwrite d1/d7/f68 [0,4194304] 0 2024-05-09T06:30:46.022 INFO:tasks.workunit.client.0.smithi046.stdout:0/564: dread d11/d4f/d5b/d5f/f6d [0,4194304] 0 2024-05-09T06:30:46.023 INFO:tasks.workunit.client.0.smithi046.stdout:0/565: mknod d11/d18/d27/d28/d36/d91/d98/db0/cb9 0 2024-05-09T06:30:46.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/684: dread d1/d7/d12/d1d/d30/d38/f8c [0,4194304] 0 2024-05-09T06:30:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/685: mkdir d1/d7/dcd 0 2024-05-09T06:30:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/686: chown d1/db/d67/d9f 2344265 1 2024-05-09T06:30:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/687: stat d1/db/dd/d11/d5d/l87 0 2024-05-09T06:30:46.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/688: mknod d1/db/d67/d6e/cce 0 2024-05-09T06:30:46.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/689: fsync d1/db/f90 0 2024-05-09T06:30:46.028 INFO:tasks.workunit.client.0.smithi046.stdout:8/690: mkdir d1/d7/d12/d1d/d30/dbd/dc7/dcf 0 2024-05-09T06:30:46.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/566: write d11/d18/d27/d28/d2d/f90 [24674,25363] 0 2024-05-09T06:30:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:0/567: fsync d11/d18/d27/d28/d6b/fae 0 2024-05-09T06:30:46.048 INFO:tasks.workunit.client.0.smithi046.stdout:0/568: dwrite d11/f62 [0,4194304] 0 2024-05-09T06:30:46.048 INFO:tasks.workunit.client.0.smithi046.stdout:0/569: fdatasync d11/f22 0 2024-05-09T06:30:46.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/570: dwrite d11/d18/f3a [4194304,4194304] 0 2024-05-09T06:30:46.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/571: unlink d11/d18/f1a 0 2024-05-09T06:30:46.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/572: getdents d11/d18/d27/d28/d6b/dac 0 2024-05-09T06:30:46.064 INFO:tasks.workunit.client.0.smithi046.stdout:0/573: mknod d11/d18/d27/d28/cba 0 2024-05-09T06:30:46.065 INFO:tasks.workunit.client.0.smithi046.stdout:0/574: symlink d11/d18/d27/d28/d36/d91/d98/db0/lbb 0 2024-05-09T06:30:46.079 INFO:tasks.workunit.client.0.smithi046.stdout:0/575: dwrite d11/d18/d1c/d53/f66 [0,4194304] 0 2024-05-09T06:30:46.080 INFO:tasks.workunit.client.0.smithi046.stdout:0/576: creat d11/d18/db1/fbc x:0 0 0 2024-05-09T06:30:46.080 INFO:tasks.workunit.client.0.smithi046.stdout:0/577: chown d11/d18/d1c/d53/f6a 646676351 1 2024-05-09T06:30:46.081 INFO:tasks.workunit.client.0.smithi046.stdout:0/578: creat d11/d4f/d5b/fbd x:0 0 0 2024-05-09T06:30:46.082 INFO:tasks.workunit.client.0.smithi046.stdout:0/579: unlink d11/d18/d27/d28/d36/d5a/l6c 0 2024-05-09T06:30:46.084 INFO:tasks.workunit.client.0.smithi046.stdout:0/580: rmdir d11/d18/d1c/d56 39 2024-05-09T06:30:46.086 INFO:tasks.workunit.client.0.smithi046.stdout:0/581: rename d11/d18/d27/d28/l88 to d11/d18/d27/d28/d2d/d81/lbe 0 2024-05-09T06:30:46.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/582: getdents d11/d4f/d5b 0 2024-05-09T06:30:46.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/583: stat d11/f52 0 2024-05-09T06:30:46.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/584: creat d11/d18/d27/d28/d36/d5a/fbf x:0 0 0 2024-05-09T06:30:46.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/585: write d11/d18/d27/d28/fa9 [566020,110107] 0 2024-05-09T06:30:46.096 INFO:tasks.workunit.client.0.smithi046.stdout:0/586: stat d11/d18/f32 0 2024-05-09T06:30:46.098 INFO:tasks.workunit.client.0.smithi046.stdout:0/587: symlink d11/lc0 0 2024-05-09T06:30:46.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/588: unlink d11/d18/d27/f79 0 2024-05-09T06:30:46.113 INFO:tasks.workunit.client.0.smithi046.stdout:0/589: dwrite d11/d18/d27/d28/d36/f37 [0,4194304] 0 2024-05-09T06:30:46.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/590: unlink d11/d18/d27/f33 0 2024-05-09T06:30:46.126 INFO:tasks.workunit.client.0.smithi046.stdout:0/591: mknod d11/d18/db1/cc1 0 2024-05-09T06:30:46.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/592: mkdir d11/d18/d1c/d53/dc2 0 2024-05-09T06:30:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/593: symlink d11/d3f/d6f/lc3 0 2024-05-09T06:30:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/594: fdatasync d11/d18/f39 0 2024-05-09T06:30:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/595: stat d11/d18/db1/db2 0 2024-05-09T06:30:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/596: stat d11/d18/db1/cc1 0 2024-05-09T06:30:46.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/597: getdents d11/d18/d27/d28/d36 0 2024-05-09T06:30:46.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/598: readlink d11/d18/d1c/l38 0 2024-05-09T06:30:46.153 INFO:tasks.workunit.client.0.smithi046.stdout:0/599: read d11/d18/d27/d28/d2d/f3e [2694678,66400] 0 2024-05-09T06:30:46.154 INFO:tasks.workunit.client.0.smithi046.stdout:0/600: mkdir d11/d18/d27/d28/d36/d5a/dc4 0 2024-05-09T06:30:46.154 INFO:tasks.workunit.client.0.smithi046.stdout:0/601: fsync d11/d18/d27/d28/f31 0 2024-05-09T06:30:46.156 INFO:tasks.workunit.client.0.smithi046.stdout:0/602: unlink d11/d18/c7b 0 2024-05-09T06:30:46.156 INFO:tasks.workunit.client.0.smithi046.stdout:0/603: read - d11/d18/d27/d28/d36/d91/d98/fb3 zero size 2024-05-09T06:30:46.157 INFO:tasks.workunit.client.0.smithi046.stdout:0/604: symlink d11/d4f/d5b/lc5 0 2024-05-09T06:30:46.166 INFO:tasks.workunit.client.0.smithi046.stdout:0/605: write d11/d4f/d5b/fb7 [3526532,67157] 0 2024-05-09T06:30:46.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/606: write d11/d4f/d5b/d5f/f6d [1283081,103006] 0 2024-05-09T06:30:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:7/584: sync 2024-05-09T06:30:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/697: sync 2024-05-09T06:30:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/522: sync 2024-05-09T06:30:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/698: write db/d10/d3f/d4f/f60 [5001835,8878] 0 2024-05-09T06:30:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/523: write d7/df/f38 [572101,49118] 0 2024-05-09T06:30:46.178 INFO:tasks.workunit.client.0.smithi046.stdout:7/585: creat d3/d7/d4c/d99/dac/db7/fb9 x:0 0 0 2024-05-09T06:30:46.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/607: dread d11/d18/d27/d28/d2d/d5c/f72 [0,4194304] 0 2024-05-09T06:30:46.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/699: unlink db/d10/d3c/l41 0 2024-05-09T06:30:46.182 INFO:tasks.workunit.client.0.smithi046.stdout:4/524: symlink d7/df/d10/d1d/d77/d87/la8 0 2024-05-09T06:30:46.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/525: creat d7/df/d53/d91/fa9 x:0 0 0 2024-05-09T06:30:46.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/586: creat d3/d6f/fba x:0 0 0 2024-05-09T06:30:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/608: dread - d11/d18/d27/d28/f7c zero size 2024-05-09T06:30:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/609: creat d11/d18/d27/d28/d6b/fc6 x:0 0 0 2024-05-09T06:30:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/610: chown d11/l4b 1 1 2024-05-09T06:30:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/611: write d11/d18/d27/d28/d36/d5a/f87 [543270,36182] 0 2024-05-09T06:30:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:4/526: mknod d7/df/d53/caa 0 2024-05-09T06:30:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:4/527: dread - d7/df/d3a/d25/d86/fa6 zero size 2024-05-09T06:30:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:4/528: chown d7/f71 63558 1 2024-05-09T06:30:46.198 INFO:tasks.workunit.client.0.smithi046.stdout:0/612: dread d11/d18/d27/d28/d6b/f77 [0,4194304] 0 2024-05-09T06:30:46.204 INFO:tasks.workunit.client.0.smithi046.stdout:7/587: rename d3/d7/d4c/d6a to d3/d7/d28/d29/d35/d5c/dad/dbb 0 2024-05-09T06:30:46.204 INFO:tasks.workunit.client.0.smithi046.stdout:4/529: dwrite d7/df/d10/d2f/fa2 [0,4194304] 0 2024-05-09T06:30:46.208 INFO:tasks.workunit.client.0.smithi046.stdout:0/613: write d11/d18/d1c/d53/f66 [1858192,110992] 0 2024-05-09T06:30:46.210 INFO:tasks.workunit.client.0.smithi046.stdout:4/530: symlink d7/df/d10/d2f/lab 0 2024-05-09T06:30:46.210 INFO:tasks.workunit.client.0.smithi046.stdout:4/531: chown d7/df/d10/d1d/c60 53 1 2024-05-09T06:30:46.210 INFO:tasks.workunit.client.0.smithi046.stdout:4/532: fdatasync d7/df/d3a/f76 0 2024-05-09T06:30:46.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/533: mkdir d7/df/d10/d1d/d77/d87/dac 0 2024-05-09T06:30:46.216 INFO:tasks.workunit.client.0.smithi046.stdout:0/614: dread d11/d18/f3a [4194304,4194304] 0 2024-05-09T06:30:46.219 INFO:tasks.workunit.client.0.smithi046.stdout:0/615: unlink d11/d18/d27/d28/f7c 0 2024-05-09T06:30:46.219 INFO:tasks.workunit.client.0.smithi046.stdout:0/616: write d11/d4f/fa4 [847989,107840] 0 2024-05-09T06:30:46.219 INFO:tasks.workunit.client.0.smithi046.stdout:0/617: creat d11/d18/d27/d28/fc7 x:0 0 0 2024-05-09T06:30:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/588: dwrite d3/d7/d28/f24 [0,4194304] 0 2024-05-09T06:30:46.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/589: symlink d3/d7/dd/lbc 0 2024-05-09T06:30:46.232 INFO:tasks.workunit.client.0.smithi046.stdout:4/534: dwrite d7/df/fa3 [0,4194304] 0 2024-05-09T06:30:46.232 INFO:tasks.workunit.client.0.smithi046.stdout:4/535: write d7/df/d3a/d25/d86/fa6 [838735,10363] 0 2024-05-09T06:30:46.232 INFO:tasks.workunit.client.0.smithi046.stdout:4/536: chown d7/df/d10/d1d/c60 1163575 1 2024-05-09T06:30:46.233 INFO:tasks.workunit.client.0.smithi046.stdout:0/618: dread d11/d18/f8c [0,4194304] 0 2024-05-09T06:30:46.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/619: chown d11/d18/d1c/f44 955218719 1 2024-05-09T06:30:46.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/620: dread - d11/d18/f3b zero size 2024-05-09T06:30:46.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/621: fsync d11/d18/d27/d28/d36/d5a/f8d 0 2024-05-09T06:30:46.234 INFO:tasks.workunit.client.0.smithi046.stdout:7/590: dread d3/d7/d28/f33 [0,4194304] 0 2024-05-09T06:30:46.235 INFO:tasks.workunit.client.0.smithi046.stdout:4/537: mknod d7/df/cad 0 2024-05-09T06:30:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:0/622: creat d11/d18/d27/d28/d6b/dac/fc8 x:0 0 0 2024-05-09T06:30:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:0/623: fsync d11/d18/d27/d28/d36/d5a/f69 0 2024-05-09T06:30:46.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/624: symlink d11/d18/db1/db2/lc9 0 2024-05-09T06:30:46.248 INFO:tasks.workunit.client.0.smithi046.stdout:4/538: write d7/df/d3a/f28 [3344061,64801] 0 2024-05-09T06:30:46.248 INFO:tasks.workunit.client.0.smithi046.stdout:4/539: write d7/df/d3a/d45/f51 [1502453,45509] 0 2024-05-09T06:30:46.248 INFO:tasks.workunit.client.0.smithi046.stdout:4/540: write d7/df/d10/d1d/f8e [1173553,68472] 0 2024-05-09T06:30:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/591: dwrite d3/d7/d28/f24 [4194304,4194304] 0 2024-05-09T06:30:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/592: write d3/d7/f52 [527079,9405] 0 2024-05-09T06:30:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/593: write d3/d7/d28/d29/f53 [1351945,66409] 0 2024-05-09T06:30:46.268 INFO:tasks.workunit.client.0.smithi046.stdout:0/625: write d11/d18/d27/d28/d36/f95 [670698,65371] 0 2024-05-09T06:30:46.268 INFO:tasks.workunit.client.0.smithi046.stdout:0/626: chown d11/d18/d27/d28/d36/d5a 0 1 2024-05-09T06:30:46.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/594: dwrite d3/d7/d28/d73/f88 [0,4194304] 0 2024-05-09T06:30:46.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/595: write d3/d6f/f8d [527631,43068] 0 2024-05-09T06:30:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/541: dwrite d7/df/d3a/d25/f5f [0,4194304] 0 2024-05-09T06:30:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/542: write d7/df/d3a/d25/d86/f88 [83169,124526] 0 2024-05-09T06:30:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/543: creat d7/df/d3a/d25/d86/fae x:0 0 0 2024-05-09T06:30:46.305 INFO:tasks.workunit.client.0.smithi046.stdout:7/596: dread d3/d7/dd/f34 [0,4194304] 0 2024-05-09T06:30:46.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/597: write d3/d7/d28/fa5 [400285,18849] 0 2024-05-09T06:30:46.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/598: truncate d3/f1e 2559613 0 2024-05-09T06:30:46.319 INFO:tasks.workunit.client.0.smithi046.stdout:7/599: rename d3/d7/d28/d29/d82 to d3/d7/d28/d29/d3b/dbd 0 2024-05-09T06:30:46.319 INFO:tasks.workunit.client.0.smithi046.stdout:7/600: write d3/d7/d4c/d99/dac/db7/fb9 [765789,84046] 0 2024-05-09T06:30:46.321 INFO:tasks.workunit.client.0.smithi046.stdout:7/601: mknod d3/d7/d28/d29/d35/d5c/cbe 0 2024-05-09T06:30:46.322 INFO:tasks.workunit.client.0.smithi046.stdout:4/544: dwrite d7/df/d3a/d25/f5f [0,4194304] 0 2024-05-09T06:30:46.342 INFO:tasks.workunit.client.0.smithi046.stdout:7/602: dwrite d3/d7/d28/d29/d3b/f70 [4194304,4194304] 0 2024-05-09T06:30:46.342 INFO:tasks.workunit.client.0.smithi046.stdout:7/603: stat d3/d7/d4c/d99/la2 0 2024-05-09T06:30:46.342 INFO:tasks.workunit.client.0.smithi046.stdout:7/604: write d3/d7/d28/f33 [6307112,99487] 0 2024-05-09T06:30:46.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/605: fdatasync d3/d7/d4c/f92 0 2024-05-09T06:30:46.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/601: sync 2024-05-09T06:30:46.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/606: rmdir d3/d7/d28/d29/d35/d5c/dad 39 2024-05-09T06:30:46.346 INFO:tasks.workunit.client.0.smithi046.stdout:5/602: mkdir d0/d3e/d53/dce 0 2024-05-09T06:30:46.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/545: dwrite d7/df/d10/d2f/f5c [0,4194304] 0 2024-05-09T06:30:46.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/546: readlink d7/ld 0 2024-05-09T06:30:46.348 INFO:tasks.workunit.client.0.smithi046.stdout:7/607: truncate d3/d7/d28/d29/d3b/f7d 962349 0 2024-05-09T06:30:46.354 INFO:tasks.workunit.client.0.smithi046.stdout:4/547: mkdir d7/daf 0 2024-05-09T06:30:46.355 INFO:tasks.workunit.client.0.smithi046.stdout:7/608: write d3/d7/d28/f66 [3617672,6843] 0 2024-05-09T06:30:46.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/609: chown d3/d7/d28/fa5 1581238807 1 2024-05-09T06:30:46.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/548: rmdir d7/df/d10/d2f 39 2024-05-09T06:30:46.364 INFO:tasks.workunit.client.0.smithi046.stdout:4/549: chown d7/df/d3a/d25/l8c 7 1 2024-05-09T06:30:46.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/610: getdents d3/d7/d28/d29/d35/d5c/d9b 0 2024-05-09T06:30:46.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/611: creat d3/d3d/d72/d79/fbf x:0 0 0 2024-05-09T06:30:46.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/612: write d3/d7/dd/f34 [1417562,89534] 0 2024-05-09T06:30:46.368 INFO:tasks.workunit.client.0.smithi046.stdout:4/550: getdents d7 0 2024-05-09T06:30:46.376 INFO:tasks.workunit.client.0.smithi046.stdout:7/613: rename d3/d7/d28/d29/d35/d5c/dad/dbb/fb1 to d3/d7/d4c/d99/fc0 0 2024-05-09T06:30:46.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/614: dread d3/d7/d28/d29/f3c [0,4194304] 0 2024-05-09T06:30:46.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/615: chown d3/d7/d28/f58 7237 1 2024-05-09T06:30:46.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/616: chown d3/d7/d28/d29/d3b/dbd/f90 0 1 2024-05-09T06:30:46.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/617: dread - d3/d7/f96 zero size 2024-05-09T06:30:46.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/618: creat d3/d7/dd/fc1 x:0 0 0 2024-05-09T06:30:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/619: mknod d3/d7/d4c/d99/dac/cc2 0 2024-05-09T06:30:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/620: dread d3/d7/d28/d29/f45 [4194304,4194304] 0 2024-05-09T06:30:46.401 INFO:tasks.workunit.client.0.smithi046.stdout:7/621: dwrite d3/d7/d28/d29/d35/f48 [0,4194304] 0 2024-05-09T06:30:46.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/622: rename d3/d6f/f8b to d3/d3d/d5b/fc3 0 2024-05-09T06:30:46.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/623: chown d3/d7/dd/f34 5090 1 2024-05-09T06:30:46.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/624: read d3/d7/d28/f50 [2762657,15854] 0 2024-05-09T06:30:46.418 INFO:tasks.workunit.client.0.smithi046.stdout:7/625: mkdir d3/dc4 0 2024-05-09T06:30:46.421 INFO:tasks.workunit.client.0.smithi046.stdout:7/626: creat d3/d7/d28/fc5 x:0 0 0 2024-05-09T06:30:46.421 INFO:tasks.workunit.client.0.smithi046.stdout:7/627: creat d3/d7/d28/fc6 x:0 0 0 2024-05-09T06:30:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/628: dread d3/d7/dd/d3e/fa1 [0,4194304] 0 2024-05-09T06:30:46.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/629: dread d3/d3d/f47 [0,4194304] 0 2024-05-09T06:30:46.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/630: dread - d3/d3d/d72/d79/fa9 zero size 2024-05-09T06:30:46.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/631: write d3/d7/d4c/f92 [943785,35796] 0 2024-05-09T06:30:46.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/632: truncate d3/d7/d28/d29/d3b/f3f 898562 0 2024-05-09T06:30:46.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/633: stat d3/l13 0 2024-05-09T06:30:46.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/634: dread d3/d7/d28/d29/d35/d5c/f61 [0,4194304] 0 2024-05-09T06:30:46.449 INFO:tasks.workunit.client.0.smithi046.stdout:7/635: dread d3/d7/d28/d29/d3b/f70 [0,4194304] 0 2024-05-09T06:30:46.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/636: dwrite d3/d7/d28/f50 [0,4194304] 0 2024-05-09T06:30:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:3/569: sync 2024-05-09T06:30:46.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/570: write d4/d20/d24/d2a/d4e/f8e [3930723,55184] 0 2024-05-09T06:30:46.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/571: readlink l2 0 2024-05-09T06:30:46.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/572: dread d4/d20/d41/f63 [0,4194304] 0 2024-05-09T06:30:46.510 INFO:tasks.workunit.client.0.smithi046.stdout:7/637: truncate d3/d7/d28/d29/d3b/f7e 4599394 0 2024-05-09T06:30:46.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/573: symlink d4/d20/d24/d29/d2b/d94/lbe 0 2024-05-09T06:30:46.517 INFO:tasks.workunit.client.0.smithi046.stdout:7/638: symlink d3/d7/d4c/lc7 0 2024-05-09T06:30:46.518 INFO:tasks.workunit.client.0.smithi046.stdout:3/574: mknod d4/d20/d24/d29/d2b/cbf 0 2024-05-09T06:30:46.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/639: symlink d3/d7/d4c/d4f/lc8 0 2024-05-09T06:30:46.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/575: mkdir d4/d48/d49/dc0 0 2024-05-09T06:30:46.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/576: dread d4/f85 [0,4194304] 0 2024-05-09T06:30:46.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/577: dread d4/d20/d24/d29/d2b/f70 [0,4194304] 0 2024-05-09T06:30:46.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/640: dwrite d3/f85 [0,4194304] 0 2024-05-09T06:30:46.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/641: chown d3/d7/d4c/lc7 107047 1 2024-05-09T06:30:46.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/642: readlink d3/d7/d28/d29/d35/d5c/lb6 0 2024-05-09T06:30:46.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/643: truncate d3/d7/d28/d29/d35/f62 847653 0 2024-05-09T06:30:46.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/644: chown d3/d3d/d72/d79/d81/c97 22642 1 2024-05-09T06:30:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:7/645: creat d3/d7/d28/d73/da3/fc9 x:0 0 0 2024-05-09T06:30:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:7/646: fsync d3/d7/f2d 0 2024-05-09T06:30:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:7/647: chown d3/d7/d28/d29/d3b/la0 21 1 2024-05-09T06:30:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/578: write d4/d48/d49/f6e [2327855,103765] 0 2024-05-09T06:30:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/579: stat l2 0 2024-05-09T06:30:46.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/648: write d3/d7/d28/f50 [2732540,25053] 0 2024-05-09T06:30:46.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/649: write d3/d7/fa [1524423,82916] 0 2024-05-09T06:30:46.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/650: symlink d3/d6f/lca 0 2024-05-09T06:30:46.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/651: creat d3/d7/d4c/fcb x:0 0 0 2024-05-09T06:30:46.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/652: fsync d3/d7/d8e/f93 0 2024-05-09T06:30:46.557 INFO:tasks.workunit.client.0.smithi046.stdout:7/653: mknod d3/d7/d28/d73/da3/ccc 0 2024-05-09T06:30:46.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/654: mknod d3/d7/d8e/ccd 0 2024-05-09T06:30:46.561 INFO:tasks.workunit.client.0.smithi046.stdout:3/580: dwrite d4/d20/f26 [0,4194304] 0 2024-05-09T06:30:46.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/655: link d3/d7/dd/d3e/l67 d3/d7/d4c/d99/dac/lce 0 2024-05-09T06:30:46.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/656: read - d3/d6f/fba zero size 2024-05-09T06:30:46.569 INFO:tasks.workunit.client.0.smithi046.stdout:3/581: rename d4/d20/d24/d29/d2b/c39 to d4/d5/cc1 0 2024-05-09T06:30:46.569 INFO:tasks.workunit.client.0.smithi046.stdout:3/582: stat d4/d48/d49/dc0 0 2024-05-09T06:30:46.574 INFO:tasks.workunit.client.0.smithi046.stdout:7/657: symlink d3/d7/dd/d3e/lcf 0 2024-05-09T06:30:46.574 INFO:tasks.workunit.client.0.smithi046.stdout:7/658: truncate d3/d7/f96 1013075 0 2024-05-09T06:30:46.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/659: getdents d3/d7/d4c/d99 0 2024-05-09T06:30:46.598 INFO:tasks.workunit.client.0.smithi046.stdout:3/583: dwrite d4/d20/d24/d2a/d46/f6f [0,4194304] 0 2024-05-09T06:30:46.598 INFO:tasks.workunit.client.0.smithi046.stdout:3/584: write d4/f3d [642223,35373] 0 2024-05-09T06:30:46.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/660: dwrite d3/d6f/f8d [0,4194304] 0 2024-05-09T06:30:46.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/661: readlink d3/d7/d4c/lc7 0 2024-05-09T06:30:46.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/662: chown d3/d7/d28/d29/d35/d5c/dad 484 1 2024-05-09T06:30:46.602 INFO:tasks.workunit.client.0.smithi046.stdout:3/585: symlink d4/d20/d24/d2a/d55/d6a/lc2 0 2024-05-09T06:30:46.602 INFO:tasks.workunit.client.0.smithi046.stdout:3/586: creat d4/d20/d24/d2a/d55/d6a/fc3 x:0 0 0 2024-05-09T06:30:46.611 INFO:tasks.workunit.client.0.smithi046.stdout:7/663: mknod d3/d6f/cd0 0 2024-05-09T06:30:46.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/587: creat d4/d20/d24/d2a/d46/fc4 x:0 0 0 2024-05-09T06:30:46.621 INFO:tasks.workunit.client.0.smithi046.stdout:3/588: creat d4/d20/d24/d29/d2b/fc5 x:0 0 0 2024-05-09T06:30:46.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/664: getdents d3 0 2024-05-09T06:30:46.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/665: chown d3/d7/d4c/d99/dac/cc2 215051597 1 2024-05-09T06:30:46.624 INFO:tasks.workunit.client.0.smithi046.stdout:3/589: unlink d4/d5d/d60/l7f 0 2024-05-09T06:30:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/666: creat d3/d3d/d5b/d84/fd1 x:0 0 0 2024-05-09T06:30:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/667: creat d3/d7/d4c/fd2 x:0 0 0 2024-05-09T06:30:46.628 INFO:tasks.workunit.client.0.smithi046.stdout:7/668: unlink d3/d7/d28/f24 0 2024-05-09T06:30:46.628 INFO:tasks.workunit.client.0.smithi046.stdout:7/669: creat d3/d6f/fd3 x:0 0 0 2024-05-09T06:30:46.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/670: rename d3/d7/f96 to d3/d3d/d72/d94/fd4 0 2024-05-09T06:30:46.631 INFO:tasks.workunit.client.0.smithi046.stdout:3/590: dread d4/d20/d24/d2a/d46/f5b [0,4194304] 0 2024-05-09T06:30:46.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/591: getdents d4/d5d 0 2024-05-09T06:30:46.636 INFO:tasks.workunit.client.0.smithi046.stdout:3/592: rmdir d4/d20/d24/d2a 39 2024-05-09T06:30:46.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/671: dwrite d3/d7/d28/d29/f98 [0,4194304] 0 2024-05-09T06:30:46.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/593: rmdir d4 39 2024-05-09T06:30:46.650 INFO:tasks.workunit.client.0.smithi046.stdout:3/594: mkdir d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/dc6 0 2024-05-09T06:30:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:3/595: fdatasync d4/d20/d24/d2a/d55/d74/f89 0 2024-05-09T06:30:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:3/596: write d4/d20/d24/d2a/d55/d74/f89 [1781871,61036] 0 2024-05-09T06:30:46.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/672: read d3/fa7 [2704434,123502] 0 2024-05-09T06:30:46.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/597: creat d4/d20/d24/d29/fc7 x:0 0 0 2024-05-09T06:30:46.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/598: fdatasync d4/d20/d41/f63 0 2024-05-09T06:30:46.656 INFO:tasks.workunit.client.0.smithi046.stdout:3/599: creat d4/d20/d24/d2a/da2/fc8 x:0 0 0 2024-05-09T06:30:46.659 INFO:tasks.workunit.client.0.smithi046.stdout:3/600: truncate d4/d5/f43 270999 0 2024-05-09T06:30:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/673: dwrite d3/d7/dd/f23 [4194304,4194304] 0 2024-05-09T06:30:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:3/601: dread d4/d20/f26 [4194304,4194304] 0 2024-05-09T06:30:46.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/674: mkdir d3/d7/d28/d29/d3b/dbd/dd5 0 2024-05-09T06:30:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/402: sync 2024-05-09T06:30:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/545: sync 2024-05-09T06:30:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/403: fdatasync d2/d6/f25 0 2024-05-09T06:30:46.680 INFO:tasks.workunit.client.0.smithi046.stdout:7/675: write d3/d7/d28/d29/d3b/f70 [7651978,1974] 0 2024-05-09T06:30:46.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/546: rename d7/d10/d28/d55/f56 to d7/d10/d28/d30/d3a/fb7 0 2024-05-09T06:30:46.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/602: dwrite d4/d5/f3a [0,4194304] 0 2024-05-09T06:30:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:9/404: read d2/d6/d7/f1d [730146,117132] 0 2024-05-09T06:30:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:9/405: creat d2/d6/d7/d1e/f7e x:0 0 0 2024-05-09T06:30:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:7/676: rename d3/d7/d28/d29/f3c to d3/fd6 0 2024-05-09T06:30:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:7/677: write d3/fd6 [1353022,7278] 0 2024-05-09T06:30:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:7/678: truncate d3/d7/d28/d73/da3/fc9 782710 0 2024-05-09T06:30:46.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/547: mkdir d7/d10/d34/d46/db8 0 2024-05-09T06:30:46.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/548: readlink d7/d10/d34/d46/l69 0 2024-05-09T06:30:46.705 INFO:tasks.workunit.client.0.smithi046.stdout:3/603: link d4/d20/d41/f68 d4/d20/d24/d2a/d4e/fc9 0 2024-05-09T06:30:46.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/406: fdatasync d2/dc/f41 0 2024-05-09T06:30:46.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/407: fdatasync d2/d6/f22 0 2024-05-09T06:30:46.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/408: fdatasync d2/d6/d33/f79 0 2024-05-09T06:30:46.710 INFO:tasks.workunit.client.0.smithi046.stdout:8/691: sync 2024-05-09T06:30:46.710 INFO:tasks.workunit.client.0.smithi046.stdout:2/541: sync 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:0/627: sync 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/551: sync 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:5/603: sync 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:0/628: chown d11/l4d 9813 1 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/552: chown d7/df/d3a/d45 358201 1 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:2/542: chown da/dc/f27 15484 1 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:0/629: fdatasync d11/d3f/f5d 0 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/700: sync 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/553: write d7/df/d53/d91/f95 [1044557,69874] 0 2024-05-09T06:30:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:0/630: write d11/d18/d27/d28/d6b/fae [440110,34400] 0 2024-05-09T06:30:46.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/679: dwrite d3/d3d/d72/f89 [0,4194304] 0 2024-05-09T06:30:46.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/549: symlink d7/d10/d28/d30/lb9 0 2024-05-09T06:30:46.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/550: write d7/d10/d28/d30/d3a/fb7 [5157167,126385] 0 2024-05-09T06:30:46.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/604: link d4/d20/d24/d2a/d55/d74/f91 d4/d20/d24/fca 0 2024-05-09T06:30:46.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/605: fdatasync d4/d20/d24/d2a/d55/d74/f91 0 2024-05-09T06:30:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:6/701: rename db/f14 to db/d10/d6b/fe9 0 2024-05-09T06:30:46.729 INFO:tasks.workunit.client.0.smithi046.stdout:7/680: mkdir d3/d7/dd/d3e/dd7 0 2024-05-09T06:30:46.732 INFO:tasks.workunit.client.0.smithi046.stdout:1/551: creat d7/d10/d28/d30/d3a/fba x:0 0 0 2024-05-09T06:30:46.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/606: symlink d4/d20/d24/d2a/d4e/d58/lcb 0 2024-05-09T06:30:46.737 INFO:tasks.workunit.client.0.smithi046.stdout:9/409: symlink d2/d20/l7f 0 2024-05-09T06:30:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:8/692: dwrite d1/db/dd/d11/d5d/f77 [0,4194304] 0 2024-05-09T06:30:46.740 INFO:tasks.workunit.client.0.smithi046.stdout:5/604: mkdir d0/d1b/d39/dcf 0 2024-05-09T06:30:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:7/681: rename d3/f1b to d3/d3d/d72/fd8 0 2024-05-09T06:30:46.742 INFO:tasks.workunit.client.0.smithi046.stdout:2/543: dwrite da/db/f6f [0,4194304] 0 2024-05-09T06:30:46.743 INFO:tasks.workunit.client.0.smithi046.stdout:2/544: chown da/dc/f56 95 1 2024-05-09T06:30:46.743 INFO:tasks.workunit.client.0.smithi046.stdout:2/545: truncate da/de/d14/d1f/d3b/f37 1159969 0 2024-05-09T06:30:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/554: dwrite d7/df/d3a/d45/d96/f67 [4194304,4194304] 0 2024-05-09T06:30:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/555: chown d7/fc 12 1 2024-05-09T06:30:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/702: dwrite db/d10/d3c/dd4/d87/fc7 [0,4194304] 0 2024-05-09T06:30:46.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/607: rename d4/lf to d4/d20/lcc 0 2024-05-09T06:30:46.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/608: readlink d4/d20/d24/d29/d2b/l8f 0 2024-05-09T06:30:46.747 INFO:tasks.workunit.client.0.smithi046.stdout:6/703: dread db/d10/d3f/d4f/d8a/d9e/fa7 [0,4194304] 0 2024-05-09T06:30:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/682: dread d3/d7/d4c/d99/dac/db7/fb9 [0,4194304] 0 2024-05-09T06:30:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/683: fsync d3/d7/d28/f33 0 2024-05-09T06:30:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/684: chown d3/d7/d28/d29/d35/f78 57 1 2024-05-09T06:30:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/693: write d1/d7/d12/f89 [2131242,25705] 0 2024-05-09T06:30:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/694: dread - d1/db/dd/fbe zero size 2024-05-09T06:30:46.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/695: write d1/d7/d12/d1d/d30/d38/f42 [1246486,16774] 0 2024-05-09T06:30:46.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/696: chown d1/db/dd/d11/d5d/d95/fbc 6 1 2024-05-09T06:30:46.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/697: fdatasync d1/d7/d12/f1f 0 2024-05-09T06:30:46.754 INFO:tasks.workunit.client.0.smithi046.stdout:3/609: getdents d4/d5 0 2024-05-09T06:30:46.756 INFO:tasks.workunit.client.0.smithi046.stdout:9/410: rename d2/d6/d33/c4b to d2/d6/d7/d1a/c80 0 2024-05-09T06:30:46.758 INFO:tasks.workunit.client.0.smithi046.stdout:5/605: dwrite d0/f24 [0,4194304] 0 2024-05-09T06:30:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:5/606: read d0/d1b/f20 [669308,106198] 0 2024-05-09T06:30:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:3/610: creat d4/d20/d24/d2a/d55/d6a/fcd x:0 0 0 2024-05-09T06:30:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:3/611: write d4/fc [8867909,91368] 0 2024-05-09T06:30:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:3/612: chown d4/d20/d24/d2a/d55/d6a/fc3 242845 1 2024-05-09T06:30:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:2/546: rename da/de/d14/d1f/d20/d5c/c7f to da/de/d14/d1f/d20/d7c/cb2 0 2024-05-09T06:30:46.762 INFO:tasks.workunit.client.0.smithi046.stdout:5/607: rmdir d0/d1b 39 2024-05-09T06:30:46.762 INFO:tasks.workunit.client.0.smithi046.stdout:5/608: chown d0/dba 89521631 1 2024-05-09T06:30:46.764 INFO:tasks.workunit.client.0.smithi046.stdout:3/613: link d4/d20/d24/d2a/d4e/c8a d4/d20/d41/cce 0 2024-05-09T06:30:46.764 INFO:tasks.workunit.client.0.smithi046.stdout:3/614: write d4/d5d/f7d [142905,85331] 0 2024-05-09T06:30:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/685: rename d3/d7/d28/d29/d3b/dbd/dd5 to d3/d7/d4c/d99/dac/db7/dd9 0 2024-05-09T06:30:46.766 INFO:tasks.workunit.client.0.smithi046.stdout:5/609: mkdir d0/d3e/dc7/dd0 0 2024-05-09T06:30:46.766 INFO:tasks.workunit.client.0.smithi046.stdout:5/610: dread - d0/d3e/d53/fc2 zero size 2024-05-09T06:30:46.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/615: mknod d4/d5/dac/db0/ccf 0 2024-05-09T06:30:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/686: link d3/d3d/d5b/cb4 d3/d7/d28/d29/d3b/dbd/cda 0 2024-05-09T06:30:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/687: chown d3/d7/dd/f34 16647741 1 2024-05-09T06:30:46.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/411: dread d2/d6/d7/d1a/d27/d2a/f72 [0,4194304] 0 2024-05-09T06:30:46.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/547: dwrite da/d2d/f93 [0,4194304] 0 2024-05-09T06:30:46.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/548: chown da/d2d/f93 8172035 1 2024-05-09T06:30:46.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/549: write da/de/d54/d65/d6c/fad [4498843,4303] 0 2024-05-09T06:30:46.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/550: creat da/db/d7d/d6d/fb3 x:0 0 0 2024-05-09T06:30:46.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/688: dread d3/d7/d28/d29/d35/f48 [0,4194304] 0 2024-05-09T06:30:46.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/689: chown d3/d7/d28/d29/d3b 840 1 2024-05-09T06:30:46.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/412: rmdir d2/d6/d7/d1a 39 2024-05-09T06:30:46.788 INFO:tasks.workunit.client.0.smithi046.stdout:7/690: mknod d3/d7/d4c/d99/dac/db7/cdb 0 2024-05-09T06:30:46.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/413: dread d2/d6/d33/f52 [4194304,4194304] 0 2024-05-09T06:30:46.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/414: write d2/d26/d2c/f50 [589672,75147] 0 2024-05-09T06:30:46.791 INFO:tasks.workunit.client.0.smithi046.stdout:9/415: creat d2/d6/d38/f81 x:0 0 0 2024-05-09T06:30:46.797 INFO:tasks.workunit.client.0.smithi046.stdout:2/551: dwrite da/d2d/f42 [0,4194304] 0 2024-05-09T06:30:46.807 INFO:tasks.workunit.client.0.smithi046.stdout:2/552: dread da/de/d14/d1f/d3b/d86/f69 [0,4194304] 0 2024-05-09T06:30:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:2/553: dread da/de/f7e [0,4194304] 0 2024-05-09T06:30:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/416: dwrite d2/d26/f43 [0,4194304] 0 2024-05-09T06:30:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/417: fsync d2/d6/d7/d1a/d66/f67 0 2024-05-09T06:30:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/418: fdatasync d2/d6/d7/d1e/f78 0 2024-05-09T06:30:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/419: write d2/d6/d7/d1a/f2e [4300825,129737] 0 2024-05-09T06:30:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/420: readlink d2/d6/d38/l7c 0 2024-05-09T06:30:46.861 INFO:tasks.workunit.client.0.smithi046.stdout:7/691: getdents d3/d7/d28/d73 0 2024-05-09T06:30:46.861 INFO:tasks.workunit.client.0.smithi046.stdout:7/692: dread - d3/d7/d4c/d99/fc0 zero size 2024-05-09T06:30:46.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/554: rmdir da/de/d14/d1f/d3b 39 2024-05-09T06:30:46.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/555: stat da/de/d14/d1f/d3b/d86/d3a/l99 0 2024-05-09T06:30:46.871 INFO:tasks.workunit.client.0.smithi046.stdout:7/693: write d3/d7/d28/d29/d3b/f4a [1002801,103968] 0 2024-05-09T06:30:46.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/421: creat d2/f82 x:0 0 0 2024-05-09T06:30:46.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/556: dread da/dc/f27 [0,4194304] 0 2024-05-09T06:30:46.878 INFO:tasks.workunit.client.0.smithi046.stdout:7/694: dread d3/d7/dd/f34 [0,4194304] 0 2024-05-09T06:30:46.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/422: symlink d2/d6/l83 0 2024-05-09T06:30:46.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/423: truncate d2/d6/d33/f52 5307708 0 2024-05-09T06:30:46.887 INFO:tasks.workunit.client.0.smithi046.stdout:2/557: rename da/dc/f56 to da/de/d14/d1f/d3b/d86/d3a/fb4 0 2024-05-09T06:30:46.888 INFO:tasks.workunit.client.0.smithi046.stdout:7/695: mkdir d3/d3d/d5b/d84/ddc 0 2024-05-09T06:30:46.888 INFO:tasks.workunit.client.0.smithi046.stdout:7/696: dread - d3/d7/dd/d3e/fb3 zero size 2024-05-09T06:30:46.892 INFO:tasks.workunit.client.0.smithi046.stdout:9/424: symlink d2/d6/d7/d1a/d66/l84 0 2024-05-09T06:30:46.896 INFO:tasks.workunit.client.0.smithi046.stdout:9/425: rename d2/d6/d38/f81 to d2/d6/d33/f85 0 2024-05-09T06:30:46.896 INFO:tasks.workunit.client.0.smithi046.stdout:2/558: write da/de/d14/d1f/d20/d7c/d8b/d95/fab [2296186,34161] 0 2024-05-09T06:30:46.896 INFO:tasks.workunit.client.0.smithi046.stdout:2/559: fsync da/de/d1c/f55 0 2024-05-09T06:30:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/560: creat da/de/d14/d1f/d3b/d86/d3d/fb5 x:0 0 0 2024-05-09T06:30:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/561: chown da/db/d7d 2 1 2024-05-09T06:30:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/562: fdatasync da/d2d/d43/f9e 0 2024-05-09T06:30:46.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/697: dwrite d3/d7/dd/fc1 [0,4194304] 0 2024-05-09T06:30:46.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/563: creat da/de/d54/d65/d6c/fb6 x:0 0 0 2024-05-09T06:30:46.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/564: creat da/de/d14/d1f/d3b/d86/d3d/fb7 x:0 0 0 2024-05-09T06:30:46.905 INFO:tasks.workunit.client.0.smithi046.stdout:7/698: creat d3/fdd x:0 0 0 2024-05-09T06:30:46.907 INFO:tasks.workunit.client.0.smithi046.stdout:2/565: creat da/de/d14/fb8 x:0 0 0 2024-05-09T06:30:46.908 INFO:tasks.workunit.client.0.smithi046.stdout:7/699: creat d3/d7/d4c/d99/dac/fde x:0 0 0 2024-05-09T06:30:46.910 INFO:tasks.workunit.client.0.smithi046.stdout:7/700: unlink d3/d7/d28/d29/d35/d5c/f8c 0 2024-05-09T06:30:46.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/701: write d3/d7/d28/d73/da3/fc9 [683843,48364] 0 2024-05-09T06:30:46.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/702: creat d3/d3d/d72/fdf x:0 0 0 2024-05-09T06:30:46.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/426: rename d2/d6/d7/d1a/d66 to d2/d6/d7/d1a/d86 0 2024-05-09T06:30:46.916 INFO:tasks.workunit.client.0.smithi046.stdout:7/703: mkdir d3/d3d/d5b/d84/ddc/de0 0 2024-05-09T06:30:46.916 INFO:tasks.workunit.client.0.smithi046.stdout:7/704: truncate d3/d7/d4c/d99/fc0 991777 0 2024-05-09T06:30:46.916 INFO:tasks.workunit.client.0.smithi046.stdout:7/705: creat d3/d7/dd/d3e/fe1 x:0 0 0 2024-05-09T06:30:46.916 INFO:tasks.workunit.client.0.smithi046.stdout:7/706: dread - d3/d7/dd/d3e/fb3 zero size 2024-05-09T06:30:46.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/566: dwrite da/de/d14/d1f/d3b/d86/d3d/faf [0,4194304] 0 2024-05-09T06:30:46.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/567: dread - da/de/d14/d1f/d20/d4e/fa0 zero size 2024-05-09T06:30:46.922 INFO:tasks.workunit.client.0.smithi046.stdout:7/707: symlink d3/d3d/d72/d94/le2 0 2024-05-09T06:30:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/568: link da/de/d14/f8a da/de/d54/d65/d70/fb9 0 2024-05-09T06:30:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/569: fdatasync da/de/d14/d1f/f8f 0 2024-05-09T06:30:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/570: rename da to da/de/d14/d1f/d3b/d86/d3d/dba 22 2024-05-09T06:30:46.929 INFO:tasks.workunit.client.0.smithi046.stdout:9/427: getdents d2/d6/d7/d1a 0 2024-05-09T06:30:46.929 INFO:tasks.workunit.client.0.smithi046.stdout:9/428: creat d2/d26/d2c/d3d/f87 x:0 0 0 2024-05-09T06:30:46.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/708: symlink d3/d7/d28/d29/d3b/le3 0 2024-05-09T06:30:46.931 INFO:tasks.workunit.client.0.smithi046.stdout:2/571: chown da/db/f88 10165619 1 2024-05-09T06:30:46.934 INFO:tasks.workunit.client.0.smithi046.stdout:2/572: link da/de/d14/d1f/d20/d7c/cb2 da/de/d14/d1f/d20/cbb 0 2024-05-09T06:30:46.934 INFO:tasks.workunit.client.0.smithi046.stdout:2/573: dread - da/de/d14/d1f/d3b/d86/d3a/fa9 zero size 2024-05-09T06:30:46.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/709: dread d3/d7/dd/fe [0,4194304] 0 2024-05-09T06:30:46.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/710: chown d3/d7/d28/l7b 3183121 1 2024-05-09T06:30:46.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/429: dwrite d2/dc/f41 [0,4194304] 0 2024-05-09T06:30:46.952 INFO:tasks.workunit.client.0.smithi046.stdout:9/430: chown d2/d6/d7/d1e/f7e 26572 1 2024-05-09T06:30:46.952 INFO:tasks.workunit.client.0.smithi046.stdout:9/431: creat d2/d6/d7/d1a/d27/f88 x:0 0 0 2024-05-09T06:30:46.952 INFO:tasks.workunit.client.0.smithi046.stdout:9/432: chown d2/d6/d7/d1a/d27/f88 36 1 2024-05-09T06:30:46.953 INFO:tasks.workunit.client.0.smithi046.stdout:9/433: creat d2/dc/f89 x:0 0 0 2024-05-09T06:30:46.954 INFO:tasks.workunit.client.0.smithi046.stdout:9/434: link d2/f5e d2/d6/d38/f8a 0 2024-05-09T06:30:46.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/574: dwrite da/de/d54/d65/d70/fb9 [0,4194304] 0 2024-05-09T06:30:46.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/435: write d2/d6/d7/d1a/d27/d2a/f72 [3915219,113299] 0 2024-05-09T06:30:46.962 INFO:tasks.workunit.client.0.smithi046.stdout:7/711: dwrite d3/d7/d28/d73/f88 [4194304,4194304] 0 2024-05-09T06:30:46.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/436: unlink d2/d6/d7/d1a/d27/d2a/f62 0 2024-05-09T06:30:46.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/437: chown d2/d6/l14 224158 1 2024-05-09T06:30:46.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/438: dread d2/f47 [0,4194304] 0 2024-05-09T06:30:46.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/439: write d2/d6/d33/f79 [1830823,52665] 0 2024-05-09T06:30:46.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/440: mkdir d2/d6/d8b 0 2024-05-09T06:30:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/441: mknod d2/d6/d8b/c8c 0 2024-05-09T06:30:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/442: write d2/dc/f4d [612736,47771] 0 2024-05-09T06:30:46.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/443: rename d2/d6/d7/d1e/f7e to d2/d6/d7/d1a/d27/d2a/f8d 0 2024-05-09T06:30:46.983 INFO:tasks.workunit.client.0.smithi046.stdout:2/575: dwrite da/de/d54/d65/d6c/fad [0,4194304] 0 2024-05-09T06:30:46.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/712: dwrite d3/d7/d28/d29/d3b/f7d [0,4194304] 0 2024-05-09T06:30:46.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/713: dread d3/d3d/d72/d94/fd4 [0,4194304] 0 2024-05-09T06:30:46.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/714: truncate d3/d7/d4c/fcb 87465 0 2024-05-09T06:30:46.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/715: readlink d3/d7/d28/d73/l83 0 2024-05-09T06:30:46.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/716: write d3/d7/dd/d3e/fb3 [234579,117030] 0 2024-05-09T06:30:46.985 INFO:tasks.workunit.client.0.smithi046.stdout:9/444: symlink d2/d26/d2c/l8e 0 2024-05-09T06:30:46.988 INFO:tasks.workunit.client.0.smithi046.stdout:9/445: rename d2/d6/d33/f85 to d2/d26/d76/f8f 0 2024-05-09T06:30:46.990 INFO:tasks.workunit.client.0.smithi046.stdout:2/576: write da/de/d1c/f82 [2271518,125317] 0 2024-05-09T06:30:46.990 INFO:tasks.workunit.client.0.smithi046.stdout:2/577: truncate da/de/d14/d1f/d3b/d86/d3d/fb7 762338 0 2024-05-09T06:30:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:9/446: mknod d2/d26/c90 0 2024-05-09T06:30:46.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/578: mkdir da/de/d54/d65/dbc 0 2024-05-09T06:30:46.993 INFO:tasks.workunit.client.0.smithi046.stdout:9/447: creat d2/d6/d7/d1a/f91 x:0 0 0 2024-05-09T06:30:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/448: rename d2/d6/d38/f8a to d2/d26/f92 0 2024-05-09T06:30:46.996 INFO:tasks.workunit.client.0.smithi046.stdout:9/449: link d2/d6/d7/d1a/d86/f67 d2/d6/d7/d1a/d27/d2a/f93 0 2024-05-09T06:30:47.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/717: dwrite d3/d7/d28/d29/d3b/f4a [4194304,4194304] 0 2024-05-09T06:30:47.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/718: link d3/f4 d3/d7/d28/d29/d35/d5c/dad/dbb/fe4 0 2024-05-09T06:30:47.004 INFO:tasks.workunit.client.0.smithi046.stdout:9/450: dread d2/d6/f25 [0,4194304] 0 2024-05-09T06:30:47.004 INFO:tasks.workunit.client.0.smithi046.stdout:9/451: chown d2/d6/d7/d1a/d27/c6b 78982725 1 2024-05-09T06:30:47.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/452: dread d2/d6/d7/d1e/f58 [0,4194304] 0 2024-05-09T06:30:47.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/453: write d2/d26/d2c/f3b [3683843,30769] 0 2024-05-09T06:30:47.005 INFO:tasks.workunit.client.0.smithi046.stdout:2/579: dread da/de/d1c/f55 [0,4194304] 0 2024-05-09T06:30:47.005 INFO:tasks.workunit.client.0.smithi046.stdout:2/580: readlink da/de/d54/d65/d6c/l6e 0 2024-05-09T06:30:47.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/719: write d3/d7/dd/fc1 [423412,77963] 0 2024-05-09T06:30:47.011 INFO:tasks.workunit.client.0.smithi046.stdout:9/454: rename d2/l6f to d2/d26/d76/l94 0 2024-05-09T06:30:47.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/581: dread da/de/d14/d1f/d20/d4e/f4f [0,4194304] 0 2024-05-09T06:30:47.016 INFO:tasks.workunit.client.0.smithi046.stdout:7/720: mkdir d3/d3d/d5b/d84/de5 0 2024-05-09T06:30:47.016 INFO:tasks.workunit.client.0.smithi046.stdout:7/721: fsync d3/d7/d4c/d99/dac/db7/fb9 0 2024-05-09T06:30:47.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/455: mknod d2/dc/c95 0 2024-05-09T06:30:47.022 INFO:tasks.workunit.client.0.smithi046.stdout:2/582: rename da/de/d14/d1f/c23 to da/de/d14/d1f/d20/cbd 0 2024-05-09T06:30:47.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/722: getdents d3/d3d/d72/d94 0 2024-05-09T06:30:47.031 INFO:tasks.workunit.client.0.smithi046.stdout:2/583: rename da/de/d1c/c35 to da/de/d54/d65/d70/cbe 0 2024-05-09T06:30:47.033 INFO:tasks.workunit.client.0.smithi046.stdout:7/723: rename d3/d7/d28/d29/f45 to d3/d3d/d72/d79/d81/fe6 0 2024-05-09T06:30:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/724: rmdir d3/d7/dd/d3e 39 2024-05-09T06:30:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/725: write d3/d7/fa [9005760,120598] 0 2024-05-09T06:30:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/726: dread d3/d7/d4c/fcb [0,4194304] 0 2024-05-09T06:30:47.043 INFO:tasks.workunit.client.0.smithi046.stdout:7/727: truncate d3/d7/d28/fa5 852671 0 2024-05-09T06:30:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/584: dwrite da/de/d1c/f3e [0,4194304] 0 2024-05-09T06:30:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/585: fsync da/de/d54/fa6 0 2024-05-09T06:30:47.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/728: creat d3/d3d/d5b/fe7 x:0 0 0 2024-05-09T06:30:47.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/729: readlink d3/d7/d28/d29/d35/d5c/lb6 0 2024-05-09T06:30:47.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/586: link da/de/d14/l36 da/de/d54/d65/dbc/lbf 0 2024-05-09T06:30:47.050 INFO:tasks.workunit.client.0.smithi046.stdout:2/587: readlink da/de/d1c/l2c 0 2024-05-09T06:30:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:7/730: truncate d3/d7/d28/f66 860077 0 2024-05-09T06:30:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/588: link da/dc/f79 da/de/d54/d65/d6c/fc0 0 2024-05-09T06:30:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/589: readlink da/de/d1c/l2c 0 2024-05-09T06:30:47.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/731: mknod d3/dc4/ce8 0 2024-05-09T06:30:47.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/590: symlink da/de/d54/d65/dbc/lc1 0 2024-05-09T06:30:47.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/591: write da/db/d7d/d6d/f8d [970748,19156] 0 2024-05-09T06:30:47.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/592: mkdir da/d2d/d43/dc2 0 2024-05-09T06:30:47.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/593: write da/dc/f79 [2251131,112691] 0 2024-05-09T06:30:47.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/594: write da/de/d14/d1f/d3b/d86/f9b [14699,78869] 0 2024-05-09T06:30:47.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/595: write da/de/d14/d1f/d3b/d86/d3a/fa9 [1046240,49852] 0 2024-05-09T06:30:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/732: dread d3/d7/d28/f33 [0,4194304] 0 2024-05-09T06:30:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/733: write d3/d3d/d5b/fe7 [122263,18789] 0 2024-05-09T06:30:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/734: stat d3/d7/fa 0 2024-05-09T06:30:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:2/596: rmdir da/de/d14/d1f/d20/d7c/d8b/d95 39 2024-05-09T06:30:47.064 INFO:tasks.workunit.client.0.smithi046.stdout:2/597: chown da/de/d14/d1f/d3b/d86/d3d/f5f 1161681 1 2024-05-09T06:30:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/598: dread da/f45 [0,4194304] 0 2024-05-09T06:30:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/599: chown da/de/d14/d1f/d3b/d86/d3a/fa9 1560678 1 2024-05-09T06:30:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/600: dread - da/de/d14/d1f/f48 zero size 2024-05-09T06:30:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/601: creat da/de/d14/d1f/d3b/d9f/fc3 x:0 0 0 2024-05-09T06:30:47.066 INFO:tasks.workunit.client.0.smithi046.stdout:7/735: link d3/d3d/d72/d79/d81/fe6 d3/d7/d28/d29/d35/d5c/fe9 0 2024-05-09T06:30:47.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/736: dwrite d3/f1d [0,4194304] 0 2024-05-09T06:30:47.087 INFO:tasks.workunit.client.0.smithi046.stdout:2/602: dwrite da/de/d14/d1f/d3b/d9f/fc3 [0,4194304] 0 2024-05-09T06:30:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:7/737: truncate d3/d7/dd/d3e/f91 153547 0 2024-05-09T06:30:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:4/556: sync 2024-05-09T06:30:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:1/552: sync 2024-05-09T06:30:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:0/631: sync 2024-05-09T06:30:47.097 INFO:tasks.workunit.client.0.smithi046.stdout:1/553: symlink d7/d10/d84/da8/lbb 0 2024-05-09T06:30:47.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/632: dread d11/f14 [0,4194304] 0 2024-05-09T06:30:47.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/603: dwrite da/dc/f5b [0,4194304] 0 2024-05-09T06:30:47.113 INFO:tasks.workunit.client.0.smithi046.stdout:2/604: mknod da/de/d54/cc4 0 2024-05-09T06:30:47.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/554: dwrite d7/f62 [4194304,4194304] 0 2024-05-09T06:30:47.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/738: dwrite d3/d7/d28/d29/d3b/f3f [0,4194304] 0 2024-05-09T06:30:47.122 INFO:tasks.workunit.client.0.smithi046.stdout:4/557: dwrite d7/df/d3a/d45/d96/f67 [0,4194304] 0 2024-05-09T06:30:47.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/555: link d7/d10/d28/d30/d3a/d7f/l98 d7/da3/lbc 0 2024-05-09T06:30:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:2/605: dwrite da/de/d54/d65/d6c/fad [4194304,4194304] 0 2024-05-09T06:30:47.134 INFO:tasks.workunit.client.0.smithi046.stdout:7/739: mknod d3/d7/d28/d29/d3b/dbd/cea 0 2024-05-09T06:30:47.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/558: dread d7/df/fa3 [0,4194304] 0 2024-05-09T06:30:47.139 INFO:tasks.workunit.client.0.smithi046.stdout:7/740: creat d3/d7/d28/d29/d35/d5c/dad/dbb/feb x:0 0 0 2024-05-09T06:30:47.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/606: rename da/de/d14/d1f/d3b/d86 to da/db/d7d/dc5 0 2024-05-09T06:30:47.151 INFO:tasks.workunit.client.0.smithi046.stdout:4/559: mknod d7/df/cb0 0 2024-05-09T06:30:47.155 INFO:tasks.workunit.client.0.smithi046.stdout:2/607: mknod da/de/d54/cc6 0 2024-05-09T06:30:47.155 INFO:tasks.workunit.client.0.smithi046.stdout:7/741: dwrite d3/d7/dd/f68 [0,4194304] 0 2024-05-09T06:30:47.160 INFO:tasks.workunit.client.0.smithi046.stdout:4/560: unlink d7/df/d10/d2f/f44 0 2024-05-09T06:30:47.170 INFO:tasks.workunit.client.0.smithi046.stdout:7/742: creat d3/d7/fec x:0 0 0 2024-05-09T06:30:47.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/743: write d3/d7/dd/d3e/fa1 [1796897,109049] 0 2024-05-09T06:30:47.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/744: write d3/d7/d28/d29/d3b/f70 [4800234,25302] 0 2024-05-09T06:30:47.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/745: read d3/d7/f2d [7550727,2586] 0 2024-05-09T06:30:47.172 INFO:tasks.workunit.client.0.smithi046.stdout:2/608: dwrite da/de/d1c/f82 [0,4194304] 0 2024-05-09T06:30:47.172 INFO:tasks.workunit.client.0.smithi046.stdout:2/609: chown da/de/d14/d1f/d20/d4e 236 1 2024-05-09T06:30:47.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/610: fdatasync da/db/d7d/d6d/fb3 0 2024-05-09T06:30:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:2/611: dread da/db/f88 [4194304,4194304] 0 2024-05-09T06:30:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:2/612: read - da/db/d7d/dc5/d3d/f47 zero size 2024-05-09T06:30:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:2/613: write da/de/d54/d65/d6c/fb6 [559213,74855] 0 2024-05-09T06:30:47.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/614: creat da/de/d14/d1f/d20/d7c/d8b/fc7 x:0 0 0 2024-05-09T06:30:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/746: dwrite d3/d7/d28/d29/f2e [4194304,4194304] 0 2024-05-09T06:30:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/747: readlink d3/d7/dd/l14 0 2024-05-09T06:30:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/748: chown d3/d7/d4c/d4f 57092 1 2024-05-09T06:30:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/749: stat d3/d7/d28/d73/da3/fc9 0 2024-05-09T06:30:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/750: truncate d3/d7/d4c/d99/fc0 1235673 0 2024-05-09T06:30:47.187 INFO:tasks.workunit.client.0.smithi046.stdout:2/615: unlink l2 0 2024-05-09T06:30:47.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/616: unlink da/de/d54/cc6 0 2024-05-09T06:30:47.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/617: chown da/db/d7d/dc5/d3d/faf 870882 1 2024-05-09T06:30:47.190 INFO:tasks.workunit.client.0.smithi046.stdout:2/618: write da/de/d54/d65/d6c/fad [8830991,19650] 0 2024-05-09T06:30:47.190 INFO:tasks.workunit.client.0.smithi046.stdout:2/619: chown da/de/d14/d1f/f48 515 1 2024-05-09T06:30:47.191 INFO:tasks.workunit.client.0.smithi046.stdout:2/620: truncate da/de/d14/d1f/d20/f3c 157542 0 2024-05-09T06:30:47.191 INFO:tasks.workunit.client.0.smithi046.stdout:2/621: fsync da/de/d14/d1f/d20/d4e/fa0 0 2024-05-09T06:30:47.192 INFO:tasks.workunit.client.0.smithi046.stdout:2/622: mkdir da/db/d7d/dc5/d3d/dc8 0 2024-05-09T06:30:47.193 INFO:tasks.workunit.client.0.smithi046.stdout:4/561: dwrite f4 [0,4194304] 0 2024-05-09T06:30:47.194 INFO:tasks.workunit.client.0.smithi046.stdout:2/623: symlink da/de/d14/d1f/d3b/lc9 0 2024-05-09T06:30:47.195 INFO:tasks.workunit.client.0.smithi046.stdout:7/751: dread d3/d6f/f8d [0,4194304] 0 2024-05-09T06:30:47.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/562: link d7/df/d3a/d45/l8d d7/df/lb1 0 2024-05-09T06:30:47.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/563: chown d7/df/d3a/d25/l6c 840 1 2024-05-09T06:30:47.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/564: getdents d7/daf 0 2024-05-09T06:30:47.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/565: fsync d7/df/d10/d2f/f9b 0 2024-05-09T06:30:47.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/566: dread - d7/df/d53/f6f zero size 2024-05-09T06:30:47.204 INFO:tasks.workunit.client.0.smithi046.stdout:2/624: truncate da/de/d54/d65/d70/fb9 1199324 0 2024-05-09T06:30:47.208 INFO:tasks.workunit.client.0.smithi046.stdout:7/752: mkdir d3/d3d/d5b/d84/ddc/ded 0 2024-05-09T06:30:47.208 INFO:tasks.workunit.client.0.smithi046.stdout:7/753: chown d3/d7/d28/d29/d35/c5d 1761443 1 2024-05-09T06:30:47.209 INFO:tasks.workunit.client.0.smithi046.stdout:4/567: getdents d7/df/d3a/d25 0 2024-05-09T06:30:47.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/625: fsync da/dc/f79 0 2024-05-09T06:30:47.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/626: dread da/de/d14/d1f/d20/d4e/f4f [0,4194304] 0 2024-05-09T06:30:47.219 INFO:tasks.workunit.client.0.smithi046.stdout:7/754: dwrite d3/fdd [0,4194304] 0 2024-05-09T06:30:47.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/568: unlink d7/df/d3a/d45/f51 0 2024-05-09T06:30:47.225 INFO:tasks.workunit.client.0.smithi046.stdout:4/569: link d7/df/d3a/d25/l6c d7/df/d53/d91/lb2 0 2024-05-09T06:30:47.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/627: dread f7 [0,4194304] 0 2024-05-09T06:30:47.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/570: dread d7/f15 [0,4194304] 0 2024-05-09T06:30:47.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/571: chown d7/df/d10/d2f/l56 90405727 1 2024-05-09T06:30:47.231 INFO:tasks.workunit.client.0.smithi046.stdout:7/755: dread d3/d3d/f47 [0,4194304] 0 2024-05-09T06:30:47.236 INFO:tasks.workunit.client.0.smithi046.stdout:7/756: creat d3/d3d/fee x:0 0 0 2024-05-09T06:30:47.236 INFO:tasks.workunit.client.0.smithi046.stdout:7/757: truncate d3/d7/fec 715353 0 2024-05-09T06:30:47.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/758: mkdir d3/d7/dd/def 0 2024-05-09T06:30:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/759: dread d3/d7/d4c/fcb [0,4194304] 0 2024-05-09T06:30:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/760: creat d3/d3d/d72/d79/ff0 x:0 0 0 2024-05-09T06:30:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/761: dread - d3/d7/d28/d29/d35/d5c/dad/dbb/feb zero size 2024-05-09T06:30:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/762: creat d3/d7/d4c/ff1 x:0 0 0 2024-05-09T06:30:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/763: creat d3/d7/d28/d73/da3/ff2 x:0 0 0 2024-05-09T06:30:47.240 INFO:tasks.workunit.client.0.smithi046.stdout:2/628: write da/dc/f81 [4028944,90891] 0 2024-05-09T06:30:47.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/629: symlink da/de/d14/d1f/d97/dae/lca 0 2024-05-09T06:30:47.256 INFO:tasks.workunit.client.0.smithi046.stdout:7/764: dwrite d3/d7/d28/d29/d35/f78 [0,4194304] 0 2024-05-09T06:30:47.256 INFO:tasks.workunit.client.0.smithi046.stdout:7/765: write d3/d7/d4c/ff1 [251824,55545] 0 2024-05-09T06:30:47.256 INFO:tasks.workunit.client.0.smithi046.stdout:7/766: creat d3/d7/dd/ff3 x:0 0 0 2024-05-09T06:30:47.259 INFO:tasks.workunit.client.0.smithi046.stdout:7/767: truncate d3/d7/dd/fc1 2894762 0 2024-05-09T06:30:47.263 INFO:tasks.workunit.client.0.smithi046.stdout:2/630: write da/de/d14/d1f/d3b/d9f/fc3 [807244,108688] 0 2024-05-09T06:30:47.266 INFO:tasks.workunit.client.0.smithi046.stdout:7/768: dread d3/d7/d28/d29/d35/f6d [0,4194304] 0 2024-05-09T06:30:47.279 INFO:tasks.workunit.client.0.smithi046.stdout:7/769: dwrite d3/d7/d4c/d99/dac/fde [0,4194304] 0 2024-05-09T06:30:47.281 INFO:tasks.workunit.client.0.smithi046.stdout:2/631: mkdir da/dcb 0 2024-05-09T06:30:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:2/632: truncate da/de/d14/d1f/d3b/f37 83870 0 2024-05-09T06:30:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:2/633: read - da/db/d7d/d6d/fb3 zero size 2024-05-09T06:30:47.291 INFO:tasks.workunit.client.0.smithi046.stdout:7/770: dwrite d3/d7/d28/fa5 [0,4194304] 0 2024-05-09T06:30:47.291 INFO:tasks.workunit.client.0.smithi046.stdout:7/771: write d3/d7/d8e/f9f [676329,9110] 0 2024-05-09T06:30:47.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/634: mkdir da/dcb/dcc 0 2024-05-09T06:30:47.307 INFO:tasks.workunit.client.0.smithi046.stdout:7/772: dwrite d3/d7/d4c/ff1 [0,4194304] 0 2024-05-09T06:30:47.307 INFO:tasks.workunit.client.0.smithi046.stdout:7/773: truncate d3/d7/d4c/fcb 1062998 0 2024-05-09T06:30:47.315 INFO:tasks.workunit.client.0.smithi046.stdout:2/635: dwrite da/db/d7d/dc5/f72 [0,4194304] 0 2024-05-09T06:30:47.317 INFO:tasks.workunit.client.0.smithi046.stdout:2/636: truncate da/de/d14/f28 1508822 0 2024-05-09T06:30:47.317 INFO:tasks.workunit.client.0.smithi046.stdout:2/637: readlink da/d2d/l7a 0 2024-05-09T06:30:47.321 INFO:tasks.workunit.client.0.smithi046.stdout:2/638: rename da/db to da/de/d14/d1f/d97/dcd 0 2024-05-09T06:30:47.324 INFO:tasks.workunit.client.0.smithi046.stdout:7/774: dwrite d3/d7/d28/d29/d3b/f7d [0,4194304] 0 2024-05-09T06:30:47.326 INFO:tasks.workunit.client.0.smithi046.stdout:7/775: symlink d3/d7/d4c/d99/dac/lf4 0 2024-05-09T06:30:47.327 INFO:tasks.workunit.client.0.smithi046.stdout:7/776: creat d3/d7/d4c/d4f/ff5 x:0 0 0 2024-05-09T06:30:47.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/777: symlink d3/d7/d28/d29/d3b/dbd/lf6 0 2024-05-09T06:30:47.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/778: creat d3/d3d/d72/ff7 x:0 0 0 2024-05-09T06:30:47.332 INFO:tasks.workunit.client.0.smithi046.stdout:7/779: link d3/d7/d28/fc5 d3/ff8 0 2024-05-09T06:30:47.337 INFO:tasks.workunit.client.0.smithi046.stdout:2/639: dwrite da/de/d14/f8a [0,4194304] 0 2024-05-09T06:30:47.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/640: creat da/de/d14/d1f/d97/dcd/d7d/fce x:0 0 0 2024-05-09T06:30:47.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/641: stat da/la1 0 2024-05-09T06:30:47.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/642: readlink da/de/l31 0 2024-05-09T06:30:47.340 INFO:tasks.workunit.client.0.smithi046.stdout:2/643: mkdir da/de/d14/d1f/d20/d5c/dcf 0 2024-05-09T06:30:47.341 INFO:tasks.workunit.client.0.smithi046.stdout:7/780: write d3/d7/d28/d29/d3b/f3f [99006,14847] 0 2024-05-09T06:30:47.341 INFO:tasks.workunit.client.0.smithi046.stdout:7/781: write d3/d7/d28/d29/d3b/f3f [902556,51167] 0 2024-05-09T06:30:47.341 INFO:tasks.workunit.client.0.smithi046.stdout:7/782: fdatasync d3/d7/d28/d29/d3b/f70 0 2024-05-09T06:30:47.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/783: getdents d3/d7/d28/d29/d35/d5c/dad 0 2024-05-09T06:30:47.344 INFO:tasks.workunit.client.0.smithi046.stdout:2/644: mkdir da/dc/dd0 0 2024-05-09T06:30:47.344 INFO:tasks.workunit.client.0.smithi046.stdout:2/645: creat da/de/d14/d1f/d20/d7c/d8b/fd1 x:0 0 0 2024-05-09T06:30:47.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/784: creat d3/d7/dd/def/ff9 x:0 0 0 2024-05-09T06:30:47.347 INFO:tasks.workunit.client.0.smithi046.stdout:7/785: symlink d3/d7/d4c/d99/lfa 0 2024-05-09T06:30:47.347 INFO:tasks.workunit.client.0.smithi046.stdout:7/786: dread - d3/d3d/fee zero size 2024-05-09T06:30:47.347 INFO:tasks.workunit.client.0.smithi046.stdout:2/646: mkdir da/de/d14/d1f/d97/dcd/dd2 0 2024-05-09T06:30:47.349 INFO:tasks.workunit.client.0.smithi046.stdout:7/787: mknod d3/d3d/d72/d79/d81/cfb 0 2024-05-09T06:30:47.349 INFO:tasks.workunit.client.0.smithi046.stdout:7/788: readlink d3/l13 0 2024-05-09T06:30:47.350 INFO:tasks.workunit.client.0.smithi046.stdout:7/789: symlink d3/d3d/d72/d79/d81/lfc 0 2024-05-09T06:30:47.350 INFO:tasks.workunit.client.0.smithi046.stdout:7/790: write d3/d7/d28/d29/d3b/f76 [275083,57963] 0 2024-05-09T06:30:47.351 INFO:tasks.workunit.client.0.smithi046.stdout:7/791: mkdir d3/d7/d28/d29/d3b/dfd 0 2024-05-09T06:30:47.352 INFO:tasks.workunit.client.0.smithi046.stdout:7/792: rmdir d3/d7/d28/d29/d35 39 2024-05-09T06:30:47.352 INFO:tasks.workunit.client.0.smithi046.stdout:7/793: creat d3/d7/d8e/ffe x:0 0 0 2024-05-09T06:30:47.352 INFO:tasks.workunit.client.0.smithi046.stdout:7/794: chown d3/d3d/d72/d79/ff0 117020818 1 2024-05-09T06:30:47.354 INFO:tasks.workunit.client.0.smithi046.stdout:7/795: creat d3/d7/dd/d3e/fff x:0 0 0 2024-05-09T06:30:47.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/647: write f1 [3028375,92563] 0 2024-05-09T06:30:47.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/648: write da/de/f60 [2566005,91859] 0 2024-05-09T06:30:47.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/796: rename d3/d7/d4c/d99/ca8 to d3/d3d/d72/d79/c100 0 2024-05-09T06:30:47.358 INFO:tasks.workunit.client.0.smithi046.stdout:7/797: dread d3/d7/d28/f58 [0,4194304] 0 2024-05-09T06:30:47.361 INFO:tasks.workunit.client.0.smithi046.stdout:7/798: dread d3/d3d/d72/d94/fd4 [0,4194304] 0 2024-05-09T06:30:47.363 INFO:tasks.workunit.client.0.smithi046.stdout:7/799: creat d3/d7/d28/d73/f101 x:0 0 0 2024-05-09T06:30:47.363 INFO:tasks.workunit.client.0.smithi046.stdout:7/800: chown d3 11 1 2024-05-09T06:30:47.364 INFO:tasks.workunit.client.0.smithi046.stdout:7/801: symlink d3/d7/d4c/d99/dac/l102 0 2024-05-09T06:30:47.369 INFO:tasks.workunit.client.0.smithi046.stdout:7/802: write d3/d6f/f8d [1747393,128763] 0 2024-05-09T06:30:47.373 INFO:tasks.workunit.client.0.smithi046.stdout:2/649: dwrite da/de/d14/d1f/d20/d7c/d8b/fd1 [0,4194304] 0 2024-05-09T06:30:47.373 INFO:tasks.workunit.client.0.smithi046.stdout:2/650: dread - da/de/d14/d1f/d97/dcd/d7d/dc5/d3a/f9d zero size 2024-05-09T06:30:47.374 INFO:tasks.workunit.client.0.smithi046.stdout:7/803: rmdir d3/d6f 39 2024-05-09T06:30:47.375 INFO:tasks.workunit.client.0.smithi046.stdout:7/804: dread d3/d7/d28/f58 [0,4194304] 0 2024-05-09T06:30:47.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/805: truncate d3/d7/dd/f37 882353 0 2024-05-09T06:30:47.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/651: dwrite da/de/d14/fb8 [0,4194304] 0 2024-05-09T06:30:47.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/652: write da/de/d14/d1f/d97/dcd/d7d/dc5/d3a/f50 [3925287,83619] 0 2024-05-09T06:30:47.393 INFO:tasks.workunit.client.0.smithi046.stdout:7/806: dread d3/d7/dd/f23 [0,4194304] 0 2024-05-09T06:30:47.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/807: truncate d3/f4 5927920 0 2024-05-09T06:30:47.415 INFO:tasks.workunit.client.0.smithi046.stdout:7/808: dwrite d3/fd6 [0,4194304] 0 2024-05-09T06:30:47.417 INFO:tasks.workunit.client.0.smithi046.stdout:7/809: mknod d3/d3d/d72/d94/c103 0 2024-05-09T06:30:47.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/611: sync 2024-05-09T06:30:47.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/612: stat d0/d1b/d39/f60 0 2024-05-09T06:30:47.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/698: sync 2024-05-09T06:30:47.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/699: stat d1/db/dd/d11/fba 0 2024-05-09T06:30:47.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/704: sync 2024-05-09T06:30:47.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/705: write db/d10/d3f/d44/f5f [4009609,34351] 0 2024-05-09T06:30:47.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/613: creat d0/d1b/d39/dcf/fd1 x:0 0 0 2024-05-09T06:30:47.434 INFO:tasks.workunit.client.0.smithi046.stdout:6/706: symlink db/d10/d3f/d44/d74/db6/lea 0 2024-05-09T06:30:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/707: truncate db/d10/d3f/d44/d5e/fa6 2098930 0 2024-05-09T06:30:47.436 INFO:tasks.workunit.client.0.smithi046.stdout:5/614: mknod d0/d1b/d39/cd2 0 2024-05-09T06:30:47.438 INFO:tasks.workunit.client.0.smithi046.stdout:6/708: rename db/d10/d3f/d44/d74/ce1 to db/d10/d3f/d44/d5e/ceb 0 2024-05-09T06:30:47.438 INFO:tasks.workunit.client.0.smithi046.stdout:6/709: stat db/c3e 0 2024-05-09T06:30:47.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/700: dread d1/db/dd/d11/f27 [0,4194304] 0 2024-05-09T06:30:47.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/701: write d1/d7/d12/d45/fb9 [71588,71002] 0 2024-05-09T06:30:47.447 INFO:tasks.workunit.client.0.smithi046.stdout:7/810: dwrite d3/d7/d4c/d4f/f6b [0,4194304] 0 2024-05-09T06:30:47.447 INFO:tasks.workunit.client.0.smithi046.stdout:7/811: readlink d3/d7/dd/d3e/l67 0 2024-05-09T06:30:47.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/615: write d0/d58/faf [763388,68592] 0 2024-05-09T06:30:47.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/616: creat d0/d3e/d50/fd3 x:0 0 0 2024-05-09T06:30:47.459 INFO:tasks.workunit.client.0.smithi046.stdout:7/812: truncate d3/d7/dd/f15 778691 0 2024-05-09T06:30:47.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/702: dwrite d1/db/dd/d11/fa0 [0,4194304] 0 2024-05-09T06:30:47.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/703: stat d1/d7/d12/f5a 0 2024-05-09T06:30:47.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/617: getdents d0/dba 0 2024-05-09T06:30:47.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/813: creat d3/d3d/d5b/d84/ddc/ded/f104 x:0 0 0 2024-05-09T06:30:47.464 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:47 smithi046 ceph-mon[26924]: pgmap v30: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 160 MiB/s rd, 206 MiB/s wr, 321 op/s 2024-05-09T06:30:47.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/704: creat d1/d7/d12/d1d/d30/fd0 x:0 0 0 2024-05-09T06:30:47.471 INFO:tasks.workunit.client.0.smithi046.stdout:6/710: dwrite db/d93/d96/dd1/fd5 [0,4194304] 0 2024-05-09T06:30:47.471 INFO:tasks.workunit.client.0.smithi046.stdout:6/711: creat db/d10/d3f/d4f/d8a/d9e/fec x:0 0 0 2024-05-09T06:30:47.471 INFO:tasks.workunit.client.0.smithi046.stdout:6/712: write db/f42 [647056,84107] 0 2024-05-09T06:30:47.473 INFO:tasks.workunit.client.0.smithi046.stdout:5/618: rmdir d0/d3e/d53/dce 0 2024-05-09T06:30:47.477 INFO:tasks.workunit.client.0.smithi046.stdout:7/814: creat d3/d7/d4c/d4f/d9d/f105 x:0 0 0 2024-05-09T06:30:47.482 INFO:tasks.workunit.client.0.smithi046.stdout:8/705: symlink d1/db/dd/d11/d43/ld1 0 2024-05-09T06:30:47.482 INFO:tasks.workunit.client.0.smithi046.stdout:8/706: fsync d1/d7/d12/d1d/d30/fcb 0 2024-05-09T06:30:47.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/815: mkdir d3/d7/d28/d29/d35/d106 0 2024-05-09T06:30:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/713: rmdir db/d10/d3f/d44/d46 39 2024-05-09T06:30:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/714: read db/d10/d3f/d44/d5e/fa6 [1101073,130757] 0 2024-05-09T06:30:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/715: chown db/d10/f16 7535 1 2024-05-09T06:30:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/716: stat db/d10/d3f/dda 0 2024-05-09T06:30:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:5/619: rename d0/d1b/d39/l48 to d0/d1b/d21/d81/ld4 0 2024-05-09T06:30:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:6/717: symlink db/d10/d3f/d4f/d8a/led 0 2024-05-09T06:30:47.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/620: rmdir d0/d3e 39 2024-05-09T06:30:47.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/621: chown d0/f16 1 1 2024-05-09T06:30:47.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/622: readlink d0/d58/lab 0 2024-05-09T06:30:47.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/623: fdatasync d0/d3e/d50/fc5 0 2024-05-09T06:30:47.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/624: chown d0/d58/lab 1549915 1 2024-05-09T06:30:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/816: rename d3/d3d/d5b/d84/ddc to d3/d3d/d72/d107 0 2024-05-09T06:30:47.553 INFO:tasks.workunit.client.0.smithi046.stdout:6/718: getdents db/d10/d30 0 2024-05-09T06:30:47.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/817: mkdir d3/d7/dd/d3e/dd7/d108 0 2024-05-09T06:30:47.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/818: dread - d3/d7/d4c/fd2 zero size 2024-05-09T06:30:47.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/819: chown d3/d7/d28/c22 5 1 2024-05-09T06:30:47.555 INFO:tasks.workunit.client.0.smithi046.stdout:6/719: dread db/d10/d3f/d44/d46/f64 [0,4194304] 0 2024-05-09T06:30:47.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/720: getdents db/d93/d96 0 2024-05-09T06:30:47.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/721: write db/d10/d30/f77 [4213012,124182] 0 2024-05-09T06:30:47.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/820: rmdir d3/d7/d28 39 2024-05-09T06:30:47.568 INFO:tasks.workunit.client.0.smithi046.stdout:6/722: getdents db/d10/d3c/d91 0 2024-05-09T06:30:47.570 INFO:tasks.workunit.client.0.smithi046.stdout:6/723: symlink db/d10/d30/lee 0 2024-05-09T06:30:47.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/724: symlink db/d10/d3f/d44/d74/db6/lef 0 2024-05-09T06:30:47.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/725: truncate db/d10/d30/fbf 1182818 0 2024-05-09T06:30:47.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/726: chown db/d93/fca 89889950 1 2024-05-09T06:30:47.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:47 smithi106 ceph-mon[34679]: pgmap v30: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 160 MiB/s rd, 206 MiB/s wr, 321 op/s 2024-05-09T06:30:47.574 INFO:tasks.workunit.client.0.smithi046.stdout:6/727: truncate db/f28 2003068 0 2024-05-09T06:30:47.574 INFO:tasks.workunit.client.0.smithi046.stdout:6/728: truncate db/d10/d3f/d44/d5e/dbe/fe4 429726 0 2024-05-09T06:30:47.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/821: dwrite d3/d7/d28/d29/f53 [0,4194304] 0 2024-05-09T06:30:47.589 INFO:tasks.workunit.client.0.smithi046.stdout:6/729: dwrite db/d10/d3c/f6d [0,4194304] 0 2024-05-09T06:30:47.589 INFO:tasks.workunit.client.0.smithi046.stdout:6/730: write db/d10/d3c/dd4/fc4 [894781,25923] 0 2024-05-09T06:30:47.591 INFO:tasks.workunit.client.0.smithi046.stdout:7/822: mknod d3/d3d/d72/d107/ded/c109 0 2024-05-09T06:30:47.608 INFO:tasks.workunit.client.0.smithi046.stdout:7/823: dwrite d3/d7/d28/fc6 [0,4194304] 0 2024-05-09T06:30:47.608 INFO:tasks.workunit.client.0.smithi046.stdout:7/824: chown d3/d7/dd 822 1 2024-05-09T06:30:47.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/825: rmdir d3/d7/d4c/d4f/d9d/dab 0 2024-05-09T06:30:47.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/826: dread - d3/ff8 zero size 2024-05-09T06:30:47.613 INFO:tasks.workunit.client.0.smithi046.stdout:7/827: truncate d3/d7/d8e/f93 372282 0 2024-05-09T06:30:47.631 INFO:tasks.workunit.client.0.smithi046.stdout:6/731: dwrite db/d10/d30/d53/f94 [4194304,4194304] 0 2024-05-09T06:30:47.631 INFO:tasks.workunit.client.0.smithi046.stdout:7/828: dwrite d3/d7/d4c/fcb [0,4194304] 0 2024-05-09T06:30:47.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/732: rmdir db/d10/d3f/d44/d74 39 2024-05-09T06:30:47.637 INFO:tasks.workunit.client.0.smithi046.stdout:7/829: mkdir d3/d7/d28/d29/d3b/dfd/d10a 0 2024-05-09T06:30:47.638 INFO:tasks.workunit.client.0.smithi046.stdout:6/733: unlink db/d10/d3f/d44/d5e/fb0 0 2024-05-09T06:30:47.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/830: creat d3/d7/dd/d3e/dd7/d108/f10b x:0 0 0 2024-05-09T06:30:47.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/831: read - d3/d7/dd/ff3 zero size 2024-05-09T06:30:47.652 INFO:tasks.workunit.client.0.smithi046.stdout:6/734: creat db/d10/d3f/dda/ff0 x:0 0 0 2024-05-09T06:30:47.655 INFO:tasks.workunit.client.0.smithi046.stdout:7/832: mknod d3/d7/d4c/d4f/d9d/c10c 0 2024-05-09T06:30:47.660 INFO:tasks.workunit.client.0.smithi046.stdout:9/456: sync 2024-05-09T06:30:47.660 INFO:tasks.workunit.client.0.smithi046.stdout:3/616: sync 2024-05-09T06:30:47.663 INFO:tasks.workunit.client.0.smithi046.stdout:3/617: mknod d4/d20/d24/d29/d2b/cd0 0 2024-05-09T06:30:47.664 INFO:tasks.workunit.client.0.smithi046.stdout:3/618: getdents d4/d20/d24/d29/d2b/d94/d5c 0 2024-05-09T06:30:47.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/833: dwrite d3/ff8 [0,4194304] 0 2024-05-09T06:30:47.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/834: fsync d3/d3d/d5b/fc3 0 2024-05-09T06:30:47.666 INFO:tasks.workunit.client.0.smithi046.stdout:3/619: symlink d4/d20/d24/d29/d2b/d94/d5c/d6c/ld1 0 2024-05-09T06:30:47.666 INFO:tasks.workunit.client.0.smithi046.stdout:3/620: write d4/d20/d24/d29/fba [522889,4619] 0 2024-05-09T06:30:47.671 INFO:tasks.workunit.client.0.smithi046.stdout:7/835: rename d3/d6f/lca to d3/d3d/d72/l10d 0 2024-05-09T06:30:47.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/457: dwrite d2/d6/f22 [0,4194304] 0 2024-05-09T06:30:47.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/458: fsync d2/d6/d38/f48 0 2024-05-09T06:30:47.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/621: dwrite d4/d20/d24/d2a/d55/d6a/fc3 [0,4194304] 0 2024-05-09T06:30:47.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/836: dwrite d3/f1e [0,4194304] 0 2024-05-09T06:30:47.701 INFO:tasks.workunit.client.0.smithi046.stdout:7/837: symlink d3/d7/d28/d29/d35/l10e 0 2024-05-09T06:30:47.704 INFO:tasks.workunit.client.0.smithi046.stdout:7/838: creat d3/d7/d28/d29/d3b/dbd/f10f x:0 0 0 2024-05-09T06:30:47.704 INFO:tasks.workunit.client.0.smithi046.stdout:3/622: dwrite d4/d20/d24/d29/d2b/fc5 [0,4194304] 0 2024-05-09T06:30:47.705 INFO:tasks.workunit.client.0.smithi046.stdout:9/459: dwrite d2/d6/d33/f52 [0,4194304] 0 2024-05-09T06:30:47.708 INFO:tasks.workunit.client.0.smithi046.stdout:7/839: mkdir d3/d7/d4c/d99/d110 0 2024-05-09T06:30:47.711 INFO:tasks.workunit.client.0.smithi046.stdout:9/460: symlink d2/d6/d7/d1e/l96 0 2024-05-09T06:30:47.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/840: truncate d3/d7/d28/d29/f98 2607878 0 2024-05-09T06:30:47.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/841: chown d3/l13 3745371 1 2024-05-09T06:30:47.716 INFO:tasks.workunit.client.0.smithi046.stdout:3/623: dread d4/d5/fb7 [0,4194304] 0 2024-05-09T06:30:47.716 INFO:tasks.workunit.client.0.smithi046.stdout:9/461: symlink d2/d26/d2c/l97 0 2024-05-09T06:30:47.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/842: mknod d3/d7/d28/d29/c111 0 2024-05-09T06:30:47.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/843: dread - d3/d7/d28/d29/fb5 zero size 2024-05-09T06:30:47.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/844: read d3/d7/d28/d29/d3b/f70 [1092037,4437] 0 2024-05-09T06:30:47.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/845: creat d3/d3d/d72/d107/ded/f112 x:0 0 0 2024-05-09T06:30:47.728 INFO:tasks.workunit.client.0.smithi046.stdout:7/846: mkdir d3/d7/d28/d29/d113 0 2024-05-09T06:30:47.730 INFO:tasks.workunit.client.0.smithi046.stdout:7/847: mknod d3/d7/d4c/d99/dac/c114 0 2024-05-09T06:30:47.733 INFO:tasks.workunit.client.0.smithi046.stdout:7/848: rename d3/d7/d28/d29/d3b/f76 to d3/d3d/d72/f115 0 2024-05-09T06:30:47.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/624: dwrite d4/d5/fb7 [0,4194304] 0 2024-05-09T06:30:47.740 INFO:tasks.workunit.client.0.smithi046.stdout:3/625: rmdir d4/d20/d24/d2a/d55 39 2024-05-09T06:30:47.747 INFO:tasks.workunit.client.0.smithi046.stdout:3/626: dread d4/d20/d24/d2a/d55/d74/f91 [0,4194304] 0 2024-05-09T06:30:47.747 INFO:tasks.workunit.client.0.smithi046.stdout:3/627: fdatasync d4/f97 0 2024-05-09T06:30:47.749 INFO:tasks.workunit.client.0.smithi046.stdout:3/628: creat d4/d20/d24/d29/d2b/d94/d5c/d6c/fd2 x:0 0 0 2024-05-09T06:30:47.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/629: unlink d4/d20/d24/d29/d2b/l57 0 2024-05-09T06:30:47.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/630: chown d4/d20/d24/d2a/d4e/c8a 26639297 1 2024-05-09T06:30:47.752 INFO:tasks.workunit.client.0.smithi046.stdout:3/631: getdents d4/d5/dac/db0 0 2024-05-09T06:30:47.754 INFO:tasks.workunit.client.0.smithi046.stdout:3/632: rename d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/dc6 to d4/d20/d24/d29/d2b/d94/dd3 0 2024-05-09T06:30:47.755 INFO:tasks.workunit.client.0.smithi046.stdout:7/849: dwrite d3/d7/dd/f59 [0,4194304] 0 2024-05-09T06:30:47.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/633: rename d4/d20/c28 to d4/d20/d24/d2a/d4e/cd4 0 2024-05-09T06:30:47.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/634: fsync d4/d48/d49/f6e 0 2024-05-09T06:30:47.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/635: dwrite d4/d48/fae [0,4194304] 0 2024-05-09T06:30:47.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/850: dwrite d3/d7/dd/f15 [0,4194304] 0 2024-05-09T06:30:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:7/851: mknod d3/d3d/d72/d107/c116 0 2024-05-09T06:30:47.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/852: chown d3/d3d/d72/d107/c116 37 1 2024-05-09T06:30:47.788 INFO:tasks.workunit.client.0.smithi046.stdout:7/853: rmdir d3/d7/dd/def 39 2024-05-09T06:30:47.791 INFO:tasks.workunit.client.0.smithi046.stdout:7/854: stat d3/d7/d28/d29/l39 0 2024-05-09T06:30:47.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/855: rmdir d3/d7/dd 39 2024-05-09T06:30:47.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/856: dread d3/f1d [0,4194304] 0 2024-05-09T06:30:47.806 INFO:tasks.workunit.client.0.smithi046.stdout:7/857: link d3/d7/fa d3/dc4/f117 0 2024-05-09T06:30:47.806 INFO:tasks.workunit.client.0.smithi046.stdout:7/858: dread - d3/d7/dd/d3e/dd7/d108/f10b zero size 2024-05-09T06:30:47.807 INFO:tasks.workunit.client.0.smithi046.stdout:7/859: creat d3/d3d/d72/d94/f118 x:0 0 0 2024-05-09T06:30:47.831 INFO:tasks.workunit.client.0.smithi046.stdout:7/860: dread d3/d7/d28/d29/d35/d5c/dad/dbb/fe4 [0,4194304] 0 2024-05-09T06:30:47.933 INFO:tasks.workunit.client.0.smithi046.stdout:1/556: sync 2024-05-09T06:30:47.933 INFO:tasks.workunit.client.0.smithi046.stdout:0/633: sync 2024-05-09T06:30:47.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/557: read d7/d10/d28/d30/d3a/f5d [518774,81869] 0 2024-05-09T06:30:47.938 INFO:tasks.workunit.client.0.smithi046.stdout:0/634: link d11/f52 d11/d18/fca 0 2024-05-09T06:30:47.943 INFO:tasks.workunit.client.0.smithi046.stdout:1/558: creat d7/fbd x:0 0 0 2024-05-09T06:30:47.945 INFO:tasks.workunit.client.0.smithi046.stdout:0/635: dread d11/d18/d27/d28/d2d/d5c/f72 [0,4194304] 0 2024-05-09T06:30:47.945 INFO:tasks.workunit.client.0.smithi046.stdout:0/636: creat d11/d18/db1/fcb x:0 0 0 2024-05-09T06:30:47.947 INFO:tasks.workunit.client.0.smithi046.stdout:1/559: rmdir d7/d10/d28/d30/d3a/d75/da2 0 2024-05-09T06:30:47.947 INFO:tasks.workunit.client.0.smithi046.stdout:1/560: fsync d7/d10/d28/d30/f38 0 2024-05-09T06:30:47.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/637: link d11/f22 d11/d4f/d5b/d5f/fcc 0 2024-05-09T06:30:47.952 INFO:tasks.workunit.client.0.smithi046.stdout:1/561: creat d7/d10/d84/da8/fbe x:0 0 0 2024-05-09T06:30:47.954 INFO:tasks.workunit.client.0.smithi046.stdout:0/638: rename d11/d18/d27/d28/d36/d5a/fbf to d11/d18/d27/d28/d36/d91/d98/fcd 0 2024-05-09T06:30:47.955 INFO:tasks.workunit.client.0.smithi046.stdout:1/562: mknod d7/d10/d34/d46/d81/cbf 0 2024-05-09T06:30:47.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/639: unlink d11/f14 0 2024-05-09T06:30:47.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/640: dread - d11/d18/fca zero size 2024-05-09T06:30:47.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/563: rename d7/d10/d28/d30/l5a to d7/d10/d28/d30/d3a/lc0 0 2024-05-09T06:30:47.959 INFO:tasks.workunit.client.0.smithi046.stdout:0/641: mknod d11/d18/cce 0 2024-05-09T06:30:47.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/564: creat d7/d10/d28/d30/da0/fc1 x:0 0 0 2024-05-09T06:30:47.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/565: write d7/d10/d34/d46/d86/f7d [1036021,41725] 0 2024-05-09T06:30:47.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/566: mknod d7/d10/d28/d30/d3a/d76/cc2 0 2024-05-09T06:30:47.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/567: dread - d7/d10/d34/d46/d81/f9e zero size 2024-05-09T06:30:47.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/568: mknod d7/d10/d84/cc3 0 2024-05-09T06:30:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/569: dread d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:47.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/570: dread d7/f42 [0,4194304] 0 2024-05-09T06:30:48.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/653: sync 2024-05-09T06:30:48.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/572: sync 2024-05-09T06:30:48.112 INFO:tasks.workunit.client.0.smithi046.stdout:4/573: dread d7/df/d53/d91/f95 [0,4194304] 0 2024-05-09T06:30:48.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/574: write d7/df/d10/d2f/f5c [2069839,104088] 0 2024-05-09T06:30:48.135 INFO:tasks.workunit.client.0.smithi046.stdout:2/654: unlink da/de/d54/la7 0 2024-05-09T06:30:48.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/575: getdents d7/df/d3a/d25/da5 0 2024-05-09T06:30:48.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/576: stat d7/df/d10/d2f/l3d 0 2024-05-09T06:30:48.136 INFO:tasks.workunit.client.0.smithi046.stdout:2/655: truncate da/de/d14/d1f/d3b/d9f/faa 115971 0 2024-05-09T06:30:48.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/577: mkdir d7/df/d3a/d45/d96/db3 0 2024-05-09T06:30:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/656: rename da/de/d14/d1f/d97/dcd/d7d/dc5/d3d/f5f to da/de/d1c/fd3 0 2024-05-09T06:30:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/657: mknod da/de/d14/d1f/d97/dcd/d7d/cd4 0 2024-05-09T06:30:48.192 INFO:tasks.workunit.client.0.smithi046.stdout:2/658: dwrite da/de/d14/f28 [0,4194304] 0 2024-05-09T06:30:48.193 INFO:tasks.workunit.client.0.smithi046.stdout:2/659: write da/de/d14/d1f/d20/f59 [6092515,121433] 0 2024-05-09T06:30:48.256 INFO:tasks.workunit.client.0.smithi046.stdout:8/707: sync 2024-05-09T06:30:48.256 INFO:tasks.workunit.client.0.smithi046.stdout:5/625: sync 2024-05-09T06:30:48.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/708: link d1/d7/d2c/c62 d1/db/d67/d9f/cd2 0 2024-05-09T06:30:48.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/709: write d1/d7/d12/d45/f4c [1842453,125985] 0 2024-05-09T06:30:48.270 INFO:tasks.workunit.client.0.smithi046.stdout:8/710: mknod d1/d7/d12/d1d/d30/d38/db4/cd3 0 2024-05-09T06:30:48.270 INFO:tasks.workunit.client.0.smithi046.stdout:8/711: write d1/d7/d2c/f5b [5201224,48303] 0 2024-05-09T06:30:48.272 INFO:tasks.workunit.client.0.smithi046.stdout:8/712: mkdir d1/db/d41/dd4 0 2024-05-09T06:30:48.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/713: rename d1/d7/f34 to d1/d7/fd5 0 2024-05-09T06:30:48.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/714: fdatasync d1/d7/d12/d1d/d30/d38/f8c 0 2024-05-09T06:30:48.288 INFO:tasks.workunit.client.0.smithi046.stdout:8/715: dwrite d1/db/f90 [4194304,4194304] 0 2024-05-09T06:30:48.289 INFO:tasks.workunit.client.0.smithi046.stdout:8/716: truncate d1/db/dd/f76 2102805 0 2024-05-09T06:30:48.292 INFO:tasks.workunit.client.0.smithi046.stdout:8/717: getdents d1/d7/d12 0 2024-05-09T06:30:48.292 INFO:tasks.workunit.client.0.smithi046.stdout:8/718: truncate d1/db/dd/d11/d43/d81/fc4 4432910 0 2024-05-09T06:30:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/719: dwrite d1/db/d41/f6c [0,4194304] 0 2024-05-09T06:30:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/720: write d1/d7/d12/f57 [3111212,67259] 0 2024-05-09T06:30:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/721: readlink d1/db/dd/d11/d5d/l87 0 2024-05-09T06:30:48.311 INFO:tasks.workunit.client.0.smithi046.stdout:8/722: chown d1/db/dd/d11/d43/d81/fc4 173981 1 2024-05-09T06:30:48.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/723: unlink d1/db/dd/d11/f27 0 2024-05-09T06:30:48.318 INFO:tasks.workunit.client.0.smithi046.stdout:8/724: getdents d1/db/dd/d11/d5d/d99 0 2024-05-09T06:30:48.318 INFO:tasks.workunit.client.0.smithi046.stdout:8/725: truncate d1/db/d67/d6e/fc8 739620 0 2024-05-09T06:30:48.320 INFO:tasks.workunit.client.0.smithi046.stdout:8/726: write d1/d7/d2c/fb5 [455764,104071] 0 2024-05-09T06:30:48.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/727: dread d1/d7/d12/d1d/d30/d38/f42 [0,4194304] 0 2024-05-09T06:30:48.338 INFO:tasks.workunit.client.0.smithi046.stdout:8/728: dwrite d1/db/dd/d11/d5d/f6b [0,4194304] 0 2024-05-09T06:30:48.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/729: creat d1/db/dd/d11/d5d/dbb/fd6 x:0 0 0 2024-05-09T06:30:48.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/730: stat d1/db/dd/d11 0 2024-05-09T06:30:48.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/731: stat d1/d7/dcd 0 2024-05-09T06:30:48.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/732: dread d1/db/d67/f82 [0,4194304] 0 2024-05-09T06:30:48.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/733: truncate d1/db/dd/d11/d5d/d95/fbc 497620 0 2024-05-09T06:30:48.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/734: chown d1/d7/d12/d45 11 1 2024-05-09T06:30:48.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/735: fdatasync d1/db/d67/fc9 0 2024-05-09T06:30:48.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/736: write d1/db/dd/d11/fa6 [215230,106516] 0 2024-05-09T06:30:48.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/737: link d1/db/d67/d9f/fb3 d1/db/dd/d11/fd7 0 2024-05-09T06:30:48.425 INFO:tasks.workunit.client.0.smithi046.stdout:8/738: creat d1/d7/d12/fd8 x:0 0 0 2024-05-09T06:30:48.431 INFO:tasks.workunit.client.0.smithi046.stdout:8/739: write d1/db/f90 [5824058,108130] 0 2024-05-09T06:30:48.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/740: creat d1/db/dd/d11/d5d/d95/fd9 x:0 0 0 2024-05-09T06:30:48.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/741: dread - d1/db/dd/d11/fba zero size 2024-05-09T06:30:48.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/742: chown d1/db/d41/c8a 416123 1 2024-05-09T06:30:48.450 INFO:tasks.workunit.client.0.smithi046.stdout:8/743: dwrite d1/d7/d12/d45/fb9 [0,4194304] 0 2024-05-09T06:30:48.459 INFO:tasks.workunit.client.0.smithi046.stdout:8/744: mkdir d1/d7/d12/d1d/d30/dda 0 2024-05-09T06:30:48.463 INFO:tasks.workunit.client.0.smithi046.stdout:8/745: dread d1/db/dd/d11/d43/f65 [0,4194304] 0 2024-05-09T06:30:48.466 INFO:tasks.workunit.client.0.smithi046.stdout:8/746: rename d1/d7/d12/d45/f83 to d1/db/dd/d11/d5d/fdb 0 2024-05-09T06:30:48.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/747: mkdir d1/ddc 0 2024-05-09T06:30:48.469 INFO:tasks.workunit.client.0.smithi046.stdout:6/735: sync 2024-05-09T06:30:48.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/748: rmdir d1/d7/d12/d1d/d30/d38/db0 0 2024-05-09T06:30:48.472 INFO:tasks.workunit.client.0.smithi046.stdout:6/736: stat db/d10/d30/d53/ca1 0 2024-05-09T06:30:48.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/749: symlink d1/d7/d12/d1d/d30/ldd 0 2024-05-09T06:30:48.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/737: getdents db/d10/d30 0 2024-05-09T06:30:48.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/738: stat db/d10/d3f/d44/d74 0 2024-05-09T06:30:48.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/739: mkdir db/d10/d3c/df1 0 2024-05-09T06:30:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/750: dwrite d1/d7/d12/f8e [0,4194304] 0 2024-05-09T06:30:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/751: readlink d1/db/d67/la3 0 2024-05-09T06:30:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/752: write d1/db/d41/fc5 [158872,63247] 0 2024-05-09T06:30:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/740: dwrite db/d10/d3f/d44/fe8 [0,4194304] 0 2024-05-09T06:30:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/741: creat db/d10/d3f/d4f/d8a/d9e/ff2 x:0 0 0 2024-05-09T06:30:48.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/742: dwrite db/d10/d30/d53/f94 [4194304,4194304] 0 2024-05-09T06:30:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/743: write db/d10/d3f/d44/f5f [68645,11543] 0 2024-05-09T06:30:48.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/744: dread db/d93/fca [0,4194304] 0 2024-05-09T06:30:48.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/636: sync 2024-05-09T06:30:48.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/637: truncate d4/d5/f43 900990 0 2024-05-09T06:30:48.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/462: sync 2024-05-09T06:30:48.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/463: write d2/dc/f11 [5171688,67580] 0 2024-05-09T06:30:48.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/642: sync 2024-05-09T06:30:48.529 INFO:tasks.workunit.client.0.smithi046.stdout:1/571: sync 2024-05-09T06:30:48.529 INFO:tasks.workunit.client.0.smithi046.stdout:1/572: chown d7/d10/d28/d30/d3a/d76 490282 1 2024-05-09T06:30:48.529 INFO:tasks.workunit.client.0.smithi046.stdout:7/861: sync 2024-05-09T06:30:48.530 INFO:tasks.workunit.client.0.smithi046.stdout:4/578: sync 2024-05-09T06:30:48.530 INFO:tasks.workunit.client.0.smithi046.stdout:7/862: chown d3/d3d/d72/d94 215674678 1 2024-05-09T06:30:48.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/745: mknod db/d10/d3f/d4f/d8a/cf3 0 2024-05-09T06:30:48.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/753: write d1/db/dd/d11/d43/d81/fc4 [4650492,70466] 0 2024-05-09T06:30:48.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/754: creat d1/db/d41/fde x:0 0 0 2024-05-09T06:30:48.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/755: write d1/db/d67/d6e/fc8 [987682,45853] 0 2024-05-09T06:30:48.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/756: read d1/d7/d12/f5e [1002979,26167] 0 2024-05-09T06:30:48.537 INFO:tasks.workunit.client.0.smithi046.stdout:3/638: mkdir d4/d20/d24/d2a/d55/d6a/dd5 0 2024-05-09T06:30:48.538 INFO:tasks.workunit.client.0.smithi046.stdout:0/643: link d11/f22 d11/d18/d27/d28/d6b/fcf 0 2024-05-09T06:30:48.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/863: mknod d3/d7/d28/d29/c119 0 2024-05-09T06:30:48.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/864: dread - d3/d7/d28/d29/fb5 zero size 2024-05-09T06:30:48.540 INFO:tasks.workunit.client.0.smithi046.stdout:6/746: mknod db/d10/d3c/d91/cf4 0 2024-05-09T06:30:48.544 INFO:tasks.workunit.client.0.smithi046.stdout:8/757: rename d1/db/dd/d11/d5d/d99/dbf to d1/d7/dcd/ddf 0 2024-05-09T06:30:48.548 INFO:tasks.workunit.client.0.smithi046.stdout:3/639: creat d4/d48/d49/dc0/fd6 x:0 0 0 2024-05-09T06:30:48.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/747: dread db/d10/f37 [0,4194304] 0 2024-05-09T06:30:48.550 INFO:tasks.workunit.client.0.smithi046.stdout:1/573: dread d7/d10/d28/d30/d3a/fb7 [0,4194304] 0 2024-05-09T06:30:48.550 INFO:tasks.workunit.client.0.smithi046.stdout:1/574: readlink d7/d10/d28/d55/l73 0 2024-05-09T06:30:48.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/644: dread d11/d18/d27/f68 [0,4194304] 0 2024-05-09T06:30:48.558 INFO:tasks.workunit.client.0.smithi046.stdout:4/579: dwrite d7/df/d3a/d45/f97 [0,4194304] 0 2024-05-09T06:30:48.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/865: rename d3/d7/dd/d3e/fa1 to d3/d7/dd/def/f11a 0 2024-05-09T06:30:48.562 INFO:tasks.workunit.client.0.smithi046.stdout:6/748: symlink db/d10/d3f/d44/d46/d70/lf5 0 2024-05-09T06:30:48.562 INFO:tasks.workunit.client.0.smithi046.stdout:6/749: read db/d10/f16 [6684485,61135] 0 2024-05-09T06:30:48.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/750: stat db/d10/d3f/d4f/d8a/led 0 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:9/464: dwrite d2/dc/f89 [0,4194304] 0 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:9/465: creat d2/d6/d7/d1a/d27/f98 x:0 0 0 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:9/466: dread - d2/d6/d7/d1e/f4a zero size 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:9/467: fsync d2/dc/f41 0 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:9/468: fdatasync d2/d6/d7/d1e/f78 0 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:1/575: symlink d7/d10/d84/lc4 0 2024-05-09T06:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/866: dread d3/d7/fec [0,4194304] 0 2024-05-09T06:30:48.565 INFO:tasks.workunit.client.0.smithi046.stdout:7/867: chown d3/d3d/d72/d79/d81/c9e 75599850 1 2024-05-09T06:30:48.565 INFO:tasks.workunit.client.0.smithi046.stdout:5/626: sync 2024-05-09T06:30:48.566 INFO:tasks.workunit.client.0.smithi046.stdout:2/660: sync 2024-05-09T06:30:48.571 INFO:tasks.workunit.client.0.smithi046.stdout:4/580: mknod d7/df/d10/d1d/d77/d87/dac/cb4 0 2024-05-09T06:30:48.575 INFO:tasks.workunit.client.0.smithi046.stdout:3/640: rename d4/d5/f77 to d4/d5d/d60/fd7 0 2024-05-09T06:30:48.578 INFO:tasks.workunit.client.0.smithi046.stdout:9/469: dread d2/dc/f41 [0,4194304] 0 2024-05-09T06:30:48.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/645: dwrite d11/d18/d1c/d53/f6a [0,4194304] 0 2024-05-09T06:30:48.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/646: write d11/f93 [230376,71375] 0 2024-05-09T06:30:48.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/647: write d11/d18/d1c/d53/d82/fa7 [151402,61576] 0 2024-05-09T06:30:48.580 INFO:tasks.workunit.client.0.smithi046.stdout:1/576: dread d7/d10/d28/f33 [0,4194304] 0 2024-05-09T06:30:48.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/627: creat d0/d3e/dc7/dd0/fd5 x:0 0 0 2024-05-09T06:30:48.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/581: dwrite d7/f72 [12582912,4194304] 0 2024-05-09T06:30:48.592 INFO:tasks.workunit.client.0.smithi046.stdout:2/661: creat da/d2d/fd5 x:0 0 0 2024-05-09T06:30:48.592 INFO:tasks.workunit.client.0.smithi046.stdout:2/662: stat da/f94 0 2024-05-09T06:30:48.592 INFO:tasks.workunit.client.0.smithi046.stdout:2/663: write da/de/d14/d1f/d20/d7c/d8b/fc7 [655796,122206] 0 2024-05-09T06:30:48.595 INFO:tasks.workunit.client.0.smithi046.stdout:3/641: mknod d4/d20/d41/d4a/cd8 0 2024-05-09T06:30:48.597 INFO:tasks.workunit.client.0.smithi046.stdout:6/751: rename db/d10/d19/f83 to db/d10/d76/ff6 0 2024-05-09T06:30:48.600 INFO:tasks.workunit.client.0.smithi046.stdout:2/664: write da/de/d1c/f3e [2700345,24934] 0 2024-05-09T06:30:48.600 INFO:tasks.workunit.client.0.smithi046.stdout:0/648: dwrite d11/d18/f8c [0,4194304] 0 2024-05-09T06:30:48.601 INFO:tasks.workunit.client.0.smithi046.stdout:4/582: dwrite d7/df/d3a/d45/d96/f5a [0,4194304] 0 2024-05-09T06:30:48.603 INFO:tasks.workunit.client.0.smithi046.stdout:9/470: mknod d2/d6/d33/c99 0 2024-05-09T06:30:48.609 INFO:tasks.workunit.client.0.smithi046.stdout:1/577: mkdir d7/da3/dc5 0 2024-05-09T06:30:48.609 INFO:tasks.workunit.client.0.smithi046.stdout:1/578: fdatasync d7/fbd 0 2024-05-09T06:30:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/868: rename d3/d7/l42 to d3/d7/d28/d29/d3b/dfd/d10a/l11b 0 2024-05-09T06:30:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/869: fdatasync d3/d7/d4c/d4f/d9d/f105 0 2024-05-09T06:30:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/870: fsync d3/d7/d28/d29/d35/d5c/dad/dbb/feb 0 2024-05-09T06:30:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/871: stat d3/d7/d4c/d99/dac/lf4 0 2024-05-09T06:30:48.617 INFO:tasks.workunit.client.0.smithi046.stdout:3/642: dwrite d4/d20/d24/d29/d2b/d94/d5c/f67 [0,4194304] 0 2024-05-09T06:30:48.617 INFO:tasks.workunit.client.0.smithi046.stdout:0/649: dwrite d11/d18/d1c/d53/d82/f9a [0,4194304] 0 2024-05-09T06:30:48.617 INFO:tasks.workunit.client.0.smithi046.stdout:0/650: write d11/d3f/f51 [387552,126835] 0 2024-05-09T06:30:48.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/583: getdents d7/df/d10/d1d 0 2024-05-09T06:30:48.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/872: dread d3/dc4/f117 [4194304,4194304] 0 2024-05-09T06:30:48.635 INFO:tasks.workunit.client.0.smithi046.stdout:5/628: rename d0/d1b/lb9 to d0/d1b/d21/d81/ld6 0 2024-05-09T06:30:48.635 INFO:tasks.workunit.client.0.smithi046.stdout:5/629: truncate d0/d1b/f9a 783404 0 2024-05-09T06:30:48.635 INFO:tasks.workunit.client.0.smithi046.stdout:0/651: dwrite d11/d18/d27/f68 [4194304,4194304] 0 2024-05-09T06:30:48.637 INFO:tasks.workunit.client.0.smithi046.stdout:0/652: write d11/d4f/fa4 [527771,17988] 0 2024-05-09T06:30:48.637 INFO:tasks.workunit.client.0.smithi046.stdout:0/653: chown d11/d18/l20 23890 1 2024-05-09T06:30:48.638 INFO:tasks.workunit.client.0.smithi046.stdout:0/654: fsync d11/fb6 0 2024-05-09T06:30:48.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/643: stat d4/d20/lcc 0 2024-05-09T06:30:48.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/644: creat d4/d20/d24/d2a/d55/d6a/fd9 x:0 0 0 2024-05-09T06:30:48.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/645: truncate d4/d20/d24/d29/d2b/d94/f84 350451 0 2024-05-09T06:30:48.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/646: stat d4/d20/d24/d2a/d55/d6a/fd9 0 2024-05-09T06:30:48.645 INFO:tasks.workunit.client.0.smithi046.stdout:4/584: symlink d7/df/d10/d1d/d77/lb5 0 2024-05-09T06:30:48.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/471: read d2/f69 [20251,37922] 0 2024-05-09T06:30:48.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/472: write d2/d6/d7/d1a/d27/d2a/f8d [812722,120578] 0 2024-05-09T06:30:48.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/473: write d2/d26/d2c/f7a [439309,68924] 0 2024-05-09T06:30:48.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/474: readlink d2/d6/d33/l7d 0 2024-05-09T06:30:48.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/873: link d3/d7/d28/d29/d3b/dfd/d10a/l11b d3/d3d/d72/d107/l11c 0 2024-05-09T06:30:48.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/579: getdents d7/d10/d28/d30/d3a 0 2024-05-09T06:30:48.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/580: write d7/d10/d34/d46/d81/f91 [214939,81236] 0 2024-05-09T06:30:48.651 INFO:tasks.workunit.client.0.smithi046.stdout:1/581: stat d7/d10/d84/laf 0 2024-05-09T06:30:48.654 INFO:tasks.workunit.client.0.smithi046.stdout:2/665: rename da/de/d14/d1f/d97/dcd/d7d/d6d/fb3 to da/de/d14/d1f/d20/d5c/dcf/fd6 0 2024-05-09T06:30:48.654 INFO:tasks.workunit.client.0.smithi046.stdout:2/666: write da/de/d54/d65/d70/fb9 [4510953,124484] 0 2024-05-09T06:30:48.657 INFO:tasks.workunit.client.0.smithi046.stdout:5/630: truncate d0/d1b/d39/f3a 1207193 0 2024-05-09T06:30:48.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/582: dread d7/d10/d34/f68 [0,4194304] 0 2024-05-09T06:30:48.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/655: truncate d11/d18/d1c/d53/f6a 178901 0 2024-05-09T06:30:48.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/656: chown f9 1 1 2024-05-09T06:30:48.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/647: creat d4/d20/d24/d2a/d4e/fda x:0 0 0 2024-05-09T06:30:48.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/585: rmdir d7/df/d3a/d45/d96 39 2024-05-09T06:30:48.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/475: rename d2/d6/d7/d1a/d27/l3a to d2/d6/d7/d1a/d27/l9a 0 2024-05-09T06:30:48.677 INFO:tasks.workunit.client.0.smithi046.stdout:7/874: getdents d3/d7/d28/d29/d35/d5c 0 2024-05-09T06:30:48.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/586: dread d7/f9 [0,4194304] 0 2024-05-09T06:30:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:4/587: write d7/df/d3a/d45/f85 [5239576,21232] 0 2024-05-09T06:30:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:2/667: creat da/dcb/dcc/fd7 x:0 0 0 2024-05-09T06:30:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:2/668: readlink da/de/d14/d1f/d20/l8c 0 2024-05-09T06:30:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:2/669: chown da/de/d14/d1f/d97/dcd/dd2 19837 1 2024-05-09T06:30:48.685 INFO:tasks.workunit.client.0.smithi046.stdout:5/631: rename d0/fd to d0/d3e/d53/fd7 0 2024-05-09T06:30:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:7/875: dread d3/d7/d28/f2c [0,4194304] 0 2024-05-09T06:30:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/583: creat d7/d10/d28/d55/fc6 x:0 0 0 2024-05-09T06:30:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/670: dread da/de/d14/d1f/d3b/d9f/fc3 [0,4194304] 0 2024-05-09T06:30:48.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/657: creat d11/d18/d1c/d53/dc2/fd0 x:0 0 0 2024-05-09T06:30:48.689 INFO:tasks.workunit.client.0.smithi046.stdout:3/648: truncate d4/d20/d24/d2a/d4e/f8e 1657834 0 2024-05-09T06:30:48.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/649: chown d4/d20/d24/d29/d2b/l73 131105 1 2024-05-09T06:30:48.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/650: fsync d4/d20/fb5 0 2024-05-09T06:30:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/476: creat d2/d6/f9b x:0 0 0 2024-05-09T06:30:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/477: write d2/d26/d76/f8f [805484,88505] 0 2024-05-09T06:30:48.694 INFO:tasks.workunit.client.0.smithi046.stdout:4/588: creat d7/df/d10/d1d/fb6 x:0 0 0 2024-05-09T06:30:48.698 INFO:tasks.workunit.client.0.smithi046.stdout:5/632: symlink d0/d58/d7a/ld8 0 2024-05-09T06:30:48.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/584: getdents d7/d10/d34 0 2024-05-09T06:30:48.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/585: stat d7/d10/d28/d55 0 2024-05-09T06:30:48.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/586: dread - d7/d10/f6c zero size 2024-05-09T06:30:48.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/658: unlink d11/d18/d1c/d53/l58 0 2024-05-09T06:30:48.709 INFO:tasks.workunit.client.0.smithi046.stdout:3/651: truncate d4/d20/d24/d2a/d46/f6f 1951624 0 2024-05-09T06:30:48.709 INFO:tasks.workunit.client.0.smithi046.stdout:3/652: chown d4/d20/d24/d2a/d4e/f8e 27 1 2024-05-09T06:30:48.713 INFO:tasks.workunit.client.0.smithi046.stdout:4/589: mkdir d7/df/d3a/d25/d81/d98/db7 0 2024-05-09T06:30:48.724 INFO:tasks.workunit.client.0.smithi046.stdout:0/659: dwrite d11/d18/d27/d28/d36/d91/f92 [0,4194304] 0 2024-05-09T06:30:48.726 INFO:tasks.workunit.client.0.smithi046.stdout:5/633: creat d0/dba/fd9 x:0 0 0 2024-05-09T06:30:48.726 INFO:tasks.workunit.client.0.smithi046.stdout:5/634: dread - d0/d1b/d39/fbb zero size 2024-05-09T06:30:48.734 INFO:tasks.workunit.client.0.smithi046.stdout:7/876: getdents d3/d3d/d5b/d84 0 2024-05-09T06:30:48.737 INFO:tasks.workunit.client.0.smithi046.stdout:0/660: dread d11/d18/f8c [0,4194304] 0 2024-05-09T06:30:48.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/587: link d7/d10/d28/c40 d7/da3/dc5/cc7 0 2024-05-09T06:30:48.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/588: write d7/d10/d34/d46/d81/f9a [769958,72228] 0 2024-05-09T06:30:48.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/589: fdatasync d7/d10/d28/d30/d3a/d76/fb3 0 2024-05-09T06:30:48.740 INFO:tasks.workunit.client.0.smithi046.stdout:5/635: dread d0/d3e/d53/fd7 [0,4194304] 0 2024-05-09T06:30:48.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/590: symlink d7/df/lb8 0 2024-05-09T06:30:48.751 INFO:tasks.workunit.client.0.smithi046.stdout:7/877: dwrite d3/d7/d28/d29/d35/d5c/f61 [0,4194304] 0 2024-05-09T06:30:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:5/636: symlink d0/d3e/d50/lda 0 2024-05-09T06:30:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:5/637: truncate d0/d3e/d53/fc2 587926 0 2024-05-09T06:30:48.759 INFO:tasks.workunit.client.0.smithi046.stdout:4/591: mkdir d7/df/d10/d1d/db9 0 2024-05-09T06:30:48.763 INFO:tasks.workunit.client.0.smithi046.stdout:7/878: write d3/d7/dd/f68 [1927264,62560] 0 2024-05-09T06:30:48.767 INFO:tasks.workunit.client.0.smithi046.stdout:7/879: dread d3/d3d/d5b/fe7 [0,4194304] 0 2024-05-09T06:30:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:7/880: dread d3/d7/d28/d29/d35/d5c/f61 [0,4194304] 0 2024-05-09T06:30:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:2/671: dwrite da/de/d14/f1b [0,4194304] 0 2024-05-09T06:30:48.775 INFO:tasks.workunit.client.0.smithi046.stdout:5/638: dwrite d0/f16 [0,4194304] 0 2024-05-09T06:30:48.775 INFO:tasks.workunit.client.0.smithi046.stdout:5/639: stat d0/dba 0 2024-05-09T06:30:48.790 INFO:tasks.workunit.client.0.smithi046.stdout:0/661: rmdir d11 39 2024-05-09T06:30:48.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/590: getdents d7/d10/d28/d30/da0 0 2024-05-09T06:30:48.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/591: dread - d7/d10/d84/da8/fbe zero size 2024-05-09T06:30:48.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/592: write d7/d10/d28/d30/f77 [687164,11840] 0 2024-05-09T06:30:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:1/593: chown d7/d10/d28/f4f 38 1 2024-05-09T06:30:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:4/592: creat d7/df/d10/d1d/d77/d87/dac/fba x:0 0 0 2024-05-09T06:30:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:4/593: chown d7/df/d3a/d25/l2a 3613455 1 2024-05-09T06:30:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:4/594: write d7/df/d3a/f2c [3924474,41556] 0 2024-05-09T06:30:48.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/881: link d3/dc4/ce8 d3/d7/d28/d29/d3b/dbd/c11d 0 2024-05-09T06:30:48.801 INFO:tasks.workunit.client.0.smithi046.stdout:5/640: symlink d0/d1b/ldb 0 2024-05-09T06:30:48.805 INFO:tasks.workunit.client.0.smithi046.stdout:1/594: symlink d7/d10/d28/d30/lc8 0 2024-05-09T06:30:48.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/595: rename d7/df/d10/d1d/c7b to d7/df/d3a/d25/da5/cbb 0 2024-05-09T06:30:48.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/596: chown d7 77931 1 2024-05-09T06:30:48.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/882: mkdir d3/d3d/d72/d79/d81/d11e 0 2024-05-09T06:30:48.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/883: write d3/d3d/d72/fdf [347204,41703] 0 2024-05-09T06:30:48.809 INFO:tasks.workunit.client.0.smithi046.stdout:4/597: write d7/df/d3a/d45/f85 [4922729,77543] 0 2024-05-09T06:30:48.814 INFO:tasks.workunit.client.0.smithi046.stdout:1/595: dread d7/d10/d34/f68 [0,4194304] 0 2024-05-09T06:30:48.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/884: mkdir d3/d3d/d72/d79/d81/d11e/d11f 0 2024-05-09T06:30:48.819 INFO:tasks.workunit.client.0.smithi046.stdout:4/598: rename d7/df/d53/d91/f95 to d7/df/d3a/d25/d81/d98/fbc 0 2024-05-09T06:30:48.820 INFO:tasks.workunit.client.0.smithi046.stdout:1/596: mkdir d7/d10/d28/d55/dc9 0 2024-05-09T06:30:48.822 INFO:tasks.workunit.client.0.smithi046.stdout:7/885: mkdir d3/d7/d28/d29/d3b/dbd/d120 0 2024-05-09T06:30:48.825 INFO:tasks.workunit.client.0.smithi046.stdout:4/599: creat d7/df/fbd x:0 0 0 2024-05-09T06:30:48.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:48 smithi046 ceph-mon[26924]: pgmap v31: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 186 MiB/s rd, 235 MiB/s wr, 373 op/s 2024-05-09T06:30:48.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/758: sync 2024-05-09T06:30:48.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/759: chown d1/db/dd/d11 0 1 2024-05-09T06:30:48.865 INFO:tasks.workunit.client.0.smithi046.stdout:8/760: truncate d1/d7/d12/f5e 2895396 0 2024-05-09T06:30:48.867 INFO:tasks.workunit.client.0.smithi046.stdout:8/761: creat d1/d7/dcd/ddf/fe0 x:0 0 0 2024-05-09T06:30:48.868 INFO:tasks.workunit.client.0.smithi046.stdout:8/762: creat d1/d7/d12/d1d/d30/dbd/dc7/fe1 x:0 0 0 2024-05-09T06:30:48.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/763: write d1/db/dd/d11/d43/f65 [312948,81797] 0 2024-05-09T06:30:48.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/764: write d1/d7/f31 [2045839,88781] 0 2024-05-09T06:30:48.870 INFO:tasks.workunit.client.0.smithi046.stdout:8/765: link d1/db/dd/d11/f72 d1/ddc/fe2 0 2024-05-09T06:30:48.871 INFO:tasks.workunit.client.0.smithi046.stdout:1/597: dwrite d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:48.871 INFO:tasks.workunit.client.0.smithi046.stdout:1/598: readlink d7/d10/d84/l88 0 2024-05-09T06:30:48.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/600: dwrite d7/df/d53/f6f [0,4194304] 0 2024-05-09T06:30:48.872 INFO:tasks.workunit.client.0.smithi046.stdout:1/599: creat d7/d10/d34/d46/d86/fca x:0 0 0 2024-05-09T06:30:48.874 INFO:tasks.workunit.client.0.smithi046.stdout:4/601: dread d7/df/f38 [0,4194304] 0 2024-05-09T06:30:48.876 INFO:tasks.workunit.client.0.smithi046.stdout:1/600: getdents d7/da3/dc5 0 2024-05-09T06:30:48.879 INFO:tasks.workunit.client.0.smithi046.stdout:7/886: rename d3/d3d to d3/d7/d4c/d4f/d121 0 2024-05-09T06:30:48.884 INFO:tasks.workunit.client.0.smithi046.stdout:8/766: write d1/db/d67/d9f/fb3 [2362882,43171] 0 2024-05-09T06:30:48.884 INFO:tasks.workunit.client.0.smithi046.stdout:8/767: chown d1/db/dd/d11/d43/d81 29389158 1 2024-05-09T06:30:48.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/601: dread d7/d10/f4c [0,4194304] 0 2024-05-09T06:30:48.901 INFO:tasks.workunit.client.0.smithi046.stdout:4/602: dwrite d7/df/f1b [0,4194304] 0 2024-05-09T06:30:48.901 INFO:tasks.workunit.client.0.smithi046.stdout:4/603: write d7/df/d10/d2f/f5c [420125,44761] 0 2024-05-09T06:30:48.907 INFO:tasks.workunit.client.0.smithi046.stdout:7/887: dwrite d3/d7/d28/d29/f2e [4194304,4194304] 0 2024-05-09T06:30:48.907 INFO:tasks.workunit.client.0.smithi046.stdout:1/602: dwrite d7/d10/d34/f51 [0,4194304] 0 2024-05-09T06:30:48.916 INFO:tasks.workunit.client.0.smithi046.stdout:4/604: dwrite d7/df/d3a/d25/f57 [0,4194304] 0 2024-05-09T06:30:48.916 INFO:tasks.workunit.client.0.smithi046.stdout:4/605: chown d7/df/d3a/f83 28880 1 2024-05-09T06:30:48.916 INFO:tasks.workunit.client.0.smithi046.stdout:4/606: chown d7/df/d3a/d45/f85 162 1 2024-05-09T06:30:48.916 INFO:tasks.workunit.client.0.smithi046.stdout:4/607: chown d7/df/d10/d1d/d77/c7e 17132771 1 2024-05-09T06:30:48.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/888: dread d3/d7/d28/d29/d35/f48 [0,4194304] 0 2024-05-09T06:30:48.929 INFO:tasks.workunit.client.0.smithi046.stdout:4/608: read d7/df/d3a/d25/f5f [3127948,60957] 0 2024-05-09T06:30:48.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/609: stat d7/df/d10/d1d/d77/c7c 0 2024-05-09T06:30:48.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/610: write d7/df/d10/d1d/d77/f7a [744234,25295] 0 2024-05-09T06:30:48.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/611: mkdir d7/df/d10/d1d/d77/d87/dbe 0 2024-05-09T06:30:48.932 INFO:tasks.workunit.client.0.smithi046.stdout:4/612: getdents d7/df/d3a/d45/d96 0 2024-05-09T06:30:48.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/603: dwrite d7/d10/d28/f33 [4194304,4194304] 0 2024-05-09T06:30:48.941 INFO:tasks.workunit.client.0.smithi046.stdout:1/604: rename d7/d10/d84/laf to d7/da3/dc5/lcb 0 2024-05-09T06:30:48.941 INFO:tasks.workunit.client.0.smithi046.stdout:1/605: dread - d7/d10/d34/d46/d81/f9e zero size 2024-05-09T06:30:48.941 INFO:tasks.workunit.client.0.smithi046.stdout:1/606: creat d7/da3/fcc x:0 0 0 2024-05-09T06:30:48.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/607: write d7/d10/f13 [821567,80818] 0 2024-05-09T06:30:48.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/608: write d7/d10/d34/d46/d81/fb6 [61451,7828] 0 2024-05-09T06:30:48.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/609: chown d7/f1d 2305 1 2024-05-09T06:30:48.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/610: stat d7/d10/f6c 0 2024-05-09T06:30:48.948 INFO:tasks.workunit.client.0.smithi046.stdout:1/611: write d7/f19 [1760582,99383] 0 2024-05-09T06:30:48.949 INFO:tasks.workunit.client.0.smithi046.stdout:1/612: symlink d7/d10/d28/d30/d3a/d7f/lcd 0 2024-05-09T06:30:48.949 INFO:tasks.workunit.client.0.smithi046.stdout:7/889: dwrite d3/d7/dd/f59 [0,4194304] 0 2024-05-09T06:30:48.949 INFO:tasks.workunit.client.0.smithi046.stdout:1/613: creat d7/d10/d34/fce x:0 0 0 2024-05-09T06:30:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:7/890: truncate d3/d7/d4c/d4f/d121/d5b/fc3 1358854 0 2024-05-09T06:30:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:4/613: dwrite d7/df/d3a/d25/f4e [0,4194304] 0 2024-05-09T06:30:48.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/614: unlink d7/df/d3a/d25/f4e 0 2024-05-09T06:30:48.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/615: chown d7/df/lb1 3 1 2024-05-09T06:30:48.954 INFO:tasks.workunit.client.0.smithi046.stdout:4/616: stat d7/df/d3a/d45/f97 0 2024-05-09T06:30:48.962 INFO:tasks.workunit.client.0.smithi046.stdout:7/891: dread d3/d7/d28/d29/d35/f78 [0,4194304] 0 2024-05-09T06:30:48.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/614: rename d7/d10/d28/d30/d3a to d7/d10/d28/d30/dcf 0 2024-05-09T06:30:48.965 INFO:tasks.workunit.client.0.smithi046.stdout:4/617: dread d7/df/fa3 [0,4194304] 0 2024-05-09T06:30:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:4/618: dread d7/df/d10/d1d/f8e [0,4194304] 0 2024-05-09T06:30:49.050 INFO:tasks.workunit.client.0.smithi046.stdout:1/615: symlink d7/d10/d28/d30/dcf/ld0 0 2024-05-09T06:30:49.052 INFO:tasks.workunit.client.0.smithi046.stdout:1/616: write d7/d10/f47 [1012503,113137] 0 2024-05-09T06:30:49.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:48 smithi106 ceph-mon[34679]: pgmap v31: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 186 MiB/s rd, 235 MiB/s wr, 373 op/s 2024-05-09T06:30:49.074 INFO:tasks.workunit.client.0.smithi046.stdout:1/617: unlink d7/d10/d84/l94 0 2024-05-09T06:30:49.074 INFO:tasks.workunit.client.0.smithi046.stdout:4/619: rmdir d7/df/d3a/d45 39 2024-05-09T06:30:49.076 INFO:tasks.workunit.client.0.smithi046.stdout:1/618: truncate d7/d10/d28/f59 2078109 0 2024-05-09T06:30:49.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/619: readlink d7/d10/d34/d46/d86/l97 0 2024-05-09T06:30:49.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/620: write d7/f1d [992652,111813] 0 2024-05-09T06:30:49.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/621: creat d7/d10/d34/fd1 x:0 0 0 2024-05-09T06:30:49.078 INFO:tasks.workunit.client.0.smithi046.stdout:1/622: dread d7/d10/d28/d30/f77 [0,4194304] 0 2024-05-09T06:30:49.081 INFO:tasks.workunit.client.0.smithi046.stdout:1/623: creat d7/d6d/fd2 x:0 0 0 2024-05-09T06:30:49.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/624: mknod d7/d10/d28/d30/da0/cd3 0 2024-05-09T06:30:49.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/625: chown d7/d10/f6c 2923927 1 2024-05-09T06:30:49.083 INFO:tasks.workunit.client.0.smithi046.stdout:4/620: dread d7/df/d3a/d45/f97 [0,4194304] 0 2024-05-09T06:30:49.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/621: mkdir d7/df/d10/d1d/dbf 0 2024-05-09T06:30:49.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/622: readlink d7/df/d3a/d25/d81/d98/l9a 0 2024-05-09T06:30:49.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/623: write d7/df/d10/d1d/d77/d87/f8f [564172,113220] 0 2024-05-09T06:30:49.089 INFO:tasks.workunit.client.0.smithi046.stdout:1/626: write d7/d10/d34/f68 [5547189,68622] 0 2024-05-09T06:30:49.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/627: symlink d7/d10/d28/d30/ld4 0 2024-05-09T06:30:49.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/628: write d7/d6d/f9f [1250337,88715] 0 2024-05-09T06:30:49.094 INFO:tasks.workunit.client.0.smithi046.stdout:4/624: dread d7/df/d10/d2f/f89 [0,4194304] 0 2024-05-09T06:30:49.101 INFO:tasks.workunit.client.0.smithi046.stdout:4/625: write d7/df/d3a/d25/f57 [3678207,95855] 0 2024-05-09T06:30:49.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/629: dread d7/d10/d28/f59 [0,4194304] 0 2024-05-09T06:30:49.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/630: chown d7/d10/f24 5781089 1 2024-05-09T06:30:49.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/631: read d7/d6d/f9f [859272,34991] 0 2024-05-09T06:30:49.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/752: sync 2024-05-09T06:30:49.109 INFO:tasks.workunit.client.0.smithi046.stdout:6/753: chown db/d10/d30/d53/l8b 9439503 1 2024-05-09T06:30:49.110 INFO:tasks.workunit.client.0.smithi046.stdout:4/626: write d7/df/d53/f6f [4132416,81180] 0 2024-05-09T06:30:49.111 INFO:tasks.workunit.client.0.smithi046.stdout:6/754: mknod db/d10/d19/cf7 0 2024-05-09T06:30:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/627: creat d7/fc0 x:0 0 0 2024-05-09T06:30:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/628: write d7/df/d10/d2f/f9b [635642,53358] 0 2024-05-09T06:30:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/629: readlink d7/l9e 0 2024-05-09T06:30:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/630: dread - d7/df/d10/d1d/d77/d87/dac/fba zero size 2024-05-09T06:30:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/631: fsync d7/df/d10/d2f/fa2 0 2024-05-09T06:30:49.116 INFO:tasks.workunit.client.0.smithi046.stdout:4/632: symlink d7/df/d3a/d25/d86/lc1 0 2024-05-09T06:30:49.123 INFO:tasks.workunit.client.0.smithi046.stdout:4/633: rename d7/df/d10/c5d to d7/df/d3a/d25/d81/d98/db7/cc2 0 2024-05-09T06:30:49.123 INFO:tasks.workunit.client.0.smithi046.stdout:4/634: chown d7/df/d10/l65 0 1 2024-05-09T06:30:49.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/755: dwrite db/d10/d3f/d4f/f63 [4194304,4194304] 0 2024-05-09T06:30:49.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/632: dwrite d7/d10/d34/f51 [4194304,4194304] 0 2024-05-09T06:30:49.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/633: dread d7/f1d [0,4194304] 0 2024-05-09T06:30:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/756: write db/d10/d30/f77 [1009020,9027] 0 2024-05-09T06:30:49.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/635: dwrite d7/df/fa3 [0,4194304] 0 2024-05-09T06:30:49.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/636: write d7/df/f38 [248,48830] 0 2024-05-09T06:30:49.140 INFO:tasks.workunit.client.0.smithi046.stdout:1/634: truncate d7/d10/d84/f99 4294461 0 2024-05-09T06:30:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/757: mknod db/d10/d3c/dd4/cf8 0 2024-05-09T06:30:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/758: write db/d10/d3f/d4f/d8a/d9e/fec [528557,74227] 0 2024-05-09T06:30:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/759: creat db/d10/d3f/d44/d5e/dbe/ff9 x:0 0 0 2024-05-09T06:30:49.145 INFO:tasks.workunit.client.0.smithi046.stdout:4/637: mkdir d7/df/d53/d91/dc3 0 2024-05-09T06:30:49.150 INFO:tasks.workunit.client.0.smithi046.stdout:6/760: dread db/d10/d3f/f56 [0,4194304] 0 2024-05-09T06:30:49.151 INFO:tasks.workunit.client.0.smithi046.stdout:1/635: mkdir d7/da3/dc5/dd5 0 2024-05-09T06:30:49.151 INFO:tasks.workunit.client.0.smithi046.stdout:1/636: readlink d7/d10/d84/l88 0 2024-05-09T06:30:49.156 INFO:tasks.workunit.client.0.smithi046.stdout:4/638: rename d7/df/d3a/d45/d96/f5a to d7/df/d3a/d25/d81/d98/fc4 0 2024-05-09T06:30:49.157 INFO:tasks.workunit.client.0.smithi046.stdout:4/639: chown f4 842643 1 2024-05-09T06:30:49.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/761: unlink db/d10/d3c/f6d 0 2024-05-09T06:30:49.162 INFO:tasks.workunit.client.0.smithi046.stdout:1/637: mkdir d7/dd6 0 2024-05-09T06:30:49.162 INFO:tasks.workunit.client.0.smithi046.stdout:1/638: truncate d7/d10/d28/d30/dcf/d7f/f90 775354 0 2024-05-09T06:30:49.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/640: write d7/fb [12809731,53325] 0 2024-05-09T06:30:49.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/639: symlink d7/d10/d34/d46/d81/ld7 0 2024-05-09T06:30:49.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/640: fsync d7/da3/fcc 0 2024-05-09T06:30:49.166 INFO:tasks.workunit.client.0.smithi046.stdout:6/762: dread db/fd [0,4194304] 0 2024-05-09T06:30:49.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/641: mknod d7/d10/d34/d46/d86/cd8 0 2024-05-09T06:30:49.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/642: truncate f6 1304913 0 2024-05-09T06:30:49.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/763: unlink db/d10/d3f/d44/d5e/dbe/ff9 0 2024-05-09T06:30:49.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/764: truncate db/d93/d96/dd1/fdb 222929 0 2024-05-09T06:30:49.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/765: truncate db/d10/d76/ff6 4764922 0 2024-05-09T06:30:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/766: stat db/d10/d57 0 2024-05-09T06:30:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/767: readlink db/d10/ldc 0 2024-05-09T06:30:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/768: fsync db/d10/d76/fc2 0 2024-05-09T06:30:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/643: mkdir d7/d10/d28/d30/da0/dd9 0 2024-05-09T06:30:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/644: chown d7/d10/d34/d46/d81/cbf 334 1 2024-05-09T06:30:49.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/769: mkdir db/d10/dfa 0 2024-05-09T06:30:49.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/770: write db/d10/d3f/d4f/d8a/d9e/ff2 [210537,95836] 0 2024-05-09T06:30:49.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/771: write db/d10/d76/fe2 [87554,6462] 0 2024-05-09T06:30:49.177 INFO:tasks.workunit.client.0.smithi046.stdout:6/772: mknod db/d10/d3c/d91/cfb 0 2024-05-09T06:30:49.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/645: getdents d7/d6d 0 2024-05-09T06:30:49.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/646: chown d7/d10/d28/d30/f38 9397783 1 2024-05-09T06:30:49.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/773: creat db/d10/d3f/d44/d74/ffc x:0 0 0 2024-05-09T06:30:49.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/774: creat db/d10/d6b/ffd x:0 0 0 2024-05-09T06:30:49.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/775: fdatasync db/d10/d3f/d4f/d8a/d9e/fa7 0 2024-05-09T06:30:49.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/641: dwrite d7/df/d10/d1d/f8e [0,4194304] 0 2024-05-09T06:30:49.182 INFO:tasks.workunit.client.0.smithi046.stdout:1/647: creat d7/fda x:0 0 0 2024-05-09T06:30:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/648: dread d7/d10/d34/d46/d81/f9a [0,4194304] 0 2024-05-09T06:30:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/649: creat d7/d10/d34/fdb x:0 0 0 2024-05-09T06:30:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/650: chown d7/d10/d28/d30/da0/dd9 1025 1 2024-05-09T06:30:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/651: chown d7/da3/fa9 508498081 1 2024-05-09T06:30:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/652: chown d7/d10/f23 44 1 2024-05-09T06:30:49.187 INFO:tasks.workunit.client.0.smithi046.stdout:6/776: dread db/d10/d76/ff6 [0,4194304] 0 2024-05-09T06:30:49.187 INFO:tasks.workunit.client.0.smithi046.stdout:6/777: creat db/d10/d3f/d44/d5e/dbe/ffe x:0 0 0 2024-05-09T06:30:49.192 INFO:tasks.workunit.client.0.smithi046.stdout:1/653: dread d7/fc [0,4194304] 0 2024-05-09T06:30:49.192 INFO:tasks.workunit.client.0.smithi046.stdout:4/642: mknod d7/df/d10/d2f/cc5 0 2024-05-09T06:30:49.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/643: mkdir d7/df/d3a/d45/dc6 0 2024-05-09T06:30:49.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/654: write d7/d10/d28/d30/f38 [2177800,87779] 0 2024-05-09T06:30:49.205 INFO:tasks.workunit.client.0.smithi046.stdout:6/778: dwrite db/d10/d3f/d44/d46/d70/fe5 [0,4194304] 0 2024-05-09T06:30:49.205 INFO:tasks.workunit.client.0.smithi046.stdout:4/644: dread d7/df/d10/d2f/f6d [0,4194304] 0 2024-05-09T06:30:49.205 INFO:tasks.workunit.client.0.smithi046.stdout:4/645: write d7/df/d10/d2f/f50 [1490480,111803] 0 2024-05-09T06:30:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/779: symlink db/d10/d3f/d44/d46/lff 0 2024-05-09T06:30:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/780: stat db/d10/d3f/f67 0 2024-05-09T06:30:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/781: chown db/d10/d3f/d4f/d8a/d9e/lde 3955 1 2024-05-09T06:30:49.225 INFO:tasks.workunit.client.0.smithi046.stdout:6/782: rename db/d10/d3f/d44/d46/lff to db/d10/d3f/l100 0 2024-05-09T06:30:49.227 INFO:tasks.workunit.client.0.smithi046.stdout:6/783: getdents db/d10 0 2024-05-09T06:30:49.228 INFO:tasks.workunit.client.0.smithi046.stdout:1/655: dwrite d7/d10/d28/d30/fae [0,4194304] 0 2024-05-09T06:30:49.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/646: dwrite d7/df/d10/d1d/d77/d87/f8f [0,4194304] 0 2024-05-09T06:30:49.234 INFO:tasks.workunit.client.0.smithi046.stdout:4/647: dread d7/df/d3a/d25/d81/d98/fbc [0,4194304] 0 2024-05-09T06:30:49.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/656: symlink d7/d10/d34/ldc 0 2024-05-09T06:30:49.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/657: chown d7/d10/d34/d46/d81/f9e 47511 1 2024-05-09T06:30:49.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/658: truncate d7/d10/d28/d30/fa1 890796 0 2024-05-09T06:30:49.239 INFO:tasks.workunit.client.0.smithi046.stdout:6/784: mknod db/d10/d30/d53/c101 0 2024-05-09T06:30:49.239 INFO:tasks.workunit.client.0.smithi046.stdout:6/785: write db/d10/d3f/d44/d74/ffc [907429,128180] 0 2024-05-09T06:30:49.240 INFO:tasks.workunit.client.0.smithi046.stdout:4/648: link d7/df/c12 d7/df/cc7 0 2024-05-09T06:30:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:4/649: dread - d7/df/d3a/d25/f70 zero size 2024-05-09T06:30:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/659: mkdir d7/d6d/ddd 0 2024-05-09T06:30:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/660: fdatasync d7/d10/d28/d55/f6f 0 2024-05-09T06:30:49.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/661: truncate d7/d6d/fd2 172466 0 2024-05-09T06:30:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:4/650: mkdir d7/df/d53/d91/dc8 0 2024-05-09T06:30:49.247 INFO:tasks.workunit.client.0.smithi046.stdout:4/651: stat d7/df/d10/d1d/ca0 0 2024-05-09T06:30:49.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/662: dread d7/f19 [0,4194304] 0 2024-05-09T06:30:49.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/663: fsync d7/d10/d28/d30/dcf/f3b 0 2024-05-09T06:30:49.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/664: read - d7/d10/d28/d55/f6f zero size 2024-05-09T06:30:49.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/786: dwrite db/d93/f7e [0,4194304] 0 2024-05-09T06:30:49.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/787: truncate db/d10/d3f/d44/d74/ffc 1458166 0 2024-05-09T06:30:49.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/665: link d7/d10/d34/d46/l66 d7/d10/d84/lde 0 2024-05-09T06:30:49.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/666: dread - d7/d10/d28/d55/f6a zero size 2024-05-09T06:30:49.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/667: readlink d7/d6d/l89 0 2024-05-09T06:30:49.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/788: write db/d10/d3f/d44/d5e/fa6 [1794056,115576] 0 2024-05-09T06:30:49.266 INFO:tasks.workunit.client.0.smithi046.stdout:4/652: dwrite d7/df/d10/d1d/f62 [0,4194304] 0 2024-05-09T06:30:49.266 INFO:tasks.workunit.client.0.smithi046.stdout:1/668: dread d7/d10/d28/d30/f95 [4194304,4194304] 0 2024-05-09T06:30:49.269 INFO:tasks.workunit.client.0.smithi046.stdout:1/669: rename d7/d10/d28/d30/dcf/d76/cc2 to d7/da3/cdf 0 2024-05-09T06:30:49.288 INFO:tasks.workunit.client.0.smithi046.stdout:6/789: dwrite db/d10/d30/faf [4194304,4194304] 0 2024-05-09T06:30:49.288 INFO:tasks.workunit.client.0.smithi046.stdout:6/790: truncate db/d10/d6b/fc8 840067 0 2024-05-09T06:30:49.288 INFO:tasks.workunit.client.0.smithi046.stdout:6/791: write db/d10/d3f/d44/d46/d70/fe5 [4359497,61771] 0 2024-05-09T06:30:49.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/653: dwrite d7/df/d3a/d45/d96/f67 [4194304,4194304] 0 2024-05-09T06:30:49.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/654: write d7/df/d3a/d25/f5f [1709902,12272] 0 2024-05-09T06:30:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:6/792: write f6 [5754430,44383] 0 2024-05-09T06:30:49.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/655: dwrite d7/f90 [0,4194304] 0 2024-05-09T06:30:49.301 INFO:tasks.workunit.client.0.smithi046.stdout:6/793: creat db/d10/d3f/d44/d74/db6/f102 x:0 0 0 2024-05-09T06:30:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/794: stat db/d10/d3c/d91/cfb 0 2024-05-09T06:30:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/795: chown db/d10/d3f/d4f/d8a/l9b 8571 1 2024-05-09T06:30:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/796: chown db/d10/f16 898227 1 2024-05-09T06:30:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/797: read db/d10/d3f/d4f/d8a/d9e/ff2 [214915,27903] 0 2024-05-09T06:30:49.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/656: symlink d7/df/d10/d1d/d77/lc9 0 2024-05-09T06:30:49.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/798: mkdir db/d10/dfa/d103 0 2024-05-09T06:30:49.312 INFO:tasks.workunit.client.0.smithi046.stdout:4/657: mknod d7/df/d10/d1d/d77/cca 0 2024-05-09T06:30:49.314 INFO:tasks.workunit.client.0.smithi046.stdout:6/799: rmdir db/d10/dfa/d103 0 2024-05-09T06:30:49.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/658: creat d7/df/d10/d1d/db9/fcb x:0 0 0 2024-05-09T06:30:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:4/659: truncate d7/df/d10/d2f/f50 1639334 0 2024-05-09T06:30:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:1/670: dwrite d7/f2c [0,4194304] 0 2024-05-09T06:30:49.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/660: rename d7/df/c12 to d7/df/d10/d1d/d77/d87/dac/ccc 0 2024-05-09T06:30:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/800: mkdir db/d10/d30/d53/d104 0 2024-05-09T06:30:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/801: truncate db/d10/d3f/d44/fb8 413908 0 2024-05-09T06:30:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/802: dread - db/d10/d19/fab zero size 2024-05-09T06:30:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/803: creat db/d10/d3f/d4f/d8a/d9e/f105 x:0 0 0 2024-05-09T06:30:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/804: fdatasync db/d10/d3f/d4f/d8a/d9e/f105 0 2024-05-09T06:30:49.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/478: sync 2024-05-09T06:30:49.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/479: dread - d2/d6/f9b zero size 2024-05-09T06:30:49.323 INFO:tasks.workunit.client.0.smithi046.stdout:9/480: write d2/dc/f4d [732222,85382] 0 2024-05-09T06:30:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:1/671: rmdir d7/d6d 39 2024-05-09T06:30:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:4/661: mknod d7/df/d3a/d45/d96/db3/ccd 0 2024-05-09T06:30:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:4/662: stat d7/fc0 0 2024-05-09T06:30:49.331 INFO:tasks.workunit.client.0.smithi046.stdout:6/805: dwrite db/d10/d19/f20 [0,4194304] 0 2024-05-09T06:30:49.331 INFO:tasks.workunit.client.0.smithi046.stdout:6/806: chown db/d10/d3f/d4f/d8a/d9e/fec 87208 1 2024-05-09T06:30:49.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/481: mknod d2/d6/c9c 0 2024-05-09T06:30:49.333 INFO:tasks.workunit.client.0.smithi046.stdout:1/672: rename d7/d10/d28/d30/dcf/d7f/c8a to d7/d10/d28/d30/dcf/ce0 0 2024-05-09T06:30:49.333 INFO:tasks.workunit.client.0.smithi046.stdout:1/673: dread - d7/d10/d28/d30/f5e zero size 2024-05-09T06:30:49.333 INFO:tasks.workunit.client.0.smithi046.stdout:1/674: fdatasync d7/d10/f13 0 2024-05-09T06:30:49.334 INFO:tasks.workunit.client.0.smithi046.stdout:6/807: mkdir db/d10/d3f/d4f/d106 0 2024-05-09T06:30:49.336 INFO:tasks.workunit.client.0.smithi046.stdout:9/482: mkdir d2/d6/d8b/d9d 0 2024-05-09T06:30:49.338 INFO:tasks.workunit.client.0.smithi046.stdout:1/675: mkdir d7/d10/d84/de1 0 2024-05-09T06:30:49.339 INFO:tasks.workunit.client.0.smithi046.stdout:1/676: dread d7/d10/d34/d46/d81/fb6 [0,4194304] 0 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/653: sync 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:2/672: sync 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/662: sync 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:8/768: sync 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:5/641: sync 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/654: truncate d4/d20/d24/d29/d7a/fa4 251541 0 2024-05-09T06:30:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/655: truncate d4/d20/d24/d29/d2b/d94/d5c/d6c/fa1 1011397 0 2024-05-09T06:30:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:7/892: sync 2024-05-09T06:30:49.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/663: creat d11/d18/d27/d28/d36/fd1 x:0 0 0 2024-05-09T06:30:49.349 INFO:tasks.workunit.client.0.smithi046.stdout:4/663: read d7/f72 [7484994,35735] 0 2024-05-09T06:30:49.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/642: rename d0/d58/lab to d0/d3e/d53/ldc 0 2024-05-09T06:30:49.351 INFO:tasks.workunit.client.0.smithi046.stdout:3/656: creat d4/d5/dac/fdb x:0 0 0 2024-05-09T06:30:49.352 INFO:tasks.workunit.client.0.smithi046.stdout:1/677: write d7/d10/d28/d30/f36 [2684260,45477] 0 2024-05-09T06:30:49.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/808: dwrite db/d10/d3f/d44/d46/fc5 [0,4194304] 0 2024-05-09T06:30:49.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/809: creat db/d93/d96/dd1/f107 x:0 0 0 2024-05-09T06:30:49.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/810: creat db/d10/d3f/d44/d5e/dbe/f108 x:0 0 0 2024-05-09T06:30:49.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/811: fsync db/d10/d76/fe2 0 2024-05-09T06:30:49.354 INFO:tasks.workunit.client.0.smithi046.stdout:8/769: getdents d1/d7/d12/d1d 0 2024-05-09T06:30:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/673: rmdir da/de/d14/d1f/d3b/d9f 39 2024-05-09T06:30:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/674: fdatasync da/de/d14/d1f/d97/dcd/d7d/dc5/f72 0 2024-05-09T06:30:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/675: stat da/de/d54/d65/d70/fb9 0 2024-05-09T06:30:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/676: chown da/de/d14/d1f/d97/dcd/d7d/dc5/f83 63193470 1 2024-05-09T06:30:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/677: write da/de/d14/d1f/d20/f5a [4366633,36442] 0 2024-05-09T06:30:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:7/893: dwrite d3/d7/dd/d3e/fb3 [0,4194304] 0 2024-05-09T06:30:49.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/894: read d3/d7/d28/d29/d3b/f4a [1592214,29652] 0 2024-05-09T06:30:49.359 INFO:tasks.workunit.client.0.smithi046.stdout:0/664: write d11/d4f/d5b/d5f/fcc [790073,37217] 0 2024-05-09T06:30:49.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/657: symlink d4/d20/d24/d29/d2b/d94/dd3/ldc 0 2024-05-09T06:30:49.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/658: fsync d4/d20/d41/f63 0 2024-05-09T06:30:49.361 INFO:tasks.workunit.client.0.smithi046.stdout:0/665: dread d11/d18/d1c/d56/f74 [0,4194304] 0 2024-05-09T06:30:49.361 INFO:tasks.workunit.client.0.smithi046.stdout:4/664: dread d7/fb [0,4194304] 0 2024-05-09T06:30:49.365 INFO:tasks.workunit.client.0.smithi046.stdout:4/665: dread d7/f1e [0,4194304] 0 2024-05-09T06:30:49.365 INFO:tasks.workunit.client.0.smithi046.stdout:4/666: chown f4 13566 1 2024-05-09T06:30:49.366 INFO:tasks.workunit.client.0.smithi046.stdout:4/667: write d7/df/d3a/d25/f70 [214611,6229] 0 2024-05-09T06:30:49.373 INFO:tasks.workunit.client.0.smithi046.stdout:6/812: creat db/d10/dfa/f109 x:0 0 0 2024-05-09T06:30:49.373 INFO:tasks.workunit.client.0.smithi046.stdout:6/813: dread - db/d10/d76/f9a zero size 2024-05-09T06:30:49.373 INFO:tasks.workunit.client.0.smithi046.stdout:6/814: dread - db/d93/d96/dd1/f107 zero size 2024-05-09T06:30:49.373 INFO:tasks.workunit.client.0.smithi046.stdout:6/815: readlink db/d10/d3f/d44/d46/d70/le7 0 2024-05-09T06:30:49.374 INFO:tasks.workunit.client.0.smithi046.stdout:8/770: mkdir d1/d7/d12/d1d/d30/dbd/dc6/de3 0 2024-05-09T06:30:49.378 INFO:tasks.workunit.client.0.smithi046.stdout:2/678: mknod da/de/d54/d65/d6c/cd8 0 2024-05-09T06:30:49.385 INFO:tasks.workunit.client.0.smithi046.stdout:0/666: mknod d11/d18/d27/cd2 0 2024-05-09T06:30:49.385 INFO:tasks.workunit.client.0.smithi046.stdout:1/678: getdents d7 0 2024-05-09T06:30:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/668: rename d7/df/d10/d1d/d77/d87/f8f to d7/df/d10/d2f/fce 0 2024-05-09T06:30:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/669: write d7/df/d10/f79 [1563819,33688] 0 2024-05-09T06:30:49.390 INFO:tasks.workunit.client.0.smithi046.stdout:6/816: link db/d10/d6b/cd8 db/d10/dfa/c10a 0 2024-05-09T06:30:49.390 INFO:tasks.workunit.client.0.smithi046.stdout:6/817: readlink db/l12 0 2024-05-09T06:30:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/771: truncate d1/db/d67/f7e 678946 0 2024-05-09T06:30:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:4/670: dread d7/df/d3a/f76 [0,4194304] 0 2024-05-09T06:30:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:4/671: stat d7/df/d3a/f76 0 2024-05-09T06:30:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:2/679: getdents da/de/d14/d1f/d97/dcd/d7d/dc5/d3d 0 2024-05-09T06:30:49.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/667: creat d11/d18/d27/d28/d2d/d5c/fd3 x:0 0 0 2024-05-09T06:30:49.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/668: dread - d11/d18/d27/d28/d2d/d5c/f8f zero size 2024-05-09T06:30:49.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/772: rename d1/d7/d12/d1d/d30/d38/db4/lcc to d1/db/dd/d11/d43/le4 0 2024-05-09T06:30:49.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/680: creat da/de/d54/fd9 x:0 0 0 2024-05-09T06:30:49.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/681: creat da/de/d14/d1f/d97/fda x:0 0 0 2024-05-09T06:30:49.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/682: fdatasync f7 0 2024-05-09T06:30:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/683: mkdir da/d2d/d43/dc2/ddb 0 2024-05-09T06:30:49.446 INFO:tasks.workunit.client.0.smithi046.stdout:7/895: dwrite d3/d7/d28/d29/d3b/f70 [0,4194304] 0 2024-05-09T06:30:49.446 INFO:tasks.workunit.client.0.smithi046.stdout:7/896: readlink d3/d7/d28/d73/lb8 0 2024-05-09T06:30:49.446 INFO:tasks.workunit.client.0.smithi046.stdout:7/897: chown d3/d7/d4c/d4f/d121/d5b 43291 1 2024-05-09T06:30:49.452 INFO:tasks.workunit.client.0.smithi046.stdout:4/672: dwrite d7/f71 [0,4194304] 0 2024-05-09T06:30:49.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/673: stat d7/df/d3a/d45/dc6 0 2024-05-09T06:30:49.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/818: dwrite db/d10/d30/f4a [0,4194304] 0 2024-05-09T06:30:49.454 INFO:tasks.workunit.client.0.smithi046.stdout:1/679: dwrite d7/fda [0,4194304] 0 2024-05-09T06:30:49.454 INFO:tasks.workunit.client.0.smithi046.stdout:1/680: fdatasync d7/d10/d34/fce 0 2024-05-09T06:30:49.454 INFO:tasks.workunit.client.0.smithi046.stdout:2/684: dwrite da/de/d14/d1f/d97/dcd/d7d/dc5/d3d/faf [0,4194304] 0 2024-05-09T06:30:49.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/819: dread db/d10/d3f/d4f/d8a/d9e/fec [0,4194304] 0 2024-05-09T06:30:49.457 INFO:tasks.workunit.client.0.smithi046.stdout:7/898: write d3/d7/d4c/ff1 [2900765,56456] 0 2024-05-09T06:30:49.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/669: dwrite d11/d18/d27/d28/d6b/fcf [0,4194304] 0 2024-05-09T06:30:49.457 INFO:tasks.workunit.client.0.smithi046.stdout:7/899: chown d3/d7/d4c/d4f/d121/f41 0 1 2024-05-09T06:30:49.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/773: rmdir d1 39 2024-05-09T06:30:49.463 INFO:tasks.workunit.client.0.smithi046.stdout:4/674: unlink d7/df/d3a/d25/d81/c99 0 2024-05-09T06:30:49.472 INFO:tasks.workunit.client.0.smithi046.stdout:4/675: dread d7/df/d10/f9f [0,4194304] 0 2024-05-09T06:30:49.473 INFO:tasks.workunit.client.0.smithi046.stdout:4/676: fdatasync d7/df/d3a/f83 0 2024-05-09T06:30:49.474 INFO:tasks.workunit.client.0.smithi046.stdout:1/681: truncate d7/d6d/f9f 398129 0 2024-05-09T06:30:49.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/670: dwrite d11/d4f/d5b/fbd [0,4194304] 0 2024-05-09T06:30:49.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/671: read - d11/f52 zero size 2024-05-09T06:30:49.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/685: symlink da/de/d14/d1f/d3b/ldc 0 2024-05-09T06:30:49.477 INFO:tasks.workunit.client.0.smithi046.stdout:8/774: dwrite d1/db/f71 [0,4194304] 0 2024-05-09T06:30:49.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/820: mknod db/d10/d3f/d44/d46/d70/c10b 0 2024-05-09T06:30:49.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/682: symlink d7/da3/dc5/dd5/le2 0 2024-05-09T06:30:49.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/672: rmdir d11/d18/d27 39 2024-05-09T06:30:49.493 INFO:tasks.workunit.client.0.smithi046.stdout:2/686: link da/de/d14/d1f/d3b/l71 da/de/d14/d1f/d20/d4e/ldd 0 2024-05-09T06:30:49.497 INFO:tasks.workunit.client.0.smithi046.stdout:8/775: symlink d1/d7/d12/d1d/d30/dda/le5 0 2024-05-09T06:30:49.497 INFO:tasks.workunit.client.0.smithi046.stdout:8/776: stat d1/db/dd/d11/d5d/d95 0 2024-05-09T06:30:49.497 INFO:tasks.workunit.client.0.smithi046.stdout:8/777: fsync d1/d7/d12/d45/f4c 0 2024-05-09T06:30:49.497 INFO:tasks.workunit.client.0.smithi046.stdout:8/778: dread - d1/db/dd/d11/d5d/f9a zero size 2024-05-09T06:30:49.498 INFO:tasks.workunit.client.0.smithi046.stdout:6/821: mkdir db/d10/d57/d10c 0 2024-05-09T06:30:49.498 INFO:tasks.workunit.client.0.smithi046.stdout:6/822: write db/f42 [1308469,107686] 0 2024-05-09T06:30:49.507 INFO:tasks.workunit.client.0.smithi046.stdout:4/677: rmdir d7/df 39 2024-05-09T06:30:49.509 INFO:tasks.workunit.client.0.smithi046.stdout:1/683: rename d7/d10/d28/d55/f6a to d7/d10/d34/fe3 0 2024-05-09T06:30:49.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/684: dread - d7/d10/d28/d30/dcf/fba zero size 2024-05-09T06:30:49.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/685: chown d7/d10/d34/ldc 178494178 1 2024-05-09T06:30:49.510 INFO:tasks.workunit.client.0.smithi046.stdout:0/673: truncate d11/d18/d27/d28/d36/f95 1620630 0 2024-05-09T06:30:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/687: symlink da/de/d14/d1f/lde 0 2024-05-09T06:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:8/779: mknod d1/d7/ce6 0 2024-05-09T06:30:49.514 INFO:tasks.workunit.client.0.smithi046.stdout:4/678: rmdir d7/df/d53 39 2024-05-09T06:30:49.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/823: rename db/d10/d3f/d44/d46/lcf to db/d10/d3f/d44/d5e/l10d 0 2024-05-09T06:30:49.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/688: symlink da/de/d14/d1f/d3b/d9f/ldf 0 2024-05-09T06:30:49.519 INFO:tasks.workunit.client.0.smithi046.stdout:4/679: link d7/df/d3a/d25/d86/lc1 d7/df/d3a/d45/lcf 0 2024-05-09T06:30:49.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/674: write d11/d18/f39 [1056031,130936] 0 2024-05-09T06:30:49.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/686: rename d7/d10/d34/c85 to d7/d10/d28/ce4 0 2024-05-09T06:30:49.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/687: write d7/d10/d28/d30/dcf/d76/fb3 [53891,116632] 0 2024-05-09T06:30:49.523 INFO:tasks.workunit.client.0.smithi046.stdout:2/689: creat da/de/d14/d1f/d97/dcd/d7d/dc5/d3d/fe0 x:0 0 0 2024-05-09T06:30:49.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/675: mknod d11/d18/d27/d28/d36/d91/d98/db0/cd4 0 2024-05-09T06:30:49.529 INFO:tasks.workunit.client.0.smithi046.stdout:6/824: rename db/d10/d3f/d44/f48 to db/d10/d57/d10c/f10e 0 2024-05-09T06:30:49.529 INFO:tasks.workunit.client.0.smithi046.stdout:6/825: chown db/d10/d3f/d4f/d8a/d9e/lde 894433 1 2024-05-09T06:30:49.529 INFO:tasks.workunit.client.0.smithi046.stdout:6/826: fsync db/d10/d30/f77 0 2024-05-09T06:30:49.529 INFO:tasks.workunit.client.0.smithi046.stdout:6/827: truncate db/d10/d6b/f8f 5216756 0 2024-05-09T06:30:49.530 INFO:tasks.workunit.client.0.smithi046.stdout:8/780: dwrite d1/db/f28 [8388608,4194304] 0 2024-05-09T06:30:49.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/688: truncate d7/d10/f23 2421755 0 2024-05-09T06:30:49.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/690: symlink da/de/d14/d1f/d97/dae/le1 0 2024-05-09T06:30:49.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/691: readlink da/de/d54/d65/dbc/lbf 0 2024-05-09T06:30:49.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/692: readlink da/de/d54/d65/d6c/l90 0 2024-05-09T06:30:49.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/680: rmdir d7 39 2024-05-09T06:30:49.537 INFO:tasks.workunit.client.0.smithi046.stdout:0/676: symlink d11/d18/d27/d28/ld5 0 2024-05-09T06:30:49.537 INFO:tasks.workunit.client.0.smithi046.stdout:0/677: readlink d11/d18/d27/d28/d36/d5a/l65 0 2024-05-09T06:30:49.545 INFO:tasks.workunit.client.0.smithi046.stdout:4/681: write d7/df/fa3 [1013271,3348] 0 2024-05-09T06:30:49.548 INFO:tasks.workunit.client.0.smithi046.stdout:8/781: creat d1/db/d41/fe7 x:0 0 0 2024-05-09T06:30:49.549 INFO:tasks.workunit.client.0.smithi046.stdout:1/689: creat d7/d10/d28/d30/dcf/d75/fe5 x:0 0 0 2024-05-09T06:30:49.550 INFO:tasks.workunit.client.0.smithi046.stdout:1/690: read d7/d10/d34/d46/d81/f91 [118223,56033] 0 2024-05-09T06:30:49.551 INFO:tasks.workunit.client.0.smithi046.stdout:1/691: readlink d7/d10/d28/d55/l73 0 2024-05-09T06:30:49.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/693: dwrite da/de/d54/d65/d70/fb9 [0,4194304] 0 2024-05-09T06:30:49.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/694: chown da/de/d14/d1f/d97/dcd/d7d/dc5/f72 11849169 1 2024-05-09T06:30:49.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/695: chown da/de/d14/d1f/d20/d5c/l75 9025 1 2024-05-09T06:30:49.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/696: chown da/de/d14/fb8 171109 1 2024-05-09T06:30:49.557 INFO:tasks.workunit.client.0.smithi046.stdout:6/828: mkdir db/d10/d30/d53/d10f 0 2024-05-09T06:30:49.559 INFO:tasks.workunit.client.0.smithi046.stdout:2/697: unlink da/de/d14/d1f/l80 0 2024-05-09T06:30:49.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/782: dwrite d1/f33 [0,4194304] 0 2024-05-09T06:30:49.588 INFO:tasks.workunit.client.0.smithi046.stdout:2/698: dwrite da/de/d14/f8a [0,4194304] 0 2024-05-09T06:30:49.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/699: fdatasync da/de/d1c/fd3 0 2024-05-09T06:30:49.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/700: chown da/de/d14/d1f/d97 2 1 2024-05-09T06:30:49.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/692: dwrite d7/d10/d28/d30/dcf/d76/f7a [0,4194304] 0 2024-05-09T06:30:49.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/682: dwrite d7/df/d3a/f76 [0,4194304] 0 2024-05-09T06:30:49.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/683: fdatasync d7/df/d10/d1d/db9/fcb 0 2024-05-09T06:30:49.592 INFO:tasks.workunit.client.0.smithi046.stdout:2/701: mkdir da/de/d54/d65/d6c/de2 0 2024-05-09T06:30:49.597 INFO:tasks.workunit.client.0.smithi046.stdout:4/684: symlink d7/df/d53/ld0 0 2024-05-09T06:30:49.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/702: creat da/de/d54/d65/fe3 x:0 0 0 2024-05-09T06:30:49.607 INFO:tasks.workunit.client.0.smithi046.stdout:1/693: rmdir d7/d10/d84/da8 39 2024-05-09T06:30:49.608 INFO:tasks.workunit.client.0.smithi046.stdout:4/685: rmdir d7/df/d10/d1d/d77/d87/dac 39 2024-05-09T06:30:49.615 INFO:tasks.workunit.client.0.smithi046.stdout:8/783: rename d1/db/d41 to d1/db/dd/d11/d5d/d99/de8 0 2024-05-09T06:30:49.615 INFO:tasks.workunit.client.0.smithi046.stdout:8/784: chown d1/db/dd/d11/d5d/f9a 0 1 2024-05-09T06:30:49.616 INFO:tasks.workunit.client.0.smithi046.stdout:1/694: mkdir d7/d10/d28/d30/dcf/d7f/de6 0 2024-05-09T06:30:49.616 INFO:tasks.workunit.client.0.smithi046.stdout:1/695: stat d7/d10/d28/d30/dcf/d76/fb3 0 2024-05-09T06:30:49.618 INFO:tasks.workunit.client.0.smithi046.stdout:8/785: mkdir d1/db/dd/d11/d43/d81/de9 0 2024-05-09T06:30:49.618 INFO:tasks.workunit.client.0.smithi046.stdout:8/786: write d1/d7/d12/f89 [1461234,3604] 0 2024-05-09T06:30:49.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/696: mknod d7/d10/d28/d30/dcf/ce7 0 2024-05-09T06:30:49.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/697: truncate d7/da3/fab 377118 0 2024-05-09T06:30:49.620 INFO:tasks.workunit.client.0.smithi046.stdout:8/787: mknod d1/db/dd/d11/d43/d81/de9/cea 0 2024-05-09T06:30:49.623 INFO:tasks.workunit.client.0.smithi046.stdout:1/698: mkdir d7/d10/d28/d30/dcf/d76/de8 0 2024-05-09T06:30:49.624 INFO:tasks.workunit.client.0.smithi046.stdout:8/788: mkdir d1/db/dd/d11/d5d/deb 0 2024-05-09T06:30:49.624 INFO:tasks.workunit.client.0.smithi046.stdout:8/789: getdents d1/d7/d12/d1d 0 2024-05-09T06:30:49.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/699: link d7/d10/d34/fe3 d7/d10/d28/d55/fe9 0 2024-05-09T06:30:49.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/700: readlink d7/d10/d28/l83 0 2024-05-09T06:30:49.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/703: dwrite da/de/d14/d1f/d97/dcd/d7d/dc5/d3a/f64 [0,4194304] 0 2024-05-09T06:30:49.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/704: truncate da/de/d14/d1f/f8f 280218 0 2024-05-09T06:30:49.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/790: rename d1/d7/dcd/ddf/fe0 to d1/fec 0 2024-05-09T06:30:49.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/701: rmdir d7/d10/d28/d30/da0 39 2024-05-09T06:30:49.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/705: unlink da/d2d/d43/f68 0 2024-05-09T06:30:49.640 INFO:tasks.workunit.client.0.smithi046.stdout:1/702: creat d7/d10/d84/de1/fea x:0 0 0 2024-05-09T06:30:49.641 INFO:tasks.workunit.client.0.smithi046.stdout:2/706: creat da/d2d/d43/dc2/fe4 x:0 0 0 2024-05-09T06:30:49.644 INFO:tasks.workunit.client.0.smithi046.stdout:2/707: creat da/de/d1c/fe5 x:0 0 0 2024-05-09T06:30:49.646 INFO:tasks.workunit.client.0.smithi046.stdout:8/791: dwrite d1/d7/fd5 [0,4194304] 0 2024-05-09T06:30:49.646 INFO:tasks.workunit.client.0.smithi046.stdout:8/792: dread - d1/db/dd/d11/d5d/d95/fd9 zero size 2024-05-09T06:30:49.646 INFO:tasks.workunit.client.0.smithi046.stdout:8/793: write d1/db/dd/f1a [589988,105893] 0 2024-05-09T06:30:49.651 INFO:tasks.workunit.client.0.smithi046.stdout:8/794: rename d1/d7/d12/d1d/d30/d38/l92 to d1/db/dd/d11/d43/dc1/led 0 2024-05-09T06:30:49.652 INFO:tasks.workunit.client.0.smithi046.stdout:1/703: dread d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:49.658 INFO:tasks.workunit.client.0.smithi046.stdout:2/708: dwrite da/de/d14/d1f/d3b/d9f/faa [0,4194304] 0 2024-05-09T06:30:49.662 INFO:tasks.workunit.client.0.smithi046.stdout:8/795: write d1/d7/d2c/f5b [3351195,6188] 0 2024-05-09T06:30:49.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/704: dwrite d7/d10/d34/fd1 [0,4194304] 0 2024-05-09T06:30:49.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/709: mknod da/de/d14/d1f/ce6 0 2024-05-09T06:30:49.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/710: readlink da/de/l31 0 2024-05-09T06:30:49.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/796: dread d1/d7/d2c/f5b [0,4194304] 0 2024-05-09T06:30:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/711: stat da/de/d14/d1f/d20/cbb 0 2024-05-09T06:30:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/712: write da/de/d14/d1f/d97/dcd/d7d/dc5/f83 [1311443,37000] 0 2024-05-09T06:30:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/705: dread d7/d10/d28/d30/dcf/d7f/f96 [0,4194304] 0 2024-05-09T06:30:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:8/797: mknod d1/db/dd/d11/cee 0 2024-05-09T06:30:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:8/798: write d1/fec [821934,7211] 0 2024-05-09T06:30:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:8/799: readlink d1/d7/d12/d1d/laa 0 2024-05-09T06:30:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:1/706: getdents d7/d6d 0 2024-05-09T06:30:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:1/707: creat d7/d10/d34/feb x:0 0 0 2024-05-09T06:30:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:1/708: chown d7/fc 33532 1 2024-05-09T06:30:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:8/800: rmdir d1/db 39 2024-05-09T06:30:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/709: symlink d7/d6d/ddd/lec 0 2024-05-09T06:30:49.681 INFO:tasks.workunit.client.0.smithi046.stdout:1/710: link d7/d10/d28/l83 d7/d10/d34/d46/d81/led 0 2024-05-09T06:30:49.681 INFO:tasks.workunit.client.0.smithi046.stdout:1/711: readlink d7/l39 0 2024-05-09T06:30:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/713: dwrite da/de/d54/d65/d70/fb9 [4194304,4194304] 0 2024-05-09T06:30:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/714: dread - da/de/d54/d65/fe3 zero size 2024-05-09T06:30:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:2/715: link da/de/f46 da/de/d1c/fe7 0 2024-05-09T06:30:49.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/712: dwrite d7/d10/d34/fd1 [0,4194304] 0 2024-05-09T06:30:49.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/713: rmdir d7/d10/d34/d46 39 2024-05-09T06:30:49.698 INFO:tasks.workunit.client.0.smithi046.stdout:8/801: dwrite d1/d7/d12/d1d/d30/dbd/f7c [0,4194304] 0 2024-05-09T06:30:49.699 INFO:tasks.workunit.client.0.smithi046.stdout:8/802: write d1/db/d67/d6e/fc8 [345428,67195] 0 2024-05-09T06:30:49.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/714: dread d7/d10/f54 [0,4194304] 0 2024-05-09T06:30:49.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/715: truncate d7/d10/d34/d46/d81/f9a 1856733 0 2024-05-09T06:30:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/803: getdents d1/db/d67/d6e 0 2024-05-09T06:30:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:8/804: mkdir d1/d7/d12/d1d/d30/dda/def 0 2024-05-09T06:30:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:1/716: write d7/d10/d34/f6e [3757414,17474] 0 2024-05-09T06:30:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:1/717: write d7/d10/d28/d30/dcf/f3c [1070832,7063] 0 2024-05-09T06:30:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:8/805: write d1/db/dd/d11/d43/f4b [583082,102928] 0 2024-05-09T06:30:49.717 INFO:tasks.workunit.client.0.smithi046.stdout:8/806: write d1/d7/d12/f79 [633652,80902] 0 2024-05-09T06:30:49.717 INFO:tasks.workunit.client.0.smithi046.stdout:8/807: write d1/db/dd/d11/d5d/fdb [4979454,26925] 0 2024-05-09T06:30:49.726 INFO:tasks.workunit.client.0.smithi046.stdout:8/808: dread d1/db/dd/d11/f5c [0,4194304] 0 2024-05-09T06:30:49.728 INFO:tasks.workunit.client.0.smithi046.stdout:8/809: stat d1/db/c70 0 2024-05-09T06:30:49.728 INFO:tasks.workunit.client.0.smithi046.stdout:8/810: fsync d1/db/dd/f1a 0 2024-05-09T06:30:49.731 INFO:tasks.workunit.client.0.smithi046.stdout:8/811: symlink d1/d7/d12/d1d/d30/dda/def/lf0 0 2024-05-09T06:30:49.736 INFO:tasks.workunit.client.0.smithi046.stdout:1/718: dwrite d7/d10/d28/f59 [0,4194304] 0 2024-05-09T06:30:49.737 INFO:tasks.workunit.client.0.smithi046.stdout:8/812: dread d1/db/dd/d11/d43/fac [0,4194304] 0 2024-05-09T06:30:49.738 INFO:tasks.workunit.client.0.smithi046.stdout:8/813: chown d1/db/dd/d11/d43/le4 475128019 1 2024-05-09T06:30:49.738 INFO:tasks.workunit.client.0.smithi046.stdout:8/814: write d1/db/f28 [286083,1304] 0 2024-05-09T06:30:49.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/719: symlink d7/d10/d34/lee 0 2024-05-09T06:30:49.746 INFO:tasks.workunit.client.0.smithi046.stdout:8/815: mknod d1/db/d67/d6e/cf1 0 2024-05-09T06:30:49.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/816: fdatasync d1/db/dd/f1a 0 2024-05-09T06:30:49.748 INFO:tasks.workunit.client.0.smithi046.stdout:1/720: creat d7/dd6/fef x:0 0 0 2024-05-09T06:30:49.748 INFO:tasks.workunit.client.0.smithi046.stdout:1/721: write d7/d10/d34/d46/d86/fb0 [3662050,100770] 0 2024-05-09T06:30:49.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/817: mkdir d1/db/dd/d11/d5d/d99/de8/df2 0 2024-05-09T06:30:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:8/818: rename d1/d7/f68 to d1/d7/d12/d1d/d30/d38/dc0/ff3 0 2024-05-09T06:30:49.757 INFO:tasks.workunit.client.0.smithi046.stdout:1/722: dread d7/d10/d28/f4f [0,4194304] 0 2024-05-09T06:30:49.758 INFO:tasks.workunit.client.0.smithi046.stdout:8/819: creat d1/db/ff4 x:0 0 0 2024-05-09T06:30:49.759 INFO:tasks.workunit.client.0.smithi046.stdout:1/723: symlink d7/d6d/lf0 0 2024-05-09T06:30:49.761 INFO:tasks.workunit.client.0.smithi046.stdout:8/820: unlink d1/db/dd/f7d 0 2024-05-09T06:30:49.761 INFO:tasks.workunit.client.0.smithi046.stdout:8/821: chown d1/db/dd/d11/d5d/d99/de8/c9e 102484922 1 2024-05-09T06:30:49.762 INFO:tasks.workunit.client.0.smithi046.stdout:1/724: mkdir d7/d10/d28/d30/df1 0 2024-05-09T06:30:49.768 INFO:tasks.workunit.client.0.smithi046.stdout:8/822: mknod d1/d7/d12/d1d/cf5 0 2024-05-09T06:30:49.768 INFO:tasks.workunit.client.0.smithi046.stdout:8/823: fdatasync d1/d7/fd5 0 2024-05-09T06:30:49.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/725: creat d7/d10/d34/d46/ff2 x:0 0 0 2024-05-09T06:30:49.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/824: rename d1/d7/d12/d1d/d30/dbd/c40 to d1/db/dd/d11/d43/dc1/cf6 0 2024-05-09T06:30:49.782 INFO:tasks.workunit.client.0.smithi046.stdout:8/825: chown d1/db/dd/f13 527 1 2024-05-09T06:30:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/483: sync 2024-05-09T06:30:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/643: sync 2024-05-09T06:30:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/484: write d2/d26/d2c/d3d/f5b [1371808,114846] 0 2024-05-09T06:30:49.785 INFO:tasks.workunit.client.0.smithi046.stdout:1/726: creat d7/d10/d28/d30/dcf/d76/de8/ff3 x:0 0 0 2024-05-09T06:30:49.786 INFO:tasks.workunit.client.0.smithi046.stdout:8/826: mknod d1/d7/d12/d1d/d30/cf7 0 2024-05-09T06:30:49.797 INFO:tasks.workunit.client.0.smithi046.stdout:5/644: dread d0/f1 [0,4194304] 0 2024-05-09T06:30:49.797 INFO:tasks.workunit.client.0.smithi046.stdout:9/485: mknod d2/c9e 0 2024-05-09T06:30:49.798 INFO:tasks.workunit.client.0.smithi046.stdout:5/645: symlink d0/db3/ldd 0 2024-05-09T06:30:49.799 INFO:tasks.workunit.client.0.smithi046.stdout:9/486: mknod d2/dc/d32/c9f 0 2024-05-09T06:30:49.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/487: dread d2/d26/d2c/f50 [0,4194304] 0 2024-05-09T06:30:49.803 INFO:tasks.workunit.client.0.smithi046.stdout:9/488: unlink d2/d6/d8b/c8c 0 2024-05-09T06:30:49.805 INFO:tasks.workunit.client.0.smithi046.stdout:5/646: rename d0/d1b/d39/f5c to d0/db3/fde 0 2024-05-09T06:30:49.805 INFO:tasks.workunit.client.0.smithi046.stdout:5/647: chown d0/d3e/d53/f97 12 1 2024-05-09T06:30:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/489: symlink d2/d6/d8b/la0 0 2024-05-09T06:30:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/490: chown d2/d6/d7/d1e/f58 963480531 1 2024-05-09T06:30:49.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/727: dwrite d7/d10/d34/feb [0,4194304] 0 2024-05-09T06:30:49.814 INFO:tasks.workunit.client.0.smithi046.stdout:8/827: dwrite d1/db/dd/d11/f5c [0,4194304] 0 2024-05-09T06:30:49.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/491: rmdir d2 39 2024-05-09T06:30:49.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/728: read d7/d10/d34/feb [2999743,120482] 0 2024-05-09T06:30:49.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/729: chown d7/d10/d84/f99 145346 1 2024-05-09T06:30:49.826 INFO:tasks.workunit.client.0.smithi046.stdout:5/648: dwrite d0/d3e/d50/fa8 [0,4194304] 0 2024-05-09T06:30:49.828 INFO:tasks.workunit.client.0.smithi046.stdout:8/828: rename d1/d7/d12/f5e to d1/ddc/ff8 0 2024-05-09T06:30:49.828 INFO:tasks.workunit.client.0.smithi046.stdout:9/492: read d2/d6/f22 [3214878,3356] 0 2024-05-09T06:30:49.829 INFO:tasks.workunit.client.0.smithi046.stdout:5/649: dread d0/d1b/f20 [0,4194304] 0 2024-05-09T06:30:49.829 INFO:tasks.workunit.client.0.smithi046.stdout:5/650: chown d0/d58/d7a/f7b 151844594 1 2024-05-09T06:30:49.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/829: rmdir d1/db/dd 39 2024-05-09T06:30:49.838 INFO:tasks.workunit.client.0.smithi046.stdout:8/830: fsync d1/db/dd/d11/d5d/fdb 0 2024-05-09T06:30:49.838 INFO:tasks.workunit.client.0.smithi046.stdout:9/493: write d2/dc/f89 [2656770,70872] 0 2024-05-09T06:30:49.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/494: dread d2/d26/d2c/d3d/f5b [0,4194304] 0 2024-05-09T06:30:49.845 INFO:tasks.workunit.client.0.smithi046.stdout:9/495: getdents d2/dc 0 2024-05-09T06:30:49.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/496: write d2/d26/d2c/f50 [18265,11103] 0 2024-05-09T06:30:49.847 INFO:tasks.workunit.client.0.smithi046.stdout:9/497: write d2/d26/d2c/d3d/f5b [1472949,14422] 0 2024-05-09T06:30:49.849 INFO:tasks.workunit.client.0.smithi046.stdout:9/498: creat d2/d26/fa1 x:0 0 0 2024-05-09T06:30:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:8/831: dwrite d1/d7/d2c/f5b [0,4194304] 0 2024-05-09T06:30:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:8/832: chown d1/d7/d12/d45/l3e 278 1 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/651: dwrite d0/d1b/f9a [0,4194304] 0 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/652: chown d0/d3e/d83/f8c 3 1 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/653: creat d0/d1b/d21/d81/fdf x:0 0 0 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/654: read - d0/d3e/d83/f9e zero size 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/655: write d0/d58/d7a/fb0 [204008,85372] 0 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/656: fsync d0/d1b/f3d 0 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/657: creat d0/d3e/d50/fe0 x:0 0 0 2024-05-09T06:30:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/658: write d0/d58/d7a/fa7 [330901,9655] 0 2024-05-09T06:30:49.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/659: rmdir d0/d1b/d39/d8b 39 2024-05-09T06:30:49.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/660: mknod d0/d1b/d39/d8a/ce1 0 2024-05-09T06:30:49.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/661: write d0/d1b/d21/f38 [336691,127706] 0 2024-05-09T06:30:49.875 INFO:tasks.workunit.client.0.smithi046.stdout:5/662: symlink d0/d3e/d83/le2 0 2024-05-09T06:30:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/833: dwrite d1/db/dd/f4a [0,4194304] 0 2024-05-09T06:30:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:5/663: symlink d0/d3e/d50/le3 0 2024-05-09T06:30:49.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/664: creat d0/d3e/d53/fe4 x:0 0 0 2024-05-09T06:30:49.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/665: fdatasync d0/d1b/d21/f42 0 2024-05-09T06:30:49.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/499: dwrite d2/d6/d7/f60 [0,4194304] 0 2024-05-09T06:30:49.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/500: stat d2/d6/d7/d1a/d27/d2a/f4e 0 2024-05-09T06:30:49.880 INFO:tasks.workunit.client.0.smithi046.stdout:8/834: mkdir d1/ddc/df9 0 2024-05-09T06:30:49.880 INFO:tasks.workunit.client.0.smithi046.stdout:8/835: stat d1/d7/d12 0 2024-05-09T06:30:49.881 INFO:tasks.workunit.client.0.smithi046.stdout:8/836: write d1/d7/d12/d45/f4c [1020177,115884] 0 2024-05-09T06:30:49.881 INFO:tasks.workunit.client.0.smithi046.stdout:8/837: readlink d1/d7/d12/d1d/d30/dda/def/lf0 0 2024-05-09T06:30:49.889 INFO:tasks.workunit.client.0.smithi046.stdout:5/666: mknod d0/db3/ce5 0 2024-05-09T06:30:49.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/501: dwrite d2/d26/f73 [8388608,4194304] 0 2024-05-09T06:30:49.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/838: mknod d1/db/dd/d11/d43/dc1/cfa 0 2024-05-09T06:30:49.894 INFO:tasks.workunit.client.0.smithi046.stdout:5/667: truncate d0/d3e/d53/f59 1442890 0 2024-05-09T06:30:49.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/839: write d1/d7/d12/f8e [429620,86478] 0 2024-05-09T06:30:49.904 INFO:tasks.workunit.client.0.smithi046.stdout:5/668: symlink d0/d58/le6 0 2024-05-09T06:30:49.904 INFO:tasks.workunit.client.0.smithi046.stdout:5/669: fdatasync d0/d1b/d21/f55 0 2024-05-09T06:30:49.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/840: link d1/d7/d2c/l36 d1/d7/d12/d1d/d30/d38/lfb 0 2024-05-09T06:30:49.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/841: stat d1/db/dd/f1a 0 2024-05-09T06:30:49.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/842: dread - d1/d7/d2c/f98 zero size 2024-05-09T06:30:49.912 INFO:tasks.workunit.client.0.smithi046.stdout:9/502: dwrite d2/d6/d7/f1b [0,4194304] 0 2024-05-09T06:30:49.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/843: mknod d1/d7/d12/d1d/d30/cfc 0 2024-05-09T06:30:49.914 INFO:tasks.workunit.client.0.smithi046.stdout:5/670: dread d0/d1b/d39/d8a/f98 [0,4194304] 0 2024-05-09T06:30:49.915 INFO:tasks.workunit.client.0.smithi046.stdout:5/671: fsync d0/d58/d7a/fb0 0 2024-05-09T06:30:49.919 INFO:tasks.workunit.client.0.smithi046.stdout:9/503: unlink d2/d6/f25 0 2024-05-09T06:30:49.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/844: creat d1/db/dd/d11/d5d/dbb/ffd x:0 0 0 2024-05-09T06:30:49.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/845: fdatasync d1/db/dd/fbe 0 2024-05-09T06:30:49.924 INFO:tasks.workunit.client.0.smithi046.stdout:9/504: creat d2/d6/d7/d1a/d27/d56/fa2 x:0 0 0 2024-05-09T06:30:49.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/846: rmdir d1/d7/dcd/ddf 39 2024-05-09T06:30:49.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/672: rename d0/d3e to d0/dba/de7 0 2024-05-09T06:30:49.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/673: creat d0/d1b/d39/d8a/fe8 x:0 0 0 2024-05-09T06:30:49.933 INFO:tasks.workunit.client.0.smithi046.stdout:8/847: unlink d1/d7/d2c/fb5 0 2024-05-09T06:30:49.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/674: dread d0/fa [0,4194304] 0 2024-05-09T06:30:49.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/675: write d0/d1b/d39/d8a/fe8 [658541,16238] 0 2024-05-09T06:30:49.938 INFO:tasks.workunit.client.0.smithi046.stdout:8/848: mkdir d1/db/dd/d11/d5d/dfe 0 2024-05-09T06:30:49.941 INFO:tasks.workunit.client.0.smithi046.stdout:9/505: dwrite d2/d6/d7/d1a/d27/d2a/f72 [0,4194304] 0 2024-05-09T06:30:49.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/676: link d0/lbf d0/d1b/d21/d81/le9 0 2024-05-09T06:30:49.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/677: dread - d0/dad/fc3 zero size 2024-05-09T06:30:49.944 INFO:tasks.workunit.client.0.smithi046.stdout:8/849: symlink d1/ddc/df9/lff 0 2024-05-09T06:30:49.945 INFO:tasks.workunit.client.0.smithi046.stdout:9/506: mknod d2/dc/d32/ca3 0 2024-05-09T06:30:49.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/659: sync 2024-05-09T06:30:49.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/660: dread d4/d5d/d60/fd7 [0,4194304] 0 2024-05-09T06:30:49.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/661: fsync d4/d48/d49/dc0/fd6 0 2024-05-09T06:30:49.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/662: chown d4/d20/d24/d2a/c2f 2496 1 2024-05-09T06:30:49.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/663: write d4/d20/d24/d29/d2b/d94/f64 [720167,49044] 0 2024-05-09T06:30:49.982 INFO:tasks.workunit.client.0.smithi046.stdout:8/850: creat d1/db/dd/d11/d5d/d99/f100 x:0 0 0 2024-05-09T06:30:49.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/507: stat d2/d6/d7/d1a/d27/l9a 0 2024-05-09T06:30:49.983 INFO:tasks.workunit.client.0.smithi046.stdout:9/508: truncate d2/dc/f4d 1270306 0 2024-05-09T06:30:49.991 INFO:tasks.workunit.client.0.smithi046.stdout:3/664: unlink d4/d20/d24/d2a/d46/f6f 0 2024-05-09T06:30:49.995 INFO:tasks.workunit.client.0.smithi046.stdout:8/851: creat d1/d7/d12/d1d/d30/dbd/dc7/dcf/f101 x:0 0 0 2024-05-09T06:30:50.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/665: mkdir d4/d5d/d60/ddd 0 2024-05-09T06:30:50.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/852: mkdir d1/db/d102 0 2024-05-09T06:30:50.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/853: readlink d1/d7/d12/d1d/d30/dda/def/lf0 0 2024-05-09T06:30:50.006 INFO:tasks.workunit.client.0.smithi046.stdout:9/509: symlink d2/d26/d2c/la4 0 2024-05-09T06:30:50.007 INFO:tasks.workunit.client.0.smithi046.stdout:3/666: symlink d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/lde 0 2024-05-09T06:30:50.007 INFO:tasks.workunit.client.0.smithi046.stdout:3/667: truncate d4/d5/f37 1670997 0 2024-05-09T06:30:50.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/854: symlink d1/d7/d12/d45/l103 0 2024-05-09T06:30:50.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/855: symlink d1/d7/dcd/ddf/l104 0 2024-05-09T06:30:50.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/856: stat d1/f33 0 2024-05-09T06:30:50.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/857: fsync d1/d7/fd5 0 2024-05-09T06:30:50.014 INFO:tasks.workunit.client.0.smithi046.stdout:8/858: rename d1/d7/d12/d45/l7b to d1/d7/dcd/ddf/l105 0 2024-05-09T06:30:50.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/668: dread d4/d20/d41/f66 [0,4194304] 0 2024-05-09T06:30:50.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/510: dwrite d2/d6/d7/d1a/d27/f34 [0,4194304] 0 2024-05-09T06:30:50.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/511: dread - d2/d6/f9b zero size 2024-05-09T06:30:50.024 INFO:tasks.workunit.client.0.smithi046.stdout:9/512: dread d2/f47 [0,4194304] 0 2024-05-09T06:30:50.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/669: creat d4/d5d/d60/fdf x:0 0 0 2024-05-09T06:30:50.033 INFO:tasks.workunit.client.0.smithi046.stdout:9/513: mkdir d2/d6/d7/d1a/d27/d2a/da5 0 2024-05-09T06:30:50.033 INFO:tasks.workunit.client.0.smithi046.stdout:9/514: read - d2/dc/d32/f5d zero size 2024-05-09T06:30:50.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/515: creat d2/d6/d7/d1a/fa6 x:0 0 0 2024-05-09T06:30:50.037 INFO:tasks.workunit.client.0.smithi046.stdout:9/516: creat d2/d6/d7/d1e/fa7 x:0 0 0 2024-05-09T06:30:50.045 INFO:tasks.workunit.client.0.smithi046.stdout:3/670: dwrite d4/d20/d24/f18 [4194304,4194304] 0 2024-05-09T06:30:50.047 INFO:tasks.workunit.client.0.smithi046.stdout:3/671: truncate d4/d20/d24/d2a/d55/d74/f91 837005 0 2024-05-09T06:30:50.048 INFO:tasks.workunit.client.0.smithi046.stdout:9/517: dread d2/d26/f68 [0,4194304] 0 2024-05-09T06:30:50.048 INFO:tasks.workunit.client.0.smithi046.stdout:9/518: stat d2/d6/d7/d1a/d86/f67 0 2024-05-09T06:30:50.053 INFO:tasks.workunit.client.0.smithi046.stdout:9/519: write d2/d6/d7/fd [2195761,87967] 0 2024-05-09T06:30:50.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/900: sync 2024-05-09T06:30:50.059 INFO:tasks.workunit.client.0.smithi046.stdout:9/520: mkdir d2/d6/d33/da8 0 2024-05-09T06:30:50.059 INFO:tasks.workunit.client.0.smithi046.stdout:9/521: chown d2/d6/d7/ff 928697385 1 2024-05-09T06:30:50.059 INFO:tasks.workunit.client.0.smithi046.stdout:3/672: dwrite d4/d20/d24/d29/d2b/f34 [0,4194304] 0 2024-05-09T06:30:50.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/522: write d2/f47 [1159673,127281] 0 2024-05-09T06:30:50.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/901: link d3/d7/d4c/d4f/c7f d3/d7/d4c/d4f/d121/d72/d79/d81/d11e/d11f/c122 0 2024-05-09T06:30:50.065 INFO:tasks.workunit.client.0.smithi046.stdout:3/673: creat d4/d5/fe0 x:0 0 0 2024-05-09T06:30:50.068 INFO:tasks.workunit.client.0.smithi046.stdout:9/523: getdents d2/d20 0 2024-05-09T06:30:50.069 INFO:tasks.workunit.client.0.smithi046.stdout:7/902: symlink d3/d7/d4c/d4f/d121/l123 0 2024-05-09T06:30:50.071 INFO:tasks.workunit.client.0.smithi046.stdout:3/674: symlink d4/d20/d24/d2a/d55/d74/le1 0 2024-05-09T06:30:50.072 INFO:tasks.workunit.client.0.smithi046.stdout:9/524: rmdir d2/d6/d38 39 2024-05-09T06:30:50.072 INFO:tasks.workunit.client.0.smithi046.stdout:9/525: stat d2/dc/d32/ca3 0 2024-05-09T06:30:50.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/903: creat d3/d7/d4c/d4f/d121/d72/d107/de0/f124 x:0 0 0 2024-05-09T06:30:50.076 INFO:tasks.workunit.client.0.smithi046.stdout:3/675: mkdir d4/d5d/d60/ddd/de2 0 2024-05-09T06:30:50.081 INFO:tasks.workunit.client.0.smithi046.stdout:9/526: creat d2/d6/d8b/fa9 x:0 0 0 2024-05-09T06:30:50.084 INFO:tasks.workunit.client.0.smithi046.stdout:7/904: getdents d3/d7/d4c/d4f/d121/d72/d79/d81/d11e/d11f 0 2024-05-09T06:30:50.084 INFO:tasks.workunit.client.0.smithi046.stdout:7/905: write d3/d7/d8e/f93 [833246,124422] 0 2024-05-09T06:30:50.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/906: write d3/d7/d8e/f9f [1051569,47899] 0 2024-05-09T06:30:50.089 INFO:tasks.workunit.client.0.smithi046.stdout:3/676: creat d4/d20/d24/d2a/d55/d74/fe3 x:0 0 0 2024-05-09T06:30:50.089 INFO:tasks.workunit.client.0.smithi046.stdout:3/677: chown d4/d5/dac/fdb 29508 1 2024-05-09T06:30:50.096 INFO:tasks.workunit.client.0.smithi046.stdout:3/678: mknod d4/d48/ce4 0 2024-05-09T06:30:50.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/679: write d4/d20/d24/d29/d2b/f70 [470542,69736] 0 2024-05-09T06:30:50.100 INFO:tasks.workunit.client.0.smithi046.stdout:7/907: dwrite d3/d7/d4c/d4f/d121/fee [0,4194304] 0 2024-05-09T06:30:50.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/908: write d3/d7/d4c/ff1 [1896644,48957] 0 2024-05-09T06:30:50.103 INFO:tasks.workunit.client.0.smithi046.stdout:3/680: getdents d4/d48/d49 0 2024-05-09T06:30:50.103 INFO:tasks.workunit.client.0.smithi046.stdout:3/681: stat d4/d20/d24 0 2024-05-09T06:30:50.106 INFO:tasks.workunit.client.0.smithi046.stdout:3/682: dread d4/d5d/f7d [0,4194304] 0 2024-05-09T06:30:50.106 INFO:tasks.workunit.client.0.smithi046.stdout:3/683: chown d4/d5/dac/db0/ccf 2181033 1 2024-05-09T06:30:50.108 INFO:tasks.workunit.client.0.smithi046.stdout:3/684: creat d4/d20/d24/d29/d2b/d94/d5c/fe5 x:0 0 0 2024-05-09T06:30:50.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/527: dwrite d2/d6/d7/f45 [0,4194304] 0 2024-05-09T06:30:50.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/528: fdatasync d2/d26/d2c/d3d/f5b 0 2024-05-09T06:30:50.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/909: write d3/d7/d28/d29/d35/f48 [2410719,20547] 0 2024-05-09T06:30:50.129 INFO:tasks.workunit.client.0.smithi046.stdout:9/529: creat d2/d6/d7/faa x:0 0 0 2024-05-09T06:30:50.135 INFO:tasks.workunit.client.0.smithi046.stdout:7/910: mknod d3/d7/d4c/d4f/d121/c125 0 2024-05-09T06:30:50.139 INFO:tasks.workunit.client.0.smithi046.stdout:9/530: mkdir d2/d26/dab 0 2024-05-09T06:30:50.141 INFO:tasks.workunit.client.0.smithi046.stdout:9/531: creat d2/d6/d7/d1a/d27/d2a/da5/fac x:0 0 0 2024-05-09T06:30:50.143 INFO:tasks.workunit.client.0.smithi046.stdout:9/532: mkdir d2/d6/d7/d1e/dad 0 2024-05-09T06:30:50.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/829: sync 2024-05-09T06:30:50.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/678: sync 2024-05-09T06:30:50.143 INFO:tasks.workunit.client.0.smithi046.stdout:4/686: sync 2024-05-09T06:30:50.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/679: fsync d11/d4f/d5b/d5f/f6d 0 2024-05-09T06:30:50.145 INFO:tasks.workunit.client.0.smithi046.stdout:6/830: dread db/d10/d3f/d44/fb8 [0,4194304] 0 2024-05-09T06:30:50.145 INFO:tasks.workunit.client.0.smithi046.stdout:6/831: chown db/d10/d3f/d44/d5e/l78 91496 1 2024-05-09T06:30:50.146 INFO:tasks.workunit.client.0.smithi046.stdout:9/533: symlink d2/d26/d2c/d3d/lae 0 2024-05-09T06:30:50.148 INFO:tasks.workunit.client.0.smithi046.stdout:6/832: mkdir db/d10/d3f/d44/d46/d70/d110 0 2024-05-09T06:30:50.150 INFO:tasks.workunit.client.0.smithi046.stdout:9/534: rmdir d2/d6/d7/d1a/d27 39 2024-05-09T06:30:50.150 INFO:tasks.workunit.client.0.smithi046.stdout:9/535: readlink d2/d6/d7/d1a/d27/d65/l7b 0 2024-05-09T06:30:50.153 INFO:tasks.workunit.client.0.smithi046.stdout:4/687: read d7/df/d3a/d45/f85 [2751114,101795] 0 2024-05-09T06:30:50.153 INFO:tasks.workunit.client.0.smithi046.stdout:7/911: dwrite d3/d7/d4c/d4f/d121/d72/f89 [0,4194304] 0 2024-05-09T06:30:50.153 INFO:tasks.workunit.client.0.smithi046.stdout:7/912: write d3/d7/d4c/d99/dac/db7/fb9 [1425841,127457] 0 2024-05-09T06:30:50.154 INFO:tasks.workunit.client.0.smithi046.stdout:6/833: symlink db/d93/d96/dd1/l111 0 2024-05-09T06:30:50.154 INFO:tasks.workunit.client.0.smithi046.stdout:6/834: fsync db/d10/d3f/d4f/d8a/fb3 0 2024-05-09T06:30:50.155 INFO:tasks.workunit.client.0.smithi046.stdout:9/536: rename d2/d6/d7/d1e/dad to d2/d26/d2c/daf 0 2024-05-09T06:30:50.155 INFO:tasks.workunit.client.0.smithi046.stdout:9/537: chown d2/d26/d2c/c5a 4460 1 2024-05-09T06:30:50.156 INFO:tasks.workunit.client.0.smithi046.stdout:4/688: mknod d7/df/d3a/d45/d96/db3/cd1 0 2024-05-09T06:30:50.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/913: mknod d3/d6f/c126 0 2024-05-09T06:30:50.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/680: dwrite d11/d18/d27/d28/f85 [0,4194304] 0 2024-05-09T06:30:50.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/681: chown d11/fb6 4 1 2024-05-09T06:30:50.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/682: chown d11/d3f/f51 170995950 1 2024-05-09T06:30:50.162 INFO:tasks.workunit.client.0.smithi046.stdout:9/538: creat d2/fb0 x:0 0 0 2024-05-09T06:30:50.163 INFO:tasks.workunit.client.0.smithi046.stdout:4/689: rename d7/df/d3a/c42 to d7/df/d10/d1d/d77/d87/dac/cd2 0 2024-05-09T06:30:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:7/914: symlink d3/d7/d4c/d99/d110/l127 0 2024-05-09T06:30:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:7/915: dread - d3/d7/d28/d29/d3b/dbd/f10f zero size 2024-05-09T06:30:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:7/916: truncate d3/d7/d28/fc6 4640431 0 2024-05-09T06:30:50.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/835: dwrite db/f42 [0,4194304] 0 2024-05-09T06:30:50.170 INFO:tasks.workunit.client.0.smithi046.stdout:6/836: write db/d10/d3f/d4f/fa9 [833167,81848] 0 2024-05-09T06:30:50.174 INFO:tasks.workunit.client.0.smithi046.stdout:0/683: rmdir d11/d18/d27/d28/d36/d91/d98 39 2024-05-09T06:30:50.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/837: write db/d10/d3f/d4f/d8a/fb3 [2178769,7083] 0 2024-05-09T06:30:50.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/838: creat db/d10/d3f/f112 x:0 0 0 2024-05-09T06:30:50.179 INFO:tasks.workunit.client.0.smithi046.stdout:9/539: mknod d2/d6/d7/d1a/d27/cb1 0 2024-05-09T06:30:50.180 INFO:tasks.workunit.client.0.smithi046.stdout:9/540: fdatasync d2/d6/d7/d1a/d27/d56/fa2 0 2024-05-09T06:30:50.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/917: getdents d3/d7/dd/d3e 0 2024-05-09T06:30:50.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/690: dwrite d7/df/d3a/d45/d96/f67 [0,4194304] 0 2024-05-09T06:30:50.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/839: rename db/d10/d3f/d44/d5e/lc6 to db/d10/d3f/d4f/d8a/l113 0 2024-05-09T06:30:50.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/840: fsync db/fd 0 2024-05-09T06:30:50.185 INFO:tasks.workunit.client.0.smithi046.stdout:9/541: chown d2/d26/c90 3 1 2024-05-09T06:30:50.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/918: truncate d3/fa7 1520258 0 2024-05-09T06:30:50.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/919: readlink d3/d7/d28/d29/d3b/le3 0 2024-05-09T06:30:50.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/920: chown d3/d7/f52 248374 1 2024-05-09T06:30:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/684: dwrite d11/d18/fca [0,4194304] 0 2024-05-09T06:30:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/685: dread - d11/d18/d27/d28/fc7 zero size 2024-05-09T06:30:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/691: rmdir d7/df/d10/d1d/dbf 0 2024-05-09T06:30:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/692: readlink d7/df/d3a/d25/d81/d98/l9a 0 2024-05-09T06:30:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:6/841: stat db/d10/dfa/c10a 0 2024-05-09T06:30:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:6/842: creat db/d10/d6b/f114 x:0 0 0 2024-05-09T06:30:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:9/542: creat d2/d6/d33/da8/fb2 x:0 0 0 2024-05-09T06:30:50.194 INFO:tasks.workunit.client.0.smithi046.stdout:4/693: dread d7/f72 [12582912,4194304] 0 2024-05-09T06:30:50.195 INFO:tasks.workunit.client.0.smithi046.stdout:4/694: chown d7/df/d10/d1d/d77/l7d 4708 1 2024-05-09T06:30:50.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/921: mknod d3/dc4/c128 0 2024-05-09T06:30:50.203 INFO:tasks.workunit.client.0.smithi046.stdout:0/686: creat d11/d18/d1c/d53/fd6 x:0 0 0 2024-05-09T06:30:50.203 INFO:tasks.workunit.client.0.smithi046.stdout:0/687: getdents d11/d18/d27/d28/d36/d5a/dc4 0 2024-05-09T06:30:50.204 INFO:tasks.workunit.client.0.smithi046.stdout:4/695: write d7/df/d3a/d45/d96/f58 [624409,70168] 0 2024-05-09T06:30:50.204 INFO:tasks.workunit.client.0.smithi046.stdout:7/922: dread d3/d7/dd/f59 [0,4194304] 0 2024-05-09T06:30:50.208 INFO:tasks.workunit.client.0.smithi046.stdout:6/843: mknod db/d10/d3f/d44/d5e/c115 0 2024-05-09T06:30:50.213 INFO:tasks.workunit.client.0.smithi046.stdout:6/844: rename db/d10/d3f/d44/fac to db/d93/f116 0 2024-05-09T06:30:50.216 INFO:tasks.workunit.client.0.smithi046.stdout:6/845: rename db/d10/d3f/d44/d46/c99 to db/d93/d96/c117 0 2024-05-09T06:30:50.216 INFO:tasks.workunit.client.0.smithi046.stdout:6/846: readlink db/d10/d30/l40 0 2024-05-09T06:30:50.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/847: rmdir db/d10/d3f/d44/d46 39 2024-05-09T06:30:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/848: creat db/d10/d3f/d44/f118 x:0 0 0 2024-05-09T06:30:50.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/849: truncate db/d10/d76/ff6 4167805 0 2024-05-09T06:30:50.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/923: dread d3/d7/d4c/d4f/d121/fee [0,4194304] 0 2024-05-09T06:30:50.226 INFO:tasks.workunit.client.0.smithi046.stdout:7/924: rename d3/d7/d28/d29/l4d to d3/d7/d28/l129 0 2024-05-09T06:30:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:4/696: dwrite d7/fb [4194304,4194304] 0 2024-05-09T06:30:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:7/925: mkdir d3/d7/d4c/d4f/d121/d12a 0 2024-05-09T06:30:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/688: dwrite d11/d18/d27/d28/d6b/fae [0,4194304] 0 2024-05-09T06:30:50.234 INFO:tasks.workunit.client.0.smithi046.stdout:4/697: link d7/df/d3a/d25/da5/cbb d7/df/d3a/d45/d96/db3/cd3 0 2024-05-09T06:30:50.236 INFO:tasks.workunit.client.0.smithi046.stdout:7/926: getdents d3/d7/d4c/d99 0 2024-05-09T06:30:50.240 INFO:tasks.workunit.client.0.smithi046.stdout:0/689: link d11/d18/d27/d28/d6b/fcf d11/d18/d1c/d53/dab/fd7 0 2024-05-09T06:30:50.242 INFO:tasks.workunit.client.0.smithi046.stdout:4/698: mknod d7/df/d10/d1d/d77/d87/dbe/cd4 0 2024-05-09T06:30:50.242 INFO:tasks.workunit.client.0.smithi046.stdout:4/699: stat d7/df/d3a/d45/dc6 0 2024-05-09T06:30:50.247 INFO:tasks.workunit.client.0.smithi046.stdout:0/690: mknod d11/d18/d1c/d53/d82/cd8 0 2024-05-09T06:30:50.250 INFO:tasks.workunit.client.0.smithi046.stdout:4/700: mkdir d7/df/d3a/d45/d96/db3/dd5 0 2024-05-09T06:30:50.250 INFO:tasks.workunit.client.0.smithi046.stdout:4/701: dread - d7/df/d53/d91/fa9 zero size 2024-05-09T06:30:50.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/850: dwrite db/d10/d76/ff6 [4194304,4194304] 0 2024-05-09T06:30:50.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/851: stat db/f27 0 2024-05-09T06:30:50.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/852: chown db/d10/dfa/f109 29638 1 2024-05-09T06:30:50.252 INFO:tasks.workunit.client.0.smithi046.stdout:4/702: rmdir d7/df/d10/d2f 39 2024-05-09T06:30:50.260 INFO:tasks.workunit.client.0.smithi046.stdout:6/853: getdents db/d10/d3f/d44/d74/db6 0 2024-05-09T06:30:50.260 INFO:tasks.workunit.client.0.smithi046.stdout:6/854: chown db/d93/f116 0 1 2024-05-09T06:30:50.260 INFO:tasks.workunit.client.0.smithi046.stdout:6/855: write db/d10/d3f/d4f/d89/f9c [2295732,51854] 0 2024-05-09T06:30:50.268 INFO:tasks.workunit.client.0.smithi046.stdout:0/691: dwrite d11/d18/f32 [0,4194304] 0 2024-05-09T06:30:50.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/703: dwrite d7/df/d3a/d25/f57 [0,4194304] 0 2024-05-09T06:30:50.272 INFO:tasks.workunit.client.0.smithi046.stdout:6/856: dread db/d10/d3f/d44/d46/d70/f79 [0,4194304] 0 2024-05-09T06:30:50.285 INFO:tasks.workunit.client.0.smithi046.stdout:4/704: dwrite d7/df/d3a/d45/d96/f67 [4194304,4194304] 0 2024-05-09T06:30:50.294 INFO:tasks.workunit.client.0.smithi046.stdout:4/705: read d7/df/d3a/d25/f57 [3886232,75045] 0 2024-05-09T06:30:50.323 INFO:tasks.workunit.client.0.smithi046.stdout:0/692: truncate d11/d18/d27/d28/f50 2173438 0 2024-05-09T06:30:50.348 INFO:tasks.workunit.client.0.smithi046.stdout:4/706: mkdir d7/daf/dd6 0 2024-05-09T06:30:50.349 INFO:tasks.workunit.client.0.smithi046.stdout:4/707: chown d7/df/d10/d1d/db9 1 1 2024-05-09T06:30:50.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/693: link d11/d18/db1/db2/lc9 d11/d18/ld9 0 2024-05-09T06:30:50.385 INFO:tasks.workunit.client.0.smithi046.stdout:4/708: mkdir d7/df/d3a/d45/d96/dd7 0 2024-05-09T06:30:50.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/694: creat d11/d18/d1c/fda x:0 0 0 2024-05-09T06:30:50.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/695: write d11/d18/fca [4499940,57613] 0 2024-05-09T06:30:50.395 INFO:tasks.workunit.client.0.smithi046.stdout:0/696: truncate d11/d18/d27/d28/d2d/f57 228786 0 2024-05-09T06:30:50.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/697: mkdir d11/d18/d27/d28/d2d/d5c/ddb 0 2024-05-09T06:30:50.399 INFO:tasks.workunit.client.0.smithi046.stdout:0/698: symlink d11/d18/d27/d28/d2d/d81/ldc 0 2024-05-09T06:30:50.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/709: dwrite d7/fc0 [0,4194304] 0 2024-05-09T06:30:50.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/710: chown d7/c78 54991 1 2024-05-09T06:30:50.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/711: read - d7/df/d10/d1d/fb6 zero size 2024-05-09T06:30:50.401 INFO:tasks.workunit.client.0.smithi046.stdout:0/699: creat d11/d18/d27/d28/d36/d5a/dc4/fdd x:0 0 0 2024-05-09T06:30:50.404 INFO:tasks.workunit.client.0.smithi046.stdout:0/700: symlink d11/d3f/lde 0 2024-05-09T06:30:50.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/701: write d11/d18/d27/d28/d2d/f4c [246776,31136] 0 2024-05-09T06:30:50.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/712: write d7/f71 [2194047,24673] 0 2024-05-09T06:30:50.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/713: mkdir d7/dd8 0 2024-05-09T06:30:50.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/714: creat d7/fd9 x:0 0 0 2024-05-09T06:30:50.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/702: dwrite d11/d18/d27/d28/f50 [0,4194304] 0 2024-05-09T06:30:50.439 INFO:tasks.workunit.client.0.smithi046.stdout:4/715: dwrite d7/df/d3a/d45/f97 [0,4194304] 0 2024-05-09T06:30:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/716: unlink f4 0 2024-05-09T06:30:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/717: read d7/df/d3a/f2c [2750928,31016] 0 2024-05-09T06:30:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/718: read d7/df/d10/d2f/f5c [3440677,43802] 0 2024-05-09T06:30:50.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/719: mknod d7/df/d10/d2f/cda 0 2024-05-09T06:30:50.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/720: readlink d7/df/d3a/l75 0 2024-05-09T06:30:50.446 INFO:tasks.workunit.client.0.smithi046.stdout:4/721: creat d7/df/d10/d2f/fdb x:0 0 0 2024-05-09T06:30:50.447 INFO:tasks.workunit.client.0.smithi046.stdout:0/703: read d11/d4f/d5b/d5f/fcc [2951063,51372] 0 2024-05-09T06:30:50.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/722: link d7/df/d3a/d25/l8c d7/dd8/ldc 0 2024-05-09T06:30:50.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/723: write d7/df/d3a/d25/d86/fa6 [1095489,34895] 0 2024-05-09T06:30:50.449 INFO:tasks.workunit.client.0.smithi046.stdout:0/704: mkdir d11/d18/d27/d28/d2d/d5c/ddf 0 2024-05-09T06:30:50.451 INFO:tasks.workunit.client.0.smithi046.stdout:0/705: creat d11/d18/d27/d28/d36/d91/d98/db0/fe0 x:0 0 0 2024-05-09T06:30:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/857: mknod db/d10/d3f/d4f/d8a/c119 0 2024-05-09T06:30:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/858: truncate db/d10/d3f/f56 4427438 0 2024-05-09T06:30:50.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/859: write db/d10/d30/fbf [957000,52043] 0 2024-05-09T06:30:50.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/860: truncate db/d10/d3f/d4f/d8a/f9f 2204233 0 2024-05-09T06:30:50.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/861: dread db/d10/d3f/f56 [4194304,4194304] 0 2024-05-09T06:30:50.456 INFO:tasks.workunit.client.0.smithi046.stdout:6/862: read db/d10/d3f/d4f/d8a/fb3 [2253659,90007] 0 2024-05-09T06:30:50.456 INFO:tasks.workunit.client.0.smithi046.stdout:6/863: stat db/d93/fca 0 2024-05-09T06:30:50.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/864: mknod db/d10/d3c/d91/c11a 0 2024-05-09T06:30:50.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/706: dread d11/d18/f6e [0,4194304] 0 2024-05-09T06:30:50.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/707: chown d11/d18/d1c/d53/fd6 3432 1 2024-05-09T06:30:50.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/708: fsync d11/d18/d27/d28/fa9 0 2024-05-09T06:30:50.461 INFO:tasks.workunit.client.0.smithi046.stdout:0/709: symlink d11/d18/d27/d28/d36/d91/d98/db0/le1 0 2024-05-09T06:30:50.462 INFO:tasks.workunit.client.0.smithi046.stdout:0/710: creat d11/d18/fe2 x:0 0 0 2024-05-09T06:30:50.462 INFO:tasks.workunit.client.0.smithi046.stdout:0/711: stat d11/d4f/d5b/d5f/c9c 0 2024-05-09T06:30:50.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/712: creat d11/d18/d1c/d56/fe3 x:0 0 0 2024-05-09T06:30:50.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/713: creat d11/d18/d27/d28/d36/d5a/dc4/fe4 x:0 0 0 2024-05-09T06:30:50.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/714: dread - d11/d18/d27/d28/d36/fd1 zero size 2024-05-09T06:30:50.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/715: chown d11/d18/d27/d28/d36/d91/d98 7770665 1 2024-05-09T06:30:50.465 INFO:tasks.workunit.client.0.smithi046.stdout:0/716: mkdir d11/d18/d27/d28/d2d/d5c/ddb/de5 0 2024-05-09T06:30:50.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/865: write db/d10/d30/faf [1942116,73254] 0 2024-05-09T06:30:50.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/866: chown db/d10/d3c/d91/fa2 175315 1 2024-05-09T06:30:50.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/867: readlink db/d10/d3c/d98/lbc 0 2024-05-09T06:30:50.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/868: fsync db/d10/d6b/fe9 0 2024-05-09T06:30:50.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/869: chown db/d10/d57/db7/lba 461684 1 2024-05-09T06:30:50.466 INFO:tasks.workunit.client.0.smithi046.stdout:0/717: symlink d11/d4f/d5b/d5f/le6 0 2024-05-09T06:30:50.467 INFO:tasks.workunit.client.0.smithi046.stdout:0/718: truncate d11/d18/d1c/d53/f66 2991830 0 2024-05-09T06:30:50.470 INFO:tasks.workunit.client.0.smithi046.stdout:0/719: creat d11/d3f/fe7 x:0 0 0 2024-05-09T06:30:50.471 INFO:tasks.workunit.client.0.smithi046.stdout:0/720: mkdir d11/d18/d27/d28/d6b/de8 0 2024-05-09T06:30:50.471 INFO:tasks.workunit.client.0.smithi046.stdout:0/721: dread - d11/d18/d27/d28/fc7 zero size 2024-05-09T06:30:50.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/870: dwrite db/d10/d3f/d4f/d89/f9c [0,4194304] 0 2024-05-09T06:30:50.483 INFO:tasks.workunit.client.0.smithi046.stdout:6/871: mknod db/d10/d57/db7/c11b 0 2024-05-09T06:30:50.484 INFO:tasks.workunit.client.0.smithi046.stdout:6/872: creat db/f11c x:0 0 0 2024-05-09T06:30:50.489 INFO:tasks.workunit.client.0.smithi046.stdout:6/873: dread db/d10/d3f/d4f/d8a/d9e/fa7 [0,4194304] 0 2024-05-09T06:30:50.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/722: dwrite d11/d18/d27/d28/d2d/f90 [0,4194304] 0 2024-05-09T06:30:50.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/874: fsync db/d10/d30/fbf 0 2024-05-09T06:30:50.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/875: fdatasync db/d10/d3f/d4f/f63 0 2024-05-09T06:30:50.496 INFO:tasks.workunit.client.0.smithi046.stdout:0/723: unlink d11/l4b 0 2024-05-09T06:30:50.497 INFO:tasks.workunit.client.0.smithi046.stdout:6/876: mknod db/d10/d3f/d4f/d106/c11d 0 2024-05-09T06:30:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/724: mknod d11/d18/d27/d28/d6b/de8/ce9 0 2024-05-09T06:30:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/725: chown d11/d18/d1c/d53 2461 1 2024-05-09T06:30:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/726: chown d11/d18/d27/d28/d6b/de8 51876 1 2024-05-09T06:30:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/727: stat d11/d18/d27/d28/ld5 0 2024-05-09T06:30:50.506 INFO:tasks.workunit.client.0.smithi046.stdout:0/728: symlink d11/d3f/lea 0 2024-05-09T06:30:50.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/877: dread db/d10/d57/d10c/f10e [0,4194304] 0 2024-05-09T06:30:50.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/878: write db/d10/d3c/f5b [2452296,68092] 0 2024-05-09T06:30:50.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/879: getdents db/d10/d30/d53/d104 0 2024-05-09T06:30:50.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/729: dread d11/d18/d1c/d56/f74 [0,4194304] 0 2024-05-09T06:30:50.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/730: truncate d11/d18/d27/d28/d6b/dac/fc8 23185 0 2024-05-09T06:30:50.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/731: readlink l2 0 2024-05-09T06:30:50.526 INFO:tasks.workunit.client.0.smithi046.stdout:0/732: dread d11/d18/d27/f68 [4194304,4194304] 0 2024-05-09T06:30:50.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/733: truncate d11/d18/d27/d28/d6b/f8b 443740 0 2024-05-09T06:30:50.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/734: truncate d11/d18/f3b 300165 0 2024-05-09T06:30:50.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/735: write d11/d18/d27/d28/d36/d5a/dc4/fe4 [628149,73987] 0 2024-05-09T06:30:50.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/736: dwrite d11/d18/d1c/d56/fe3 [0,4194304] 0 2024-05-09T06:30:50.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/724: getdents d7/dd8 0 2024-05-09T06:30:50.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/725: stat d7/fd9 0 2024-05-09T06:30:50.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/726: readlink d7/df/d10/l65 0 2024-05-09T06:30:50.562 INFO:tasks.workunit.client.0.smithi046.stdout:9/543: sync 2024-05-09T06:30:50.563 INFO:tasks.workunit.client.0.smithi046.stdout:5/678: sync 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:3/685: sync 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/716: sync 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/927: sync 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/928: write d3/d7/d28/d29/d3b/f7e [2291701,54846] 0 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:1/730: sync 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/859: sync 2024-05-09T06:30:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/860: write d1/db/dd/fbe [164243,68657] 0 2024-05-09T06:30:50.571 INFO:tasks.workunit.client.0.smithi046.stdout:9/544: rename d2/d26/d2c/d3d/lae to d2/dc/lb3 0 2024-05-09T06:30:50.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/686: unlink d4/f3d 0 2024-05-09T06:30:50.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/687: write d4/d20/d41/fb6 [99080,66787] 0 2024-05-09T06:30:50.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/717: creat da/dc/dd0/fe8 x:0 0 0 2024-05-09T06:30:50.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/718: write da/de/d14/d1f/d20/d7c/d8b/fd1 [4358021,122376] 0 2024-05-09T06:30:50.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/719: fdatasync da/de/d14/d1f/d20/d5c/dcf/fd6 0 2024-05-09T06:30:50.580 INFO:tasks.workunit.client.0.smithi046.stdout:1/731: getdents d7/d10/d28/d30 0 2024-05-09T06:30:50.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/545: creat d2/dc/fb4 x:0 0 0 2024-05-09T06:30:50.586 INFO:tasks.workunit.client.0.smithi046.stdout:2/720: stat da/de/d14/d1f/c39 0 2024-05-09T06:30:50.586 INFO:tasks.workunit.client.0.smithi046.stdout:2/721: truncate da/de/d14/d1f/d3b/d9f/fc3 5185315 0 2024-05-09T06:30:50.588 INFO:tasks.workunit.client.0.smithi046.stdout:1/732: rmdir d7/d10/d34/d46/db8 0 2024-05-09T06:30:50.590 INFO:tasks.workunit.client.0.smithi046.stdout:9/546: symlink d2/d6/d8b/lb5 0 2024-05-09T06:30:50.590 INFO:tasks.workunit.client.0.smithi046.stdout:9/547: fdatasync d2/d26/d2c/d3d/f87 0 2024-05-09T06:30:50.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/727: dwrite d7/df/d3a/d25/f5f [0,4194304] 0 2024-05-09T06:30:50.591 INFO:tasks.workunit.client.0.smithi046.stdout:2/722: creat da/dc/fe9 x:0 0 0 2024-05-09T06:30:50.592 INFO:tasks.workunit.client.0.smithi046.stdout:3/688: write d4/d20/d24/d2a/d55/d6a/fc3 [3575582,101889] 0 2024-05-09T06:30:50.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/929: dwrite d3/d7/d28/fc5 [0,4194304] 0 2024-05-09T06:30:50.594 INFO:tasks.workunit.client.0.smithi046.stdout:9/548: rename d2/d6/d7/d1a/f91 to d2/d6/d8b/fb6 0 2024-05-09T06:30:50.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/728: mknod d7/daf/dd6/cdd 0 2024-05-09T06:30:50.601 INFO:tasks.workunit.client.0.smithi046.stdout:3/689: mkdir d4/d5d/de6 0 2024-05-09T06:30:50.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/861: dwrite d1/d7/d12/d1d/d30/d38/fb6 [0,4194304] 0 2024-05-09T06:30:50.602 INFO:tasks.workunit.client.0.smithi046.stdout:1/733: dread d7/d6d/f92 [0,4194304] 0 2024-05-09T06:30:50.602 INFO:tasks.workunit.client.0.smithi046.stdout:1/734: write d7/d10/d34/d46/ff2 [443045,27865] 0 2024-05-09T06:30:50.602 INFO:tasks.workunit.client.0.smithi046.stdout:7/930: symlink d3/l12b 0 2024-05-09T06:30:50.604 INFO:tasks.workunit.client.0.smithi046.stdout:9/549: stat d2/dc/d32/c57 0 2024-05-09T06:30:50.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/931: write d3/d7/d4c/d4f/d121/d72/d79/d81/fe6 [4163760,111753] 0 2024-05-09T06:30:50.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/729: symlink d7/lde 0 2024-05-09T06:30:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/932: dread d3/d7/d4c/f92 [0,4194304] 0 2024-05-09T06:30:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/679: dwrite d0/d1b/f20 [0,4194304] 0 2024-05-09T06:30:50.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/723: dwrite da/de/d54/d65/d70/fb9 [4194304,4194304] 0 2024-05-09T06:30:50.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/724: write da/f94 [4423225,70199] 0 2024-05-09T06:30:50.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/725: chown da/dc 119 1 2024-05-09T06:30:50.612 INFO:tasks.workunit.client.0.smithi046.stdout:3/690: rename d4/d20/d24/d2a/d4e to d4/d20/d24/d29/d2b/de7 0 2024-05-09T06:30:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/550: dread d2/dc/f11 [0,4194304] 0 2024-05-09T06:30:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/551: stat f0 0 2024-05-09T06:30:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/552: stat d2/d26/c90 0 2024-05-09T06:30:50.619 INFO:tasks.workunit.client.0.smithi046.stdout:8/862: mknod d1/db/dd/d11/d5d/d99/de8/c106 0 2024-05-09T06:30:50.620 INFO:tasks.workunit.client.0.smithi046.stdout:1/735: truncate d7/d10/d28/d30/dcf/f41 2514167 0 2024-05-09T06:30:50.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/933: mknod d3/d7/d4c/d99/dac/c12c 0 2024-05-09T06:30:50.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/934: chown d3/d7/d4c/d4f/d121/d72 1759 1 2024-05-09T06:30:50.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/935: getdents d3/d7/d4c/d4f/d121/d72/d79/d81/d11e/d11f 0 2024-05-09T06:30:50.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/726: mknod da/de/d54/d65/d6c/cea 0 2024-05-09T06:30:50.630 INFO:tasks.workunit.client.0.smithi046.stdout:3/691: mkdir d4/d48/d49/de8 0 2024-05-09T06:30:50.632 INFO:tasks.workunit.client.0.smithi046.stdout:5/680: rename d0/c32 to d0/d1b/d39/d8a/cea 0 2024-05-09T06:30:50.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/553: creat d2/d20/fb7 x:0 0 0 2024-05-09T06:30:50.635 INFO:tasks.workunit.client.0.smithi046.stdout:8/863: write d1/d7/d12/d1d/d30/d38/f46 [1731073,42159] 0 2024-05-09T06:30:50.635 INFO:tasks.workunit.client.0.smithi046.stdout:8/864: chown d1/d7/l8f 1269 1 2024-05-09T06:30:50.635 INFO:tasks.workunit.client.0.smithi046.stdout:8/865: truncate d1/d7/d12/d1d/d30/fcb 2768001 0 2024-05-09T06:30:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:7/936: creat d3/f12d x:0 0 0 2024-05-09T06:30:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:7/937: chown d3/d7/d4c/d4f/d121/d72/d107/c116 3985021 1 2024-05-09T06:30:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:7/938: stat d3/d7/d4c/d4f/d121/d5b/d84/de5 0 2024-05-09T06:30:50.637 INFO:tasks.workunit.client.0.smithi046.stdout:7/939: fsync d3/d7/d28/d29/f2e 0 2024-05-09T06:30:50.639 INFO:tasks.workunit.client.0.smithi046.stdout:2/727: mkdir da/d2d/d43/dc2/deb 0 2024-05-09T06:30:50.641 INFO:tasks.workunit.client.0.smithi046.stdout:5/681: unlink d0/d1b/d21/f42 0 2024-05-09T06:30:50.641 INFO:tasks.workunit.client.0.smithi046.stdout:5/682: fsync d0/d58/fa9 0 2024-05-09T06:30:50.642 INFO:tasks.workunit.client.0.smithi046.stdout:7/940: symlink d3/d7/d4c/d4f/d121/l12e 0 2024-05-09T06:30:50.642 INFO:tasks.workunit.client.0.smithi046.stdout:7/941: fsync d3/d7/d28/d73/f88 0 2024-05-09T06:30:50.644 INFO:tasks.workunit.client.0.smithi046.stdout:5/683: mkdir d0/db3/deb 0 2024-05-09T06:30:50.644 INFO:tasks.workunit.client.0.smithi046.stdout:9/554: read d2/d6/d7/f1b [3766477,62414] 0 2024-05-09T06:30:50.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/730: dwrite d7/df/d10/f9f [0,4194304] 0 2024-05-09T06:30:50.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/731: stat d7/df/c17 0 2024-05-09T06:30:50.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/942: creat d3/d7/d4c/d4f/f12f x:0 0 0 2024-05-09T06:30:50.648 INFO:tasks.workunit.client.0.smithi046.stdout:9/555: symlink d2/d6/d7/d1a/d86/lb8 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:7/943: stat d3/d7/d28/d29/d35/f78 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:7/944: fdatasync d3/d7/d28/d29/d35/d5c/dad/dbb/feb 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/556: write d2/d6/d7/d1e/f78 [345715,71589] 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/557: creat d2/d6/d7/d1e/fb9 x:0 0 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/558: read d2/d26/d2c/f50 [219111,27345] 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/559: dread - d2/d6/d8b/fa9 zero size 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/692: dread d4/d20/d41/f63 [0,4194304] 0 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/693: chown d4/d20/d24/d2a/d46/fc4 3022216 1 2024-05-09T06:30:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/694: readlink d4/d20/d24/d2a/d46/l5f 0 2024-05-09T06:30:50.651 INFO:tasks.workunit.client.0.smithi046.stdout:4/732: creat d7/dd8/fdf x:0 0 0 2024-05-09T06:30:50.651 INFO:tasks.workunit.client.0.smithi046.stdout:4/733: chown d7/df/fbd 12232749 1 2024-05-09T06:30:50.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/736: dwrite d7/d10/d28/d30/dcf/f3c [0,4194304] 0 2024-05-09T06:30:50.655 INFO:tasks.workunit.client.0.smithi046.stdout:7/945: symlink d3/d7/d4c/d4f/d121/d72/d79/d81/d11e/l130 0 2024-05-09T06:30:50.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/728: write da/de/d14/d1f/d3b/d9f/faa [1270849,100381] 0 2024-05-09T06:30:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:8/866: dwrite d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:8/867: truncate d1/db/dd/d11/d5d/d99/de8/fde 307390 0 2024-05-09T06:30:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:3/695: link d4/d5d/d60/fd7 d4/d5d/d60/ddd/fe9 0 2024-05-09T06:30:50.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/737: dread d7/f62 [0,4194304] 0 2024-05-09T06:30:50.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/738: fsync d7/da3/fcc 0 2024-05-09T06:30:50.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/946: rename d3/d6f/c126 to d3/d7/d4c/d99/dac/db7/c131 0 2024-05-09T06:30:50.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/947: stat d3/d7/d28/d29/f2e 0 2024-05-09T06:30:50.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/560: dwrite d2/fb0 [0,4194304] 0 2024-05-09T06:30:50.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/729: mkdir da/d2d/d43/dc2/dec 0 2024-05-09T06:30:50.677 INFO:tasks.workunit.client.0.smithi046.stdout:7/948: dread d3/d7/d4c/d4f/d121/f41 [0,4194304] 0 2024-05-09T06:30:50.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/730: dread da/de/d14/d1f/d97/dcd/d7d/f85 [0,4194304] 0 2024-05-09T06:30:50.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/739: dwrite d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:8/868: getdents d1/db 0 2024-05-09T06:30:50.692 INFO:tasks.workunit.client.0.smithi046.stdout:8/869: fdatasync d1/db/dd/d11/f5c 0 2024-05-09T06:30:50.694 INFO:tasks.workunit.client.0.smithi046.stdout:3/696: creat d4/d20/d24/d29/d2b/de7/d58/fea x:0 0 0 2024-05-09T06:30:50.695 INFO:tasks.workunit.client.0.smithi046.stdout:3/697: creat d4/d48/d49/dc0/feb x:0 0 0 2024-05-09T06:30:50.695 INFO:tasks.workunit.client.0.smithi046.stdout:3/698: fsync d4/d20/d41/f66 0 2024-05-09T06:30:50.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/737: dwrite d11/d18/d1c/d53/fa5 [0,4194304] 0 2024-05-09T06:30:50.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/738: truncate d11/d18/d1c/d53/dc2/fd0 700030 0 2024-05-09T06:30:50.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/561: truncate d2/d6/d7/fd 761028 0 2024-05-09T06:30:50.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/562: truncate d2/d26/d2c/f75 660109 0 2024-05-09T06:30:50.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/949: symlink d3/l132 0 2024-05-09T06:30:50.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/731: symlink da/de/d14/d1f/d20/d5c/led 0 2024-05-09T06:30:50.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/732: readlink da/de/d54/d65/dbc/lbf 0 2024-05-09T06:30:50.713 INFO:tasks.workunit.client.0.smithi046.stdout:9/563: dread d2/d26/f68 [0,4194304] 0 2024-05-09T06:30:50.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/740: getdents d7/d10/d28/d30/dcf 0 2024-05-09T06:30:50.715 INFO:tasks.workunit.client.0.smithi046.stdout:0/739: dread d11/f62 [0,4194304] 0 2024-05-09T06:30:50.715 INFO:tasks.workunit.client.0.smithi046.stdout:0/740: fsync d11/d18/db1/fbc 0 2024-05-09T06:30:50.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/870: truncate d1/db/dd/f13 1441290 0 2024-05-09T06:30:50.717 INFO:tasks.workunit.client.0.smithi046.stdout:7/950: dread d3/d7/d28/f2a [0,4194304] 0 2024-05-09T06:30:50.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/699: creat d4/d20/d24/d2a/d55/d6a/dd5/fec x:0 0 0 2024-05-09T06:30:50.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/564: link d2/d6/d7/d1a/d27/f88 d2/d26/d2c/d3d/fba 0 2024-05-09T06:30:50.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/565: fdatasync d2/d6/d7/d1a/d86/f67 0 2024-05-09T06:30:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/951: mknod d3/d7/d4c/d4f/c133 0 2024-05-09T06:30:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/952: write d3/f8f [518729,86403] 0 2024-05-09T06:30:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/953: write d3/f85 [5207262,119380] 0 2024-05-09T06:30:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/954: fsync d3/d7/d4c/d4f/d121/d72/d79/d81/fe6 0 2024-05-09T06:30:50.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/741: dread d7/d10/d34/d46/d86/f7c [0,4194304] 0 2024-05-09T06:30:50.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/742: stat d7/d10/d34/d46/d86/fca 0 2024-05-09T06:30:50.731 INFO:tasks.workunit.client.0.smithi046.stdout:8/871: link d1/db/dd/f4a d1/db/dd/d11/f107 0 2024-05-09T06:30:50.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/700: creat d4/d48/d49/fed x:0 0 0 2024-05-09T06:30:50.736 INFO:tasks.workunit.client.0.smithi046.stdout:9/566: mkdir d2/d6/dbb 0 2024-05-09T06:30:50.736 INFO:tasks.workunit.client.0.smithi046.stdout:9/567: read - d2/d6/d7/d1a/fa6 zero size 2024-05-09T06:30:50.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/733: dwrite da/f94 [0,4194304] 0 2024-05-09T06:30:50.738 INFO:tasks.workunit.client.0.smithi046.stdout:0/741: dwrite d11/d18/f3a [0,4194304] 0 2024-05-09T06:30:50.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/742: write d11/d3f/f5d [56208,40351] 0 2024-05-09T06:30:50.741 INFO:tasks.workunit.client.0.smithi046.stdout:7/955: mknod d3/d7/d28/d29/d35/c134 0 2024-05-09T06:30:50.745 INFO:tasks.workunit.client.0.smithi046.stdout:1/743: dwrite d7/d10/d34/d46/d81/f9a [0,4194304] 0 2024-05-09T06:30:50.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/744: getdents d7/d10/d28/d30 0 2024-05-09T06:30:50.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/745: dread - d7/da3/fcc zero size 2024-05-09T06:30:50.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/746: fsync d7/d10/d34/f6e 0 2024-05-09T06:30:50.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/747: read d7/d10/d28/d30/f95 [7922137,119855] 0 2024-05-09T06:30:50.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/748: fdatasync d7/d10/d28/d55/f6f 0 2024-05-09T06:30:50.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/749: chown d7/d6d/fd2 104914033 1 2024-05-09T06:30:50.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/872: symlink d1/d7/dcd/ddf/l108 0 2024-05-09T06:30:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/701: creat d4/d48/d49/de8/fee x:0 0 0 2024-05-09T06:30:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/702: creat d4/d20/d24/d2a/d55/d6a/fef x:0 0 0 2024-05-09T06:30:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/703: dread - d4/d20/d24/d2a/d55/d6a/fcd zero size 2024-05-09T06:30:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/704: dread - d4/d5/dac/fdb zero size 2024-05-09T06:30:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/705: truncate d4/d20/d24/d29/d2b/d94/d5c/fe5 782976 0 2024-05-09T06:30:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/568: symlink d2/d26/d2c/lbc 0 2024-05-09T06:30:50.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/569: fsync d2/d26/d2c/d3d/f87 0 2024-05-09T06:30:50.753 INFO:tasks.workunit.client.0.smithi046.stdout:2/734: dwrite f6 [0,4194304] 0 2024-05-09T06:30:50.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/743: getdents d11/d18/db1 0 2024-05-09T06:30:50.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/744: creat d11/d18/d1c/feb x:0 0 0 2024-05-09T06:30:50.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/745: chown d11/d18/d27/d28/d36/l64 0 1 2024-05-09T06:30:50.761 INFO:tasks.workunit.client.0.smithi046.stdout:8/873: mkdir d1/d7/d12/d1d/d30/d38/db4/d109 0 2024-05-09T06:30:50.762 INFO:tasks.workunit.client.0.smithi046.stdout:9/570: dread d2/d6/d7/d1a/d27/d2a/f72 [0,4194304] 0 2024-05-09T06:30:50.762 INFO:tasks.workunit.client.0.smithi046.stdout:9/571: creat d2/dc/fbd x:0 0 0 2024-05-09T06:30:50.767 INFO:tasks.workunit.client.0.smithi046.stdout:2/735: dwrite da/de/f1e [0,4194304] 0 2024-05-09T06:30:50.767 INFO:tasks.workunit.client.0.smithi046.stdout:2/736: chown da/de/d14/d1f/d97 1790 1 2024-05-09T06:30:50.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/706: rmdir d4/d5d/d60/ddd/de2 0 2024-05-09T06:30:50.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/707: truncate d4/d20/fad 686977 0 2024-05-09T06:30:50.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/708: chown d4/d20/d24/d2a/d46/l5f 7511538 1 2024-05-09T06:30:50.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/709: stat d4/d48/d49 0 2024-05-09T06:30:50.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/710: dread d4/d20/d24/d29/d2b/f70 [0,4194304] 0 2024-05-09T06:30:50.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/711: fsync d4/d20/d24/d2a/f40 0 2024-05-09T06:30:50.775 INFO:tasks.workunit.client.0.smithi046.stdout:0/746: mknod d11/d18/db1/cec 0 2024-05-09T06:30:50.778 INFO:tasks.workunit.client.0.smithi046.stdout:8/874: rename d1/db/f28 to d1/d7/d12/d1d/d30/dbd/dc7/f10a 0 2024-05-09T06:30:50.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/572: symlink d2/d6/d7/d1a/d27/d2a/lbe 0 2024-05-09T06:30:50.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/712: creat d4/d20/d24/d29/d2b/de7/d58/ff0 x:0 0 0 2024-05-09T06:30:50.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/713: dread - d4/d20/d24/d29/d2b/de7/d58/fea zero size 2024-05-09T06:30:50.787 INFO:tasks.workunit.client.0.smithi046.stdout:8/875: creat d1/db/dd/d11/d5d/dfe/f10b x:0 0 0 2024-05-09T06:30:50.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/573: mknod d2/dc/d32/d70/cbf 0 2024-05-09T06:30:50.790 INFO:tasks.workunit.client.0.smithi046.stdout:0/747: dwrite d11/d18/d27/d28/d36/d5a/fb4 [0,4194304] 0 2024-05-09T06:30:50.834 INFO:tasks.workunit.client.0.smithi046.stdout:2/737: getdents da/dc 0 2024-05-09T06:30:50.834 INFO:tasks.workunit.client.0.smithi046.stdout:2/738: dread - da/de/d14/d1f/d20/d5c/dcf/fd6 zero size 2024-05-09T06:30:50.834 INFO:tasks.workunit.client.0.smithi046.stdout:2/739: readlink da/de/d14/d1f/d3b/l57 0 2024-05-09T06:30:50.835 INFO:tasks.workunit.client.0.smithi046.stdout:3/714: symlink d4/d20/d24/d29/d2b/de7/lf1 0 2024-05-09T06:30:50.835 INFO:tasks.workunit.client.0.smithi046.stdout:3/715: dread - d4/d20/d24/d29/d2b/de7/d58/fea zero size 2024-05-09T06:30:50.836 INFO:tasks.workunit.client.0.smithi046.stdout:8/876: dwrite d1/db/dd/d11/d5d/f6b [0,4194304] 0 2024-05-09T06:30:50.839 INFO:tasks.workunit.client.0.smithi046.stdout:0/748: getdents d11/d18/d1c/d53/dab 0 2024-05-09T06:30:50.843 INFO:tasks.workunit.client.0.smithi046.stdout:3/716: symlink d4/d48/d49/de8/lf2 0 2024-05-09T06:30:50.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/574: getdents d2/d20 0 2024-05-09T06:30:50.848 INFO:tasks.workunit.client.0.smithi046.stdout:3/717: mkdir d4/d20/d24/d29/df3 0 2024-05-09T06:30:50.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/575: link d2/d6/d7/f60 d2/d26/d2c/d3d/fc0 0 2024-05-09T06:30:50.852 INFO:tasks.workunit.client.0.smithi046.stdout:2/740: rename da/de/d14/d1f/d97 to da/dcb/dcc/dee 0 2024-05-09T06:30:50.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/576: write d2/d26/f43 [4738988,11073] 0 2024-05-09T06:30:50.855 INFO:tasks.workunit.client.0.smithi046.stdout:9/577: write d2/f47 [649925,120731] 0 2024-05-09T06:30:50.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/749: rename d11/d18/fe2 to d11/d18/d27/d28/d36/d91/d98/db0/fed 0 2024-05-09T06:30:50.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/750: creat d11/d18/d1c/d53/fee x:0 0 0 2024-05-09T06:30:50.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/751: write d11/d18/d27/d28/d6b/fae [4639679,75550] 0 2024-05-09T06:30:50.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/718: write d4/d5/f3a [6473666,48115] 0 2024-05-09T06:30:50.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/719: stat d4/d20/d24/d2a/d55 0 2024-05-09T06:30:50.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/578: creat d2/dc/d32/d70/fc1 x:0 0 0 2024-05-09T06:30:50.860 INFO:tasks.workunit.client.0.smithi046.stdout:8/877: dwrite d1/d7/d12/d1d/d30/dbd/f7c [0,4194304] 0 2024-05-09T06:30:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:2/741: dread da/de/d54/fa6 [0,4194304] 0 2024-05-09T06:30:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:2/742: write da/de/d14/f1b [4257007,23499] 0 2024-05-09T06:30:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:2/743: write da/de/d14/d1f/d3b/d9f/faa [1563527,7614] 0 2024-05-09T06:30:50.862 INFO:tasks.workunit.client.0.smithi046.stdout:3/720: dread d4/d20/d24/d29/d2b/f70 [0,4194304] 0 2024-05-09T06:30:50.862 INFO:tasks.workunit.client.0.smithi046.stdout:3/721: fdatasync d4/d20/d24/d2a/d46/fc4 0 2024-05-09T06:30:50.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/752: dread d11/d18/f8c [0,4194304] 0 2024-05-09T06:30:50.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/878: creat d1/d7/f10c x:0 0 0 2024-05-09T06:30:50.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/722: dread d4/d20/d41/f68 [0,4194304] 0 2024-05-09T06:30:50.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/744: mknod da/de/d54/d65/d6c/de2/cef 0 2024-05-09T06:30:50.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/745: fdatasync da/de/d14/fb8 0 2024-05-09T06:30:50.874 INFO:tasks.workunit.client.0.smithi046.stdout:8/879: creat d1/d7/d12/d1d/d30/dbd/dc7/f10d x:0 0 0 2024-05-09T06:30:50.874 INFO:tasks.workunit.client.0.smithi046.stdout:8/880: chown d1/db/d67/d6e/cce 392833 1 2024-05-09T06:30:50.875 INFO:tasks.workunit.client.0.smithi046.stdout:3/723: creat d4/d20/d24/d29/d2b/d94/dd3/ff4 x:0 0 0 2024-05-09T06:30:50.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/746: mkdir da/de/d54/d65/d6c/de2/df0 0 2024-05-09T06:30:50.877 INFO:tasks.workunit.client.0.smithi046.stdout:8/881: unlink d1/db/dd/d11/d5d/f77 0 2024-05-09T06:30:50.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/579: dwrite d2/d6/d7/d1a/f2e [4194304,4194304] 0 2024-05-09T06:30:50.879 INFO:tasks.workunit.client.0.smithi046.stdout:0/753: dwrite d11/d18/d27/d28/d6b/fcf [0,4194304] 0 2024-05-09T06:30:50.881 INFO:tasks.workunit.client.0.smithi046.stdout:3/724: creat d4/d20/d24/d29/df3/ff5 x:0 0 0 2024-05-09T06:30:50.881 INFO:tasks.workunit.client.0.smithi046.stdout:3/725: fdatasync d4/d20/d24/d2a/d55/d6a/f9d 0 2024-05-09T06:30:50.883 INFO:tasks.workunit.client.0.smithi046.stdout:8/882: rename d1/db/d67/f7e to d1/db/f10e 0 2024-05-09T06:30:50.883 INFO:tasks.workunit.client.0.smithi046.stdout:8/883: fdatasync d1/d7/d12/d1d/d30/d38/dc0/ff3 0 2024-05-09T06:30:50.886 INFO:tasks.workunit.client.0.smithi046.stdout:9/580: creat d2/d6/d7/d1a/d27/fc2 x:0 0 0 2024-05-09T06:30:50.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/754: symlink d11/d4f/lef 0 2024-05-09T06:30:50.888 INFO:tasks.workunit.client.0.smithi046.stdout:2/747: dwrite da/de/d14/d1f/d20/d5c/dcf/fd6 [0,4194304] 0 2024-05-09T06:30:50.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/755: chown d11/d18/d27/d28/d36/l83 5 1 2024-05-09T06:30:50.888 INFO:tasks.workunit.client.0.smithi046.stdout:2/748: write da/dc/f13 [4840513,102021] 0 2024-05-09T06:30:50.890 INFO:tasks.workunit.client.0.smithi046.stdout:3/726: link d4/d20/d24/d2a/d55/d6a/f9d d4/d20/d24/d2a/d55/d6a/dd5/ff6 0 2024-05-09T06:30:50.896 INFO:tasks.workunit.client.0.smithi046.stdout:0/756: mkdir d11/d18/d27/d28/d2d/d5c/ddf/df0 0 2024-05-09T06:30:50.899 INFO:tasks.workunit.client.0.smithi046.stdout:2/749: link da/de/d14/d1f/d3b/d9f/fa8 da/dcb/dcc/dee/dae/ff1 0 2024-05-09T06:30:50.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/727: mkdir d4/d20/d24/d29/df3/df7 0 2024-05-09T06:30:50.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/728: chown d4/d20/d24/d2a/d46/c99 850897181 1 2024-05-09T06:30:50.903 INFO:tasks.workunit.client.0.smithi046.stdout:9/581: rename d2/d6/d7/d1a/fa6 to d2/fc3 0 2024-05-09T06:30:50.907 INFO:tasks.workunit.client.0.smithi046.stdout:0/757: symlink d11/d18/d27/d28/lf1 0 2024-05-09T06:30:50.907 INFO:tasks.workunit.client.0.smithi046.stdout:0/758: dread - d11/d18/d27/d28/d36/d91/d98/db0/fed zero size 2024-05-09T06:30:50.913 INFO:tasks.workunit.client.0.smithi046.stdout:3/729: link d4/d5/fb7 d4/d20/d24/d29/df3/ff8 0 2024-05-09T06:30:50.913 INFO:tasks.workunit.client.0.smithi046.stdout:3/730: chown d4/d5/ca9 20221 1 2024-05-09T06:30:50.916 INFO:tasks.workunit.client.0.smithi046.stdout:0/759: rename d11/d3f/d6f/c78 to d11/d18/d27/cf2 0 2024-05-09T06:30:50.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/750: symlink da/dcb/dcc/dee/dcd/d7d/dc5/lf2 0 2024-05-09T06:30:50.919 INFO:tasks.workunit.client.0.smithi046.stdout:3/731: rmdir d4/d9e 0 2024-05-09T06:30:50.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/582: dwrite d2/dc/f11 [0,4194304] 0 2024-05-09T06:30:50.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/751: rename da/de/f10 to da/de/d54/ff3 0 2024-05-09T06:30:50.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/752: chown da/dc/dd0/fe8 101025 1 2024-05-09T06:30:50.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/732: mkdir d4/df9 0 2024-05-09T06:30:50.924 INFO:tasks.workunit.client.0.smithi046.stdout:2/753: rename da/de/d54/cc4 to da/d2d/d43/dc2/deb/cf4 0 2024-05-09T06:30:50.924 INFO:tasks.workunit.client.0.smithi046.stdout:2/754: chown da/dcb/dcc/dee/dae 607323 1 2024-05-09T06:30:50.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/755: chown da/de/d14/d1f/d20/d4e/f4f 613094 1 2024-05-09T06:30:50.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/756: chown da/dc/c19 56 1 2024-05-09T06:30:50.925 INFO:tasks.workunit.client.0.smithi046.stdout:3/733: mknod d4/d5d/de6/cfa 0 2024-05-09T06:30:50.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/757: unlink da/de/d1c/f55 0 2024-05-09T06:30:50.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/758: fsync da/dcb/dcc/dee/dcd/d7d/dc5/d3a/fa9 0 2024-05-09T06:30:50.928 INFO:tasks.workunit.client.0.smithi046.stdout:3/734: symlink d4/d5/dac/lfb 0 2024-05-09T06:30:50.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/735: unlink d4/d20/d24/d2a/d46/f5b 0 2024-05-09T06:30:50.945 INFO:tasks.workunit.client.0.smithi046.stdout:9/583: dwrite d2/fb0 [0,4194304] 0 2024-05-09T06:30:50.950 INFO:tasks.workunit.client.0.smithi046.stdout:2/759: dwrite da/de/d54/fd9 [0,4194304] 0 2024-05-09T06:30:50.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/736: dwrite d4/d5/fe0 [0,4194304] 0 2024-05-09T06:30:50.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/737: creat d4/d20/d24/d2a/da2/ffc x:0 0 0 2024-05-09T06:30:50.952 INFO:tasks.workunit.client.0.smithi046.stdout:2/760: mkdir da/dcb/df5 0 2024-05-09T06:30:50.953 INFO:tasks.workunit.client.0.smithi046.stdout:2/761: write da/dcb/dcc/dee/dcd/d7d/dc5/f9b [573699,69256] 0 2024-05-09T06:30:50.957 INFO:tasks.workunit.client.0.smithi046.stdout:3/738: rename d4/d5/f37 to d4/d5d/ffd 0 2024-05-09T06:30:50.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/739: mkdir d4/d20/d24/d2a/d55/d6a/dfe 0 2024-05-09T06:30:50.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/584: dwrite d2/d6/d7/d1a/d27/d2a/f93 [0,4194304] 0 2024-05-09T06:30:50.962 INFO:tasks.workunit.client.0.smithi046.stdout:3/740: mknod d4/d20/d24/d29/d2b/d94/d5c/cff 0 2024-05-09T06:30:50.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/741: dread - d4/d5d/d60/fdf zero size 2024-05-09T06:30:50.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/742: stat d4/d5/dac/fdb 0 2024-05-09T06:30:50.964 INFO:tasks.workunit.client.0.smithi046.stdout:3/743: truncate d4/d20/d24/d29/d2b/d94/f84 1271094 0 2024-05-09T06:30:50.964 INFO:tasks.workunit.client.0.smithi046.stdout:3/744: chown d4/d5d/de6/cfa 27629554 1 2024-05-09T06:30:50.965 INFO:tasks.workunit.client.0.smithi046.stdout:3/745: mknod d4/d20/d24/d29/c100 0 2024-05-09T06:30:50.965 INFO:tasks.workunit.client.0.smithi046.stdout:3/746: write d4/d20/fad [794229,13630] 0 2024-05-09T06:30:50.967 INFO:tasks.workunit.client.0.smithi046.stdout:3/747: getdents d4/d5d/de6 0 2024-05-09T06:30:50.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/748: dread d4/d20/d24/d29/d2b/d94/f64 [0,4194304] 0 2024-05-09T06:30:50.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/585: dread f0 [0,4194304] 0 2024-05-09T06:30:50.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/586: chown d2/dc/l19 39433781 1 2024-05-09T06:30:50.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/587: creat d2/fc4 x:0 0 0 2024-05-09T06:30:50.977 INFO:tasks.workunit.client.0.smithi046.stdout:3/749: dread d4/d20/fad [0,4194304] 0 2024-05-09T06:30:50.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/588: symlink d2/d26/d2c/d3d/lc5 0 2024-05-09T06:30:50.979 INFO:tasks.workunit.client.0.smithi046.stdout:3/750: link d4/d5/dac/db0/fbc d4/d20/d24/d29/d2b/f101 0 2024-05-09T06:30:50.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/589: rmdir d2/d6/d7/d1a/d27/d56 39 2024-05-09T06:30:50.983 INFO:tasks.workunit.client.0.smithi046.stdout:9/590: symlink d2/lc6 0 2024-05-09T06:30:50.987 INFO:tasks.workunit.client.0.smithi046.stdout:3/751: dread d4/d20/d24/d2a/d55/d6a/fc3 [0,4194304] 0 2024-05-09T06:30:50.988 INFO:tasks.workunit.client.0.smithi046.stdout:3/752: creat d4/d20/d24/d29/d2b/d94/f102 x:0 0 0 2024-05-09T06:30:50.989 INFO:tasks.workunit.client.0.smithi046.stdout:3/753: mkdir d4/d5d/de6/d103 0 2024-05-09T06:30:50.990 INFO:tasks.workunit.client.0.smithi046.stdout:3/754: stat l2 0 2024-05-09T06:30:50.999 INFO:tasks.workunit.client.0.smithi046.stdout:3/755: write d4/d5/fb7 [2090897,80686] 0 2024-05-09T06:30:51.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/756: creat d4/d20/d24/d29/d2b/d94/d5c/f104 x:0 0 0 2024-05-09T06:30:51.009 INFO:tasks.workunit.client.0.smithi046.stdout:9/591: dwrite d2/d6/d7/f1d [0,4194304] 0 2024-05-09T06:30:51.050 INFO:tasks.workunit.client.0.smithi046.stdout:3/757: rename d4/d20/d24/d29/d2b/de7/d58/fea to d4/d20/d41/d4a/f105 0 2024-05-09T06:30:51.056 INFO:tasks.workunit.client.0.smithi046.stdout:9/592: mknod d2/d6/d33/cc7 0 2024-05-09T06:30:51.079 INFO:tasks.workunit.client.0.smithi046.stdout:3/758: dwrite d4/d20/d24/d29/fba [0,4194304] 0 2024-05-09T06:30:51.079 INFO:tasks.workunit.client.0.smithi046.stdout:9/593: dwrite d2/f47 [0,4194304] 0 2024-05-09T06:30:51.080 INFO:tasks.workunit.client.0.smithi046.stdout:9/594: fsync d2/d6/d7/d1a/d86/f67 0 2024-05-09T06:30:51.087 INFO:tasks.workunit.client.0.smithi046.stdout:9/595: creat d2/d26/d2c/daf/fc8 x:0 0 0 2024-05-09T06:30:51.089 INFO:tasks.workunit.client.0.smithi046.stdout:9/596: mknod d2/dc/d32/cc9 0 2024-05-09T06:30:51.089 INFO:tasks.workunit.client.0.smithi046.stdout:9/597: write d2/d6/d7/d1a/d27/d2a/f8d [1851555,109965] 0 2024-05-09T06:30:51.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/598: dread d2/d6/d33/f79 [0,4194304] 0 2024-05-09T06:30:51.092 INFO:tasks.workunit.client.0.smithi046.stdout:9/599: fdatasync d2/d26/f43 0 2024-05-09T06:30:51.095 INFO:tasks.workunit.client.0.smithi046.stdout:9/600: truncate d2/d26/f92 357423 0 2024-05-09T06:30:51.098 INFO:tasks.workunit.client.0.smithi046.stdout:9/601: rename d2/fc3 to d2/dc/fca 0 2024-05-09T06:30:51.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/759: dwrite d4/d20/d24/d29/df3/ff5 [0,4194304] 0 2024-05-09T06:30:51.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/760: write d4/d20/d24/d29/df3/ff8 [2215271,14216] 0 2024-05-09T06:30:51.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/761: dread - d4/d5/dac/db0/fbc zero size 2024-05-09T06:30:51.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/762: stat d4/c3b 0 2024-05-09T06:30:51.101 INFO:tasks.workunit.client.0.smithi046.stdout:9/602: mknod d2/d26/d2c/d3d/ccb 0 2024-05-09T06:30:51.109 INFO:tasks.workunit.client.0.smithi046.stdout:3/763: creat d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/f106 x:0 0 0 2024-05-09T06:30:51.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/603: symlink d2/d26/d2c/daf/lcc 0 2024-05-09T06:30:51.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/764: symlink d4/d20/d24/d29/d2b/l107 0 2024-05-09T06:30:51.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/604: link d2/d6/d7/d1a/c64 d2/d6/d7/d1a/d86/ccd 0 2024-05-09T06:30:51.118 INFO:tasks.workunit.client.0.smithi046.stdout:3/765: rename d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/f106 to d4/d20/d24/d29/d2b/f108 0 2024-05-09T06:30:51.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/605: mknod d2/d6/d38/cce 0 2024-05-09T06:30:51.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/766: rename d4/d20/d41/f68 to d4/d20/d24/d29/d2b/d94/d5c/f109 0 2024-05-09T06:30:51.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/767: dread - d4/d20/d24/d2a/d55/d6a/dd5/ff6 zero size 2024-05-09T06:30:51.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/768: stat d4/d20/d24/d29/d2b/d94/d5c/cb2 0 2024-05-09T06:30:51.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/606: rename d2/d6/d7/d1a/d86/lb8 to d2/d6/d7/d1a/lcf 0 2024-05-09T06:30:51.125 INFO:tasks.workunit.client.0.smithi046.stdout:3/769: mknod d4/d20/d41/c10a 0 2024-05-09T06:30:51.125 INFO:tasks.workunit.client.0.smithi046.stdout:3/770: chown d4/d20/d24/d29/d2b/d94/f102 24557 1 2024-05-09T06:30:51.127 INFO:tasks.workunit.client.0.smithi046.stdout:9/607: symlink d2/d26/d2c/ld0 0 2024-05-09T06:30:51.127 INFO:tasks.workunit.client.0.smithi046.stdout:9/608: write d2/d6/d7/d1a/d27/fc2 [805884,47844] 0 2024-05-09T06:30:51.130 INFO:tasks.workunit.client.0.smithi046.stdout:3/771: link d4/d5d/f7d d4/d20/d24/d29/d2b/de7/d58/f10b 0 2024-05-09T06:30:51.132 INFO:tasks.workunit.client.0.smithi046.stdout:3/772: symlink d4/d5d/l10c 0 2024-05-09T06:30:51.132 INFO:tasks.workunit.client.0.smithi046.stdout:3/773: write d4/d20/d24/d2a/d55/d6a/fef [934516,62453] 0 2024-05-09T06:30:51.139 INFO:tasks.workunit.client.0.smithi046.stdout:3/774: dread d4/d20/d41/fb6 [0,4194304] 0 2024-05-09T06:30:51.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/775: symlink d4/d48/d49/l10d 0 2024-05-09T06:30:51.142 INFO:tasks.workunit.client.0.smithi046.stdout:9/609: dwrite d2/d6/f9b [0,4194304] 0 2024-05-09T06:30:51.145 INFO:tasks.workunit.client.0.smithi046.stdout:9/610: mkdir d2/d6/d7/d1a/d27/d65/dd1 0 2024-05-09T06:30:51.148 INFO:tasks.workunit.client.0.smithi046.stdout:9/611: truncate d2/d6/d7/f1b 1459235 0 2024-05-09T06:30:51.148 INFO:tasks.workunit.client.0.smithi046.stdout:9/612: creat d2/d6/d7/d1e/fd2 x:0 0 0 2024-05-09T06:30:51.154 INFO:tasks.workunit.client.0.smithi046.stdout:9/613: unlink d2/d6/d7/d1a/d27/f5f 0 2024-05-09T06:30:51.156 INFO:tasks.workunit.client.0.smithi046.stdout:3/776: dwrite d4/d20/fb5 [0,4194304] 0 2024-05-09T06:30:51.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/614: getdents d2/d6/d8b 0 2024-05-09T06:30:51.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/615: dread - d2/dc/fca zero size 2024-05-09T06:30:51.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/616: write d2/d6/d8b/fa9 [815516,67194] 0 2024-05-09T06:30:51.162 INFO:tasks.workunit.client.0.smithi046.stdout:3/777: creat d4/d20/d24/d29/df3/df7/f10e x:0 0 0 2024-05-09T06:30:51.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/617: stat d2/d6/d33/l7d 0 2024-05-09T06:30:51.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/618: fsync d2/f82 0 2024-05-09T06:30:51.165 INFO:tasks.workunit.client.0.smithi046.stdout:3/778: symlink d4/d20/d24/d29/d2b/d94/d5c/d6c/l10f 0 2024-05-09T06:30:51.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/619: rmdir d2/d6/d8b/d9d 0 2024-05-09T06:30:51.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/620: dread - d2/d6/d7/d1a/d27/d2a/da5/fac zero size 2024-05-09T06:30:51.167 INFO:tasks.workunit.client.0.smithi046.stdout:3/779: link d4/d20/d24/d29/d2b/f108 d4/d20/f110 0 2024-05-09T06:30:51.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/780: creat d4/d20/d41/d4a/f111 x:0 0 0 2024-05-09T06:30:51.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/781: dread - d4/d20/d24/d2a/d55/d6a/dd5/fec zero size 2024-05-09T06:30:51.178 INFO:tasks.workunit.client.0.smithi046.stdout:9/621: dread d2/d26/f73 [0,4194304] 0 2024-05-09T06:30:51.180 INFO:tasks.workunit.client.0.smithi046.stdout:9/622: creat d2/d6/fd3 x:0 0 0 2024-05-09T06:30:51.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/623: rmdir d2/d6/d33/da8 39 2024-05-09T06:30:51.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/782: dwrite d4/d20/d24/d2a/d55/d6a/dd5/ff6 [0,4194304] 0 2024-05-09T06:30:51.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/783: chown d4/d20/d41/d4a/f105 102111203 1 2024-05-09T06:30:51.198 INFO:tasks.workunit.client.0.smithi046.stdout:3/784: dwrite d4/d20/d41/f66 [0,4194304] 0 2024-05-09T06:30:51.198 INFO:tasks.workunit.client.0.smithi046.stdout:3/785: creat d4/d5/f112 x:0 0 0 2024-05-09T06:30:51.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/786: mknod d4/df9/c113 0 2024-05-09T06:30:51.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/787: write d4/d48/fae [4718087,73772] 0 2024-05-09T06:30:51.215 INFO:tasks.workunit.client.0.smithi046.stdout:3/788: write d4/d20/d24/f18 [680242,116440] 0 2024-05-09T06:30:51.230 INFO:tasks.workunit.client.0.smithi046.stdout:3/789: dwrite d4/d20/d24/d2a/da2/fc8 [0,4194304] 0 2024-05-09T06:30:51.233 INFO:tasks.workunit.client.0.smithi046.stdout:3/790: getdents d4/d20 0 2024-05-09T06:30:51.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/791: symlink d4/d20/d24/l114 0 2024-05-09T06:30:51.236 INFO:tasks.workunit.client.0.smithi046.stdout:3/792: mkdir d4/d20/d24/d2a/d55/d74/d115 0 2024-05-09T06:30:51.236 INFO:tasks.workunit.client.0.smithi046.stdout:3/793: truncate d4/d5/dac/db0/fbc 370446 0 2024-05-09T06:30:51.236 INFO:tasks.workunit.client.0.smithi046.stdout:3/794: fsync d4/d20/d41/fb6 0 2024-05-09T06:30:51.238 INFO:tasks.workunit.client.0.smithi046.stdout:3/795: rmdir d4/d5/dac 39 2024-05-09T06:30:51.238 INFO:tasks.workunit.client.0.smithi046.stdout:3/796: chown d4/d20/d24/c35 11 1 2024-05-09T06:30:51.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:51 smithi106 ceph-mon[34679]: pgmap v32: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 187 MiB/s rd, 234 MiB/s wr, 418 op/s 2024-05-09T06:30:51.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:51 smithi046 ceph-mon[26924]: pgmap v32: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 187 MiB/s rd, 234 MiB/s wr, 418 op/s 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/734: sync 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/684: sync 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/750: sync 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:8/884: sync 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:2/762: sync 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/956: sync 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:2/763: dread - da/dcb/dcc/dee/dcd/d7d/dc5/d3a/f9d zero size 2024-05-09T06:30:51.343 INFO:tasks.workunit.client.0.smithi046.stdout:6/880: sync 2024-05-09T06:30:51.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/760: sync 2024-05-09T06:30:51.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/761: chown d11/d3f/fe7 38 1 2024-05-09T06:30:51.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/762: write d11/d18/d27/d28/d36/d5a/f80 [1769635,100764] 0 2024-05-09T06:30:51.344 INFO:tasks.workunit.client.0.smithi046.stdout:8/885: rmdir d1/ddc 39 2024-05-09T06:30:51.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/751: link d7/d10/d28/d30/l37 d7/dd6/lf4 0 2024-05-09T06:30:51.346 INFO:tasks.workunit.client.0.smithi046.stdout:1/752: readlink d7/d10/d84/da8/lbb 0 2024-05-09T06:30:51.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/735: mkdir d7/df/d10/d1d/db9/de0 0 2024-05-09T06:30:51.347 INFO:tasks.workunit.client.0.smithi046.stdout:7/957: mkdir d3/d7/d4c/d4f/d135 0 2024-05-09T06:30:51.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/685: symlink d0/dba/de7/dc7/lec 0 2024-05-09T06:30:51.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/881: creat db/d10/d57/f11e x:0 0 0 2024-05-09T06:30:51.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/882: write db/d10/d3f/d4f/d8a/fb3 [2987653,113467] 0 2024-05-09T06:30:51.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/763: unlink d11/d18/c2a 0 2024-05-09T06:30:51.354 INFO:tasks.workunit.client.0.smithi046.stdout:8/886: creat d1/db/dd/d11/d5d/d99/de8/dd4/f10f x:0 0 0 2024-05-09T06:30:51.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/736: unlink d7/df/d3a/l75 0 2024-05-09T06:30:51.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/737: write d7/df/d3a/f83 [2416709,24541] 0 2024-05-09T06:30:51.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/958: mkdir d3/d7/d28/d29/d136 0 2024-05-09T06:30:51.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/959: fdatasync d3/d7/d4c/d4f/d121/f47 0 2024-05-09T06:30:51.364 INFO:tasks.workunit.client.0.smithi046.stdout:7/960: write d3/d7/d4c/d4f/d121/f41 [4429726,52681] 0 2024-05-09T06:30:51.364 INFO:tasks.workunit.client.0.smithi046.stdout:5/686: rename d0/d58/le6 to d0/d1b/d21/led 0 2024-05-09T06:30:51.367 INFO:tasks.workunit.client.0.smithi046.stdout:2/764: dwrite da/de/d14/d1f/d20/f5a [0,4194304] 0 2024-05-09T06:30:51.367 INFO:tasks.workunit.client.0.smithi046.stdout:0/764: dwrite d11/d18/f3b [0,4194304] 0 2024-05-09T06:30:51.367 INFO:tasks.workunit.client.0.smithi046.stdout:0/765: chown d11/d18/d1c/d53/fd6 281 1 2024-05-09T06:30:51.367 INFO:tasks.workunit.client.0.smithi046.stdout:0/766: stat d11/l17 0 2024-05-09T06:30:51.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/887: unlink d1/db/dd/d11/fa6 0 2024-05-09T06:30:51.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/888: chown d1/db/dd/d11/d5d/d99/de8/dd4/f10f 7544 1 2024-05-09T06:30:51.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/753: getdents d7/d10/d34/d46 0 2024-05-09T06:30:51.374 INFO:tasks.workunit.client.0.smithi046.stdout:4/738: dwrite d7/df/d53/f6f [4194304,4194304] 0 2024-05-09T06:30:51.374 INFO:tasks.workunit.client.0.smithi046.stdout:4/739: dread - d7/df/d3a/f39 zero size 2024-05-09T06:30:51.375 INFO:tasks.workunit.client.0.smithi046.stdout:0/767: read d11/d18/d27/d28/d36/d5a/f69 [213171,83966] 0 2024-05-09T06:30:51.375 INFO:tasks.workunit.client.0.smithi046.stdout:7/961: truncate d3/d7/d28/d29/d35/f56 1430739 0 2024-05-09T06:30:51.378 INFO:tasks.workunit.client.0.smithi046.stdout:6/883: rename db/d10/d57/d10c to db/d10/d3f/d44/d46/d70/d11f 0 2024-05-09T06:30:51.378 INFO:tasks.workunit.client.0.smithi046.stdout:5/687: creat d0/dba/de7/dc7/fee x:0 0 0 2024-05-09T06:30:51.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/765: mkdir da/de/d14/d1f/d3b/df6 0 2024-05-09T06:30:51.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/766: dread - da/dcb/dcc/dee/dcd/d7d/dc5/d3d/fe0 zero size 2024-05-09T06:30:51.383 INFO:tasks.workunit.client.0.smithi046.stdout:8/889: creat d1/d7/d12/d1d/d30/d38/dc0/f110 x:0 0 0 2024-05-09T06:30:51.384 INFO:tasks.workunit.client.0.smithi046.stdout:8/890: truncate d1/db/dd/d11/d5d/dbb/ffd 838380 0 2024-05-09T06:30:51.384 INFO:tasks.workunit.client.0.smithi046.stdout:8/891: stat d1/db/dd/d11/d5d/f6b 0 2024-05-09T06:30:51.384 INFO:tasks.workunit.client.0.smithi046.stdout:7/962: write d3/d7/d4c/d4f/d121/fee [3925404,2519] 0 2024-05-09T06:30:51.386 INFO:tasks.workunit.client.0.smithi046.stdout:1/754: creat d7/d10/d28/d30/df1/ff5 x:0 0 0 2024-05-09T06:30:51.392 INFO:tasks.workunit.client.0.smithi046.stdout:4/740: mkdir d7/df/d3a/d25/d86/de1 0 2024-05-09T06:30:51.392 INFO:tasks.workunit.client.0.smithi046.stdout:4/741: truncate d7/df/d10/d2f/f6d 4683274 0 2024-05-09T06:30:51.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/768: unlink d11/d18/d1c/d53/f6a 0 2024-05-09T06:30:51.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/688: dwrite d0/d1b/f31 [0,4194304] 0 2024-05-09T06:30:51.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/767: mkdir da/de/d54/d65/dbc/df7 0 2024-05-09T06:30:51.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/768: chown da/dcb/dcc/dee/dcd/d7d/dc5/d3d/dc8 0 1 2024-05-09T06:30:51.407 INFO:tasks.workunit.client.0.smithi046.stdout:8/892: creat d1/d7/d12/d1d/d30/f111 x:0 0 0 2024-05-09T06:30:51.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/963: mkdir d3/d7/d4c/d99/dac/d137 0 2024-05-09T06:30:51.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/964: readlink d3/d7/d4c/lc7 0 2024-05-09T06:30:51.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/965: readlink d3/l21 0 2024-05-09T06:30:51.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/966: chown d3/d7/d4c/d4f/d121/d72/d79/fa9 45 1 2024-05-09T06:30:51.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/769: dwrite d11/d18/d27/d28/d36/f37 [4194304,4194304] 0 2024-05-09T06:30:51.417 INFO:tasks.workunit.client.0.smithi046.stdout:5/689: getdents d0/d1b/d39/d8b 0 2024-05-09T06:30:51.421 INFO:tasks.workunit.client.0.smithi046.stdout:2/769: mkdir da/df8 0 2024-05-09T06:30:51.421 INFO:tasks.workunit.client.0.smithi046.stdout:2/770: write da/de/d54/ff3 [6226060,17085] 0 2024-05-09T06:30:51.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/893: rename d1/l6 to d1/db/dd/d11/d5d/d99/de8/dd4/l112 0 2024-05-09T06:30:51.425 INFO:tasks.workunit.client.0.smithi046.stdout:8/894: fsync d1/ddc/fe2 0 2024-05-09T06:30:51.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/967: truncate d3/d7/d4c/d4f/d121/d72/f115 303457 0 2024-05-09T06:30:51.435 INFO:tasks.workunit.client.0.smithi046.stdout:4/742: getdents d7/df/d3a 0 2024-05-09T06:30:51.435 INFO:tasks.workunit.client.0.smithi046.stdout:4/743: write d7/f72 [10753525,1367] 0 2024-05-09T06:30:51.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/770: mknod d11/d18/d1c/d53/cf3 0 2024-05-09T06:30:51.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/690: rename d0/d1b/d21/f7c to d0/d1b/d21/d81/fef 0 2024-05-09T06:30:51.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/691: creat d0/d1b/d21/d81/ff0 x:0 0 0 2024-05-09T06:30:51.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/692: creat d0/dad/ff1 x:0 0 0 2024-05-09T06:30:51.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/744: symlink d7/df/d10/d1d/d77/d87/dac/le2 0 2024-05-09T06:30:51.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/745: chown d7/df/d3a/f83 56 1 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:7/968: read d3/fd6 [1372864,22671] 0 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/884: dwrite db/d10/d6b/f8f [0,4194304] 0 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/885: read - db/d10/d3f/f112 zero size 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/886: readlink db/d10/d3c/d91/ld2 0 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/887: truncate db/d10/d3f/d44/fb8 1338631 0 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/888: creat db/d10/d6b/f120 x:0 0 0 2024-05-09T06:30:51.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/889: write db/d93/f116 [5126599,117832] 0 2024-05-09T06:30:51.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/771: dwrite da/f94 [0,4194304] 0 2024-05-09T06:30:51.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/895: dwrite d1/db/dd/d11/d5d/fb1 [0,4194304] 0 2024-05-09T06:30:51.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/896: truncate d1/db/dd/d11/d5d/d99/de8/dd4/f10f 64240 0 2024-05-09T06:30:51.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/897: stat d1/d7/d12/d45/l103 0 2024-05-09T06:30:51.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/898: chown d1/db/d102 187 1 2024-05-09T06:30:51.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/899: read - d1/db/dd/d11/fba zero size 2024-05-09T06:30:51.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/900: chown d1/d7/d12/d1d/d30/d38/dc0/ff3 1051758 1 2024-05-09T06:30:51.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/901: getdents d1/db/dd/d11/d5d/d99/de8/df2 0 2024-05-09T06:30:51.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/969: dread d3/d7/d4c/d4f/d121/fee [0,4194304] 0 2024-05-09T06:30:51.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/970: chown d3/d7/d4c/d4f/d121/l12e 146 1 2024-05-09T06:30:51.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/971: write d3/d7/d4c/d4f/d121/d5b/d84/fd1 [311511,47843] 0 2024-05-09T06:30:51.452 INFO:tasks.workunit.client.0.smithi046.stdout:5/693: mknod d0/d58/cf2 0 2024-05-09T06:30:51.454 INFO:tasks.workunit.client.0.smithi046.stdout:4/746: creat d7/df/fe3 x:0 0 0 2024-05-09T06:30:51.455 INFO:tasks.workunit.client.0.smithi046.stdout:0/771: rmdir d11/d18/d1c/d56 39 2024-05-09T06:30:51.455 INFO:tasks.workunit.client.0.smithi046.stdout:0/772: truncate d11/d18/d27/d28/d36/faa 1373357 0 2024-05-09T06:30:51.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/890: unlink db/d10/d3f/d44/d5e/ceb 0 2024-05-09T06:30:51.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/772: symlink da/de/d14/d1f/d20/d7c/d8b/d95/lf9 0 2024-05-09T06:30:51.468 INFO:tasks.workunit.client.0.smithi046.stdout:7/972: rename d3/d7/d4c/d99/d110/l127 to d3/d7/d4c/d99/dac/l138 0 2024-05-09T06:30:51.468 INFO:tasks.workunit.client.0.smithi046.stdout:7/973: fdatasync d3/d7/fa 0 2024-05-09T06:30:51.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/773: dwrite d11/d18/d1c/d53/f61 [0,4194304] 0 2024-05-09T06:30:51.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/774: write d11/d18/d1c/d53/d82/fa7 [511150,64188] 0 2024-05-09T06:30:51.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/694: mkdir d0/df3 0 2024-05-09T06:30:51.472 INFO:tasks.workunit.client.0.smithi046.stdout:4/747: mkdir d7/df/d3a/d45/d96/db3/de4 0 2024-05-09T06:30:51.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/891: getdents db/d93 0 2024-05-09T06:30:51.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/773: mknod da/de/d14/d1f/d3b/cfa 0 2024-05-09T06:30:51.489 INFO:tasks.workunit.client.0.smithi046.stdout:5/695: mkdir d0/db3/deb/df4 0 2024-05-09T06:30:51.489 INFO:tasks.workunit.client.0.smithi046.stdout:5/696: dread - d0/dba/de7/d50/fe0 zero size 2024-05-09T06:30:51.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/774: getdents da/dcb/dcc/dee/dcd/d7d/dc5/d3d 0 2024-05-09T06:30:51.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/775: chown da/dcb/dcc/dee/dcd/d7d/dc5/d3d/fe0 0 1 2024-05-09T06:30:51.494 INFO:tasks.workunit.client.0.smithi046.stdout:7/974: write d3/d7/d28/d29/d35/d5c/dad/dbb/fe4 [1927187,81035] 0 2024-05-09T06:30:51.498 INFO:tasks.workunit.client.0.smithi046.stdout:4/748: dwrite d7/fd9 [0,4194304] 0 2024-05-09T06:30:51.500 INFO:tasks.workunit.client.0.smithi046.stdout:2/776: dread da/de/d54/fd9 [0,4194304] 0 2024-05-09T06:30:51.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/697: write d0/d1b/d21/f55 [727518,58941] 0 2024-05-09T06:30:51.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/892: dwrite db/d10/d3c/fb4 [4194304,4194304] 0 2024-05-09T06:30:51.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/698: dread - d0/dba/de7/d50/fc5 zero size 2024-05-09T06:30:51.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/699: getdents d0/df3 0 2024-05-09T06:30:51.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/700: fdatasync d0/dad/fc3 0 2024-05-09T06:30:51.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/749: creat d7/df/d10/d1d/fe5 x:0 0 0 2024-05-09T06:30:51.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/750: creat d7/df/d10/d1d/fe6 x:0 0 0 2024-05-09T06:30:51.504 INFO:tasks.workunit.client.0.smithi046.stdout:2/777: creat da/de/d14/d1f/d20/d7c/ffb x:0 0 0 2024-05-09T06:30:51.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/701: symlink d0/dba/de7/d83/lf5 0 2024-05-09T06:30:51.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/702: dread - d0/d1b/d39/d8b/fb7 zero size 2024-05-09T06:30:51.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/703: fdatasync d0/dba/de7/d50/fe0 0 2024-05-09T06:30:51.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/704: creat d0/dad/ff6 x:0 0 0 2024-05-09T06:30:51.509 INFO:tasks.workunit.client.0.smithi046.stdout:4/751: mknod d7/df/d3a/d45/ce7 0 2024-05-09T06:30:51.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/752: chown d7/df/d3a/d25/l6c 2 1 2024-05-09T06:30:51.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/753: stat f1 0 2024-05-09T06:30:51.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/778: read da/de/d14/d1f/d3b/f37 [80960,127644] 0 2024-05-09T06:30:51.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/975: dwrite d3/d7/d28/d73/f88 [0,4194304] 0 2024-05-09T06:30:51.519 INFO:tasks.workunit.client.0.smithi046.stdout:2/779: mkdir da/dcb/dcc/dee/dcd/d7d/dfc 0 2024-05-09T06:30:51.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/780: mknod da/de/d1c/cfd 0 2024-05-09T06:30:51.521 INFO:tasks.workunit.client.0.smithi046.stdout:2/781: chown da/c4a 17 1 2024-05-09T06:30:51.524 INFO:tasks.workunit.client.0.smithi046.stdout:4/754: write d7/fd9 [4002564,483] 0 2024-05-09T06:30:51.524 INFO:tasks.workunit.client.0.smithi046.stdout:4/755: readlink d7/df/lb1 0 2024-05-09T06:30:51.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/893: dwrite db/d10/d3f/d44/d5e/dbe/fc1 [0,4194304] 0 2024-05-09T06:30:51.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/894: creat db/d10/dfa/f121 x:0 0 0 2024-05-09T06:30:51.525 INFO:tasks.workunit.client.0.smithi046.stdout:5/705: dwrite d0/d1b/f82 [4194304,4194304] 0 2024-05-09T06:30:51.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/756: symlink d7/df/d3a/d45/d96/db3/de4/le8 0 2024-05-09T06:30:51.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/757: write d7/f72 [15132971,41708] 0 2024-05-09T06:30:51.526 INFO:tasks.workunit.client.0.smithi046.stdout:7/976: write d3/d7/d28/fc5 [1687350,9398] 0 2024-05-09T06:30:51.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/895: link db/d10/d3f/d44/d5e/l10d db/d10/d3f/d4f/l122 0 2024-05-09T06:30:51.537 INFO:tasks.workunit.client.0.smithi046.stdout:5/706: dread d0/d1b/f20 [0,4194304] 0 2024-05-09T06:30:51.537 INFO:tasks.workunit.client.0.smithi046.stdout:4/758: stat d7/df/d3a/d25/d81/d98/db7/cc2 0 2024-05-09T06:30:51.538 INFO:tasks.workunit.client.0.smithi046.stdout:4/759: write d7/f1e [530487,37205] 0 2024-05-09T06:30:51.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/782: dwrite da/f45 [0,4194304] 0 2024-05-09T06:30:51.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/977: rename d3/d7/d4c/d99/dac/c12c to d3/d7/d28/d29/d35/d5c/c139 0 2024-05-09T06:30:51.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/707: link d0/d1b/d39/d8a/cc1 d0/db3/deb/df4/cf7 0 2024-05-09T06:30:51.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/783: chown da/dcb/dcc/dee/dcd/d7d/dc5/l4b 235233347 1 2024-05-09T06:30:51.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/784: write da/de/d14/d1f/d20/d7c/d8b/d95/fab [1176483,58779] 0 2024-05-09T06:30:51.546 INFO:tasks.workunit.client.0.smithi046.stdout:2/785: dread da/de/d14/d1f/d20/f3c [0,4194304] 0 2024-05-09T06:30:51.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/786: read da/dcb/dcc/dee/dcd/d7d/f85 [114246,67691] 0 2024-05-09T06:30:51.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/787: fsync da/dc/dd0/fe8 0 2024-05-09T06:30:51.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/760: dread d7/df/d10/d1d/f8e [0,4194304] 0 2024-05-09T06:30:51.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/708: rmdir d0/dba 39 2024-05-09T06:30:51.553 INFO:tasks.workunit.client.0.smithi046.stdout:2/788: write da/de/d54/d65/d70/f91 [846641,38821] 0 2024-05-09T06:30:51.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/761: truncate d7/df/d3a/f2c 2923381 0 2024-05-09T06:30:51.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/709: symlink d0/db3/deb/lf8 0 2024-05-09T06:30:51.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/710: write d0/dba/de7/dc7/dd0/fd5 [548911,29177] 0 2024-05-09T06:30:51.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/711: write d0/dba/de7/d50/f73 [1835440,105052] 0 2024-05-09T06:30:51.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/789: write da/dcb/dcc/dee/dcd/d7d/dc5/d3a/fb4 [2181701,64961] 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:2/790: truncate da/dcb/dcc/dee/dcd/d7d/dc5/f78 531822 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:2/791: creat da/de/d1c/ffe x:0 0 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:2/792: truncate da/d2d/f42 4327672 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:2/793: fdatasync da/dcb/dcc/dee/dcd/f88 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:2/794: write da/dcb/dcc/dee/dcd/d7d/dc5/d3a/f64 [4388520,85637] 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:5/712: symlink d0/dba/de7/lf9 0 2024-05-09T06:30:51.561 INFO:tasks.workunit.client.0.smithi046.stdout:5/713: creat d0/dad/ffa x:0 0 0 2024-05-09T06:30:51.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/762: dread d7/df/d10/d2f/fce [0,4194304] 0 2024-05-09T06:30:51.568 INFO:tasks.workunit.client.0.smithi046.stdout:2/795: read da/de/d54/d65/d70/fb9 [2956781,129331] 0 2024-05-09T06:30:51.570 INFO:tasks.workunit.client.0.smithi046.stdout:5/714: mkdir d0/dba/de7/dfb 0 2024-05-09T06:30:51.573 INFO:tasks.workunit.client.0.smithi046.stdout:5/715: dread d0/dba/de7/dc7/dd0/fd5 [0,4194304] 0 2024-05-09T06:30:51.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/763: rename d7/df/d3a/d45/f82 to d7/df/d3a/d25/d81/fe9 0 2024-05-09T06:30:51.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/764: chown d7/df/d10/d1d/d77/d87/dbe/cd4 5588994 1 2024-05-09T06:30:51.576 INFO:tasks.workunit.client.0.smithi046.stdout:2/796: symlink da/dcb/dcc/dee/lff 0 2024-05-09T06:30:51.576 INFO:tasks.workunit.client.0.smithi046.stdout:2/797: write da/dcb/dcc/dee/dcd/d7d/dc5/d3a/fb4 [1462426,64447] 0 2024-05-09T06:30:51.581 INFO:tasks.workunit.client.0.smithi046.stdout:4/765: truncate d7/fd9 3666175 0 2024-05-09T06:30:51.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/798: creat da/dcb/dcc/dee/dcd/d7d/dc5/d3d/f100 x:0 0 0 2024-05-09T06:30:51.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/799: dread da/dcb/dcc/dee/dcd/d7d/dc5/f9b [0,4194304] 0 2024-05-09T06:30:51.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/800: chown da/dcb/dcc/dee/dcd/d7d/dc5/d3a/fa9 12 1 2024-05-09T06:30:51.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/801: write da/dcb/dcc/dee/dcd/d7d/dc5/d3a/f50 [2103518,68342] 0 2024-05-09T06:30:51.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/766: rename d7/df/cb0 to d7/daf/dd6/cea 0 2024-05-09T06:30:51.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/767: chown d7/df/d3a/d25/l94 16 1 2024-05-09T06:30:51.597 INFO:tasks.workunit.client.0.smithi046.stdout:2/802: read da/de/d1c/f82 [1458492,108109] 0 2024-05-09T06:30:51.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/803: creat da/de/d54/d65/dbc/f101 x:0 0 0 2024-05-09T06:30:51.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/768: dwrite d7/df/d3a/d25/d86/fa6 [0,4194304] 0 2024-05-09T06:30:51.605 INFO:tasks.workunit.client.0.smithi046.stdout:2/804: dread da/de/d1c/f6a [0,4194304] 0 2024-05-09T06:30:51.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/805: dread da/de/d1c/f3e [0,4194304] 0 2024-05-09T06:30:51.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/769: mkdir d7/df/d53/deb 0 2024-05-09T06:30:51.619 INFO:tasks.workunit.client.0.smithi046.stdout:2/806: write da/de/d14/d1f/d20/d5c/dcf/fd6 [2775882,20741] 0 2024-05-09T06:30:51.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/770: creat d7/df/d53/deb/fec x:0 0 0 2024-05-09T06:30:51.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/771: chown d7/fc 24 1 2024-05-09T06:30:51.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/807: creat da/d2d/d43/dc2/dec/f102 x:0 0 0 2024-05-09T06:30:51.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/808: creat da/de/d14/d1f/d20/d7c/f103 x:0 0 0 2024-05-09T06:30:51.628 INFO:tasks.workunit.client.0.smithi046.stdout:4/772: symlink d7/df/d3a/led 0 2024-05-09T06:30:51.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/773: mkdir d7/df/d3a/dee 0 2024-05-09T06:30:51.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/774: dread - d7/df/fbd zero size 2024-05-09T06:30:51.632 INFO:tasks.workunit.client.0.smithi046.stdout:2/809: dread da/de/d14/d1f/d20/d5c/dcf/fd6 [0,4194304] 0 2024-05-09T06:30:51.633 INFO:tasks.workunit.client.0.smithi046.stdout:4/775: unlink d7/dd8/fdf 0 2024-05-09T06:30:51.634 INFO:tasks.workunit.client.0.smithi046.stdout:2/810: getdents da/de/d14/d1f/d3b/da2 0 2024-05-09T06:30:51.634 INFO:tasks.workunit.client.0.smithi046.stdout:2/811: readlink da/de/d1c/l38 0 2024-05-09T06:30:51.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/776: symlink d7/df/d3a/d25/d81/d98/db7/lef 0 2024-05-09T06:30:51.637 INFO:tasks.workunit.client.0.smithi046.stdout:4/777: readlink d7/ld 0 2024-05-09T06:30:51.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/812: mkdir da/d2d/d104 0 2024-05-09T06:30:51.638 INFO:tasks.workunit.client.0.smithi046.stdout:4/778: symlink d7/df/lf0 0 2024-05-09T06:30:51.641 INFO:tasks.workunit.client.0.smithi046.stdout:4/779: rmdir d7/df/d3a/d45/dc6 0 2024-05-09T06:30:51.642 INFO:tasks.workunit.client.0.smithi046.stdout:4/780: getdents d7/df/d3a/d45/d96 0 2024-05-09T06:30:51.643 INFO:tasks.workunit.client.0.smithi046.stdout:4/781: creat d7/df/d10/d1d/d77/ff1 x:0 0 0 2024-05-09T06:30:51.644 INFO:tasks.workunit.client.0.smithi046.stdout:4/782: unlink d7/fa 0 2024-05-09T06:30:51.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/783: dread d7/df/d3a/f83 [0,4194304] 0 2024-05-09T06:30:51.650 INFO:tasks.workunit.client.0.smithi046.stdout:4/784: getdents d7/df/d3a/d45/d96/db3 0 2024-05-09T06:30:51.653 INFO:tasks.workunit.client.0.smithi046.stdout:4/785: rmdir d7/df/d3a/d45/d96/dd7 0 2024-05-09T06:30:51.653 INFO:tasks.workunit.client.0.smithi046.stdout:4/786: readlink d7/ld 0 2024-05-09T06:30:51.660 INFO:tasks.workunit.client.0.smithi046.stdout:4/787: write d7/df/d3a/f76 [254826,77730] 0 2024-05-09T06:30:51.661 INFO:tasks.workunit.client.0.smithi046.stdout:4/788: mkdir d7/daf/dd6/df2 0 2024-05-09T06:30:51.661 INFO:tasks.workunit.client.0.smithi046.stdout:4/789: chown d7/df/d3a/d25/d81/d98 744 1 2024-05-09T06:30:51.662 INFO:tasks.workunit.client.0.smithi046.stdout:4/790: mknod d7/df/d3a/cf3 0 2024-05-09T06:30:51.663 INFO:tasks.workunit.client.0.smithi046.stdout:2/813: dwrite da/dcb/dcc/dee/dcd/d7d/dc5/f78 [0,4194304] 0 2024-05-09T06:30:51.664 INFO:tasks.workunit.client.0.smithi046.stdout:4/791: rename d7/df/d10/d1d/fb6 to d7/df/d3a/d25/d86/de1/ff4 0 2024-05-09T06:30:51.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/792: link d7/df/d3a/d25/d81/c8b d7/df/d10/d1d/cf5 0 2024-05-09T06:30:51.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/793: write d7/df/d10/d1d/fe5 [694905,26759] 0 2024-05-09T06:30:51.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/794: readlink d7/df/d3a/d25/l6c 0 2024-05-09T06:30:51.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/795: mkdir d7/df/d3a/d25/df6 0 2024-05-09T06:30:51.673 INFO:tasks.workunit.client.0.smithi046.stdout:4/796: rmdir d7/daf 39 2024-05-09T06:30:51.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/797: mkdir d7/dd8/df7 0 2024-05-09T06:30:51.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/798: chown d7/df/fa3 13363 1 2024-05-09T06:30:51.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/799: rmdir d7/df/d3a/d25/d86/de1 39 2024-05-09T06:30:51.679 INFO:tasks.workunit.client.0.smithi046.stdout:2/814: dwrite da/de/d14/d1f/d3b/d9f/fc3 [0,4194304] 0 2024-05-09T06:30:51.679 INFO:tasks.workunit.client.0.smithi046.stdout:2/815: readlink da/l92 0 2024-05-09T06:30:51.681 INFO:tasks.workunit.client.0.smithi046.stdout:2/816: link da/dcb/dcc/dee/dcd/d7d/dc5/d3d/faf da/de/d14/d1f/d20/d7c/d8b/f105 0 2024-05-09T06:30:51.683 INFO:tasks.workunit.client.0.smithi046.stdout:4/800: dread d7/df/d3a/d25/d81/d98/fc4 [0,4194304] 0 2024-05-09T06:30:51.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/817: rename da/de/d14/d1f/d3b/d9f/faa to da/dcb/dcc/dee/f106 0 2024-05-09T06:30:51.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/818: stat da/dc/f27 0 2024-05-09T06:30:51.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/819: truncate da/dcb/dcc/dee/dcd/d7d/fce 645253 0 2024-05-09T06:30:51.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/820: chown da/dcb/dcc/dee/dcd/d7d/dc5 50656 1 2024-05-09T06:30:51.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/821: write da/dcb/dcc/dee/dcd/d7d/dc5/d3a/fb4 [1083329,5156] 0 2024-05-09T06:30:51.684 INFO:tasks.workunit.client.0.smithi046.stdout:4/801: symlink d7/df/d53/d91/lf8 0 2024-05-09T06:30:51.686 INFO:tasks.workunit.client.0.smithi046.stdout:4/802: symlink d7/df/d3a/d25/df6/lf9 0 2024-05-09T06:30:51.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/803: readlink d7/df/d3a/d25/l7f 0 2024-05-09T06:30:51.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/804: getdents d7/df/d3a/d45 0 2024-05-09T06:30:51.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/805: chown d7/df/d3a/d25/d81/d98/l9a 22282639 1 2024-05-09T06:30:51.689 INFO:tasks.workunit.client.0.smithi046.stdout:4/806: chown d7/f72 717535032 1 2024-05-09T06:30:51.690 INFO:tasks.workunit.client.0.smithi046.stdout:4/807: getdents d7/df/d10/d1d/d77/d87/dac 0 2024-05-09T06:30:51.694 INFO:tasks.workunit.client.0.smithi046.stdout:4/808: creat d7/df/d3a/d25/d86/ffa x:0 0 0 2024-05-09T06:30:51.694 INFO:tasks.workunit.client.0.smithi046.stdout:4/809: write d7/df/d10/d1d/f8e [4673635,83321] 0 2024-05-09T06:30:51.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/810: dwrite d7/df/d10/d2f/f5c [0,4194304] 0 2024-05-09T06:30:51.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/811: fsync d7/df/d10/d2f/f9b 0 2024-05-09T06:30:51.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/812: creat d7/df/d3a/d25/d86/ffb x:0 0 0 2024-05-09T06:30:51.718 INFO:tasks.workunit.client.0.smithi046.stdout:4/813: symlink d7/df/d53/lfc 0 2024-05-09T06:30:51.718 INFO:tasks.workunit.client.0.smithi046.stdout:4/814: write d7/df/d53/d91/fa9 [670999,85230] 0 2024-05-09T06:30:51.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/815: mkdir d7/df/d3a/d25/da5/dfd 0 2024-05-09T06:30:51.721 INFO:tasks.workunit.client.0.smithi046.stdout:4/816: creat d7/df/d53/d91/ffe x:0 0 0 2024-05-09T06:30:51.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/817: mkdir d7/df/d10/d1d/d77/d87/dbe/dff 0 2024-05-09T06:30:51.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/818: dread - d7/df/d3a/d25/d86/ffa zero size 2024-05-09T06:30:51.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/819: write d7/f90 [2330474,107657] 0 2024-05-09T06:30:51.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/820: chown d7/df/d53/d91/lb2 1026 1 2024-05-09T06:30:51.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/821: stat d7/df/d3a/f39 0 2024-05-09T06:30:51.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/822: creat d7/df/d3a/d25/da5/f100 x:0 0 0 2024-05-09T06:30:51.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/823: fsync d7/df/d10/d2f/fa2 0 2024-05-09T06:30:51.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/624: sync 2024-05-09T06:30:51.752 INFO:tasks.workunit.client.0.smithi046.stdout:3/797: sync 2024-05-09T06:30:51.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/798: mknod d4/d20/d24/d2a/c116 0 2024-05-09T06:30:51.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/799: creat d4/d20/d24/d29/d7a/f117 x:0 0 0 2024-05-09T06:30:51.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/800: read - d4/d20/d24/d2a/d55/d6a/dd5/fec zero size 2024-05-09T06:30:51.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/801: creat d4/d20/d24/d2a/d55/d74/f118 x:0 0 0 2024-05-09T06:30:51.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/802: write d4/d48/f53 [3916653,106122] 0 2024-05-09T06:30:51.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/803: write d4/d5/fb7 [6135857,106559] 0 2024-05-09T06:30:51.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/625: dwrite d2/d6/d7/d1e/f4a [0,4194304] 0 2024-05-09T06:30:51.778 INFO:tasks.workunit.client.0.smithi046.stdout:3/804: dwrite d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/fab [0,4194304] 0 2024-05-09T06:30:51.778 INFO:tasks.workunit.client.0.smithi046.stdout:3/805: readlink d4/d20/d24/d29/d2b/de7/d58/lcb 0 2024-05-09T06:30:51.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/626: rename d2/f69 to d2/d6/d8b/fd4 0 2024-05-09T06:30:51.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/627: readlink d2/d6/l6a 0 2024-05-09T06:30:51.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/628: readlink d2/d6/d7/d1a/d27/l9a 0 2024-05-09T06:30:51.781 INFO:tasks.workunit.client.0.smithi046.stdout:3/806: mkdir d4/d119 0 2024-05-09T06:30:51.787 INFO:tasks.workunit.client.0.smithi046.stdout:3/807: dread d4/d20/d24/d29/d2b/d94/d5c/f109 [0,4194304] 0 2024-05-09T06:30:51.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/808: rename d4/d48/d49/de8/fee to d4/d20/d24/f11a 0 2024-05-09T06:30:51.793 INFO:tasks.workunit.client.0.smithi046.stdout:9/629: dwrite d2/d20/fb7 [0,4194304] 0 2024-05-09T06:30:51.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/630: rename d2/d6/d7/d1a/d27/f34 to d2/d6/dbb/fd5 0 2024-05-09T06:30:51.797 INFO:tasks.workunit.client.0.smithi046.stdout:3/809: write d4/d20/d24/d29/fba [1479176,69127] 0 2024-05-09T06:30:51.797 INFO:tasks.workunit.client.0.smithi046.stdout:3/810: write d4/d20/d24/d2a/d55/d6a/dd5/fec [942312,127101] 0 2024-05-09T06:30:51.797 INFO:tasks.workunit.client.0.smithi046.stdout:3/811: stat d4/d20/d41/d4a/f105 0 2024-05-09T06:30:51.797 INFO:tasks.workunit.client.0.smithi046.stdout:3/812: fdatasync d4/d20/d24/f18 0 2024-05-09T06:30:51.799 INFO:tasks.workunit.client.0.smithi046.stdout:9/631: unlink d2/d26/d2c/ld0 0 2024-05-09T06:30:51.800 INFO:tasks.workunit.client.0.smithi046.stdout:3/813: creat d4/d20/d24/d2a/d55/d74/d115/f11b x:0 0 0 2024-05-09T06:30:51.800 INFO:tasks.workunit.client.0.smithi046.stdout:3/814: write d4/d20/d41/d4a/f105 [838076,45934] 0 2024-05-09T06:30:51.802 INFO:tasks.workunit.client.0.smithi046.stdout:3/815: dread d4/d20/d24/d2a/d55/d74/f91 [0,4194304] 0 2024-05-09T06:30:51.803 INFO:tasks.workunit.client.0.smithi046.stdout:9/632: creat d2/d26/d76/fd6 x:0 0 0 2024-05-09T06:30:51.804 INFO:tasks.workunit.client.0.smithi046.stdout:3/816: mknod d4/d5d/c11c 0 2024-05-09T06:30:51.804 INFO:tasks.workunit.client.0.smithi046.stdout:3/817: truncate d4/d20/d24/d2a/f9a 456147 0 2024-05-09T06:30:51.805 INFO:tasks.workunit.client.0.smithi046.stdout:9/633: creat d2/fd7 x:0 0 0 2024-05-09T06:30:51.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/818: mkdir d4/d20/d24/d29/d2b/d94/d11d 0 2024-05-09T06:30:51.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/819: chown d4/d5d/fa8 505687 1 2024-05-09T06:30:51.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/634: rename d2/d6/d38/c4f to d2/d6/d33/da8/cd8 0 2024-05-09T06:30:51.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/635: creat d2/d26/d76/fd9 x:0 0 0 2024-05-09T06:30:51.808 INFO:tasks.workunit.client.0.smithi046.stdout:3/820: mknod d4/d20/d41/d4a/c11e 0 2024-05-09T06:30:51.808 INFO:tasks.workunit.client.0.smithi046.stdout:3/821: creat d4/d48/d49/de8/f11f x:0 0 0 2024-05-09T06:30:51.808 INFO:tasks.workunit.client.0.smithi046.stdout:3/822: creat d4/d5d/d60/f120 x:0 0 0 2024-05-09T06:30:51.814 INFO:tasks.workunit.client.0.smithi046.stdout:3/823: rename d4/d20/d24/d2a/d55/d74/f118 to d4/d5d/f121 0 2024-05-09T06:30:51.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/636: dwrite d2/d6/d8b/fb6 [0,4194304] 0 2024-05-09T06:30:51.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/637: write d2/d6/d7/f54 [16640,109646] 0 2024-05-09T06:30:51.822 INFO:tasks.workunit.client.0.smithi046.stdout:9/638: mknod d2/d6/d33/da8/cda 0 2024-05-09T06:30:51.823 INFO:tasks.workunit.client.0.smithi046.stdout:9/639: creat d2/d20/fdb x:0 0 0 2024-05-09T06:30:51.833 INFO:tasks.workunit.client.0.smithi046.stdout:9/640: dread d2/d6/d33/f52 [0,4194304] 0 2024-05-09T06:30:51.834 INFO:tasks.workunit.client.0.smithi046.stdout:9/641: rename d2/dc/d32/d70/fc1 to d2/d6/fdc 0 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:3/824: dwrite d4/d20/d24/d29/d2b/fc5 [4194304,4194304] 0 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:3/825: chown d4/d20/d41/c10a 795098931 1 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:3/826: write d4/d20/d24/d29/fa5 [692260,35423] 0 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:3/827: read - d4/d20/d24/f11a zero size 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/642: link d2/dc/fbd d2/d26/d2c/d3d/fdd 0 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/643: fsync d2/d6/d7/d1a/d27/d2a/f93 0 2024-05-09T06:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/644: write d2/d6/d7/d1a/d27/d2a/da5/fac [957621,120970] 0 2024-05-09T06:30:51.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/828: rename d4/d20/d24/d2a/d55/d74/f76 to d4/d20/d24/d29/d7a/f122 0 2024-05-09T06:30:51.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/829: readlink d4/d20/d24/d2a/d55/d6a/lc2 0 2024-05-09T06:30:51.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/830: chown d4/d5/l1f 4784468 1 2024-05-09T06:30:51.840 INFO:tasks.workunit.client.0.smithi046.stdout:3/831: creat d4/d20/d24/d29/d2b/de7/d58/f123 x:0 0 0 2024-05-09T06:30:51.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/645: write d2/d6/d7/d1a/d27/d2a/f93 [65403,58703] 0 2024-05-09T06:30:51.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/646: chown d2/d6/d7/f54 9806 1 2024-05-09T06:30:51.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/647: fdatasync d2/d26/f68 0 2024-05-09T06:30:51.844 INFO:tasks.workunit.client.0.smithi046.stdout:3/832: creat d4/d20/d24/d2a/d46/f124 x:0 0 0 2024-05-09T06:30:51.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/648: unlink d2/f82 0 2024-05-09T06:30:51.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/649: creat d2/d6/d8b/fde x:0 0 0 2024-05-09T06:30:51.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/650: dread - d2/d6/d7/d1a/d27/d56/fa2 zero size 2024-05-09T06:30:51.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/651: mkdir d2/d6/d7/d1a/d86/ddf 0 2024-05-09T06:30:51.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/652: dread - d2/dc/d32/f5d zero size 2024-05-09T06:30:51.854 INFO:tasks.workunit.client.0.smithi046.stdout:9/653: creat d2/d6/d7/fe0 x:0 0 0 2024-05-09T06:30:51.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/654: fdatasync d2/d6/d7/d1a/d86/f67 0 2024-05-09T06:30:51.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/655: rename d2/d6/d7/d1a to d2/d6/d7/d1a/d27/d56/de1 22 2024-05-09T06:30:51.866 INFO:tasks.workunit.client.0.smithi046.stdout:3/833: dwrite d4/d5d/fa8 [0,4194304] 0 2024-05-09T06:30:51.869 INFO:tasks.workunit.client.0.smithi046.stdout:3/834: creat d4/d5d/d60/ddd/f125 x:0 0 0 2024-05-09T06:30:51.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/656: dwrite d2/d6/d7/d1a/d86/f67 [0,4194304] 0 2024-05-09T06:30:51.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/657: mknod d2/dc/d32/ce2 0 2024-05-09T06:30:51.879 INFO:tasks.workunit.client.0.smithi046.stdout:3/835: dread d4/d5/fb7 [0,4194304] 0 2024-05-09T06:30:51.879 INFO:tasks.workunit.client.0.smithi046.stdout:3/836: read - d4/d48/d49/de8/f11f zero size 2024-05-09T06:30:51.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/658: dread d2/d26/d2c/f3b [0,4194304] 0 2024-05-09T06:30:51.901 INFO:tasks.workunit.client.0.smithi046.stdout:9/659: dwrite d2/d26/d2c/f7a [0,4194304] 0 2024-05-09T06:30:51.902 INFO:tasks.workunit.client.0.smithi046.stdout:9/660: write d2/fc4 [35700,44876] 0 2024-05-09T06:30:51.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/837: mkdir d4/d20/d24/d29/d2b/d94/d126 0 2024-05-09T06:30:51.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/838: readlink d4/d20/d24/l33 0 2024-05-09T06:30:51.945 INFO:tasks.workunit.client.0.smithi046.stdout:9/661: symlink d2/dc/le3 0 2024-05-09T06:30:51.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/839: creat d4/d20/d41/f127 x:0 0 0 2024-05-09T06:30:51.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/662: truncate d2/dc/f4d 1270279 0 2024-05-09T06:30:51.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/663: rmdir d2/d26/d76 39 2024-05-09T06:30:51.953 INFO:tasks.workunit.client.0.smithi046.stdout:9/664: mknod d2/dc/d32/ce4 0 2024-05-09T06:30:51.953 INFO:tasks.workunit.client.0.smithi046.stdout:9/665: write d2/d6/d7/f1b [1430926,65152] 0 2024-05-09T06:30:51.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/666: unlink d2/d6/d7/d1a/d27/d2a/l2b 0 2024-05-09T06:30:51.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/667: dread - d2/d20/fdb zero size 2024-05-09T06:30:51.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/755: sync 2024-05-09T06:30:51.962 INFO:tasks.workunit.client.0.smithi046.stdout:8/902: sync 2024-05-09T06:30:51.962 INFO:tasks.workunit.client.0.smithi046.stdout:8/903: fsync d1/d7/d12/f89 0 2024-05-09T06:30:51.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/756: truncate d7/d10/d28/d30/dcf/f3b 1543163 0 2024-05-09T06:30:51.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/757: creat d7/da3/ff6 x:0 0 0 2024-05-09T06:30:51.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/758: write d7/f42 [4627336,78253] 0 2024-05-09T06:30:51.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/759: rename d7/da3/dc5/lcb to d7/d6d/lf7 0 2024-05-09T06:30:51.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/760: fdatasync d7/da3/fcc 0 2024-05-09T06:30:51.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/761: mknod d7/d10/d28/d30/dcf/cf8 0 2024-05-09T06:30:51.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/904: dread d1/d7/d12/d1d/d30/d38/f8c [0,4194304] 0 2024-05-09T06:30:51.972 INFO:tasks.workunit.client.0.smithi046.stdout:1/762: rename d7/d10/d84/lde to d7/da3/dc5/dd5/lf9 0 2024-05-09T06:30:51.972 INFO:tasks.workunit.client.0.smithi046.stdout:1/763: write d7/fc [8851850,8736] 0 2024-05-09T06:30:51.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/905: symlink d1/d7/d12/d1d/d30/dda/l113 0 2024-05-09T06:30:51.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/764: creat d7/d10/d84/da8/ffa x:0 0 0 2024-05-09T06:30:51.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/765: fdatasync d7/d10/f13 0 2024-05-09T06:30:51.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/766: fdatasync d7/da3/ff6 0 2024-05-09T06:30:51.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/767: truncate d7/da3/fa9 613420 0 2024-05-09T06:30:51.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/906: stat d1/d7/c3a 0 2024-05-09T06:30:51.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/907: truncate d1/d7/d2c/f15 2464552 0 2024-05-09T06:30:51.975 INFO:tasks.workunit.client.0.smithi046.stdout:1/768: symlink d7/d10/d28/d30/lfb 0 2024-05-09T06:30:51.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/908: rename d1/db/dd/d11/d5d/la9 to d1/db/d67/l114 0 2024-05-09T06:30:51.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/909: mknod d1/d7/d12/d45/c115 0 2024-05-09T06:30:51.978 INFO:tasks.workunit.client.0.smithi046.stdout:1/769: dread d7/d10/d34/f35 [0,4194304] 0 2024-05-09T06:30:51.978 INFO:tasks.workunit.client.0.smithi046.stdout:1/770: chown d7/d10/d28/d30/fae 26123 1 2024-05-09T06:30:51.978 INFO:tasks.workunit.client.0.smithi046.stdout:8/910: rename d1/db/dd/d11/d5d/d99/de8/c106 to d1/d7/d12/d1d/d30/dbd/c116 0 2024-05-09T06:30:51.984 INFO:tasks.workunit.client.0.smithi046.stdout:3/840: dwrite d4/d5/f112 [0,4194304] 0 2024-05-09T06:30:51.984 INFO:tasks.workunit.client.0.smithi046.stdout:9/668: dwrite d2/f5e [0,4194304] 0 2024-05-09T06:30:51.984 INFO:tasks.workunit.client.0.smithi046.stdout:3/841: dread - d4/d20/d24/d2a/d46/f124 zero size 2024-05-09T06:30:51.986 INFO:tasks.workunit.client.0.smithi046.stdout:9/669: mknod d2/d6/d7/d1a/d27/d56/ce5 0 2024-05-09T06:30:51.990 INFO:tasks.workunit.client.0.smithi046.stdout:1/771: dwrite d7/d10/d34/d46/ff2 [0,4194304] 0 2024-05-09T06:30:51.992 INFO:tasks.workunit.client.0.smithi046.stdout:3/842: mkdir d4/df9/d128 0 2024-05-09T06:30:52.000 INFO:tasks.workunit.client.0.smithi046.stdout:9/670: rmdir d2/d6/d7/d1a/d27/d2a 39 2024-05-09T06:30:52.002 INFO:tasks.workunit.client.0.smithi046.stdout:9/671: mkdir d2/d6/d38/de6 0 2024-05-09T06:30:52.007 INFO:tasks.workunit.client.0.smithi046.stdout:1/772: dwrite d7/d10/d28/d30/dcf/f78 [0,4194304] 0 2024-05-09T06:30:52.007 INFO:tasks.workunit.client.0.smithi046.stdout:1/773: creat d7/d10/d28/d30/dcf/d76/de8/ffc x:0 0 0 2024-05-09T06:30:52.013 INFO:tasks.workunit.client.0.smithi046.stdout:9/672: read d2/fb0 [2998762,18898] 0 2024-05-09T06:30:52.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/774: rename d7/d10/d34/d46/d86/fb0 to d7/d6d/ffd 0 2024-05-09T06:30:52.017 INFO:tasks.workunit.client.0.smithi046.stdout:9/673: mknod d2/d6/d33/da8/ce7 0 2024-05-09T06:30:52.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/674: dread - d2/d6/d33/da8/fb2 zero size 2024-05-09T06:30:52.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/675: write d2/dc/d32/f5d [1001198,107464] 0 2024-05-09T06:30:52.018 INFO:tasks.workunit.client.0.smithi046.stdout:1/775: mkdir d7/d10/d28/d30/da0/dd9/dfe 0 2024-05-09T06:30:52.020 INFO:tasks.workunit.client.0.smithi046.stdout:9/676: dread d2/d6/d33/f79 [0,4194304] 0 2024-05-09T06:30:52.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/677: rename d2/d6/d7/d1a/d27/d2a/f8d to d2/d6/d7/d1a/d27/fe8 0 2024-05-09T06:30:52.025 INFO:tasks.workunit.client.0.smithi046.stdout:9/678: creat d2/d6/d7/d1a/d27/d56/fe9 x:0 0 0 2024-05-09T06:30:52.027 INFO:tasks.workunit.client.0.smithi046.stdout:1/776: dread d7/d10/d28/f4f [0,4194304] 0 2024-05-09T06:30:52.028 INFO:tasks.workunit.client.0.smithi046.stdout:1/777: dread - d7/d10/d28/d55/f6f zero size 2024-05-09T06:30:52.028 INFO:tasks.workunit.client.0.smithi046.stdout:1/778: chown d7/d10/d34/d46/d86/f57 55 1 2024-05-09T06:30:52.028 INFO:tasks.workunit.client.0.smithi046.stdout:1/779: fsync d7/d10/d34/d46/d86/f57 0 2024-05-09T06:30:52.029 INFO:tasks.workunit.client.0.smithi046.stdout:1/780: creat d7/da3/dc5/fff x:0 0 0 2024-05-09T06:30:52.029 INFO:tasks.workunit.client.0.smithi046.stdout:1/781: write d7/d10/d28/f4f [5208498,71217] 0 2024-05-09T06:30:52.029 INFO:tasks.workunit.client.0.smithi046.stdout:1/782: dread - d7/da3/dc5/fff zero size 2024-05-09T06:30:52.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/679: dread d2/d6/d7/d1a/d86/f67 [0,4194304] 0 2024-05-09T06:30:52.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/896: sync 2024-05-09T06:30:52.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/775: sync 2024-05-09T06:30:52.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/776: dread - d11/f35 zero size 2024-05-09T06:30:52.071 INFO:tasks.workunit.client.0.smithi046.stdout:0/777: creat d11/d18/d27/d28/d36/ff4 x:0 0 0 2024-05-09T06:30:52.072 INFO:tasks.workunit.client.0.smithi046.stdout:6/897: rmdir db/d10/d3f/d44/d5e/dbe 39 2024-05-09T06:30:52.073 INFO:tasks.workunit.client.0.smithi046.stdout:6/898: truncate db/d10/d3f/d44/f118 172663 0 2024-05-09T06:30:52.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/783: dwrite d7/d10/f2b [0,4194304] 0 2024-05-09T06:30:52.073 INFO:tasks.workunit.client.0.smithi046.stdout:9/680: dwrite d2/d6/d7/d1a/d27/fc2 [0,4194304] 0 2024-05-09T06:30:52.074 INFO:tasks.workunit.client.0.smithi046.stdout:0/778: mknod d11/d18/d1c/cf5 0 2024-05-09T06:30:52.076 INFO:tasks.workunit.client.0.smithi046.stdout:9/681: write d2/d6/d33/f79 [1602690,22366] 0 2024-05-09T06:30:52.076 INFO:tasks.workunit.client.0.smithi046.stdout:9/682: chown d2/d6/d7/d1e/fa7 237824511 1 2024-05-09T06:30:52.076 INFO:tasks.workunit.client.0.smithi046.stdout:6/899: unlink db/d10/d3f/d4f/d8a/d9e/f105 0 2024-05-09T06:30:52.079 INFO:tasks.workunit.client.0.smithi046.stdout:6/900: symlink db/d10/d57/db7/l123 0 2024-05-09T06:30:52.081 INFO:tasks.workunit.client.0.smithi046.stdout:6/901: truncate db/d10/d19/f54 1637074 0 2024-05-09T06:30:52.087 INFO:tasks.workunit.client.0.smithi046.stdout:6/902: link db/d10/d6b/cd8 db/d10/c124 0 2024-05-09T06:30:52.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/903: creat db/d10/d3f/d44/d5e/f125 x:0 0 0 2024-05-09T06:30:52.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/683: read d2/dc/f11 [75383,14539] 0 2024-05-09T06:30:52.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/684: chown d2/d26/d2c/d3d/f87 3409777 1 2024-05-09T06:30:52.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/685: chown d2/d26/d76/l94 6 1 2024-05-09T06:30:52.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/686: write d2/d6/d7/d1e/fa7 [486300,1708] 0 2024-05-09T06:30:52.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/784: dread d7/d10/d28/d30/dcf/fb7 [0,4194304] 0 2024-05-09T06:30:52.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/785: write d7/d10/d28/d30/df1/ff5 [745670,58128] 0 2024-05-09T06:30:52.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/904: mkdir db/d10/d3f/d44/d46/d70/d11f/d126 0 2024-05-09T06:30:52.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/786: mknod d7/da3/dc5/c100 0 2024-05-09T06:30:52.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/905: symlink db/d10/d3f/d44/d46/d70/l127 0 2024-05-09T06:30:52.104 INFO:tasks.workunit.client.0.smithi046.stdout:9/687: dwrite d2/d6/d7/f54 [0,4194304] 0 2024-05-09T06:30:52.104 INFO:tasks.workunit.client.0.smithi046.stdout:0/779: dwrite d11/d18/d27/d28/d36/ff4 [0,4194304] 0 2024-05-09T06:30:52.116 INFO:tasks.workunit.client.0.smithi046.stdout:1/787: link d7/d10/d28/f4f d7/d10/d28/d30/da0/dd9/f101 0 2024-05-09T06:30:52.116 INFO:tasks.workunit.client.0.smithi046.stdout:1/788: readlink d7/da3/dc5/dd5/le2 0 2024-05-09T06:30:52.116 INFO:tasks.workunit.client.0.smithi046.stdout:1/789: fdatasync d7/d10/d34/d46/d86/f7c 0 2024-05-09T06:30:52.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/790: dread - d7/d10/d28/d55/fc6 zero size 2024-05-09T06:30:52.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/791: fsync d7/d10/d28/d30/dcf/f3b 0 2024-05-09T06:30:52.118 INFO:tasks.workunit.client.0.smithi046.stdout:6/906: rename db/d10/d3c/dd4/d87/cb2 to db/d10/d3f/d44/d46/d70/c128 0 2024-05-09T06:30:52.124 INFO:tasks.workunit.client.0.smithi046.stdout:1/792: write d7/d10/f4c [2782471,2968] 0 2024-05-09T06:30:52.125 INFO:tasks.workunit.client.0.smithi046.stdout:9/688: creat d2/d6/d38/de6/fea x:0 0 0 2024-05-09T06:30:52.125 INFO:tasks.workunit.client.0.smithi046.stdout:9/689: dread - d2/fd7 zero size 2024-05-09T06:30:52.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/907: link db/d10/d3f/d4f/l122 db/d10/d3f/d44/d46/d70/l129 0 2024-05-09T06:30:52.132 INFO:tasks.workunit.client.0.smithi046.stdout:1/793: truncate d7/d10/d34/f6e 4097775 0 2024-05-09T06:30:52.132 INFO:tasks.workunit.client.0.smithi046.stdout:1/794: creat d7/d10/d84/de1/f102 x:0 0 0 2024-05-09T06:30:52.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/690: rename d2/d26/d76/l94 to d2/d6/d7/d1a/d27/d2a/da5/leb 0 2024-05-09T06:30:52.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/691: stat d2/dc/f89 0 2024-05-09T06:30:52.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/780: dwrite d11/d4f/d5b/d5f/f6d [0,4194304] 0 2024-05-09T06:30:52.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/781: truncate d11/d18/d27/d28/fc7 186181 0 2024-05-09T06:30:52.138 INFO:tasks.workunit.client.0.smithi046.stdout:6/908: unlink db/f27 0 2024-05-09T06:30:52.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/795: unlink d7/d10/d28/d30/lb9 0 2024-05-09T06:30:52.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/796: creat d7/d10/d84/de1/f103 x:0 0 0 2024-05-09T06:30:52.148 INFO:tasks.workunit.client.0.smithi046.stdout:6/909: dread db/d10/d76/ff6 [4194304,4194304] 0 2024-05-09T06:30:52.151 INFO:tasks.workunit.client.0.smithi046.stdout:1/797: symlink d7/l104 0 2024-05-09T06:30:52.155 INFO:tasks.workunit.client.0.smithi046.stdout:6/910: mknod db/d10/d3f/d4f/c12a 0 2024-05-09T06:30:52.155 INFO:tasks.workunit.client.0.smithi046.stdout:9/692: dwrite d2/d6/d7/d1a/f2e [4194304,4194304] 0 2024-05-09T06:30:52.155 INFO:tasks.workunit.client.0.smithi046.stdout:0/782: dwrite d11/d18/d1c/d53/fee [0,4194304] 0 2024-05-09T06:30:52.157 INFO:tasks.workunit.client.0.smithi046.stdout:6/911: symlink db/d10/d3f/d44/d74/l12b 0 2024-05-09T06:30:52.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/693: symlink d2/d6/d38/de6/lec 0 2024-05-09T06:30:52.162 INFO:tasks.workunit.client.0.smithi046.stdout:1/798: dwrite d7/d10/d28/d30/dcf/d76/f7a [4194304,4194304] 0 2024-05-09T06:30:52.167 INFO:tasks.workunit.client.0.smithi046.stdout:1/799: dread d7/d10/d28/d30/dcf/fb7 [0,4194304] 0 2024-05-09T06:30:52.167 INFO:tasks.workunit.client.0.smithi046.stdout:1/800: chown d7/d10/d34/d46/d81/ld7 1 1 2024-05-09T06:30:52.168 INFO:tasks.workunit.client.0.smithi046.stdout:6/912: rmdir db/d10/d3f/d4f/d89 39 2024-05-09T06:30:52.170 INFO:tasks.workunit.client.0.smithi046.stdout:9/694: mkdir d2/d26/d2c/daf/ded 0 2024-05-09T06:30:52.170 INFO:tasks.workunit.client.0.smithi046.stdout:9/695: chown d2/d6/d7/d1a 322 1 2024-05-09T06:30:52.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/801: mknod d7/d10/d28/d30/da0/dd9/dfe/c105 0 2024-05-09T06:30:52.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/802: truncate d7/d10/d28/d55/fe9 669927 0 2024-05-09T06:30:52.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/803: dread - d7/fbd zero size 2024-05-09T06:30:52.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/804: chown d7/d10/d34/d46/l69 431944 1 2024-05-09T06:30:52.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/805: readlink d7/d10/d34/d46/l4e 0 2024-05-09T06:30:52.173 INFO:tasks.workunit.client.0.smithi046.stdout:6/913: mknod db/d10/d3f/d44/d46/d70/d110/c12c 0 2024-05-09T06:30:52.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/914: write db/d10/dfa/f121 [230073,129392] 0 2024-05-09T06:30:52.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/915: chown db/d10/d6b/fc8 9 1 2024-05-09T06:30:52.176 INFO:tasks.workunit.client.0.smithi046.stdout:9/696: rename d2/dc/d32/f5d to d2/d6/d7/d1a/d86/ddf/fee 0 2024-05-09T06:30:52.176 INFO:tasks.workunit.client.0.smithi046.stdout:9/697: chown d2/d6/d7/l6c 0 1 2024-05-09T06:30:52.176 INFO:tasks.workunit.client.0.smithi046.stdout:1/806: getdents d7/d10 0 2024-05-09T06:30:52.179 INFO:tasks.workunit.client.0.smithi046.stdout:9/698: link d2/dc/f11 d2/d6/d7/d1a/d27/d2a/da5/fef 0 2024-05-09T06:30:52.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/699: symlink d2/d6/d7/d1a/d27/d65/lf0 0 2024-05-09T06:30:52.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/700: chown d2/d6/d38/l7c 796396 1 2024-05-09T06:30:52.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/701: stat d2/d26/d2c 0 2024-05-09T06:30:52.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/702: creat d2/dc/d32/ff1 x:0 0 0 2024-05-09T06:30:52.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/703: chown d2/d6/d38/de6/lec 5760 1 2024-05-09T06:30:52.182 INFO:tasks.workunit.client.0.smithi046.stdout:9/704: fdatasync d2/d26/f92 0 2024-05-09T06:30:52.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/705: link d2/dc/d32/ff1 d2/d6/d8b/ff2 0 2024-05-09T06:30:52.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/716: sync 2024-05-09T06:30:52.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/978: sync 2024-05-09T06:30:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/807: dwrite d7/d10/d28/d30/f38 [0,4194304] 0 2024-05-09T06:30:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/808: symlink d7/d10/d28/d30/dcf/d76/de8/l106 0 2024-05-09T06:30:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:7/979: dwrite d3/d7/dd/f23 [8388608,4194304] 0 2024-05-09T06:30:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:1/809: getdents d7/d10/d84 0 2024-05-09T06:30:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:1/810: getdents d7/d10/d28/d30/df1 0 2024-05-09T06:30:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/811: readlink d7/d10/d34/d46/l69 0 2024-05-09T06:30:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/812: truncate d7/fda 560742 0 2024-05-09T06:30:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:1/813: mknod d7/c107 0 2024-05-09T06:30:52.212 INFO:tasks.workunit.client.0.smithi046.stdout:1/814: mknod d7/d10/d28/c108 0 2024-05-09T06:30:52.212 INFO:tasks.workunit.client.0.smithi046.stdout:1/815: fsync d7/d10/d34/fe3 0 2024-05-09T06:30:52.233 INFO:tasks.workunit.client.0.smithi046.stdout:1/816: dwrite d7/d10/d34/f68 [4194304,4194304] 0 2024-05-09T06:30:52.233 INFO:tasks.workunit.client.0.smithi046.stdout:1/817: fdatasync d7/d10/d28/d30/dcf/d7f/f90 0 2024-05-09T06:30:52.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/818: link d7/d10/d34/d46/d86/l97 d7/d10/d34/l109 0 2024-05-09T06:30:52.247 INFO:tasks.workunit.client.0.smithi046.stdout:1/819: dwrite d7/dd6/fef [0,4194304] 0 2024-05-09T06:30:52.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/820: dread d7/d10/d34/d46/d86/f7d [0,4194304] 0 2024-05-09T06:30:52.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/821: write d7/d10/d28/d30/dcf/fb7 [5703293,116686] 0 2024-05-09T06:30:52.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/822: stat d7/d6d/ddd/lec 0 2024-05-09T06:30:52.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/823: read - d7/d10/d28/d30/dcf/fba zero size 2024-05-09T06:30:52.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/824: chown d7/d6d/fd2 2359195 1 2024-05-09T06:30:52.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/825: truncate d7/d10/d28/d30/dcf/d76/fb3 27434 0 2024-05-09T06:30:52.255 INFO:tasks.workunit.client.0.smithi046.stdout:1/826: mkdir d7/d10/d28/d30/dcf/d7f/d10a 0 2024-05-09T06:30:52.255 INFO:tasks.workunit.client.0.smithi046.stdout:1/827: truncate d7/fda 1217420 0 2024-05-09T06:30:52.265 INFO:tasks.workunit.client.0.smithi046.stdout:1/828: read d7/d10/d28/d30/dcf/d76/fb3 [14141,87517] 0 2024-05-09T06:30:52.268 INFO:tasks.workunit.client.0.smithi046.stdout:1/829: symlink d7/d10/d84/de1/l10b 0 2024-05-09T06:30:52.270 INFO:tasks.workunit.client.0.smithi046.stdout:1/830: symlink d7/d10/d28/d30/dcf/l10c 0 2024-05-09T06:30:52.270 INFO:tasks.workunit.client.0.smithi046.stdout:1/831: dread - d7/d10/f6c zero size 2024-05-09T06:30:52.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/832: dread d7/d10/d34/d46/ff2 [0,4194304] 0 2024-05-09T06:30:52.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/833: creat d7/d10/d28/d30/da0/dd9/f10d x:0 0 0 2024-05-09T06:30:52.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/834: readlink d7/d6d/l9c 0 2024-05-09T06:30:52.279 INFO:tasks.workunit.client.0.smithi046.stdout:1/835: dread d7/d10/d28/d30/dcf/d76/fb3 [0,4194304] 0 2024-05-09T06:30:52.280 INFO:tasks.workunit.client.0.smithi046.stdout:1/836: mkdir d7/d10/d28/d30/dcf/d7f/d10e 0 2024-05-09T06:30:52.281 INFO:tasks.workunit.client.0.smithi046.stdout:1/837: mkdir d7/d10/d28/d30/da0/d10f 0 2024-05-09T06:30:52.282 INFO:tasks.workunit.client.0.smithi046.stdout:1/838: symlink d7/d10/d28/d30/dcf/d76/l110 0 2024-05-09T06:30:52.294 INFO:tasks.workunit.client.0.smithi046.stdout:1/839: dwrite d7/d10/f13 [0,4194304] 0 2024-05-09T06:30:52.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/822: sync 2024-05-09T06:30:52.298 INFO:tasks.workunit.client.0.smithi046.stdout:2/823: chown da/d2d/d43/dc2/deb 37 1 2024-05-09T06:30:52.298 INFO:tasks.workunit.client.0.smithi046.stdout:2/824: write da/dcb/dcc/dee/dcd/d7d/dc5/d3a/f9d [313546,95708] 0 2024-05-09T06:30:52.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/840: write d7/d6d/f92 [818080,65821] 0 2024-05-09T06:30:52.309 INFO:tasks.workunit.client.0.smithi046.stdout:1/841: write d7/d10/f24 [1362450,81963] 0 2024-05-09T06:30:52.309 INFO:tasks.workunit.client.0.smithi046.stdout:1/842: chown d7/da3/fcc 11 1 2024-05-09T06:30:52.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/843: mknod d7/da3/c111 0 2024-05-09T06:30:52.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:52 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:52.324 INFO:tasks.workunit.client.0.smithi046.stdout:1/844: dwrite d7/d10/f24 [0,4194304] 0 2024-05-09T06:30:52.331 INFO:tasks.workunit.client.0.smithi046.stdout:1/845: dread d7/d10/d34/f6e [0,4194304] 0 2024-05-09T06:30:52.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:52 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:30:52.378 INFO:tasks.workunit.client.0.smithi046.stdout:1/846: mkdir d7/d10/d28/d30/dcf/d75/d112 0 2024-05-09T06:30:52.379 INFO:tasks.workunit.client.0.smithi046.stdout:1/847: mkdir d7/d10/d28/d30/dcf/d7f/d10e/d113 0 2024-05-09T06:30:52.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/848: rename d7/d10/d34/f35 to d7/d10/d34/f114 0 2024-05-09T06:30:52.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/849: fsync d7/da3/dc5/fff 0 2024-05-09T06:30:52.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/850: chown d7/d10/d28/d30/f36 0 1 2024-05-09T06:30:52.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/851: dread - d7/d10/d84/de1/f103 zero size 2024-05-09T06:30:52.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/852: write d7/d10/d28/d55/f6f [358026,128655] 0 2024-05-09T06:30:52.382 INFO:tasks.workunit.client.0.smithi046.stdout:1/853: unlink d7/d10/d28/f33 0 2024-05-09T06:30:52.383 INFO:tasks.workunit.client.0.smithi046.stdout:1/854: fsync d7/da3/fab 0 2024-05-09T06:30:52.384 INFO:tasks.workunit.client.0.smithi046.stdout:1/855: mknod d7/d10/d34/c115 0 2024-05-09T06:30:52.384 INFO:tasks.workunit.client.0.smithi046.stdout:1/856: creat d7/d10/d34/d46/d86/f116 x:0 0 0 2024-05-09T06:30:52.384 INFO:tasks.workunit.client.0.smithi046.stdout:1/857: chown d7/d10/d34/d46/d86/f57 60796 1 2024-05-09T06:30:52.390 INFO:tasks.workunit.client.0.smithi046.stdout:1/858: dread d7/f62 [0,4194304] 0 2024-05-09T06:30:52.391 INFO:tasks.workunit.client.0.smithi046.stdout:1/859: mkdir d7/d10/d28/d30/dcf/d7f/d10e/d117 0 2024-05-09T06:30:52.393 INFO:tasks.workunit.client.0.smithi046.stdout:1/860: mkdir d7/d10/d84/de1/d118 0 2024-05-09T06:30:52.393 INFO:tasks.workunit.client.0.smithi046.stdout:1/861: truncate d7/d10/d28/d30/dcf/d76/fb3 546502 0 2024-05-09T06:30:52.395 INFO:tasks.workunit.client.0.smithi046.stdout:1/862: mkdir d7/d10/d28/d30/dcf/d7f/d10e/d117/d119 0 2024-05-09T06:30:52.396 INFO:tasks.workunit.client.0.smithi046.stdout:1/863: creat d7/d10/d28/d30/dcf/d7f/d10e/d117/f11a x:0 0 0 2024-05-09T06:30:52.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/824: sync 2024-05-09T06:30:52.448 INFO:tasks.workunit.client.0.smithi046.stdout:8/911: sync 2024-05-09T06:30:52.448 INFO:tasks.workunit.client.0.smithi046.stdout:3/843: sync 2024-05-09T06:30:52.450 INFO:tasks.workunit.client.0.smithi046.stdout:4/825: unlink d7/df/d10/d2f/f5c 0 2024-05-09T06:30:52.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/826: unlink d7/df/d10/d1d/cf5 0 2024-05-09T06:30:52.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/844: rename d4/d20/d24/d29/d2b/de7 to d4/d20/d24/d29/d2b/d94/d126/d129 0 2024-05-09T06:30:52.458 INFO:tasks.workunit.client.0.smithi046.stdout:4/827: creat d7/daf/dd6/f101 x:0 0 0 2024-05-09T06:30:52.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/845: creat d4/d20/d24/d29/d2b/d94/d11d/f12a x:0 0 0 2024-05-09T06:30:52.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/846: rename d4/d20/d24/d2a/l47 to d4/d20/d24/d29/df3/df7/l12b 0 2024-05-09T06:30:52.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/847: write d4/d20/d24/d2a/d55/d6a/fcd [644201,65539] 0 2024-05-09T06:30:52.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/848: write d4/d20/d24/d29/d2b/d94/d5c/f109 [8672890,128519] 0 2024-05-09T06:30:52.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/849: fdatasync d4/d20/d41/d4a/f105 0 2024-05-09T06:30:52.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/850: creat d4/d5/dac/f12c x:0 0 0 2024-05-09T06:30:52.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/851: chown d4/d20/d24/d2a/da2/lb3 6649921 1 2024-05-09T06:30:52.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/852: chown d4/c17 13354895 1 2024-05-09T06:30:52.467 INFO:tasks.workunit.client.0.smithi046.stdout:4/828: getdents d7/daf/dd6 0 2024-05-09T06:30:52.469 INFO:tasks.workunit.client.0.smithi046.stdout:4/829: unlink d7/df/d3a/d45/d96/db3/ccd 0 2024-05-09T06:30:52.525 INFO:tasks.workunit.client.0.smithi046.stdout:3/853: getdents d4/d5/dac 0 2024-05-09T06:30:52.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/830: symlink d7/df/d3a/d25/d81/d98/db7/l102 0 2024-05-09T06:30:52.531 INFO:tasks.workunit.client.0.smithi046.stdout:3/854: rename d4/d5/l1f to d4/d5d/de6/d103/l12d 0 2024-05-09T06:30:52.532 INFO:tasks.workunit.client.0.smithi046.stdout:4/831: unlink d7/df/d10/d2f/f6d 0 2024-05-09T06:30:52.536 INFO:tasks.workunit.client.0.smithi046.stdout:3/855: rename d4/d48/d49/de8/lf2 to d4/d5d/d60/ddd/l12e 0 2024-05-09T06:30:52.538 INFO:tasks.workunit.client.0.smithi046.stdout:4/832: unlink d7/df/lf0 0 2024-05-09T06:30:52.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/856: mknod d4/d5d/d60/ddd/c12f 0 2024-05-09T06:30:52.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/857: creat d4/d20/d24/d29/d2b/d94/dd3/f130 x:0 0 0 2024-05-09T06:30:52.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/858: chown d4/d20/fb5 75970908 1 2024-05-09T06:30:52.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/859: read - d4/d20/d24/d29/d2b/d94/d126/d129/f71 zero size 2024-05-09T06:30:52.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/860: chown d4/d20/d24/d2a/d55/d74/d115/f11b 7 1 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/861: mknod d4/d48/d49/de8/c131 0 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/862: dread - d4/d20/d24/d29/d2b/d94/d126/d129/fda zero size 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/833: rmdir d7/df/d10/d2f 39 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/834: chown d7/df/d10/d1d/l23 26284 1 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/835: write d7/df/d3a/d25/d86/f88 [953472,90763] 0 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/836: dread - d7/df/fbd zero size 2024-05-09T06:30:52.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/837: stat d7/l27 0 2024-05-09T06:30:52.549 INFO:tasks.workunit.client.0.smithi046.stdout:4/838: creat d7/df/d10/d1d/db9/f103 x:0 0 0 2024-05-09T06:30:52.549 INFO:tasks.workunit.client.0.smithi046.stdout:4/839: chown d7/df/d10/d1d/c33 1319267 1 2024-05-09T06:30:52.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/840: dread d7/df/d10/d1d/fe5 [0,4194304] 0 2024-05-09T06:30:52.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/841: mkdir d7/df/d3a/d45/d96/db3/de4/d104 0 2024-05-09T06:30:52.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/842: link d7/df/d3a/f28 d7/df/d3a/d25/df6/f105 0 2024-05-09T06:30:52.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/843: write d7/fb [13438011,61594] 0 2024-05-09T06:30:52.555 INFO:tasks.workunit.client.0.smithi046.stdout:4/844: fsync d7/df/d3a/d25/d86/ffa 0 2024-05-09T06:30:52.562 INFO:tasks.workunit.client.0.smithi046.stdout:4/845: dread d7/df/d3a/d25/d86/fa6 [0,4194304] 0 2024-05-09T06:30:52.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/846: rename d7/fc to d7/df/d3a/d45/d96/db3/f106 0 2024-05-09T06:30:52.578 INFO:tasks.workunit.client.0.smithi046.stdout:6/916: sync 2024-05-09T06:30:52.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/783: sync 2024-05-09T06:30:52.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/784: fdatasync d11/d18/d27/d28/d2d/f4c 0 2024-05-09T06:30:52.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/785: symlink d11/d4f/d5b/lf6 0 2024-05-09T06:30:52.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/786: fsync f4 0 2024-05-09T06:30:52.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/787: write d11/f35 [652189,94459] 0 2024-05-09T06:30:52.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/788: truncate d11/f52 976326 0 2024-05-09T06:30:52.594 INFO:tasks.workunit.client.0.smithi046.stdout:6/917: dwrite db/d10/d3f/d44/d46/f4d [0,4194304] 0 2024-05-09T06:30:52.594 INFO:tasks.workunit.client.0.smithi046.stdout:6/918: getdents db/d10/d57/db7/dcc 0 2024-05-09T06:30:52.595 INFO:tasks.workunit.client.0.smithi046.stdout:0/789: rmdir d11/d18/d27/d28/d6b/de8 39 2024-05-09T06:30:52.595 INFO:tasks.workunit.client.0.smithi046.stdout:0/790: readlink d11/d3f/d6f/lc3 0 2024-05-09T06:30:52.603 INFO:tasks.workunit.client.0.smithi046.stdout:6/919: rename db/d10/d57 to db/d10/d3c/dd4/d87/d12d 0 2024-05-09T06:30:52.620 INFO:tasks.workunit.client.0.smithi046.stdout:6/920: dwrite db/d10/d3c/dd4/fce [0,4194304] 0 2024-05-09T06:30:52.622 INFO:tasks.workunit.client.0.smithi046.stdout:6/921: creat db/d10/d3f/d4f/d8a/f12e x:0 0 0 2024-05-09T06:30:52.627 INFO:tasks.workunit.client.0.smithi046.stdout:6/922: dread db/d10/d3f/d4f/d8a/f9f [0,4194304] 0 2024-05-09T06:30:52.627 INFO:tasks.workunit.client.0.smithi046.stdout:6/923: creat db/d10/d3f/d4f/d8a/f12f x:0 0 0 2024-05-09T06:30:52.634 INFO:tasks.workunit.client.0.smithi046.stdout:6/924: dread db/d10/f16 [0,4194304] 0 2024-05-09T06:30:52.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/925: dread db/d10/d3f/d4f/d8a/d9e/ff2 [0,4194304] 0 2024-05-09T06:30:52.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/926: stat db/d10/d3f/dda/ff0 0 2024-05-09T06:30:52.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/927: stat db/d10/d3f/f56 0 2024-05-09T06:30:52.638 INFO:tasks.workunit.client.0.smithi046.stdout:6/928: truncate db/d10/d3f/d44/d5e/dbe/fe4 329035 0 2024-05-09T06:30:52.638 INFO:tasks.workunit.client.0.smithi046.stdout:6/929: creat db/d10/d3f/dda/f130 x:0 0 0 2024-05-09T06:30:52.640 INFO:tasks.workunit.client.0.smithi046.stdout:6/930: rmdir db/d10/d3f/d44/d74/db6 39 2024-05-09T06:30:52.640 INFO:tasks.workunit.client.0.smithi046.stdout:6/931: write db/d10/d6b/ffd [56333,36417] 0 2024-05-09T06:30:52.641 INFO:tasks.workunit.client.0.smithi046.stdout:6/932: symlink db/d10/d3f/l131 0 2024-05-09T06:30:52.658 INFO:tasks.workunit.client.0.smithi046.stdout:6/933: dwrite db/d10/d30/f52 [0,4194304] 0 2024-05-09T06:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:6/934: write db/d10/d3f/d4f/d8a/f9f [1626321,104538] 0 2024-05-09T06:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:6/935: chown db/d10/d6b/fe9 62 1 2024-05-09T06:30:52.660 INFO:tasks.workunit.client.0.smithi046.stdout:6/936: dread db/d10/d3f/d4f/d8a/d9e/fa7 [0,4194304] 0 2024-05-09T06:30:52.660 INFO:tasks.workunit.client.0.smithi046.stdout:6/937: creat db/d93/d96/dd1/f132 x:0 0 0 2024-05-09T06:30:52.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/938: dwrite db/d10/d3f/dda/fe0 [0,4194304] 0 2024-05-09T06:30:52.679 INFO:tasks.workunit.client.0.smithi046.stdout:6/939: rename db/d10/d19/f54 to db/d10/d30/d53/d104/f133 0 2024-05-09T06:30:52.684 INFO:tasks.workunit.client.0.smithi046.stdout:6/940: mkdir db/d10/d3f/d44/d134 0 2024-05-09T06:30:52.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/941: truncate db/d10/d6b/fc8 880141 0 2024-05-09T06:30:52.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/942: mknod db/d93/d96/dd1/c135 0 2024-05-09T06:30:52.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/943: chown db/d10/d30/d53/c101 102 1 2024-05-09T06:30:52.697 INFO:tasks.workunit.client.0.smithi046.stdout:6/944: dread db/d10/d30/d53/f94 [4194304,4194304] 0 2024-05-09T06:30:52.697 INFO:tasks.workunit.client.0.smithi046.stdout:6/945: truncate db/d10/d3c/f5b 3468884 0 2024-05-09T06:30:52.730 INFO:tasks.workunit.client.0.smithi046.stdout:2/825: sync 2024-05-09T06:30:52.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/706: sync 2024-05-09T06:30:52.731 INFO:tasks.workunit.client.0.smithi046.stdout:9/707: unlink d2/d6/d33/l7d 0 2024-05-09T06:30:52.745 INFO:tasks.workunit.client.0.smithi046.stdout:9/708: dwrite d2/d6/d8b/fde [0,4194304] 0 2024-05-09T06:30:52.745 INFO:tasks.workunit.client.0.smithi046.stdout:9/709: stat d2/d26/c90 0 2024-05-09T06:30:52.745 INFO:tasks.workunit.client.0.smithi046.stdout:9/710: creat d2/d6/d38/de6/ff3 x:0 0 0 2024-05-09T06:30:52.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/711: mknod d2/d26/cf4 0 2024-05-09T06:30:52.756 INFO:tasks.workunit.client.0.smithi046.stdout:9/712: rename d2/d6/d7/d1a/d27/d56/fa2 to d2/dc/ff5 0 2024-05-09T06:30:52.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/713: creat d2/d26/d2c/ff6 x:0 0 0 2024-05-09T06:30:52.760 INFO:tasks.workunit.client.0.smithi046.stdout:9/714: rmdir d2/d6/d33 39 2024-05-09T06:30:52.764 INFO:tasks.workunit.client.0.smithi046.stdout:9/715: link d2/d6/d7/l17 d2/d26/lf7 0 2024-05-09T06:30:52.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/716: unlink d2/d6/d33/da8/fb2 0 2024-05-09T06:30:52.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/717: mkdir d2/d6/d7/d1a/d27/d56/df8 0 2024-05-09T06:30:52.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/718: chown d2/d6/d7/d1e/fd2 1354 1 2024-05-09T06:30:52.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/719: creat d2/d6/d7/d1e/ff9 x:0 0 0 2024-05-09T06:30:52.786 INFO:tasks.workunit.client.0.smithi046.stdout:9/720: dwrite d2/d6/d7/d1e/f78 [0,4194304] 0 2024-05-09T06:30:52.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/721: dwrite d2/d26/d2c/d3d/fba [0,4194304] 0 2024-05-09T06:30:52.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/722: creat d2/d26/dab/ffa x:0 0 0 2024-05-09T06:30:52.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/723: rename d2/d26/d2c/d3d to d2/d26/d76/dfb 0 2024-05-09T06:30:52.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/724: dwrite d2/d26/d76/fd9 [0,4194304] 0 2024-05-09T06:30:52.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/725: fsync d2/dc/ff5 0 2024-05-09T06:30:52.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/726: symlink d2/d26/d2c/daf/lfc 0 2024-05-09T06:30:52.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/727: symlink d2/d6/d38/de6/lfd 0 2024-05-09T06:30:52.824 INFO:tasks.workunit.client.0.smithi046.stdout:9/728: creat d2/d26/d76/dfb/ffe x:0 0 0 2024-05-09T06:30:52.827 INFO:tasks.workunit.client.0.smithi046.stdout:9/729: mknod d2/d26/d76/cff 0 2024-05-09T06:30:52.855 INFO:tasks.workunit.client.0.smithi046.stdout:9/730: creat d2/d6/d7/d1a/d27/d2a/f100 x:0 0 0 2024-05-09T06:30:52.857 INFO:tasks.workunit.client.0.smithi046.stdout:9/731: symlink d2/d6/d8b/l101 0 2024-05-09T06:30:52.862 INFO:tasks.workunit.client.0.smithi046.stdout:5/717: sync 2024-05-09T06:30:52.864 INFO:tasks.workunit.client.0.smithi046.stdout:5/718: mkdir d0/db3/deb/dfc 0 2024-05-09T06:30:52.864 INFO:tasks.workunit.client.0.smithi046.stdout:5/719: fsync d0/dba/de7/d50/fc5 0 2024-05-09T06:30:52.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/732: dwrite d2/d6/d7/f1b [0,4194304] 0 2024-05-09T06:30:52.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/720: dread d0/d1b/d21/d81/fa4 [0,4194304] 0 2024-05-09T06:30:52.873 INFO:tasks.workunit.client.0.smithi046.stdout:9/733: rename d2/fd7 to d2/d6/d7/f102 0 2024-05-09T06:30:52.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/721: symlink d0/d1b/d21/d81/lfd 0 2024-05-09T06:30:52.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/734: symlink d2/d26/d76/dfb/l103 0 2024-05-09T06:30:52.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/722: mknod d0/dba/de7/d83/cfe 0 2024-05-09T06:30:52.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/735: mknod d2/d6/d7/d1a/d27/d56/df8/c104 0 2024-05-09T06:30:52.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/723: symlink d0/d1b/d39/d8a/lff 0 2024-05-09T06:30:52.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/736: creat d2/d6/d7/d1a/d86/ddf/f105 x:0 0 0 2024-05-09T06:30:52.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/724: write d0/d1b/d21/f85 [982942,127088] 0 2024-05-09T06:30:52.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/725: chown d0/d1b/c7f 204977 1 2024-05-09T06:30:52.889 INFO:tasks.workunit.client.0.smithi046.stdout:9/737: write d2/d6/dbb/fd5 [355293,62522] 0 2024-05-09T06:30:52.889 INFO:tasks.workunit.client.0.smithi046.stdout:9/738: dread - d2/d6/d7/d1a/f59 zero size 2024-05-09T06:30:52.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/739: mkdir d2/d6/d7/d1a/d27/d56/df8/d106 0 2024-05-09T06:30:52.894 INFO:tasks.workunit.client.0.smithi046.stdout:9/740: mknod d2/d6/d7/c107 0 2024-05-09T06:30:52.901 INFO:tasks.workunit.client.0.smithi046.stdout:9/741: write d2/d20/fb7 [1455491,78470] 0 2024-05-09T06:30:52.908 INFO:tasks.workunit.client.0.smithi046.stdout:9/742: dread d2/d6/d7/d1e/f4a [0,4194304] 0 2024-05-09T06:30:52.929 INFO:tasks.workunit.client.0.smithi046.stdout:9/743: dwrite d2/d6/d7/d1a/d27/d2a/f4e [4194304,4194304] 0 2024-05-09T06:30:52.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/744: dread d2/fb0 [0,4194304] 0 2024-05-09T06:30:52.934 INFO:tasks.workunit.client.0.smithi046.stdout:9/745: mknod d2/d26/d2c/daf/c108 0 2024-05-09T06:30:52.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/746: fdatasync d2/d20/fb7 0 2024-05-09T06:30:52.950 INFO:tasks.workunit.client.0.smithi046.stdout:9/747: dwrite d2/d6/d7/d1a/d27/d2a/f93 [0,4194304] 0 2024-05-09T06:30:52.963 INFO:tasks.workunit.client.0.smithi046.stdout:9/748: dwrite d2/d6/d7/d1a/d27/f98 [0,4194304] 0 2024-05-09T06:30:52.969 INFO:tasks.workunit.client.0.smithi046.stdout:9/749: link d2/d6/d38/f48 d2/d6/d7/d1a/d27/d56/f109 0 2024-05-09T06:30:52.978 INFO:tasks.workunit.client.0.smithi046.stdout:9/750: dread d2/dc/f41 [0,4194304] 0 2024-05-09T06:30:52.978 INFO:tasks.workunit.client.0.smithi046.stdout:9/751: chown d2/dc/ff5 5 1 2024-05-09T06:30:53.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/980: sync 2024-05-09T06:30:53.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/981: write d3/d7/d28/f58 [1194463,18889] 0 2024-05-09T06:30:53.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/982: creat d3/d7/dd/d3e/f13a x:0 0 0 2024-05-09T06:30:53.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/983: readlink d3/l21 0 2024-05-09T06:30:53.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/984: fsync d3/d7/d28/d29/d3b/f3f 0 2024-05-09T06:30:53.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/985: chown d3/d7/dd/d3e/lcf 897 1 2024-05-09T06:30:53.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/986: truncate d3/f85 3772967 0 2024-05-09T06:30:53.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/987: readlink d3/d7/d4c/d4f/d121/l12e 0 2024-05-09T06:30:53.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/988: dread - d3/d7/dd/d3e/f13a zero size 2024-05-09T06:30:53.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/989: dwrite d3/d7/d4c/ff1 [4194304,4194304] 0 2024-05-09T06:30:53.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/990: creat d3/d7/d4c/d4f/d121/d72/d107/de0/f13b x:0 0 0 2024-05-09T06:30:53.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/991: write d3/d7/d4c/d4f/d121/d72/d79/fa9 [198600,116746] 0 2024-05-09T06:30:53.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/992: readlink d3/d7/d28/d29/d3b/dbd/lf6 0 2024-05-09T06:30:53.094 INFO:tasks.workunit.client.0.smithi046.stdout:7/993: dwrite d3/d7/d28/d29/f98 [0,4194304] 0 2024-05-09T06:30:53.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/994: write d3/d7/d28/d73/f88 [401703,94504] 0 2024-05-09T06:30:53.104 INFO:tasks.workunit.client.0.smithi046.stdout:7/995: getdents d3/d7/d28/d29/d3b/dfd 0 2024-05-09T06:30:53.104 INFO:tasks.workunit.client.0.smithi046.stdout:7/996: chown d3/d7/d4c/fd2 19102 1 2024-05-09T06:30:53.111 INFO:tasks.workunit.client.0.smithi046.stdout:7/997: dread d3/ff8 [0,4194304] 0 2024-05-09T06:30:53.111 INFO:tasks.workunit.client.0.smithi046.stdout:7/998: write d3/d7/d28/d29/d3b/f7e [324374,24068] 0 2024-05-09T06:30:53.111 INFO:tasks.workunit.client.0.smithi046.stdout:7/999: write d3/f8f [862229,44303] 0 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/864: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:6/946: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/847: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/791: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/752: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/912: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/726: sync 2024-05-09T06:30:53.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/753: fsync d2/d6/f9b 0 2024-05-09T06:30:53.162 INFO:tasks.workunit.client.0.smithi046.stdout:8/913: chown d1/db/dd/d11/f5c 154297 1 2024-05-09T06:30:53.162 INFO:tasks.workunit.client.0.smithi046.stdout:5/727: write d0/d1b/d21/f85 [1206681,36254] 0 2024-05-09T06:30:53.162 INFO:tasks.workunit.client.0.smithi046.stdout:2/826: sync 2024-05-09T06:30:53.162 INFO:tasks.workunit.client.0.smithi046.stdout:3/863: sync 2024-05-09T06:30:53.163 INFO:tasks.workunit.client.0.smithi046.stdout:0/792: getdents d11/d4f/d5b/d5f 0 2024-05-09T06:30:53.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/865: truncate d7/d10/d28/d30/fae 922473 0 2024-05-09T06:30:53.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/866: chown d7/d10/d28/d30/dcf/fb7 1336103 1 2024-05-09T06:30:53.165 INFO:tasks.workunit.client.0.smithi046.stdout:6/947: mkdir db/d10/d3f/d44/d46/d136 0 2024-05-09T06:30:53.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/754: symlink d2/d6/d7/d1a/d27/d56/df8/l10a 0 2024-05-09T06:30:53.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/755: creat d2/d26/d76/dfb/f10b x:0 0 0 2024-05-09T06:30:53.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/756: write d2/d6/d38/de6/fea [287707,79818] 0 2024-05-09T06:30:53.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/728: symlink d0/dba/de7/d83/l100 0 2024-05-09T06:30:53.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/848: dread d7/df/d53/f6f [4194304,4194304] 0 2024-05-09T06:30:53.172 INFO:tasks.workunit.client.0.smithi046.stdout:2/827: mkdir da/dcb/dcc/dee/dcd/dd2/d107 0 2024-05-09T06:30:53.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/864: creat d4/df9/d128/f132 x:0 0 0 2024-05-09T06:30:53.174 INFO:tasks.workunit.client.0.smithi046.stdout:0/793: dread d11/d18/d27/d28/d36/f37 [4194304,4194304] 0 2024-05-09T06:30:53.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/867: rmdir d7/d10/d34/d46 39 2024-05-09T06:30:53.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/868: fsync d7/d10/d28/d30/f5e 0 2024-05-09T06:30:53.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/869: getdents d7/d10 0 2024-05-09T06:30:53.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/870: chown d7/d10/d34/d46/d81/led 1571765 1 2024-05-09T06:30:53.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/948: rename db/d10/d3f/d44/d46/d70/f9d to db/d10/d3f/d44/d5e/f137 0 2024-05-09T06:30:53.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/949: chown db/d10/d3f/d44/d46/d70/fe5 3295942 1 2024-05-09T06:30:53.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/757: mkdir d2/d6/d7/d1a/d27/d56/df8/d106/d10c 0 2024-05-09T06:30:53.185 INFO:tasks.workunit.client.0.smithi046.stdout:5/729: symlink d0/l101 0 2024-05-09T06:30:53.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/849: creat d7/df/d3a/d45/d96/db3/de4/d104/f107 x:0 0 0 2024-05-09T06:30:53.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/828: rmdir da/de/d14/d1f/d3b/d9f 39 2024-05-09T06:30:53.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/829: fdatasync f8 0 2024-05-09T06:30:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:3/865: mknod d4/d20/d41/c133 0 2024-05-09T06:30:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:3/866: dread d4/d48/d49/f54 [0,4194304] 0 2024-05-09T06:30:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/871: unlink d7/d10/d28/d30/f77 0 2024-05-09T06:30:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:6/950: dwrite db/d10/d3f/d44/f118 [0,4194304] 0 2024-05-09T06:30:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:5/730: dread d0/d58/d7a/f86 [0,4194304] 0 2024-05-09T06:30:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:5/731: readlink d0/dba/de7/d50/lda 0 2024-05-09T06:30:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/758: unlink d2/dc/fb4 0 2024-05-09T06:30:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/759: chown d2/d26/cf4 11316517 1 2024-05-09T06:30:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/760: readlink d2/d26/lf7 0 2024-05-09T06:30:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:4/850: rename d7/l27 to d7/df/d3a/d45/d96/db3/l108 0 2024-05-09T06:30:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:4/851: dread d7/df/d3a/d25/d81/d98/fbc [0,4194304] 0 2024-05-09T06:30:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:2/830: mkdir da/dcb/dcc/dee/dae/d108 0 2024-05-09T06:30:53.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/794: rmdir d11/d18 39 2024-05-09T06:30:53.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/872: mknod d7/d10/d34/d46/d86/c11b 0 2024-05-09T06:30:53.216 INFO:tasks.workunit.client.0.smithi046.stdout:6/951: link db/d10/d3f/d44/d5e/dbe/f108 db/d10/d3c/dd4/d87/d12d/f138 0 2024-05-09T06:30:53.218 INFO:tasks.workunit.client.0.smithi046.stdout:5/732: mknod d0/db3/deb/dfc/c102 0 2024-05-09T06:30:53.218 INFO:tasks.workunit.client.0.smithi046.stdout:5/733: write d0/dad/ff6 [577310,27599] 0 2024-05-09T06:30:53.219 INFO:tasks.workunit.client.0.smithi046.stdout:9/761: symlink d2/d6/d38/l10d 0 2024-05-09T06:30:53.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/852: rename d7/df/d10/d2f/fa2 to d7/df/d53/deb/f109 0 2024-05-09T06:30:53.225 INFO:tasks.workunit.client.0.smithi046.stdout:3/867: getdents d4/d20/d24/d29/df3 0 2024-05-09T06:30:53.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/868: dread d4/d20/d41/d4a/f105 [0,4194304] 0 2024-05-09T06:30:53.228 INFO:tasks.workunit.client.0.smithi046.stdout:1/873: symlink d7/d10/d28/d30/da0/dd9/dfe/l11c 0 2024-05-09T06:30:53.228 INFO:tasks.workunit.client.0.smithi046.stdout:1/874: chown d7/d10/d28/d30/la5 7 1 2024-05-09T06:30:53.229 INFO:tasks.workunit.client.0.smithi046.stdout:6/952: symlink db/d10/d3f/d44/d134/l139 0 2024-05-09T06:30:53.229 INFO:tasks.workunit.client.0.smithi046.stdout:6/953: chown db/d10/d3f/d4f/d8a/d9e/ff2 94402 1 2024-05-09T06:30:53.232 INFO:tasks.workunit.client.0.smithi046.stdout:9/762: symlink d2/d6/d8b/l10e 0 2024-05-09T06:30:53.232 INFO:tasks.workunit.client.0.smithi046.stdout:5/734: dwrite d0/f1c [0,4194304] 0 2024-05-09T06:30:53.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/795: rename d11/d18/d27/d28/d36/d91/d98/db0/le1 to d11/d3f/lf7 0 2024-05-09T06:30:53.237 INFO:tasks.workunit.client.0.smithi046.stdout:4/853: creat d7/df/d3a/d25/f10a x:0 0 0 2024-05-09T06:30:53.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/763: read d2/d6/d7/d1a/d27/d56/f109 [7114566,38670] 0 2024-05-09T06:30:53.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/831: rmdir da/de/d14/d1f/d20/d7c 39 2024-05-09T06:30:53.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/832: stat da/df8 0 2024-05-09T06:30:53.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/869: mknod d4/d20/d24/d29/c134 0 2024-05-09T06:30:53.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/875: mkdir d7/d10/d84/de1/d118/d11d 0 2024-05-09T06:30:53.241 INFO:tasks.workunit.client.0.smithi046.stdout:6/954: rmdir db/d10/d3f 39 2024-05-09T06:30:53.242 INFO:tasks.workunit.client.0.smithi046.stdout:6/955: fsync db/d10/d3f/d44/d5e/f125 0 2024-05-09T06:30:53.242 INFO:tasks.workunit.client.0.smithi046.stdout:6/956: stat db/d10/d3f/d4f/d8a/f12f 0 2024-05-09T06:30:53.245 INFO:tasks.workunit.client.0.smithi046.stdout:5/735: mknod d0/dba/de7/d53/c103 0 2024-05-09T06:30:53.248 INFO:tasks.workunit.client.0.smithi046.stdout:0/796: mknod d11/d18/d1c/d53/dc2/cf8 0 2024-05-09T06:30:53.249 INFO:tasks.workunit.client.0.smithi046.stdout:4/854: rmdir d7/df/d3a/d25/d81 39 2024-05-09T06:30:53.249 INFO:tasks.workunit.client.0.smithi046.stdout:4/855: write d7/f90 [3258642,56319] 0 2024-05-09T06:30:53.253 INFO:tasks.workunit.client.0.smithi046.stdout:2/833: mknod da/d2d/d104/c109 0 2024-05-09T06:30:53.259 INFO:tasks.workunit.client.0.smithi046.stdout:9/764: dwrite d2/d6/d7/ff [0,4194304] 0 2024-05-09T06:30:53.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/876: symlink d7/d6d/l11e 0 2024-05-09T06:30:53.262 INFO:tasks.workunit.client.0.smithi046.stdout:0/797: dread d11/d18/d27/d28/d6b/f77 [0,4194304] 0 2024-05-09T06:30:53.262 INFO:tasks.workunit.client.0.smithi046.stdout:6/957: creat db/d10/d3f/d4f/d106/f13a x:0 0 0 2024-05-09T06:30:53.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/736: symlink d0/d1b/d39/dcf/l104 0 2024-05-09T06:30:53.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/737: creat d0/d1b/d39/dcf/f105 x:0 0 0 2024-05-09T06:30:53.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/738: write d0/dba/de7/d50/fd3 [460516,67621] 0 2024-05-09T06:30:53.264 INFO:tasks.workunit.client.0.smithi046.stdout:0/798: dread d11/f93 [0,4194304] 0 2024-05-09T06:30:53.264 INFO:tasks.workunit.client.0.smithi046.stdout:0/799: truncate d11/d3f/f51 1251692 0 2024-05-09T06:30:53.264 INFO:tasks.workunit.client.0.smithi046.stdout:0/800: truncate d11/d18/db1/fbc 521293 0 2024-05-09T06:30:53.266 INFO:tasks.workunit.client.0.smithi046.stdout:4/856: symlink d7/daf/l10b 0 2024-05-09T06:30:53.267 INFO:tasks.workunit.client.0.smithi046.stdout:2/834: dwrite da/de/d14/d1f/f48 [0,4194304] 0 2024-05-09T06:30:53.271 INFO:tasks.workunit.client.0.smithi046.stdout:9/765: mkdir d2/d6/d7/d1a/d27/d65/dd1/d10f 0 2024-05-09T06:30:53.275 INFO:tasks.workunit.client.0.smithi046.stdout:2/835: dread da/dcb/dcc/dee/dcd/d7d/dc5/d3a/fb4 [0,4194304] 0 2024-05-09T06:30:53.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/877: link d7/l39 d7/d10/d28/d30/dcf/d7f/l11f 0 2024-05-09T06:30:53.278 INFO:tasks.workunit.client.0.smithi046.stdout:6/958: link db/d10/d3f/d44/fb8 db/d10/d30/f13b 0 2024-05-09T06:30:53.281 INFO:tasks.workunit.client.0.smithi046.stdout:5/739: symlink d0/d1b/d21/d81/l106 0 2024-05-09T06:30:53.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/801: rmdir d11/d18/d27/d28/d2d/d5c/ddf/df0 0 2024-05-09T06:30:53.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/802: rename d11/d18/d27 to d11/d18/d27/d28/d6b/df9 22 2024-05-09T06:30:53.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/803: write d11/d18/d1c/d53/d82/f9a [4974343,57334] 0 2024-05-09T06:30:53.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/740: dread d0/dba/de7/d50/fa8 [0,4194304] 0 2024-05-09T06:30:53.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/741: truncate d0/d1b/d39/d8b/f9f 437632 0 2024-05-09T06:30:53.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/804: dread d11/d18/d27/d28/f50 [0,4194304] 0 2024-05-09T06:30:53.294 INFO:tasks.workunit.client.0.smithi046.stdout:4/857: mknod d7/dd8/c10c 0 2024-05-09T06:30:53.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:53 smithi046 ceph-mon[26924]: pgmap v33: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 117 MiB/s rd, 144 MiB/s wr, 263 op/s 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:3/870: dwrite d4/d20/d24/d2a/f9a [0,4194304] 0 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:3/871: chown d4/d20/d41/d4a/f111 0 1 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:9/766: dwrite d2/d6/d7/d1e/f78 [0,4194304] 0 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:9/767: chown d2/d6/d33/da8/ce7 1 1 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:9/768: chown d2/d6/d7/d1a/d27/d65/dd1/d10f 19538 1 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:9/769: dread - d2/d6/d7/d1e/fd2 zero size 2024-05-09T06:30:53.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/836: creat da/de/d54/d65/d70/f10a x:0 0 0 2024-05-09T06:30:53.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/878: symlink d7/d10/d34/d46/l120 0 2024-05-09T06:30:53.306 INFO:tasks.workunit.client.0.smithi046.stdout:6/959: mknod db/d10/d3c/dd4/d87/d12d/c13c 0 2024-05-09T06:30:53.311 INFO:tasks.workunit.client.0.smithi046.stdout:9/770: write d2/d6/d8b/fb6 [3458318,31277] 0 2024-05-09T06:30:53.311 INFO:tasks.workunit.client.0.smithi046.stdout:4/858: dwrite d7/df/d53/deb/fec [0,4194304] 0 2024-05-09T06:30:53.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/742: mkdir d0/dba/de7/d50/d107 0 2024-05-09T06:30:53.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/743: creat d0/d1b/d39/d8a/f108 x:0 0 0 2024-05-09T06:30:53.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/744: chown d0/d1b/d21/l96 138 1 2024-05-09T06:30:53.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/805: creat d11/d18/d27/d28/d36/d91/d98/db0/ffa x:0 0 0 2024-05-09T06:30:53.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/806: chown d11/d18/d27/d28/d36/d91/d98/fcd 124 1 2024-05-09T06:30:53.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/807: chown d11/d4f/d5b 19793208 1 2024-05-09T06:30:53.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/808: chown d11/d4f 934 1 2024-05-09T06:30:53.315 INFO:tasks.workunit.client.0.smithi046.stdout:1/879: write d7/d10/d34/d46/d86/f7c [921881,68840] 0 2024-05-09T06:30:53.319 INFO:tasks.workunit.client.0.smithi046.stdout:3/872: link d4/d5/dac/fdb d4/d20/d24/f135 0 2024-05-09T06:30:53.319 INFO:tasks.workunit.client.0.smithi046.stdout:3/873: dread - d4/d20/d24/f135 zero size 2024-05-09T06:30:53.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/837: mknod da/dcb/dcc/dee/dcd/d7d/dc5/d3a/c10b 0 2024-05-09T06:30:53.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/838: chown da/de/d14/d1f/d20/d7c/d8b 18857036 1 2024-05-09T06:30:53.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:53 smithi106 ceph-mon[34679]: pgmap v33: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 117 MiB/s rd, 144 MiB/s wr, 263 op/s 2024-05-09T06:30:53.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/859: rename d7/f72 to d7/dd8/df7/f10d 0 2024-05-09T06:30:53.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/860: truncate d7/f15 1597153 0 2024-05-09T06:30:53.327 INFO:tasks.workunit.client.0.smithi046.stdout:5/745: chown d0/d1b/d39/c66 32553 1 2024-05-09T06:30:53.328 INFO:tasks.workunit.client.0.smithi046.stdout:5/746: fdatasync d0/d1b/d21/d81/fa6 0 2024-05-09T06:30:53.329 INFO:tasks.workunit.client.0.smithi046.stdout:0/809: unlink d11/d18/d1c/cf5 0 2024-05-09T06:30:53.332 INFO:tasks.workunit.client.0.smithi046.stdout:3/874: mknod d4/d5d/c136 0 2024-05-09T06:30:53.336 INFO:tasks.workunit.client.0.smithi046.stdout:1/880: rename d7/d6d/lf7 to d7/d10/d28/d30/dcf/d7f/l121 0 2024-05-09T06:30:53.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/810: symlink d11/d18/d27/d28/d36/d91/lfb 0 2024-05-09T06:30:53.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/811: fdatasync d11/d18/d27/d28/d6b/fcf 0 2024-05-09T06:30:53.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/812: truncate d11/d18/d27/d28/d36/d5a/f80 2057713 0 2024-05-09T06:30:53.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/813: dread - d11/d18/d27/d28/d6b/fc6 zero size 2024-05-09T06:30:53.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/875: symlink d4/d20/d24/d2a/d46/l137 0 2024-05-09T06:30:53.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/876: truncate d4/d20/d24/d2a/d46/f124 654049 0 2024-05-09T06:30:53.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/877: write d4/d20/d41/d4a/f111 [599434,17246] 0 2024-05-09T06:30:53.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/861: rename d7/df/d10/d1d/db9/fcb to d7/df/d10/d1d/d77/d87/dbe/f10e 0 2024-05-09T06:30:53.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/747: dwrite d0/dba/de7/fb5 [0,4194304] 0 2024-05-09T06:30:53.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/748: write d0/d58/d7a/fbc [56189,169] 0 2024-05-09T06:30:53.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/749: chown d0/d58/d7a/lc9 25 1 2024-05-09T06:30:53.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/750: dread - d0/dad/ff1 zero size 2024-05-09T06:30:53.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/751: readlink d0/dba/de7/dc7/lec 0 2024-05-09T06:30:53.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/881: unlink d7/d6d/c8c 0 2024-05-09T06:30:53.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/882: chown d7/d10/d28/d30/dcf/lc0 26312888 1 2024-05-09T06:30:53.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/814: rename d11/d18/d27/d28/d2d/f4c to d11/d18/d27/d28/d36/d5a/ffc 0 2024-05-09T06:30:53.352 INFO:tasks.workunit.client.0.smithi046.stdout:4/862: creat d7/df/d3a/d45/d96/db3/f10f x:0 0 0 2024-05-09T06:30:53.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/883: dread d7/d10/d28/d30/f36 [0,4194304] 0 2024-05-09T06:30:53.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/884: stat d7/d10/d28/d30/dcf/d76/f7a 0 2024-05-09T06:30:53.355 INFO:tasks.workunit.client.0.smithi046.stdout:3/878: dwrite d4/d20/d24/d29/d7a/f122 [0,4194304] 0 2024-05-09T06:30:53.356 INFO:tasks.workunit.client.0.smithi046.stdout:5/752: rename d0/d58/d7a/c95 to d0/dba/de7/d50/c109 0 2024-05-09T06:30:53.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/815: mknod d11/d18/d27/d28/d2d/d5c/ddf/cfd 0 2024-05-09T06:30:53.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/816: fdatasync d11/d18/d27/d28/d36/d5a/f87 0 2024-05-09T06:30:53.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/817: chown d11/d18/d27/d28/d36/faa 5776 1 2024-05-09T06:30:53.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/885: unlink d7/d10/d28/d55/c5c 0 2024-05-09T06:30:53.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/886: creat d7/da3/f122 x:0 0 0 2024-05-09T06:30:53.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/753: getdents d0/dba/de7 0 2024-05-09T06:30:53.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/754: readlink d0/d1b/d21/led 0 2024-05-09T06:30:53.368 INFO:tasks.workunit.client.0.smithi046.stdout:0/818: truncate d11/d18/d27/d28/d6b/fcf 602604 0 2024-05-09T06:30:53.368 INFO:tasks.workunit.client.0.smithi046.stdout:0/819: readlink d11/d18/d1c/d53/l96 0 2024-05-09T06:30:53.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/755: creat d0/dba/de7/dfb/f10a x:0 0 0 2024-05-09T06:30:53.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/756: fdatasync d0/d58/faf 0 2024-05-09T06:30:53.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/757: chown d0/f6a 31354869 1 2024-05-09T06:30:53.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/758: chown d0/d1b/d21/c80 649569 1 2024-05-09T06:30:53.394 INFO:tasks.workunit.client.0.smithi046.stdout:5/759: dwrite d0/d1b/d21/d81/fdf [0,4194304] 0 2024-05-09T06:30:53.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/760: chown d0/dba/de7/dc7/dd0/fd5 10528616 1 2024-05-09T06:30:53.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/839: dwrite da/de/d14/d1f/d3b/f37 [0,4194304] 0 2024-05-09T06:30:53.483 INFO:tasks.workunit.client.0.smithi046.stdout:5/761: creat d0/dba/de7/d50/f10b x:0 0 0 2024-05-09T06:30:53.486 INFO:tasks.workunit.client.0.smithi046.stdout:2/840: truncate da/dc/f5b 42331 0 2024-05-09T06:30:53.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/841: dread da/d2d/f93 [0,4194304] 0 2024-05-09T06:30:53.498 INFO:tasks.workunit.client.0.smithi046.stdout:5/762: creat d0/dba/de7/f10c x:0 0 0 2024-05-09T06:30:53.500 INFO:tasks.workunit.client.0.smithi046.stdout:4/863: rename d7/df/d10/d1d/db9 to d7/dd8/df7/d110 0 2024-05-09T06:30:53.500 INFO:tasks.workunit.client.0.smithi046.stdout:1/887: rename d7/d10/d28 to d7/d10/d28/d30/dcf/d7f/d10a/d123 22 2024-05-09T06:30:53.505 INFO:tasks.workunit.client.0.smithi046.stdout:5/763: mknod d0/d1b/d39/d8b/c10d 0 2024-05-09T06:30:53.507 INFO:tasks.workunit.client.0.smithi046.stdout:4/864: write d7/df/d3a/d25/f57 [1890581,10015] 0 2024-05-09T06:30:53.514 INFO:tasks.workunit.client.0.smithi046.stdout:0/820: rename d11/d18/d27/d28/d36/l83 to d11/d18/d1c/lfe 0 2024-05-09T06:30:53.514 INFO:tasks.workunit.client.0.smithi046.stdout:0/821: fsync d11/d18/d27/d28/d2d/d5c/f72 0 2024-05-09T06:30:53.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/842: rename da/de/d14/d1f/d3b/l57 to da/de/d14/d1f/d20/d7c/l10c 0 2024-05-09T06:30:53.515 INFO:tasks.workunit.client.0.smithi046.stdout:1/888: getdents d7/d10/d84/da8 0 2024-05-09T06:30:53.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/865: dread d7/df/d3a/d25/f57 [0,4194304] 0 2024-05-09T06:30:53.517 INFO:tasks.workunit.client.0.smithi046.stdout:1/889: creat d7/d10/d28/d55/dc9/f124 x:0 0 0 2024-05-09T06:30:53.520 INFO:tasks.workunit.client.0.smithi046.stdout:4/866: creat d7/dd8/df7/d110/f111 x:0 0 0 2024-05-09T06:30:53.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/764: write d0/d1b/d21/f5d [3034900,20758] 0 2024-05-09T06:30:53.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/765: write d0/d1b/d21/f85 [832048,62972] 0 2024-05-09T06:30:53.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/766: mkdir d0/db3/dc0/d10e 0 2024-05-09T06:30:53.525 INFO:tasks.workunit.client.0.smithi046.stdout:5/767: mknod d0/dba/de7/dfb/c10f 0 2024-05-09T06:30:53.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/768: symlink d0/dba/de7/dc7/l110 0 2024-05-09T06:30:53.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/769: fsync d0/dba/de7/d50/fae 0 2024-05-09T06:30:53.529 INFO:tasks.workunit.client.0.smithi046.stdout:5/770: mkdir d0/dba/de7/dc7/dd0/d111 0 2024-05-09T06:30:53.531 INFO:tasks.workunit.client.0.smithi046.stdout:2/843: dwrite da/d2d/f42 [0,4194304] 0 2024-05-09T06:30:53.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/844: truncate da/dcb/dcc/dee/dcd/d7d/d6d/f8d 31589 0 2024-05-09T06:30:53.534 INFO:tasks.workunit.client.0.smithi046.stdout:2/845: creat da/dcb/dcc/dee/dcd/d7d/dfc/f10d x:0 0 0 2024-05-09T06:30:53.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/846: fsync da/dcb/dcc/dee/dcd/d7d/dc5/f72 0 2024-05-09T06:30:53.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/847: fdatasync f1 0 2024-05-09T06:30:53.553 INFO:tasks.workunit.client.0.smithi046.stdout:5/771: dwrite d0/f1 [0,4194304] 0 2024-05-09T06:30:53.554 INFO:tasks.workunit.client.0.smithi046.stdout:2/848: dwrite da/de/d14/d1f/d20/d7c/ffb [0,4194304] 0 2024-05-09T06:30:53.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/772: link d0/dba/lca d0/l112 0 2024-05-09T06:30:53.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/773: chown d0/d1b/d21/l9c 233234674 1 2024-05-09T06:30:53.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/774: write d0/d1b/d21/f79 [2147388,14684] 0 2024-05-09T06:30:53.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/775: dread - d0/dad/fc3 zero size 2024-05-09T06:30:53.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/776: chown d0/d58 10627 1 2024-05-09T06:30:53.569 INFO:tasks.workunit.client.0.smithi046.stdout:5/777: truncate d0/d1b/f9a 3107629 0 2024-05-09T06:30:53.575 INFO:tasks.workunit.client.0.smithi046.stdout:2/849: dwrite da/de/d1c/fe5 [0,4194304] 0 2024-05-09T06:30:53.576 INFO:tasks.workunit.client.0.smithi046.stdout:5/778: read d0/d58/f9d [1355490,77545] 0 2024-05-09T06:30:53.579 INFO:tasks.workunit.client.0.smithi046.stdout:2/850: mknod da/d2d/c10e 0 2024-05-09T06:30:53.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/851: write da/dcb/dcc/dee/dcd/d7d/dc5/f9b [505937,96261] 0 2024-05-09T06:30:53.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/852: truncate da/de/d14/d1f/d20/d7c/d8b/f105 5213565 0 2024-05-09T06:30:53.584 INFO:tasks.workunit.client.0.smithi046.stdout:5/779: rename d0/d1b/d21/d81/faa to d0/d58/f113 0 2024-05-09T06:30:53.596 INFO:tasks.workunit.client.0.smithi046.stdout:8/914: sync 2024-05-09T06:30:53.596 INFO:tasks.workunit.client.0.smithi046.stdout:8/915: read - d1/db/dd/d11/d5d/d99/de8/fa4 zero size 2024-05-09T06:30:53.601 INFO:tasks.workunit.client.0.smithi046.stdout:8/916: unlink d1/db/dd/f1a 0 2024-05-09T06:30:53.603 INFO:tasks.workunit.client.0.smithi046.stdout:5/780: dwrite d0/dad/ff1 [0,4194304] 0 2024-05-09T06:30:53.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/781: write d0/dba/de7/d50/fa8 [4097902,94031] 0 2024-05-09T06:30:53.614 INFO:tasks.workunit.client.0.smithi046.stdout:8/917: write d1/d7/fd5 [2393591,82305] 0 2024-05-09T06:30:53.614 INFO:tasks.workunit.client.0.smithi046.stdout:8/918: write d1/d7/d2c/f98 [97111,130731] 0 2024-05-09T06:30:53.623 INFO:tasks.workunit.client.0.smithi046.stdout:8/919: mknod d1/db/d67/d6e/c117 0 2024-05-09T06:30:53.629 INFO:tasks.workunit.client.0.smithi046.stdout:8/920: creat d1/d7/d12/d1d/d30/d38/f118 x:0 0 0 2024-05-09T06:30:53.629 INFO:tasks.workunit.client.0.smithi046.stdout:8/921: rename d1/d7/dcd/ddf to d1/d7/dcd/ddf/d119 22 2024-05-09T06:30:53.631 INFO:tasks.workunit.client.0.smithi046.stdout:5/782: dwrite d0/dba/de7/d50/fc5 [0,4194304] 0 2024-05-09T06:30:53.636 INFO:tasks.workunit.client.0.smithi046.stdout:8/922: getdents d1/d7/dcd/ddf 0 2024-05-09T06:30:53.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/923: truncate d1/db/d67/fc9 502220 0 2024-05-09T06:30:53.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/783: dwrite d0/f4 [0,4194304] 0 2024-05-09T06:30:53.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/924: dwrite d1/d7/d12/d1d/d30/fd0 [0,4194304] 0 2024-05-09T06:30:53.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/925: fsync d1/db/dd/d11/d5d/d99/de8/dd4/f10f 0 2024-05-09T06:30:53.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/784: symlink d0/dba/de7/dc7/l114 0 2024-05-09T06:30:53.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/926: rmdir d1/db/d102 0 2024-05-09T06:30:53.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/927: creat d1/d7/dcd/f11a x:0 0 0 2024-05-09T06:30:53.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/928: rmdir d1/db/dd/d11/d5d/d99/de8 39 2024-05-09T06:30:53.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/929: readlink d1/db/d67/la5 0 2024-05-09T06:30:53.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/930: truncate d1/d7/dcd/f11a 231735 0 2024-05-09T06:30:53.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/931: creat d1/d7/d12/d1d/d30/dbd/dc7/dcf/f11b x:0 0 0 2024-05-09T06:30:53.684 INFO:tasks.workunit.client.0.smithi046.stdout:8/932: dread d1/db/dd/d11/d5d/d99/de8/dd4/f10f [0,4194304] 0 2024-05-09T06:30:53.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/933: fsync d1/d7/d12/d1d/d30/d38/dc0/ff3 0 2024-05-09T06:30:53.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/934: chown d1/d7/d2c/f15 521015 1 2024-05-09T06:30:53.687 INFO:tasks.workunit.client.0.smithi046.stdout:5/785: dwrite d0/dba/de7/d53/f6f [4194304,4194304] 0 2024-05-09T06:30:53.687 INFO:tasks.workunit.client.0.smithi046.stdout:5/786: truncate d0/dba/de7/d53/f5a 887390 0 2024-05-09T06:30:53.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/787: mkdir d0/d1b/d21/d81/d115 0 2024-05-09T06:30:53.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/788: symlink d0/d1b/d39/dcf/l116 0 2024-05-09T06:30:53.694 INFO:tasks.workunit.client.0.smithi046.stdout:2/853: truncate da/de/d1c/fe5 691255 0 2024-05-09T06:30:53.695 INFO:tasks.workunit.client.0.smithi046.stdout:2/854: creat da/de/d14/f10f x:0 0 0 2024-05-09T06:30:53.702 INFO:tasks.workunit.client.0.smithi046.stdout:5/789: dread d0/d58/d7a/f86 [0,4194304] 0 2024-05-09T06:30:53.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/790: dread d0/dba/de7/f3f [0,4194304] 0 2024-05-09T06:30:53.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/791: fdatasync d0/dba/de7/d83/f90 0 2024-05-09T06:30:53.714 INFO:tasks.workunit.client.0.smithi046.stdout:2/855: dwrite da/dcb/dcc/dee/dcd/d7d/f85 [0,4194304] 0 2024-05-09T06:30:53.715 INFO:tasks.workunit.client.0.smithi046.stdout:5/792: rmdir d0/d58/d7a 39 2024-05-09T06:30:53.716 INFO:tasks.workunit.client.0.smithi046.stdout:2/856: rmdir da/dcb/dcc/dee/dcd/d7d 39 2024-05-09T06:30:53.718 INFO:tasks.workunit.client.0.smithi046.stdout:5/793: symlink d0/dba/de7/d83/l117 0 2024-05-09T06:30:53.718 INFO:tasks.workunit.client.0.smithi046.stdout:2/857: readlink da/dcb/dcc/dee/dcd/d7d/dc5/l2f 0 2024-05-09T06:30:53.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/858: read da/dcb/dcc/dee/dcd/f88 [3252972,116168] 0 2024-05-09T06:30:53.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/859: symlink da/de/d14/d1f/d3b/l110 0 2024-05-09T06:30:53.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/860: stat da/dcb/dcc/dee/dcd/d7d/dc5/lf2 0 2024-05-09T06:30:53.888 INFO:tasks.workunit.client.0.smithi046.stdout:6/960: sync 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:0/822: sync 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:9/771: sync 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:1/890: sync 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/879: sync 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:4/867: sync 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/880: creat d4/d20/d24/d29/d2b/d94/f138 x:0 0 0 2024-05-09T06:30:54.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/881: write d4/d20/d24/d29/d2b/d94/f138 [794494,100297] 0 2024-05-09T06:30:54.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/882: symlink d4/d48/d49/dc0/l139 0 2024-05-09T06:30:54.040 INFO:tasks.workunit.client.0.smithi046.stdout:3/883: chown d4/d5/dac/db0/fbc 13490605 1 2024-05-09T06:30:54.040 INFO:tasks.workunit.client.0.smithi046.stdout:3/884: truncate d4/d20/d24/d29/d7a/fa4 829169 0 2024-05-09T06:30:54.041 INFO:tasks.workunit.client.0.smithi046.stdout:3/885: symlink d4/d20/d41/d4a/l13a 0 2024-05-09T06:30:54.042 INFO:tasks.workunit.client.0.smithi046.stdout:3/886: chown d4/d20/d24/d2a/c116 2526 1 2024-05-09T06:30:54.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/887: symlink d4/d20/d24/d2a/da2/l13b 0 2024-05-09T06:30:54.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/888: creat d4/d20/d24/d2a/d55/d6a/dd5/f13c x:0 0 0 2024-05-09T06:30:54.046 INFO:tasks.workunit.client.0.smithi046.stdout:1/891: dread d7/d10/d28/d30/f36 [0,4194304] 0 2024-05-09T06:30:54.047 INFO:tasks.workunit.client.0.smithi046.stdout:1/892: write d7/d10/d28/d30/dcf/d76/fb3 [1310940,62293] 0 2024-05-09T06:30:54.052 INFO:tasks.workunit.client.0.smithi046.stdout:0/823: write f9 [3943748,35787] 0 2024-05-09T06:30:54.052 INFO:tasks.workunit.client.0.smithi046.stdout:0/824: dread d11/d18/d27/d28/fc7 [0,4194304] 0 2024-05-09T06:30:54.054 INFO:tasks.workunit.client.0.smithi046.stdout:1/893: symlink d7/d6d/ddd/l125 0 2024-05-09T06:30:54.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/868: write d7/fc0 [3143165,76261] 0 2024-05-09T06:30:54.057 INFO:tasks.workunit.client.0.smithi046.stdout:0/825: dread d11/d18/d27/d28/fa9 [0,4194304] 0 2024-05-09T06:30:54.058 INFO:tasks.workunit.client.0.smithi046.stdout:4/869: rmdir d7/df/d3a/d45 39 2024-05-09T06:30:54.058 INFO:tasks.workunit.client.0.smithi046.stdout:4/870: fsync d7/df/d10/f9f 0 2024-05-09T06:30:54.058 INFO:tasks.workunit.client.0.smithi046.stdout:4/871: readlink d7/df/d10/d2f/lab 0 2024-05-09T06:30:54.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/889: dwrite d4/d20/d24/d2a/f40 [0,4194304] 0 2024-05-09T06:30:54.062 INFO:tasks.workunit.client.0.smithi046.stdout:0/826: creat d11/d18/d27/d28/d2d/d5c/fff x:0 0 0 2024-05-09T06:30:54.062 INFO:tasks.workunit.client.0.smithi046.stdout:0/827: stat d11/d18/d27/d28/d36/d5a/dc4 0 2024-05-09T06:30:54.062 INFO:tasks.workunit.client.0.smithi046.stdout:0/828: fsync d11/d4f/d5b/d5f/f6d 0 2024-05-09T06:30:54.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/872: creat d7/df/d10/d1d/d77/d87/dac/f112 x:0 0 0 2024-05-09T06:30:54.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/873: fdatasync d7/df/d53/deb/f109 0 2024-05-09T06:30:54.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/874: fsync d7/df/d3a/d25/d86/de1/ff4 0 2024-05-09T06:30:54.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/890: mknod d4/df9/d128/c13d 0 2024-05-09T06:30:54.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/891: write d4/d20/d24/d29/d2b/d94/d5c/d6c/fd2 [384810,113129] 0 2024-05-09T06:30:54.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/892: creat d4/d20/d24/d29/d2b/d94/d5c/f13e x:0 0 0 2024-05-09T06:30:54.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/875: mknod d7/c113 0 2024-05-09T06:30:54.074 INFO:tasks.workunit.client.0.smithi046.stdout:1/894: dwrite d7/da3/fb4 [0,4194304] 0 2024-05-09T06:30:54.074 INFO:tasks.workunit.client.0.smithi046.stdout:4/876: mknod d7/df/d3a/d45/d96/db3/de4/d104/c114 0 2024-05-09T06:30:54.080 INFO:tasks.workunit.client.0.smithi046.stdout:1/895: truncate d7/d10/d28/f59 868857 0 2024-05-09T06:30:54.080 INFO:tasks.workunit.client.0.smithi046.stdout:1/896: write d7/d10/d28/d55/fc6 [91118,305] 0 2024-05-09T06:30:54.080 INFO:tasks.workunit.client.0.smithi046.stdout:1/897: readlink d7/d10/d28/d30/l9d 0 2024-05-09T06:30:54.082 INFO:tasks.workunit.client.0.smithi046.stdout:4/877: unlink d7/df/d10/d1d/c33 0 2024-05-09T06:30:54.085 INFO:tasks.workunit.client.0.smithi046.stdout:1/898: symlink d7/d10/d84/l126 0 2024-05-09T06:30:54.093 INFO:tasks.workunit.client.0.smithi046.stdout:3/893: dwrite d4/d5/f9 [0,4194304] 0 2024-05-09T06:30:54.093 INFO:tasks.workunit.client.0.smithi046.stdout:3/894: readlink l2 0 2024-05-09T06:30:54.095 INFO:tasks.workunit.client.0.smithi046.stdout:1/899: write d7/d10/d34/fd1 [2626355,40048] 0 2024-05-09T06:30:54.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/829: dwrite d11/d3f/fe7 [0,4194304] 0 2024-05-09T06:30:54.096 INFO:tasks.workunit.client.0.smithi046.stdout:3/895: mkdir d4/d20/d24/d2a/da2/d13f 0 2024-05-09T06:30:54.105 INFO:tasks.workunit.client.0.smithi046.stdout:0/830: mknod d11/d18/d27/d28/c100 0 2024-05-09T06:30:54.105 INFO:tasks.workunit.client.0.smithi046.stdout:0/831: readlink d11/d18/d27/d28/d36/d5a/l65 0 2024-05-09T06:30:54.106 INFO:tasks.workunit.client.0.smithi046.stdout:4/878: dwrite d7/df/d53/f6f [0,4194304] 0 2024-05-09T06:30:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:4/879: creat d7/df/d3a/d25/d81/d98/db7/f115 x:0 0 0 2024-05-09T06:30:54.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/832: write f4 [498238,352] 0 2024-05-09T06:30:54.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/833: rename d11/d18 to d11/d18/d27/d101 22 2024-05-09T06:30:54.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/834: dread d11/d18/d27/d28/d6b/dac/fc8 [0,4194304] 0 2024-05-09T06:30:54.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/896: dwrite d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/fab [0,4194304] 0 2024-05-09T06:30:54.118 INFO:tasks.workunit.client.0.smithi046.stdout:0/835: creat d11/d18/d27/f102 x:0 0 0 2024-05-09T06:30:54.118 INFO:tasks.workunit.client.0.smithi046.stdout:0/836: dread - d11/d18/d27/d28/d36/d91/d98/db0/ffa zero size 2024-05-09T06:30:54.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/900: dwrite d7/d10/d34/d46/d81/f9e [0,4194304] 0 2024-05-09T06:30:54.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/901: stat d7/da3/fcc 0 2024-05-09T06:30:54.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/902: stat d7/d6d/f9f 0 2024-05-09T06:30:54.125 INFO:tasks.workunit.client.0.smithi046.stdout:3/897: creat d4/d20/d24/d2a/da2/d13f/f140 x:0 0 0 2024-05-09T06:30:54.127 INFO:tasks.workunit.client.0.smithi046.stdout:3/898: dread d4/d5d/f7d [0,4194304] 0 2024-05-09T06:30:54.134 INFO:tasks.workunit.client.0.smithi046.stdout:3/899: read d4/d20/d24/d29/d2b/fc5 [6406416,76196] 0 2024-05-09T06:30:54.134 INFO:tasks.workunit.client.0.smithi046.stdout:0/837: rename d11/d18/d27/d28/f2e to d11/d4f/f103 0 2024-05-09T06:30:54.138 INFO:tasks.workunit.client.0.smithi046.stdout:1/903: mkdir d7/d10/d84/d127 0 2024-05-09T06:30:54.140 INFO:tasks.workunit.client.0.smithi046.stdout:3/900: mknod d4/d20/d24/d2a/d55/d74/c141 0 2024-05-09T06:30:54.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/838: creat d11/d18/d27/d28/d2d/d5c/ddf/f104 x:0 0 0 2024-05-09T06:30:54.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/839: stat d11/d18/d27/d28/f50 0 2024-05-09T06:30:54.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/840: chown d11/d18/d27/d28/ld5 313408 1 2024-05-09T06:30:54.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/904: mknod d7/d10/d28/d30/c128 0 2024-05-09T06:30:54.145 INFO:tasks.workunit.client.0.smithi046.stdout:3/901: mknod d4/d20/d24/d29/d2b/d94/d11d/c142 0 2024-05-09T06:30:54.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/841: link d11/d4f/d5b/d5f/fcc d11/d18/d27/d28/d2d/d5c/ddb/f105 0 2024-05-09T06:30:54.158 INFO:tasks.workunit.client.0.smithi046.stdout:1/905: rmdir d7/d10/d28/d30/dcf/d75 39 2024-05-09T06:30:54.162 INFO:tasks.workunit.client.0.smithi046.stdout:1/906: creat d7/d6d/ddd/f129 x:0 0 0 2024-05-09T06:30:54.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/842: dwrite d11/d18/d1c/d56/fe3 [0,4194304] 0 2024-05-09T06:30:54.164 INFO:tasks.workunit.client.0.smithi046.stdout:0/843: fsync d11/d18/d27/d28/f50 0 2024-05-09T06:30:54.164 INFO:tasks.workunit.client.0.smithi046.stdout:3/902: rename d4/d20/d24/d29/d7a to d4/d20/d24/d29/d2b/d94/dd3/d143 0 2024-05-09T06:30:54.165 INFO:tasks.workunit.client.0.smithi046.stdout:1/907: mknod d7/d10/d28/d30/dcf/d7f/de6/c12a 0 2024-05-09T06:30:54.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/903: mkdir d4/df9/d128/d144 0 2024-05-09T06:30:54.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/908: rmdir d7/da3/dc5/dd5 39 2024-05-09T06:30:54.177 INFO:tasks.workunit.client.0.smithi046.stdout:3/904: getdents d4/df9/d128 0 2024-05-09T06:30:54.178 INFO:tasks.workunit.client.0.smithi046.stdout:3/905: chown d4/d20/d24/d2a/da2/fc8 11233 1 2024-05-09T06:30:54.179 INFO:tasks.workunit.client.0.smithi046.stdout:0/844: dwrite d11/d18/d1c/d53/f66 [0,4194304] 0 2024-05-09T06:30:54.180 INFO:tasks.workunit.client.0.smithi046.stdout:3/906: link d4/d20/c32 d4/d20/d41/c145 0 2024-05-09T06:30:54.182 INFO:tasks.workunit.client.0.smithi046.stdout:3/907: creat d4/d20/d24/d29/d2b/d94/dd3/f146 x:0 0 0 2024-05-09T06:30:54.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/845: rename d11/d3f/fe7 to d11/d4f/d5b/f106 0 2024-05-09T06:30:54.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/908: rename d4/d20/d24/d29/d2b/d94/d126/d129/fda to d4/d20/d24/d29/d2b/d94/d5c/d6c/f147 0 2024-05-09T06:30:54.187 INFO:tasks.workunit.client.0.smithi046.stdout:1/909: dwrite d7/d10/d28/d30/dcf/f3b [0,4194304] 0 2024-05-09T06:30:54.187 INFO:tasks.workunit.client.0.smithi046.stdout:1/910: stat d7/d10/d34/d46/ff2 0 2024-05-09T06:30:54.187 INFO:tasks.workunit.client.0.smithi046.stdout:1/911: fsync d7/d6d/ddd/f129 0 2024-05-09T06:30:54.187 INFO:tasks.workunit.client.0.smithi046.stdout:0/846: mknod d11/d18/d27/d28/d2d/d5c/ddb/de5/c107 0 2024-05-09T06:30:54.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/909: dwrite d4/d20/fad [0,4194304] 0 2024-05-09T06:30:54.220 INFO:tasks.workunit.client.0.smithi046.stdout:0/847: dwrite d11/d18/d27/d28/d36/d5a/dc4/fdd [0,4194304] 0 2024-05-09T06:30:54.220 INFO:tasks.workunit.client.0.smithi046.stdout:0/848: write d11/d4f/fa4 [978005,52177] 0 2024-05-09T06:30:54.220 INFO:tasks.workunit.client.0.smithi046.stdout:1/912: dwrite d7/d10/d28/d30/f36 [0,4194304] 0 2024-05-09T06:30:54.228 INFO:tasks.workunit.client.0.smithi046.stdout:0/849: read d11/d18/f39 [5588389,90849] 0 2024-05-09T06:30:54.228 INFO:tasks.workunit.client.0.smithi046.stdout:1/913: mkdir d7/d10/d28/d30/dcf/d76/de8/d12b 0 2024-05-09T06:30:54.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/910: write d4/d5/f3a [3492901,100341] 0 2024-05-09T06:30:54.232 INFO:tasks.workunit.client.0.smithi046.stdout:3/911: symlink d4/df9/d128/d144/l148 0 2024-05-09T06:30:54.233 INFO:tasks.workunit.client.0.smithi046.stdout:3/912: read - d4/d20/d24/d2a/d55/d74/fe3 zero size 2024-05-09T06:30:54.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/914: rename d7/d10/d34/d46/d81/cbf to d7/da3/dc5/dd5/c12c 0 2024-05-09T06:30:54.237 INFO:tasks.workunit.client.0.smithi046.stdout:3/913: rename d4/d48/d49/dc0/feb to d4/d20/d24/d29/d2b/d94/d5c/f149 0 2024-05-09T06:30:54.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/915: unlink d7/d10/d28/d30/dcf/d76/l110 0 2024-05-09T06:30:54.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/916: fdatasync d7/d10/d28/d30/f38 0 2024-05-09T06:30:54.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/917: truncate d7/d10/d28/d30/dcf/fba 713855 0 2024-05-09T06:30:54.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/918: write d7/da3/f122 [553608,117946] 0 2024-05-09T06:30:54.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/919: getdents d7/d10/d28/d55/dc9 0 2024-05-09T06:30:54.242 INFO:tasks.workunit.client.0.smithi046.stdout:1/920: creat d7/f12d x:0 0 0 2024-05-09T06:30:54.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/921: rename d7/d10/d34/f6e to d7/d10/d28/d30/f12e 0 2024-05-09T06:30:54.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/922: creat d7/f12f x:0 0 0 2024-05-09T06:30:54.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/923: chown d7/d10/c7e 2512904 1 2024-05-09T06:30:54.244 INFO:tasks.workunit.client.0.smithi046.stdout:0/850: dwrite d11/f22 [0,4194304] 0 2024-05-09T06:30:54.255 INFO:tasks.workunit.client.0.smithi046.stdout:3/914: dread d4/d20/fad [0,4194304] 0 2024-05-09T06:30:54.257 INFO:tasks.workunit.client.0.smithi046.stdout:3/915: symlink d4/d5/dac/l14a 0 2024-05-09T06:30:54.258 INFO:tasks.workunit.client.0.smithi046.stdout:3/916: truncate d4/d48/fae 3227436 0 2024-05-09T06:30:54.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/924: dwrite d7/d10/d28/d30/f38 [0,4194304] 0 2024-05-09T06:30:54.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/925: fdatasync d7/d10/d84/da8/fbe 0 2024-05-09T06:30:54.269 INFO:tasks.workunit.client.0.smithi046.stdout:8/935: sync 2024-05-09T06:30:54.269 INFO:tasks.workunit.client.0.smithi046.stdout:8/936: fsync d1/d7/d12/d1d/d30/d38/f118 0 2024-05-09T06:30:54.271 INFO:tasks.workunit.client.0.smithi046.stdout:8/937: rmdir d1/d7/d12/d1d/d30/dbd/dc7 39 2024-05-09T06:30:54.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/917: dwrite d4/fc [8388608,4194304] 0 2024-05-09T06:30:54.281 INFO:tasks.workunit.client.0.smithi046.stdout:3/918: write d4/d5d/fa8 [659041,126908] 0 2024-05-09T06:30:54.281 INFO:tasks.workunit.client.0.smithi046.stdout:3/919: readlink d4/d20/d24/l87 0 2024-05-09T06:30:54.284 INFO:tasks.workunit.client.0.smithi046.stdout:3/920: rmdir d4/d20/d24/d2a/d55/d74/d115 39 2024-05-09T06:30:54.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/921: mkdir d4/d20/d24/d29/d2b/d94/d14b 0 2024-05-09T06:30:54.288 INFO:tasks.workunit.client.0.smithi046.stdout:3/922: creat d4/d5d/de6/d103/f14c x:0 0 0 2024-05-09T06:30:54.288 INFO:tasks.workunit.client.0.smithi046.stdout:3/923: write d4/d20/d24/d29/d2b/d94/f138 [575111,107353] 0 2024-05-09T06:30:54.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/924: dwrite d4/d20/d24/d29/d2b/d94/d5c/f109 [0,4194304] 0 2024-05-09T06:30:54.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/925: truncate d4/d20/f36 1648093 0 2024-05-09T06:30:54.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/926: chown d4/d20/d24/d2a/d55/d74/f89 2279 1 2024-05-09T06:30:54.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/927: write d4/d5/f9 [2560271,121913] 0 2024-05-09T06:30:54.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/928: write d4/d20/d24/d29/d2b/d94/d5c/d6c/f147 [810563,102435] 0 2024-05-09T06:30:54.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/929: creat d4/d20/d24/d29/d2b/d94/d5c/d6c/f14d x:0 0 0 2024-05-09T06:30:54.316 INFO:tasks.workunit.client.0.smithi046.stdout:3/930: creat d4/d20/d24/d29/d2b/f14e x:0 0 0 2024-05-09T06:30:54.333 INFO:tasks.workunit.client.0.smithi046.stdout:3/931: dwrite d4/d5/f3a [4194304,4194304] 0 2024-05-09T06:30:54.333 INFO:tasks.workunit.client.0.smithi046.stdout:3/932: readlink d4/d20/d24/d29/d2b/d94/d126/d129/lf1 0 2024-05-09T06:30:54.431 INFO:tasks.workunit.client.0.smithi046.stdout:5/794: sync 2024-05-09T06:30:54.431 INFO:tasks.workunit.client.0.smithi046.stdout:2/861: sync 2024-05-09T06:30:54.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/795: mknod d0/dba/de7/d53/c118 0 2024-05-09T06:30:54.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/796: dread - d0/d58/d7a/fa1 zero size 2024-05-09T06:30:54.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/797: readlink d0/d58/la5 0 2024-05-09T06:30:54.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/798: dread d0/d1b/f35 [0,4194304] 0 2024-05-09T06:30:54.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/799: mkdir d0/d58/d119 0 2024-05-09T06:30:54.443 INFO:tasks.workunit.client.0.smithi046.stdout:5/800: creat d0/dba/f11a x:0 0 0 2024-05-09T06:30:54.446 INFO:tasks.workunit.client.0.smithi046.stdout:5/801: link d0/dba/de7/d50/fae d0/d1b/d21/f11b 0 2024-05-09T06:30:54.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/862: dwrite da/d2d/d43/dc2/dec/f102 [0,4194304] 0 2024-05-09T06:30:54.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/802: creat d0/d1b/d39/d8b/f11c x:0 0 0 2024-05-09T06:30:54.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/803: creat d0/dba/de7/f11d x:0 0 0 2024-05-09T06:30:54.452 INFO:tasks.workunit.client.0.smithi046.stdout:2/863: rename da/de/l31 to da/dcb/dcc/dee/l111 0 2024-05-09T06:30:54.452 INFO:tasks.workunit.client.0.smithi046.stdout:2/864: stat da/de/d14/d1f/d20/d4e/fa0 0 2024-05-09T06:30:54.452 INFO:tasks.workunit.client.0.smithi046.stdout:2/865: truncate da/dcb/dcc/dee/dcd/d7d/dc5/d3d/fe0 313620 0 2024-05-09T06:30:54.456 INFO:tasks.workunit.client.0.smithi046.stdout:2/866: rmdir da/de/d14/d1f/d3b/da2 39 2024-05-09T06:30:54.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/867: mknod da/dcb/df5/c112 0 2024-05-09T06:30:54.463 INFO:tasks.workunit.client.0.smithi046.stdout:5/804: dwrite d0/d58/d7a/f86 [0,4194304] 0 2024-05-09T06:30:54.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/805: dread d0/d58/d7a/fb0 [0,4194304] 0 2024-05-09T06:30:54.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/806: dread d0/f14 [0,4194304] 0 2024-05-09T06:30:54.555 INFO:tasks.workunit.client.0.smithi046.stdout:5/807: rename d0/d1b/d21/f44 to d0/db3/dc0/f11e 0 2024-05-09T06:30:54.576 INFO:tasks.workunit.client.0.smithi046.stdout:5/808: dwrite d0/dba/de7/f10c [0,4194304] 0 2024-05-09T06:30:54.577 INFO:tasks.workunit.client.0.smithi046.stdout:5/809: write d0/dba/de7/d50/fd3 [729874,59263] 0 2024-05-09T06:30:54.582 INFO:tasks.workunit.client.0.smithi046.stdout:5/810: mkdir d0/db3/dc0/d11f 0 2024-05-09T06:30:54.583 INFO:tasks.workunit.client.0.smithi046.stdout:5/811: mknod d0/db3/deb/c120 0 2024-05-09T06:30:54.583 INFO:tasks.workunit.client.0.smithi046.stdout:5/812: dread - d0/f19 zero size 2024-05-09T06:30:54.583 INFO:tasks.workunit.client.0.smithi046.stdout:5/813: fsync d0/dba/de7/d53/f97 0 2024-05-09T06:30:54.604 INFO:tasks.workunit.client.0.smithi046.stdout:6/961: sync 2024-05-09T06:30:54.604 INFO:tasks.workunit.client.0.smithi046.stdout:9/772: sync 2024-05-09T06:30:54.606 INFO:tasks.workunit.client.0.smithi046.stdout:5/814: dwrite d0/dba/de7/d53/f5a [0,4194304] 0 2024-05-09T06:30:54.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/773: truncate d2/d26/d2c/f50 351204 0 2024-05-09T06:30:54.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/774: readlink d2/d6/d7/d1a/d27/d2a/lbe 0 2024-05-09T06:30:54.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/775: mknod d2/d26/dab/c110 0 2024-05-09T06:30:54.616 INFO:tasks.workunit.client.0.smithi046.stdout:9/776: unlink d2/d26/d76/dfb/lc5 0 2024-05-09T06:30:54.623 INFO:tasks.workunit.client.0.smithi046.stdout:9/777: getdents d2/d6 0 2024-05-09T06:30:54.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/962: dwrite db/d10/d3c/d91/fa2 [0,4194304] 0 2024-05-09T06:30:54.624 INFO:tasks.workunit.client.0.smithi046.stdout:5/815: dwrite d0/dba/de7/d53/fc2 [0,4194304] 0 2024-05-09T06:30:54.628 INFO:tasks.workunit.client.0.smithi046.stdout:9/778: mkdir d2/d6/d7/d1a/d86/ddf/d111 0 2024-05-09T06:30:54.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/779: mknod d2/d6/d7/d1a/d86/ddf/c112 0 2024-05-09T06:30:54.639 INFO:tasks.workunit.client.0.smithi046.stdout:9/780: symlink d2/d26/d2c/daf/l113 0 2024-05-09T06:30:54.640 INFO:tasks.workunit.client.0.smithi046.stdout:5/816: dwrite d0/d1b/d39/d8b/fb7 [0,4194304] 0 2024-05-09T06:30:54.641 INFO:tasks.workunit.client.0.smithi046.stdout:9/781: mkdir d2/d26/d2c/d114 0 2024-05-09T06:30:54.641 INFO:tasks.workunit.client.0.smithi046.stdout:9/782: truncate d2/d26/f68 6155113 0 2024-05-09T06:30:54.646 INFO:tasks.workunit.client.0.smithi046.stdout:6/963: write db/d10/d6b/fc8 [617229,119424] 0 2024-05-09T06:30:54.646 INFO:tasks.workunit.client.0.smithi046.stdout:6/964: fdatasync db/d93/d96/dd1/f107 0 2024-05-09T06:30:54.646 INFO:tasks.workunit.client.0.smithi046.stdout:6/965: fsync db/d93/d96/dd1/fd5 0 2024-05-09T06:30:54.652 INFO:tasks.workunit.client.0.smithi046.stdout:5/817: mkdir d0/db3/d121 0 2024-05-09T06:30:54.657 INFO:tasks.workunit.client.0.smithi046.stdout:5/818: rename d0/d1b/f35 to d0/db3/dc0/f122 0 2024-05-09T06:30:54.659 INFO:tasks.workunit.client.0.smithi046.stdout:5/819: dread d0/d58/d7a/f7b [0,4194304] 0 2024-05-09T06:30:54.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/820: truncate d0/d1b/f82 5180760 0 2024-05-09T06:30:54.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/821: symlink d0/db3/deb/dfc/l123 0 2024-05-09T06:30:54.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/822: write d0/d58/d7a/fa1 [139457,18194] 0 2024-05-09T06:30:54.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/823: fsync d0/dad/ffa 0 2024-05-09T06:30:54.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/824: dread - d0/d58/f113 zero size 2024-05-09T06:30:54.663 INFO:tasks.workunit.client.0.smithi046.stdout:5/825: symlink d0/dba/de7/l124 0 2024-05-09T06:30:54.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/826: creat d0/d58/d7a/f125 x:0 0 0 2024-05-09T06:30:54.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/827: truncate d0/dba/de7/d50/fd3 1129470 0 2024-05-09T06:30:54.665 INFO:tasks.workunit.client.0.smithi046.stdout:9/783: dwrite d2/d6/d7/d1a/d27/d2a/da5/fef [0,4194304] 0 2024-05-09T06:30:54.666 INFO:tasks.workunit.client.0.smithi046.stdout:6/966: dwrite db/d10/d3f/d4f/f60 [4194304,4194304] 0 2024-05-09T06:30:54.666 INFO:tasks.workunit.client.0.smithi046.stdout:4/880: sync 2024-05-09T06:30:54.666 INFO:tasks.workunit.client.0.smithi046.stdout:0/851: sync 2024-05-09T06:30:54.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/784: mkdir d2/d6/d7/d1e/d115 0 2024-05-09T06:30:54.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/785: dread - d2/d6/d7/d1a/d27/d2a/f100 zero size 2024-05-09T06:30:54.670 INFO:tasks.workunit.client.0.smithi046.stdout:0/852: dread d11/d18/d27/d28/d36/f37 [4194304,4194304] 0 2024-05-09T06:30:54.672 INFO:tasks.workunit.client.0.smithi046.stdout:0/853: dread d11/d18/d1c/d53/d82/fa7 [0,4194304] 0 2024-05-09T06:30:54.672 INFO:tasks.workunit.client.0.smithi046.stdout:0/854: write d11/d18/d27/d28/d6b/f8b [1272834,119165] 0 2024-05-09T06:30:54.672 INFO:tasks.workunit.client.0.smithi046.stdout:0/855: fdatasync d11/d18/d27/d28/d36/faa 0 2024-05-09T06:30:54.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/786: symlink d2/d6/d7/d1a/d27/d56/df8/d106/d10c/l116 0 2024-05-09T06:30:54.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/787: chown d2/dc/d32/ca3 13 1 2024-05-09T06:30:54.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/788: read d2/d6/d38/de6/fea [320576,36833] 0 2024-05-09T06:30:54.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/967: getdents db/d10/d3f/d4f/d106 0 2024-05-09T06:30:54.678 INFO:tasks.workunit.client.0.smithi046.stdout:5/828: dread d0/dba/de7/d53/f6c [0,4194304] 0 2024-05-09T06:30:54.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/856: rmdir d11/d18/d27/d28/d2d 39 2024-05-09T06:30:54.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/789: mknod d2/d6/d7/d1a/d27/d56/df8/c117 0 2024-05-09T06:30:54.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/790: write d2/d26/d76/dfb/fdd [428784,65249] 0 2024-05-09T06:30:54.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/791: dread - d2/d6/fd3 zero size 2024-05-09T06:30:54.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/792: readlink d2/d6/d38/de6/lec 0 2024-05-09T06:30:54.689 INFO:tasks.workunit.client.0.smithi046.stdout:5/829: symlink d0/df3/l126 0 2024-05-09T06:30:54.692 INFO:tasks.workunit.client.0.smithi046.stdout:4/881: rename d7/df/d53/deb to d7/df/d3a/d116 0 2024-05-09T06:30:54.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/793: stat d2/d6/d7/d1a/d27/d2a/c61 0 2024-05-09T06:30:54.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/830: mkdir d0/dad/d127 0 2024-05-09T06:30:54.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/968: dwrite db/d10/d3f/d44/d46/fbd [0,4194304] 0 2024-05-09T06:30:54.695 INFO:tasks.workunit.client.0.smithi046.stdout:5/831: dread - d0/dba/de7/dfb/f10a zero size 2024-05-09T06:30:54.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/969: truncate db/d10/d30/fe3 2632 0 2024-05-09T06:30:54.695 INFO:tasks.workunit.client.0.smithi046.stdout:0/857: dwrite d11/f93 [0,4194304] 0 2024-05-09T06:30:54.698 INFO:tasks.workunit.client.0.smithi046.stdout:4/882: rename d7/ld to d7/df/d3a/d25/l117 0 2024-05-09T06:30:54.699 INFO:tasks.workunit.client.0.smithi046.stdout:3/933: sync 2024-05-09T06:30:54.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/868: sync 2024-05-09T06:30:54.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/938: sync 2024-05-09T06:30:54.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/926: sync 2024-05-09T06:30:54.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/934: read - d4/d20/d24/d29/d2b/d94/d126/d129/d58/f123 zero size 2024-05-09T06:30:54.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/927: write d7/d10/d28/d30/da0/dd9/f101 [3303564,96191] 0 2024-05-09T06:30:54.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/928: readlink d7/d10/d34/d46/l60 0 2024-05-09T06:30:54.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/929: chown d7/d10/d28/d30/dcf/f5d 436239 1 2024-05-09T06:30:54.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/930: dread d7/d10/f4c [0,4194304] 0 2024-05-09T06:30:54.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/931: dread - d7/d10/d84/de1/f103 zero size 2024-05-09T06:30:54.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/939: dread d1/d7/d12/f8e [0,4194304] 0 2024-05-09T06:30:54.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/940: chown d1/db/dd/fbe 0 1 2024-05-09T06:30:54.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/941: write d1/db/dd/d11/d5d/d99/f100 [290304,126874] 0 2024-05-09T06:30:54.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/942: write d1/db/dd/d11/f5c [4873840,90472] 0 2024-05-09T06:30:54.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/943: readlink d1/db/dd/d11/d5d/d99/de8/lad 0 2024-05-09T06:30:54.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/932: dread d7/d10/d34/f114 [0,4194304] 0 2024-05-09T06:30:54.710 INFO:tasks.workunit.client.0.smithi046.stdout:1/933: dread - d7/d6d/ddd/f129 zero size 2024-05-09T06:30:54.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/970: rename db/f25 to db/d10/d3c/d91/f13d 0 2024-05-09T06:30:54.717 INFO:tasks.workunit.client.0.smithi046.stdout:9/794: symlink d2/l118 0 2024-05-09T06:30:54.717 INFO:tasks.workunit.client.0.smithi046.stdout:9/795: fsync d2/d26/d2c/f75 0 2024-05-09T06:30:54.720 INFO:tasks.workunit.client.0.smithi046.stdout:2/869: rmdir da/de/d54/d65/d6c/de2/df0 0 2024-05-09T06:30:54.720 INFO:tasks.workunit.client.0.smithi046.stdout:2/870: fsync da/de/d14/d1f/d3b/d9f/fc3 0 2024-05-09T06:30:54.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/934: dwrite d7/d10/d28/d55/f7b [0,4194304] 0 2024-05-09T06:30:54.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/935: fsync d7/d10/d28/d30/f12e 0 2024-05-09T06:30:54.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/936: readlink d7/d10/d28/d30/dcf/d7f/l11f 0 2024-05-09T06:30:54.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/935: truncate d4/d20/d41/f63 1394854 0 2024-05-09T06:30:54.724 INFO:tasks.workunit.client.0.smithi046.stdout:0/858: link d11/d18/d1c/lfe d11/d4f/d5b/l108 0 2024-05-09T06:30:54.724 INFO:tasks.workunit.client.0.smithi046.stdout:0/859: write d11/d18/d27/d28/d36/d5a/f8d [995906,99407] 0 2024-05-09T06:30:54.727 INFO:tasks.workunit.client.0.smithi046.stdout:8/944: rename d1/db/dd/d11/d5d/d99/de8/fc5 to d1/db/dd/d11/d5d/d95/f11c 0 2024-05-09T06:30:54.729 INFO:tasks.workunit.client.0.smithi046.stdout:8/945: dread d1/db/dd/d11/d5d/d95/f11c [0,4194304] 0 2024-05-09T06:30:54.729 INFO:tasks.workunit.client.0.smithi046.stdout:6/971: symlink db/d10/d3c/dd4/d87/d12d/l13e 0 2024-05-09T06:30:54.729 INFO:tasks.workunit.client.0.smithi046.stdout:8/946: chown d1/d7/d12/d1d/d30/dda/l113 167742 1 2024-05-09T06:30:54.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/796: creat d2/f119 x:0 0 0 2024-05-09T06:30:54.731 INFO:tasks.workunit.client.0.smithi046.stdout:2/871: creat da/de/d14/d1f/f113 x:0 0 0 2024-05-09T06:30:54.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/937: mknod d7/da3/c130 0 2024-05-09T06:30:54.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/936: link d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/fab d4/d20/d41/f14f 0 2024-05-09T06:30:54.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/860: mkdir d11/d109 0 2024-05-09T06:30:54.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/861: chown d11/d3f 7 1 2024-05-09T06:30:54.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/862: truncate d11/d18/db1/fbc 1493099 0 2024-05-09T06:30:54.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/863: fsync d11/d18/d27/d28/d36/d5a/dc4/fe4 0 2024-05-09T06:30:54.742 INFO:tasks.workunit.client.0.smithi046.stdout:0/864: dread d11/d18/d27/d28/fc7 [0,4194304] 0 2024-05-09T06:30:54.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/972: rmdir db/d10/d3f/d44/d5e/dbe 39 2024-05-09T06:30:54.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/973: chown db/d10/d3f/d4f/c12a 121404276 1 2024-05-09T06:30:54.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/974: write db/d10/d3f/d4f/d8a/d9e/fec [784270,61461] 0 2024-05-09T06:30:54.747 INFO:tasks.workunit.client.0.smithi046.stdout:6/975: dread - db/d10/d3f/d4f/d8a/f12e zero size 2024-05-09T06:30:54.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/947: creat d1/db/dd/d11/d43/f11d x:0 0 0 2024-05-09T06:30:54.750 INFO:tasks.workunit.client.0.smithi046.stdout:0/865: dread d11/d18/d27/d28/d2d/d5c/ddb/f105 [0,4194304] 0 2024-05-09T06:30:54.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/937: dwrite d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/fab [0,4194304] 0 2024-05-09T06:30:54.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/797: mknod d2/d26/dab/c11a 0 2024-05-09T06:30:54.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/798: readlink d2/d6/d8b/lb5 0 2024-05-09T06:30:54.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/938: unlink d7/fda 0 2024-05-09T06:30:54.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/799: write d2/d26/d2c/f3b [306433,101321] 0 2024-05-09T06:30:54.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/800: creat d2/d26/d2c/f11b x:0 0 0 2024-05-09T06:30:54.759 INFO:tasks.workunit.client.0.smithi046.stdout:6/976: link db/fd db/d10/d3f/d44/d134/f13f 0 2024-05-09T06:30:54.764 INFO:tasks.workunit.client.0.smithi046.stdout:8/948: symlink d1/db/dd/d11/d43/d81/de9/l11e 0 2024-05-09T06:30:54.765 INFO:tasks.workunit.client.0.smithi046.stdout:0/866: creat d11/d18/d27/d28/f10a x:0 0 0 2024-05-09T06:30:54.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/938: mknod d4/d5d/de6/d103/c150 0 2024-05-09T06:30:54.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/939: write d4/d20/d41/f127 [1024575,1005] 0 2024-05-09T06:30:54.773 INFO:tasks.workunit.client.0.smithi046.stdout:1/939: mkdir d7/d10/d28/d30/da0/d131 0 2024-05-09T06:30:54.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/801: dwrite d2/d6/d7/faa [0,4194304] 0 2024-05-09T06:30:54.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/949: getdents d1/d7/d12/d1d 0 2024-05-09T06:30:54.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/950: dread - d1/d7/d12/f97 zero size 2024-05-09T06:30:54.777 INFO:tasks.workunit.client.0.smithi046.stdout:3/940: rmdir d4/df9 39 2024-05-09T06:30:54.778 INFO:tasks.workunit.client.0.smithi046.stdout:2/872: rename da/de/d54 to da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114 0 2024-05-09T06:30:54.781 INFO:tasks.workunit.client.0.smithi046.stdout:9/802: symlink d2/d26/d2c/daf/ded/l11c 0 2024-05-09T06:30:54.784 INFO:tasks.workunit.client.0.smithi046.stdout:3/941: creat d4/d5d/de6/f151 x:0 0 0 2024-05-09T06:30:54.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/951: rename d1/db/d67/f82 to d1/db/dd/d11/f11f 0 2024-05-09T06:30:54.785 INFO:tasks.workunit.client.0.smithi046.stdout:8/952: readlink d1/db/lca 0 2024-05-09T06:30:54.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/873: getdents da/d2d/d104 0 2024-05-09T06:30:54.786 INFO:tasks.workunit.client.0.smithi046.stdout:0/867: dwrite d11/d18/d27/d28/f31 [0,4194304] 0 2024-05-09T06:30:54.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/803: mknod d2/d6/d7/d1a/d27/d56/df8/d106/c11d 0 2024-05-09T06:30:54.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/804: stat d2/d6/d33/da8/cda 0 2024-05-09T06:30:54.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/805: chown d2 565865 1 2024-05-09T06:30:54.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/942: unlink d4/d5d/de6/f151 0 2024-05-09T06:30:54.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/943: chown d4/d20/d24/d29/d2b/d94/d5c/d6c/fd2 6 1 2024-05-09T06:30:54.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/944: write d4/d20/d24/d2a/d55/d6a/dd5/fec [1027910,60129] 0 2024-05-09T06:30:54.795 INFO:tasks.workunit.client.0.smithi046.stdout:2/874: mkdir da/de/d1c/db1/d115 0 2024-05-09T06:30:54.795 INFO:tasks.workunit.client.0.smithi046.stdout:2/875: readlink da/de/d14/d1f/d20/l3f 0 2024-05-09T06:30:54.796 INFO:tasks.workunit.client.0.smithi046.stdout:0/868: symlink d11/d18/d1c/d53/d82/l10b 0 2024-05-09T06:30:54.797 INFO:tasks.workunit.client.0.smithi046.stdout:9/806: read d2/d26/f43 [1432972,50983] 0 2024-05-09T06:30:54.798 INFO:tasks.workunit.client.0.smithi046.stdout:3/945: rename d4/d5/dac/db0/ccf to d4/d20/d24/d29/d2b/d94/d126/d129/c152 0 2024-05-09T06:30:54.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/876: mknod da/dcb/dcc/dee/dcd/dd2/c116 0 2024-05-09T06:30:54.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/877: chown da/dcb/dcc/dee/dcd/d7d/dc5/l2f 3139573 1 2024-05-09T06:30:54.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/878: readlink da/dcb/dcc/dee/dcd/d7d/dc5/lf2 0 2024-05-09T06:30:54.799 INFO:tasks.workunit.client.0.smithi046.stdout:0/869: mknod d11/d18/d1c/d56/c10c 0 2024-05-09T06:30:54.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/953: dwrite d1/db/d67/d9f/fb3 [0,4194304] 0 2024-05-09T06:30:54.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/807: truncate d2/dc/f41 1588576 0 2024-05-09T06:30:54.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/808: write d2/d6/f22 [1669191,35651] 0 2024-05-09T06:30:54.803 INFO:tasks.workunit.client.0.smithi046.stdout:3/946: creat d4/d20/d24/d29/d2b/d94/d126/d129/d58/f153 x:0 0 0 2024-05-09T06:30:54.803 INFO:tasks.workunit.client.0.smithi046.stdout:3/947: stat d4/d20/d24/d29/fc7 0 2024-05-09T06:30:54.803 INFO:tasks.workunit.client.0.smithi046.stdout:3/948: stat d4/fc 0 2024-05-09T06:30:54.803 INFO:tasks.workunit.client.0.smithi046.stdout:2/879: read f8 [2577831,6114] 0 2024-05-09T06:30:54.804 INFO:tasks.workunit.client.0.smithi046.stdout:2/880: truncate da/de/d14/d1f/d20/d7c/d8b/d95/fab 4768105 0 2024-05-09T06:30:54.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/870: dread d11/d18/d1c/d53/dab/fd7 [0,4194304] 0 2024-05-09T06:30:54.810 INFO:tasks.workunit.client.0.smithi046.stdout:8/954: creat d1/db/dd/d11/d5d/d99/f120 x:0 0 0 2024-05-09T06:30:54.815 INFO:tasks.workunit.client.0.smithi046.stdout:9/809: dwrite d2/d6/d8b/fd4 [0,4194304] 0 2024-05-09T06:30:54.818 INFO:tasks.workunit.client.0.smithi046.stdout:8/955: write d1/db/dd/d11/d5d/fdb [1471246,111283] 0 2024-05-09T06:30:54.849 INFO:tasks.workunit.client.0.smithi046.stdout:0/871: rmdir d11/d18/d27/d28/d2d/d81 39 2024-05-09T06:30:54.861 INFO:tasks.workunit.client.0.smithi046.stdout:9/810: link d2/d6/d7/d1a/c64 d2/d20/c11e 0 2024-05-09T06:30:54.861 INFO:tasks.workunit.client.0.smithi046.stdout:9/811: write d2/d26/d2c/f75 [1370459,22617] 0 2024-05-09T06:30:54.874 INFO:tasks.workunit.client.0.smithi046.stdout:2/881: mkdir da/dcb/dcc/dee/dcd/d7d/dc5/d117 0 2024-05-09T06:30:54.875 INFO:tasks.workunit.client.0.smithi046.stdout:0/872: mknod d11/d18/d27/d28/d2d/d5c/c10d 0 2024-05-09T06:30:54.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/956: dread d1/db/dd/f13 [0,4194304] 0 2024-05-09T06:30:54.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/812: dwrite d2/d6/d7/fd [0,4194304] 0 2024-05-09T06:30:54.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/813: creat d2/d6/d38/de6/f11f x:0 0 0 2024-05-09T06:30:54.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/882: dread da/de/d1c/fe5 [0,4194304] 0 2024-05-09T06:30:54.877 INFO:tasks.workunit.client.0.smithi046.stdout:3/949: rename d4/d5d/de6 to d4/d20/d24/d29/df3/df7/d154 0 2024-05-09T06:30:54.878 INFO:tasks.workunit.client.0.smithi046.stdout:8/957: mkdir d1/d7/d12/d121 0 2024-05-09T06:30:54.881 INFO:tasks.workunit.client.0.smithi046.stdout:3/950: getdents d4/d5/dac 0 2024-05-09T06:30:54.884 INFO:tasks.workunit.client.0.smithi046.stdout:0/873: dread d11/d18/f1b [0,4194304] 0 2024-05-09T06:30:54.884 INFO:tasks.workunit.client.0.smithi046.stdout:8/958: creat d1/d7/d12/d1d/d30/d38/db4/d109/f122 x:0 0 0 2024-05-09T06:30:54.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/951: symlink d4/d20/d24/d29/d2b/d94/dd3/l155 0 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/952: chown d4/d48/f53 143353 1 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/953: readlink d4/d20/d41/d4a/l13a 0 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/954: write d4/fc [13519276,27394] 0 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/874: getdents d11/d18/d27/d28/d2d/d5c/ddb/de5 0 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:2/883: dread da/d2d/f42 [0,4194304] 0 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:2/884: fsync da/dcb/dcc/dee/dcd/d7d/dc5/d3d/faf 0 2024-05-09T06:30:54.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/955: read d4/d20/d24/d2a/d55/d6a/fcd [243014,98261] 0 2024-05-09T06:30:54.890 INFO:tasks.workunit.client.0.smithi046.stdout:3/956: write d4/d5d/f7d [453224,33636] 0 2024-05-09T06:30:54.890 INFO:tasks.workunit.client.0.smithi046.stdout:9/814: dwrite d2/d6/d33/f79 [0,4194304] 0 2024-05-09T06:30:54.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/885: dread da/de/d14/d1f/d20/d4e/f4f [0,4194304] 0 2024-05-09T06:30:54.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/959: rmdir d1/db/dd/d11/d43/d81 39 2024-05-09T06:30:54.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/960: fdatasync d1/d7/d12/d1d/d30/d38/dc0/f110 0 2024-05-09T06:30:54.896 INFO:tasks.workunit.client.0.smithi046.stdout:0/875: creat d11/d18/d27/d28/d36/f10e x:0 0 0 2024-05-09T06:30:54.900 INFO:tasks.workunit.client.0.smithi046.stdout:9/815: write d2/d6/d38/f48 [2363819,112176] 0 2024-05-09T06:30:54.903 INFO:tasks.workunit.client.0.smithi046.stdout:3/957: dwrite d4/d20/d41/f14f [0,4194304] 0 2024-05-09T06:30:54.907 INFO:tasks.workunit.client.0.smithi046.stdout:2/886: link da/dcb/dcc/dee/dcd/d7d/dc5/d3d/f100 da/dcb/dcc/dee/dcd/d7d/d6d/f118 0 2024-05-09T06:30:54.907 INFO:tasks.workunit.client.0.smithi046.stdout:2/887: chown da/de/d14/d1f/d20/d5c/dcf/fd6 2877 1 2024-05-09T06:30:54.909 INFO:tasks.workunit.client.0.smithi046.stdout:8/961: getdents d1 0 2024-05-09T06:30:54.909 INFO:tasks.workunit.client.0.smithi046.stdout:8/962: read - d1/d7/d12/d1d/d30/dbd/dc7/dcf/f11b zero size 2024-05-09T06:30:54.909 INFO:tasks.workunit.client.0.smithi046.stdout:0/876: creat d11/d18/d27/d28/d36/d5a/f10f x:0 0 0 2024-05-09T06:30:54.911 INFO:tasks.workunit.client.0.smithi046.stdout:9/816: mknod d2/d6/d8b/c120 0 2024-05-09T06:30:54.913 INFO:tasks.workunit.client.0.smithi046.stdout:2/888: rename da/dc/c66 to da/de/d14/d1f/d20/d4e/c119 0 2024-05-09T06:30:54.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/963: creat d1/d7/d12/d1d/d30/dbd/dc6/de3/f123 x:0 0 0 2024-05-09T06:30:54.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/964: write d1/d7/d12/d1d/d30/dbd/dc7/f10a [5670384,32399] 0 2024-05-09T06:30:54.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/877: mknod d11/d18/d27/d28/d36/d91/d98/c110 0 2024-05-09T06:30:54.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/817: write d2/d6/d8b/fde [3754655,36694] 0 2024-05-09T06:30:54.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/958: rmdir d4/d20/d41/d4a 39 2024-05-09T06:30:54.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/878: unlink d11/d18/d27/d28/d2d/f3e 0 2024-05-09T06:30:54.942 INFO:tasks.workunit.client.0.smithi046.stdout:2/889: dwrite da/de/d1c/fe5 [0,4194304] 0 2024-05-09T06:30:54.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/965: dwrite d1/d7/d12/d1d/d30/d38/f118 [0,4194304] 0 2024-05-09T06:30:54.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/959: dwrite d4/d5d/d60/fd7 [0,4194304] 0 2024-05-09T06:30:54.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/960: creat d4/d5d/d60/f156 x:0 0 0 2024-05-09T06:30:54.944 INFO:tasks.workunit.client.0.smithi046.stdout:9/818: rename d2/d6/d8b/fd4 to d2/d26/d2c/f121 0 2024-05-09T06:30:54.945 INFO:tasks.workunit.client.0.smithi046.stdout:3/961: write d4/d20/d24/d2a/d55/d74/f89 [1042471,24598] 0 2024-05-09T06:30:54.945 INFO:tasks.workunit.client.0.smithi046.stdout:0/879: mkdir d11/d18/db1/d111 0 2024-05-09T06:30:54.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/890: dread da/de/d14/d1f/d3b/d9f/fa8 [0,4194304] 0 2024-05-09T06:30:54.955 INFO:tasks.workunit.client.0.smithi046.stdout:8/966: read d1/d7/d12/d1d/d30/dbd/dc7/f10a [9389362,104851] 0 2024-05-09T06:30:54.958 INFO:tasks.workunit.client.0.smithi046.stdout:9/819: symlink d2/d6/d7/d1a/d27/d65/dd1/d10f/l122 0 2024-05-09T06:30:54.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/880: symlink d11/d18/d27/d28/d36/d5a/dc4/l112 0 2024-05-09T06:30:54.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/881: chown d11/d18/d27/d28/d6b/dac/fc8 819673 1 2024-05-09T06:30:54.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/882: fdatasync d11/f12 0 2024-05-09T06:30:54.961 INFO:tasks.workunit.client.0.smithi046.stdout:8/967: rmdir d1/d7/d12/d45 39 2024-05-09T06:30:54.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/891: dwrite da/de/d14/d1f/d3b/d9f/fc3 [0,4194304] 0 2024-05-09T06:30:54.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/883: getdents d11/d18/d1c/d53/d82 0 2024-05-09T06:30:54.965 INFO:tasks.workunit.client.0.smithi046.stdout:8/968: rmdir d1/db/dd/d11/d5d/dbb 39 2024-05-09T06:30:54.965 INFO:tasks.workunit.client.0.smithi046.stdout:8/969: chown d1/db/dd/d11/d5d/l87 10739 1 2024-05-09T06:30:54.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/884: creat d11/d18/d1c/d53/dc2/f113 x:0 0 0 2024-05-09T06:30:54.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/885: dread - d11/d18/d27/d28/d36/fd1 zero size 2024-05-09T06:30:54.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/886: creat d11/d18/d27/f114 x:0 0 0 2024-05-09T06:30:54.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/970: creat d1/d7/dcd/ddf/f124 x:0 0 0 2024-05-09T06:30:54.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/887: creat d11/d18/d27/d28/d6b/f115 x:0 0 0 2024-05-09T06:30:54.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/888: creat d11/d109/f116 x:0 0 0 2024-05-09T06:30:54.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/971: getdents d1/d7/d12/d1d/d30 0 2024-05-09T06:30:54.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/972: dread - d1/db/dd/d11/d5d/d99/f120 zero size 2024-05-09T06:30:54.975 INFO:tasks.workunit.client.0.smithi046.stdout:0/889: getdents d11/d18/d27/d28/d36/d91 0 2024-05-09T06:30:54.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/973: creat d1/d7/d12/d1d/d30/d38/db4/f125 x:0 0 0 2024-05-09T06:30:54.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/820: dwrite d2/d6/d7/d1a/d27/d2a/da5/fac [0,4194304] 0 2024-05-09T06:30:54.979 INFO:tasks.workunit.client.0.smithi046.stdout:8/974: symlink d1/d7/dcd/l126 0 2024-05-09T06:30:54.983 INFO:tasks.workunit.client.0.smithi046.stdout:3/962: truncate d4/d5d/d60/fd7 3950656 0 2024-05-09T06:30:54.983 INFO:tasks.workunit.client.0.smithi046.stdout:3/963: creat d4/d20/d24/d2a/d46/f157 x:0 0 0 2024-05-09T06:30:54.984 INFO:tasks.workunit.client.0.smithi046.stdout:0/890: write d11/d18/f3b [3618613,8998] 0 2024-05-09T06:30:54.984 INFO:tasks.workunit.client.0.smithi046.stdout:0/891: write d11/d18/d1c/d56/fe3 [5086768,8345] 0 2024-05-09T06:30:54.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/975: creat d1/d7/d12/d45/f127 x:0 0 0 2024-05-09T06:30:54.989 INFO:tasks.workunit.client.0.smithi046.stdout:0/892: creat d11/d4f/f117 x:0 0 0 2024-05-09T06:30:54.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/976: mkdir d1/ddc/df9/d128 0 2024-05-09T06:30:54.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/977: fdatasync d1/db/dd/d11/d5d/fb1 0 2024-05-09T06:30:54.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/978: dread - d1/db/dd/d11/d43/f11d zero size 2024-05-09T06:30:54.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/893: symlink d11/d18/d27/d28/l118 0 2024-05-09T06:30:54.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/894: creat d11/d18/d27/d28/d6b/f119 x:0 0 0 2024-05-09T06:30:54.994 INFO:tasks.workunit.client.0.smithi046.stdout:8/979: getdents d1/d7/d12/d1d/d30/dbd/dc6 0 2024-05-09T06:30:54.997 INFO:tasks.workunit.client.0.smithi046.stdout:9/821: dwrite d2/dc/fbd [0,4194304] 0 2024-05-09T06:30:54.997 INFO:tasks.workunit.client.0.smithi046.stdout:9/822: fsync d2/d6/dbb/fd5 0 2024-05-09T06:30:55.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/964: read d4/d5d/d60/ddd/fe9 [2507974,80732] 0 2024-05-09T06:30:55.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/823: rename d2/d6/d7/d1a/d86/ddf/c112 to d2/d26/d2c/d114/c123 0 2024-05-09T06:30:55.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/980: dwrite d1/db/dd/d11/fa0 [0,4194304] 0 2024-05-09T06:30:55.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/981: dread - d1/d7/d12/d1d/d30/f111 zero size 2024-05-09T06:30:55.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/824: write d2/d26/d76/fd9 [252351,27188] 0 2024-05-09T06:30:55.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/825: chown d2/dc/l4c 231278 1 2024-05-09T06:30:55.018 INFO:tasks.workunit.client.0.smithi046.stdout:0/895: rmdir d11/d18/d27 39 2024-05-09T06:30:55.021 INFO:tasks.workunit.client.0.smithi046.stdout:3/965: mkdir d4/df9/d128/d144/d158 0 2024-05-09T06:30:55.021 INFO:tasks.workunit.client.0.smithi046.stdout:3/966: chown d4/d20/d24/d29/d2b/d94/d5c 0 1 2024-05-09T06:30:55.022 INFO:tasks.workunit.client.0.smithi046.stdout:8/982: mkdir d1/db/d129 0 2024-05-09T06:30:55.025 INFO:tasks.workunit.client.0.smithi046.stdout:9/826: unlink d2/d6/f9b 0 2024-05-09T06:30:55.026 INFO:tasks.workunit.client.0.smithi046.stdout:0/896: symlink d11/d18/d27/d28/d2d/d5c/l11a 0 2024-05-09T06:30:55.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/967: symlink d4/d20/d41/l159 0 2024-05-09T06:30:55.029 INFO:tasks.workunit.client.0.smithi046.stdout:8/983: symlink d1/db/dd/d11/l12a 0 2024-05-09T06:30:55.030 INFO:tasks.workunit.client.0.smithi046.stdout:0/897: symlink d11/d18/d27/d28/d2d/d5c/l11b 0 2024-05-09T06:30:55.030 INFO:tasks.workunit.client.0.smithi046.stdout:0/898: readlink d11/d3f/lde 0 2024-05-09T06:30:55.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/899: link d11/d18/d27/d28/d2d/d81/ldc d11/d109/l11c 0 2024-05-09T06:30:55.034 INFO:tasks.workunit.client.0.smithi046.stdout:0/900: creat d11/d18/d27/f11d x:0 0 0 2024-05-09T06:30:55.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/968: dread d4/d20/d24/d29/df3/ff8 [0,4194304] 0 2024-05-09T06:30:55.039 INFO:tasks.workunit.client.0.smithi046.stdout:8/984: dread d1/d7/d12/f1f [0,4194304] 0 2024-05-09T06:30:55.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/901: rename d11/d18/d27/d28/d2d/d5c to d11/d18/d1c/d53/dc2/d11e 0 2024-05-09T06:30:55.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/902: read - d11/d109/f116 zero size 2024-05-09T06:30:55.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/903: stat d11/d4f/d5b/d5f/c9c 0 2024-05-09T06:30:55.045 INFO:tasks.workunit.client.0.smithi046.stdout:8/985: dread d1/d7/f37 [0,4194304] 0 2024-05-09T06:30:55.046 INFO:tasks.workunit.client.0.smithi046.stdout:3/969: rename d4/d20/d24/d2a/f40 to d4/d20/d24/d29/df3/f15a 0 2024-05-09T06:30:55.047 INFO:tasks.workunit.client.0.smithi046.stdout:3/970: write d4/d20/d24/d29/d2b/d94/d5c/d6c/d9b/fab [4222090,32010] 0 2024-05-09T06:30:55.048 INFO:tasks.workunit.client.0.smithi046.stdout:0/904: symlink d11/d3f/d6f/l11f 0 2024-05-09T06:30:55.050 INFO:tasks.workunit.client.0.smithi046.stdout:8/986: mknod d1/d7/d12/d45/c12b 0 2024-05-09T06:30:55.051 INFO:tasks.workunit.client.0.smithi046.stdout:8/987: mknod d1/db/dd/d11/c12c 0 2024-05-09T06:30:55.052 INFO:tasks.workunit.client.0.smithi046.stdout:8/988: dread - d1/db/dd/d11/d5d/d99/de8/fe7 zero size 2024-05-09T06:30:55.052 INFO:tasks.workunit.client.0.smithi046.stdout:0/905: write d11/d3f/f51 [1227197,68029] 0 2024-05-09T06:30:55.054 INFO:tasks.workunit.client.0.smithi046.stdout:8/989: creat d1/db/dd/d11/d5d/d95/f12d x:0 0 0 2024-05-09T06:30:55.054 INFO:tasks.workunit.client.0.smithi046.stdout:0/906: getdents d11/d18/d1c/d53/dc2/d11e/ddb 0 2024-05-09T06:30:55.057 INFO:tasks.workunit.client.0.smithi046.stdout:8/990: truncate d1/d7/d12/f79 186538 0 2024-05-09T06:30:55.065 INFO:tasks.workunit.client.0.smithi046.stdout:0/907: dread d11/d18/f3a [0,4194304] 0 2024-05-09T06:30:55.065 INFO:tasks.workunit.client.0.smithi046.stdout:0/908: truncate d11/d18/d1c/d53/dc2/d11e/ddf/f104 905183 0 2024-05-09T06:30:55.068 INFO:tasks.workunit.client.0.smithi046.stdout:8/991: dread d1/db/dd/f51 [0,4194304] 0 2024-05-09T06:30:55.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/971: dwrite d4/d20/d24/d29/df3/df7/f10e [0,4194304] 0 2024-05-09T06:30:55.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/909: creat d11/d4f/d5b/f120 x:0 0 0 2024-05-09T06:30:55.073 INFO:tasks.workunit.client.0.smithi046.stdout:3/972: read d4/d5d/ffd [824964,71828] 0 2024-05-09T06:30:55.077 INFO:tasks.workunit.client.0.smithi046.stdout:8/992: write d1/db/f90 [2550569,61297] 0 2024-05-09T06:30:55.081 INFO:tasks.workunit.client.0.smithi046.stdout:0/910: dwrite d11/d18/d1c/d53/fee [0,4194304] 0 2024-05-09T06:30:55.081 INFO:tasks.workunit.client.0.smithi046.stdout:8/993: rename d1/db/dd/d11/d5d/d95/fbc to d1/db/d67/f12e 0 2024-05-09T06:30:55.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/994: truncate d1/db/dd/d11/d5d/d99/f100 580604 0 2024-05-09T06:30:55.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/973: dread d4/d20/d24/f18 [4194304,4194304] 0 2024-05-09T06:30:55.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/974: getdents d4/d119 0 2024-05-09T06:30:55.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/975: write d4/d20/d24/d29/fa5 [112710,96755] 0 2024-05-09T06:30:55.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/911: creat d11/d18/d1c/d53/f121 x:0 0 0 2024-05-09T06:30:55.086 INFO:tasks.workunit.client.0.smithi046.stdout:8/995: write d1/db/dd/f76 [1143401,14715] 0 2024-05-09T06:30:55.086 INFO:tasks.workunit.client.0.smithi046.stdout:8/996: write d1/db/dd/d11/d5d/d99/f100 [611497,130926] 0 2024-05-09T06:30:55.088 INFO:tasks.workunit.client.0.smithi046.stdout:3/976: dread d4/d20/d24/d29/d2b/d94/d126/d129/d58/f10b [0,4194304] 0 2024-05-09T06:30:55.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/997: rmdir d1/db/d67/d6e 39 2024-05-09T06:30:55.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/998: fdatasync d1/d7/d12/d1d/d30/dbd/dc7/f10d 0 2024-05-09T06:30:55.090 INFO:tasks.workunit.client.0.smithi046.stdout:8/999: getdents d1/d7/d12/d1d/d30/dbd/dc7 0 2024-05-09T06:30:55.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/912: dwrite f9 [0,4194304] 0 2024-05-09T06:30:55.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/913: chown d11/d18/d27/d28/f10a 30 1 2024-05-09T06:30:55.128 INFO:tasks.workunit.client.0.smithi046.stdout:0/914: dread d11/d18/d27/f68 [0,4194304] 0 2024-05-09T06:30:55.128 INFO:tasks.workunit.client.0.smithi046.stdout:0/915: readlink d11/d4f/lef 0 2024-05-09T06:30:55.128 INFO:tasks.workunit.client.0.smithi046.stdout:0/916: write d11/d18/f1b [3110490,106295] 0 2024-05-09T06:30:55.128 INFO:tasks.workunit.client.0.smithi046.stdout:0/917: chown d11/d18/d27/d28/d36/d91/d98/db0/cd4 418130023 1 2024-05-09T06:30:55.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/940: sync 2024-05-09T06:30:55.130 INFO:tasks.workunit.client.0.smithi046.stdout:4/883: sync 2024-05-09T06:30:55.130 INFO:tasks.workunit.client.0.smithi046.stdout:5/832: sync 2024-05-09T06:30:55.130 INFO:tasks.workunit.client.0.smithi046.stdout:5/833: chown d0/d1b/d21/d81/ld6 5919846 1 2024-05-09T06:30:55.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/941: write d7/f42 [5171822,32354] 0 2024-05-09T06:30:55.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/977: sync 2024-05-09T06:30:55.132 INFO:tasks.workunit.client.0.smithi046.stdout:4/884: link d7/df/d3a/d45/f97 d7/df/d10/d1d/f118 0 2024-05-09T06:30:55.132 INFO:tasks.workunit.client.0.smithi046.stdout:4/885: write d7/f90 [4164751,78540] 0 2024-05-09T06:30:55.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/918: read f9 [292931,73629] 0 2024-05-09T06:30:55.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/919: creat d11/d109/f122 x:0 0 0 2024-05-09T06:30:55.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/920: dread - d11/d18/d27/d28/d36/d91/d98/db0/fed zero size 2024-05-09T06:30:55.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/921: write d11/d18/d1c/d53/f121 [549533,13249] 0 2024-05-09T06:30:55.139 INFO:tasks.workunit.client.0.smithi046.stdout:1/942: dread d7/d10/f54 [0,4194304] 0 2024-05-09T06:30:55.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/886: link d7/df/d10/d1d/d77/f7a d7/df/d10/d1d/d77/d87/f119 0 2024-05-09T06:30:55.139 INFO:tasks.workunit.client.0.smithi046.stdout:6/978: write db/d10/d19/f20 [4087010,32164] 0 2024-05-09T06:30:55.140 INFO:tasks.workunit.client.0.smithi046.stdout:0/922: dread d11/d3f/f5d [0,4194304] 0 2024-05-09T06:30:55.147 INFO:tasks.workunit.client.0.smithi046.stdout:1/943: link d7/d10/d34/feb d7/d10/d84/f132 0 2024-05-09T06:30:55.150 INFO:tasks.workunit.client.0.smithi046.stdout:4/887: symlink d7/df/d3a/d25/da5/dfd/l11a 0 2024-05-09T06:30:55.151 INFO:tasks.workunit.client.0.smithi046.stdout:4/888: creat d7/df/d53/d91/f11b x:0 0 0 2024-05-09T06:30:55.151 INFO:tasks.workunit.client.0.smithi046.stdout:4/889: stat d7/df/d3a/d25/d81/d98/fbc 0 2024-05-09T06:30:55.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/923: symlink d11/d18/d1c/d53/dc2/d11e/l123 0 2024-05-09T06:30:55.156 INFO:tasks.workunit.client.0.smithi046.stdout:5/834: dwrite d0/dba/de7/d53/f59 [0,4194304] 0 2024-05-09T06:30:55.156 INFO:tasks.workunit.client.0.smithi046.stdout:1/944: creat d7/d10/d28/d30/dcf/d75/d112/f133 x:0 0 0 2024-05-09T06:30:55.156 INFO:tasks.workunit.client.0.smithi046.stdout:1/945: truncate d7/da3/dc5/fff 189905 0 2024-05-09T06:30:55.159 INFO:tasks.workunit.client.0.smithi046.stdout:0/924: rename d11/d4f/d5b/d5f/c9c to d11/d18/d27/d28/d6b/c124 0 2024-05-09T06:30:55.160 INFO:tasks.workunit.client.0.smithi046.stdout:0/925: write d11/d4f/f103 [1607906,51711] 0 2024-05-09T06:30:55.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/890: dread d7/df/d10/d1d/f8e [0,4194304] 0 2024-05-09T06:30:55.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/891: fdatasync d7/df/d3a/d25/d86/fa6 0 2024-05-09T06:30:55.165 INFO:tasks.workunit.client.0.smithi046.stdout:5/835: symlink d0/dba/de7/d50/l128 0 2024-05-09T06:30:55.167 INFO:tasks.workunit.client.0.smithi046.stdout:0/926: creat d11/d18/d1c/d56/f125 x:0 0 0 2024-05-09T06:30:55.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/836: getdents d0 0 2024-05-09T06:30:55.170 INFO:tasks.workunit.client.0.smithi046.stdout:0/927: mkdir d11/d18/d27/d28/d36/d91/d98/d126 0 2024-05-09T06:30:55.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/837: mkdir d0/d58/d7a/d129 0 2024-05-09T06:30:55.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/946: read d7/d10/d34/d46/d81/f9e [1943015,40760] 0 2024-05-09T06:30:55.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/947: fsync d7/d10/d28/d30/f12e 0 2024-05-09T06:30:55.173 INFO:tasks.workunit.client.0.smithi046.stdout:0/928: link d11/l4d d11/d18/d1c/l127 0 2024-05-09T06:30:55.175 INFO:tasks.workunit.client.0.smithi046.stdout:1/948: truncate d7/d10/d28/d30/dcf/fb7 5462931 0 2024-05-09T06:30:55.175 INFO:tasks.workunit.client.0.smithi046.stdout:1/949: readlink d7/d10/d34/d46/l60 0 2024-05-09T06:30:55.175 INFO:tasks.workunit.client.0.smithi046.stdout:1/950: dread - d7/d10/d28/d30/dcf/d7f/d10e/d117/f11a zero size 2024-05-09T06:30:55.176 INFO:tasks.workunit.client.0.smithi046.stdout:1/951: rmdir d7/d10/d34/d46 39 2024-05-09T06:30:55.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/952: write d7/d10/d28/d30/dcf/d76/de8/ffc [973988,65339] 0 2024-05-09T06:30:55.182 INFO:tasks.workunit.client.0.smithi046.stdout:5/838: read d0/dba/de7/d50/fc5 [826530,62559] 0 2024-05-09T06:30:55.182 INFO:tasks.workunit.client.0.smithi046.stdout:5/839: write d0/dba/de7/d83/f90 [1197049,79044] 0 2024-05-09T06:30:55.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/953: getdents d7/da3 0 2024-05-09T06:30:55.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/892: dwrite d7/df/d53/f6f [0,4194304] 0 2024-05-09T06:30:55.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/840: creat d0/d58/d7a/d129/f12a x:0 0 0 2024-05-09T06:30:55.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/929: dwrite d11/d18/d1c/d53/dc2/d11e/fd3 [0,4194304] 0 2024-05-09T06:30:55.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/930: fsync d11/d18/d27/d28/d36/faa 0 2024-05-09T06:30:55.191 INFO:tasks.workunit.client.0.smithi046.stdout:4/893: unlink d7/df/fe3 0 2024-05-09T06:30:55.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/954: dread d7/d10/d28/d30/dcf/f3c [0,4194304] 0 2024-05-09T06:30:55.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/841: mknod d0/db3/dc0/c12b 0 2024-05-09T06:30:55.199 INFO:tasks.workunit.client.0.smithi046.stdout:4/894: write d7/df/d10/f9f [3013377,98516] 0 2024-05-09T06:30:55.199 INFO:tasks.workunit.client.0.smithi046.stdout:4/895: chown d7/df/d3a/d25/da5/dfd/l11a 4220744 1 2024-05-09T06:30:55.200 INFO:tasks.workunit.client.0.smithi046.stdout:0/931: stat d11/d18/d27/d28/d6b/c124 0 2024-05-09T06:30:55.200 INFO:tasks.workunit.client.0.smithi046.stdout:0/932: write d11/d18/d1c/d56/f74 [1250853,5279] 0 2024-05-09T06:30:55.200 INFO:tasks.workunit.client.0.smithi046.stdout:0/933: dread - d11/d18/db1/fcb zero size 2024-05-09T06:30:55.200 INFO:tasks.workunit.client.0.smithi046.stdout:0/934: stat d11/d18/f39 0 2024-05-09T06:30:55.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/955: rename d7/d6d/f92 to d7/d10/d34/d46/f134 0 2024-05-09T06:30:55.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/842: creat d0/d1b/d39/f12c x:0 0 0 2024-05-09T06:30:55.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/935: dread d11/f12 [0,4194304] 0 2024-05-09T06:30:55.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/936: dread - d11/d18/d27/d28/d36/d91/d98/fb3 zero size 2024-05-09T06:30:55.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/896: rmdir d7/df/d3a/d45/d96/db3/de4 39 2024-05-09T06:30:55.214 INFO:tasks.workunit.client.0.smithi046.stdout:5/843: mknod d0/dba/de7/c12d 0 2024-05-09T06:30:55.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/897: symlink d7/df/d10/d1d/d77/l11c 0 2024-05-09T06:30:55.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/898: readlink d7/l9e 0 2024-05-09T06:30:55.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/956: dwrite d7/d10/d84/da8/fbe [0,4194304] 0 2024-05-09T06:30:55.218 INFO:tasks.workunit.client.0.smithi046.stdout:5/844: symlink d0/db3/d121/l12e 0 2024-05-09T06:30:55.218 INFO:tasks.workunit.client.0.smithi046.stdout:5/845: chown d0/d58/d7a/lc9 78695102 1 2024-05-09T06:30:55.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/899: creat d7/df/d3a/d45/d96/db3/de4/f11d x:0 0 0 2024-05-09T06:30:55.221 INFO:tasks.workunit.client.0.smithi046.stdout:0/937: dread d11/d18/d1c/d53/d82/f9a [0,4194304] 0 2024-05-09T06:30:55.221 INFO:tasks.workunit.client.0.smithi046.stdout:0/938: dread - d11/d4f/d5b/f120 zero size 2024-05-09T06:30:55.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/957: unlink d7/d10/d28/d30/fa1 0 2024-05-09T06:30:55.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/958: truncate d7/da3/ff6 767724 0 2024-05-09T06:30:55.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/959: fdatasync d7/d10/d28/d55/fe9 0 2024-05-09T06:30:55.227 INFO:tasks.workunit.client.0.smithi046.stdout:5/846: mkdir d0/dad/d127/d12f 0 2024-05-09T06:30:55.227 INFO:tasks.workunit.client.0.smithi046.stdout:5/847: write d0/dba/de7/d50/f73 [2174776,12144] 0 2024-05-09T06:30:55.229 INFO:tasks.workunit.client.0.smithi046.stdout:4/900: mknod d7/dd8/df7/c11e 0 2024-05-09T06:30:55.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/939: mknod d11/d18/d27/c128 0 2024-05-09T06:30:55.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/940: truncate d11/d109/f116 698377 0 2024-05-09T06:30:55.233 INFO:tasks.workunit.client.0.smithi046.stdout:5/848: creat d0/dba/de7/d53/f130 x:0 0 0 2024-05-09T06:30:55.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/901: mknod d7/dd8/df7/d110/c11f 0 2024-05-09T06:30:55.236 INFO:tasks.workunit.client.0.smithi046.stdout:0/941: getdents d11/d18/d1c/d53/dc2/d11e 0 2024-05-09T06:30:55.236 INFO:tasks.workunit.client.0.smithi046.stdout:0/942: creat d11/d18/d1c/d53/f129 x:0 0 0 2024-05-09T06:30:55.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/960: truncate d7/d10/d34/d46/d81/f9a 830968 0 2024-05-09T06:30:55.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/961: fdatasync d7/d10/d34/fd1 0 2024-05-09T06:30:55.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/849: link d0/dba/de7/d50/c51 d0/db3/dc0/d10e/c131 0 2024-05-09T06:30:55.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/850: chown d0/d1b/d21/l9c 68846 1 2024-05-09T06:30:55.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/851: write d0/d58/d7a/d129/f12a [863594,24935] 0 2024-05-09T06:30:55.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/852: getdents d0 0 2024-05-09T06:30:55.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/943: getdents d11/d18/d1c/d53/dc2/d11e/ddf 0 2024-05-09T06:30:55.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/944: creat d11/d3f/f12a x:0 0 0 2024-05-09T06:30:55.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/945: fdatasync d11/f35 0 2024-05-09T06:30:55.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/853: mknod d0/db3/d121/c132 0 2024-05-09T06:30:55.253 INFO:tasks.workunit.client.0.smithi046.stdout:4/902: dwrite d7/df/d3a/f83 [0,4194304] 0 2024-05-09T06:30:55.257 INFO:tasks.workunit.client.0.smithi046.stdout:4/903: dread d7/df/d3a/d25/d86/f88 [0,4194304] 0 2024-05-09T06:30:55.260 INFO:tasks.workunit.client.0.smithi046.stdout:0/946: getdents d11/d18/d27/d28/d2d 0 2024-05-09T06:30:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:5/854: symlink d0/d58/l133 0 2024-05-09T06:30:55.268 INFO:tasks.workunit.client.0.smithi046.stdout:0/947: write d11/d18/d27/d28/f50 [3935482,98467] 0 2024-05-09T06:30:55.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/904: rename d7/df/c74 to d7/df/d3a/d25/d81/d98/db7/c120 0 2024-05-09T06:30:55.283 INFO:tasks.workunit.client.0.smithi046.stdout:5/855: dwrite d0/dba/de7/dfb/f10a [0,4194304] 0 2024-05-09T06:30:55.291 INFO:tasks.workunit.client.0.smithi046.stdout:0/948: dwrite d11/d18/f32 [4194304,4194304] 0 2024-05-09T06:30:55.292 INFO:tasks.workunit.client.0.smithi046.stdout:0/949: chown d11/d18/d1c/d53/fa5 1844 1 2024-05-09T06:30:55.293 INFO:tasks.workunit.client.0.smithi046.stdout:4/905: dwrite d7/df/d3a/d25/df6/f105 [0,4194304] 0 2024-05-09T06:30:55.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/950: dwrite d11/d18/f8c [0,4194304] 0 2024-05-09T06:30:55.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:55 smithi106 ceph-mon[34679]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 174 MiB/s rd, 210 MiB/s wr, 380 op/s 2024-05-09T06:30:55.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:55 smithi046 ceph-mon[26924]: pgmap v34: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 174 MiB/s rd, 210 MiB/s wr, 380 op/s 2024-05-09T06:30:55.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/856: link d0/d1b/c6e d0/dad/d127/d12f/c134 0 2024-05-09T06:30:55.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/857: write d0/d1b/d21/f11b [113006,100015] 0 2024-05-09T06:30:55.408 INFO:tasks.workunit.client.0.smithi046.stdout:4/906: mknod d7/df/d3a/dee/c121 0 2024-05-09T06:30:55.408 INFO:tasks.workunit.client.0.smithi046.stdout:4/907: dread - d7/dd8/df7/d110/f111 zero size 2024-05-09T06:30:55.429 INFO:tasks.workunit.client.0.smithi046.stdout:4/908: dwrite d7/df/d3a/d25/d81/d98/fc4 [4194304,4194304] 0 2024-05-09T06:30:55.454 INFO:tasks.workunit.client.0.smithi046.stdout:5/858: creat d0/d1b/f135 x:0 0 0 2024-05-09T06:30:55.462 INFO:tasks.workunit.client.0.smithi046.stdout:5/859: dread d0/dba/de7/d53/f6c [0,4194304] 0 2024-05-09T06:30:55.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/860: truncate d0/dba/de7/d83/f90 1017742 0 2024-05-09T06:30:55.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/861: truncate d0/d1b/d21/f79 3495061 0 2024-05-09T06:30:55.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/862: fdatasync d0/d58/d7a/f7b 0 2024-05-09T06:30:55.465 INFO:tasks.workunit.client.0.smithi046.stdout:5/863: fsync d0/d58/d7a/d129/f12a 0 2024-05-09T06:30:55.465 INFO:tasks.workunit.client.0.smithi046.stdout:5/864: dread - d0/dba/de7/f11d zero size 2024-05-09T06:30:55.472 INFO:tasks.workunit.client.0.smithi046.stdout:5/865: write d0/dba/de7/d53/f59 [3258356,22909] 0 2024-05-09T06:30:55.472 INFO:tasks.workunit.client.0.smithi046.stdout:5/866: creat d0/d1b/d21/d81/f136 x:0 0 0 2024-05-09T06:30:55.487 INFO:tasks.workunit.client.0.smithi046.stdout:0/951: creat d11/d18/f12b x:0 0 0 2024-05-09T06:30:55.488 INFO:tasks.workunit.client.0.smithi046.stdout:0/952: rmdir d11/d18/d27/d28/d6b/de8 39 2024-05-09T06:30:55.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/953: stat d11/d18/ld9 0 2024-05-09T06:30:55.490 INFO:tasks.workunit.client.0.smithi046.stdout:0/954: symlink d11/d4f/l12c 0 2024-05-09T06:30:55.505 INFO:tasks.workunit.client.0.smithi046.stdout:0/955: dwrite d11/d18/f1b [0,4194304] 0 2024-05-09T06:30:55.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/956: read d11/d18/d27/f3c [754463,123415] 0 2024-05-09T06:30:55.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/957: dread - d11/d18/d1c/d53/fd6 zero size 2024-05-09T06:30:55.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/958: chown d11/d18/d27/d28/d6b/fae 27103657 1 2024-05-09T06:30:55.512 INFO:tasks.workunit.client.0.smithi046.stdout:0/959: dread f4 [0,4194304] 0 2024-05-09T06:30:55.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/960: write d11/d18/d1c/d53/fd6 [968071,62120] 0 2024-05-09T06:30:55.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/867: write d0/dba/de7/d83/f90 [1123578,76542] 0 2024-05-09T06:30:55.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/868: chown d0/d1b/d21/d81/lb8 90 1 2024-05-09T06:30:55.530 INFO:tasks.workunit.client.0.smithi046.stdout:0/961: dwrite d11/d18/d1c/d53/fa5 [0,4194304] 0 2024-05-09T06:30:55.530 INFO:tasks.workunit.client.0.smithi046.stdout:0/962: write d11/d18/d27/d28/d36/fd1 [370893,100492] 0 2024-05-09T06:30:55.532 INFO:tasks.workunit.client.0.smithi046.stdout:0/963: creat d11/d18/d27/d28/d36/d91/d98/d126/f12d x:0 0 0 2024-05-09T06:30:55.535 INFO:tasks.workunit.client.0.smithi046.stdout:5/869: dread d0/dad/ff1 [0,4194304] 0 2024-05-09T06:30:55.542 INFO:tasks.workunit.client.0.smithi046.stdout:0/964: symlink d11/d18/d27/d28/d36/d91/l12e 0 2024-05-09T06:30:55.544 INFO:tasks.workunit.client.0.smithi046.stdout:5/870: symlink d0/d1b/d21/d81/d115/l137 0 2024-05-09T06:30:55.544 INFO:tasks.workunit.client.0.smithi046.stdout:5/871: dread - d0/dba/de7/f11d zero size 2024-05-09T06:30:55.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/965: rename d11/d18/d27/d28/d36/d5a/dc4/l112 to d11/d3f/l12f 0 2024-05-09T06:30:55.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/966: readlink d11/d18/d1c/d53/l96 0 2024-05-09T06:30:55.549 INFO:tasks.workunit.client.0.smithi046.stdout:5/872: rename d0/dba/de7/dc7/dd0/d111 to d0/d58/d119/d138 0 2024-05-09T06:30:55.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/873: mknod d0/d1b/c139 0 2024-05-09T06:30:55.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/874: getdents d0/db3/deb/dfc 0 2024-05-09T06:30:55.555 INFO:tasks.workunit.client.0.smithi046.stdout:5/875: rename d0/df3 to d0/db3/deb/dfc/d13a 0 2024-05-09T06:30:55.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/876: symlink d0/dba/de7/d50/d107/l13b 0 2024-05-09T06:30:55.559 INFO:tasks.workunit.client.0.smithi046.stdout:5/877: mknod d0/dba/de7/dfb/c13c 0 2024-05-09T06:30:55.565 INFO:tasks.workunit.client.0.smithi046.stdout:0/967: dwrite d11/d18/d27/d28/d36/d5a/f10f [0,4194304] 0 2024-05-09T06:30:55.565 INFO:tasks.workunit.client.0.smithi046.stdout:0/968: truncate d11/d18/d1c/d53/dc2/d11e/f8f 938276 0 2024-05-09T06:30:55.571 INFO:tasks.workunit.client.0.smithi046.stdout:0/969: write d11/d18/f3a [3933292,117377] 0 2024-05-09T06:30:55.573 INFO:tasks.workunit.client.0.smithi046.stdout:0/970: creat d11/d18/db1/f130 x:0 0 0 2024-05-09T06:30:55.576 INFO:tasks.workunit.client.0.smithi046.stdout:0/971: rename d11/lc0 to d11/d18/db1/db2/l131 0 2024-05-09T06:30:55.577 INFO:tasks.workunit.client.0.smithi046.stdout:0/972: read - d11/d18/d1c/d56/f125 zero size 2024-05-09T06:30:55.579 INFO:tasks.workunit.client.0.smithi046.stdout:0/973: dread d11/d18/d27/d28/d36/d5a/ffc [0,4194304] 0 2024-05-09T06:30:55.580 INFO:tasks.workunit.client.0.smithi046.stdout:5/878: mkdir d0/dba/de7/d13d 0 2024-05-09T06:30:55.582 INFO:tasks.workunit.client.0.smithi046.stdout:5/879: rename d0/d58/c5f to d0/dad/c13e 0 2024-05-09T06:30:55.582 INFO:tasks.workunit.client.0.smithi046.stdout:5/880: fsync d0/db3/dc0/f122 0 2024-05-09T06:30:55.586 INFO:tasks.workunit.client.0.smithi046.stdout:5/881: rename d0/d1b/d39/dcf/l116 to d0/d58/d7a/d129/l13f 0 2024-05-09T06:30:55.586 INFO:tasks.workunit.client.0.smithi046.stdout:5/882: write d0/dba/de7/d53/f97 [2771159,129817] 0 2024-05-09T06:30:55.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/974: write d11/d18/f3a [6176810,19294] 0 2024-05-09T06:30:55.590 INFO:tasks.workunit.client.0.smithi046.stdout:0/975: fsync d11/d18/d27/d28/d6b/f119 0 2024-05-09T06:30:55.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/976: link d11/d18/d1c/d53/fa5 d11/d109/f132 0 2024-05-09T06:30:55.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/977: chown d11/d18/d1c/d53/d82/f9a 106398948 1 2024-05-09T06:30:55.596 INFO:tasks.workunit.client.0.smithi046.stdout:0/978: creat d11/d18/d27/d28/d36/f133 x:0 0 0 2024-05-09T06:30:55.597 INFO:tasks.workunit.client.0.smithi046.stdout:5/883: write d0/f16 [2951287,43935] 0 2024-05-09T06:30:55.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/979: symlink d11/d18/d1c/d53/dc2/d11e/l134 0 2024-05-09T06:30:55.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/980: truncate d11/f15 4320175 0 2024-05-09T06:30:55.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/981: truncate d11/d18/d27/d28/d36/d91/d98/d126/f12d 621068 0 2024-05-09T06:30:55.605 INFO:tasks.workunit.client.0.smithi046.stdout:5/884: creat d0/db3/deb/f140 x:0 0 0 2024-05-09T06:30:55.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/982: mkdir d11/d3f/d6f/d135 0 2024-05-09T06:30:55.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/983: getdents d11/d18/d1c/d53/dc2/d11e/ddf 0 2024-05-09T06:30:55.609 INFO:tasks.workunit.client.0.smithi046.stdout:0/984: mknod d11/d18/d1c/d53/c136 0 2024-05-09T06:30:55.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/885: dread d0/f16 [0,4194304] 0 2024-05-09T06:30:55.624 INFO:tasks.workunit.client.0.smithi046.stdout:0/985: dwrite d11/d18/d27/d28/d6b/f8b [0,4194304] 0 2024-05-09T06:30:55.628 INFO:tasks.workunit.client.0.smithi046.stdout:0/986: mkdir d11/d18/d1c/d53/dc2/d11e/d137 0 2024-05-09T06:30:55.632 INFO:tasks.workunit.client.0.smithi046.stdout:0/987: unlink d11/d18/d27/f68 0 2024-05-09T06:30:55.632 INFO:tasks.workunit.client.0.smithi046.stdout:0/988: fsync d11/d18/fca 0 2024-05-09T06:30:55.632 INFO:tasks.workunit.client.0.smithi046.stdout:0/989: fsync d11/d18/d27/d28/d36/faa 0 2024-05-09T06:30:55.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/990: mknod d11/d18/d27/c138 0 2024-05-09T06:30:55.648 INFO:tasks.workunit.client.0.smithi046.stdout:0/991: dwrite d11/d18/d27/d28/d36/d5a/f69 [4194304,4194304] 0 2024-05-09T06:30:55.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/992: write d11/d18/d1c/d53/fa5 [924834,104859] 0 2024-05-09T06:30:55.655 INFO:tasks.workunit.client.0.smithi046.stdout:0/993: fsync d11/d18/d1c/d53/f121 0 2024-05-09T06:30:55.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/994: dwrite d11/f12 [4194304,4194304] 0 2024-05-09T06:30:55.668 INFO:tasks.workunit.client.0.smithi046.stdout:0/995: symlink d11/d3f/d6f/l139 0 2024-05-09T06:30:55.669 INFO:tasks.workunit.client.0.smithi046.stdout:0/996: dread d11/d18/d1c/d53/f121 [0,4194304] 0 2024-05-09T06:30:55.671 INFO:tasks.workunit.client.0.smithi046.stdout:0/997: link d11/d18/ld9 d11/d18/d1c/d53/l13a 0 2024-05-09T06:30:55.671 INFO:tasks.workunit.client.0.smithi046.stdout:0/998: symlink d11/d18/d27/d28/d2d/l13b 0 2024-05-09T06:30:55.674 INFO:tasks.workunit.client.0.smithi046.stdout:0/999: creat d11/d18/d27/d28/d2d/f13c x:0 0 0 2024-05-09T06:30:55.674 INFO:tasks.workunit.client.0.smithi046.stdout:2/892: sync 2024-05-09T06:30:55.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/827: sync 2024-05-09T06:30:55.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/977: sync 2024-05-09T06:30:55.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/979: sync 2024-05-09T06:30:55.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/978: read - d4/d48/d49/f9f zero size 2024-05-09T06:30:55.675 INFO:tasks.workunit.client.0.smithi046.stdout:2/893: write da/dc/f13 [5978026,72020] 0 2024-05-09T06:30:55.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/909: sync 2024-05-09T06:30:55.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/962: sync 2024-05-09T06:30:55.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/963: chown d7/d10/d28/d30 102419 1 2024-05-09T06:30:55.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/828: creat d2/d6/d7/d1e/d115/f124 x:0 0 0 2024-05-09T06:30:55.677 INFO:tasks.workunit.client.0.smithi046.stdout:6/980: creat db/d10/d30/f140 x:0 0 0 2024-05-09T06:30:55.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/981: read db/d10/d6b/f8f [5009950,28836] 0 2024-05-09T06:30:55.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/982: chown db/d10/d76 0 1 2024-05-09T06:30:55.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/894: rename da/de/d14/f10f to da/d2d/d43/dc2/dec/f11a 0 2024-05-09T06:30:55.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/964: unlink d7/d10/d28/c40 0 2024-05-09T06:30:55.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/965: creat d7/d6d/ddd/f135 x:0 0 0 2024-05-09T06:30:55.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/983: dread db/d10/d3f/d44/d5e/f86 [0,4194304] 0 2024-05-09T06:30:55.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/979: rmdir d4/d20/d24/d2a/d46 39 2024-05-09T06:30:55.689 INFO:tasks.workunit.client.0.smithi046.stdout:4/910: rename d7/df/d3a/d25/d81/d98/fc4 to d7/df/d10/f122 0 2024-05-09T06:30:55.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/895: dread da/de/d1c/fd3 [0,4194304] 0 2024-05-09T06:30:55.693 INFO:tasks.workunit.client.0.smithi046.stdout:3/980: symlink d4/d20/d24/d2a/d55/d74/d115/l15b 0 2024-05-09T06:30:55.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/911: mknod d7/df/d3a/d25/d81/c123 0 2024-05-09T06:30:55.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/912: creat d7/df/d3a/d25/da5/f124 x:0 0 0 2024-05-09T06:30:55.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/896: truncate f8 2437855 0 2024-05-09T06:30:55.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/897: fsync da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/ff3 0 2024-05-09T06:30:55.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/898: fsync da/dcb/dcc/dee/dcd/d7d/dc5/f69 0 2024-05-09T06:30:55.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/899: dread - da/dcb/dcc/dee/dcd/d7d/dc5/d3d/fb5 zero size 2024-05-09T06:30:55.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/966: symlink d7/d10/d34/d46/d81/l136 0 2024-05-09T06:30:55.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/913: dread d7/df/d3a/d116/fec [0,4194304] 0 2024-05-09T06:30:55.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/900: mknod da/de/d14/d1f/d20/d4e/c11b 0 2024-05-09T06:30:55.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/901: write da/dcb/dcc/fd7 [147779,47337] 0 2024-05-09T06:30:55.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/902: fdatasync da/de/d1c/f3e 0 2024-05-09T06:30:55.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/903: stat da/d2d/d43/f9e 0 2024-05-09T06:30:55.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/904: chown da/dcb/dcc/dee/dcd/d7d/dc5/f78 23916575 1 2024-05-09T06:30:55.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/967: mknod d7/d10/d28/c137 0 2024-05-09T06:30:55.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/981: dwrite d4/d20/d24/f135 [0,4194304] 0 2024-05-09T06:30:55.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/914: mkdir d7/df/d3a/d25/d86/de1/d125 0 2024-05-09T06:30:55.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/968: mkdir d7/d10/d28/d30/da0/d138 0 2024-05-09T06:30:55.720 INFO:tasks.workunit.client.0.smithi046.stdout:3/982: symlink d4/d20/d24/d2a/d55/d6a/dfe/l15c 0 2024-05-09T06:30:55.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/915: getdents d7/df/d3a/d116 0 2024-05-09T06:30:55.722 INFO:tasks.workunit.client.0.smithi046.stdout:2/905: dwrite da/dcb/dcc/dee/dcd/d7d/dc5/f69 [0,4194304] 0 2024-05-09T06:30:55.723 INFO:tasks.workunit.client.0.smithi046.stdout:2/906: dread f7 [8388608,4194304] 0 2024-05-09T06:30:55.723 INFO:tasks.workunit.client.0.smithi046.stdout:1/969: unlink d7/d10/d28/d30/dcf/d76/de8/l106 0 2024-05-09T06:30:55.726 INFO:tasks.workunit.client.0.smithi046.stdout:3/983: rename d4/d20/d24/d29/d2b/d94/d5c/f149 to d4/d48/d49/dc0/f15d 0 2024-05-09T06:30:55.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/916: symlink d7/df/d3a/d45/d96/db3/dd5/l126 0 2024-05-09T06:30:55.730 INFO:tasks.workunit.client.0.smithi046.stdout:2/907: read da/dcb/dcc/dee/dcd/d7d/dc5/d3d/faf [3436903,46670] 0 2024-05-09T06:30:55.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/970: mkdir d7/d10/d84/d127/d139 0 2024-05-09T06:30:55.734 INFO:tasks.workunit.client.0.smithi046.stdout:3/984: rmdir d4/d20/d24/d29/d2b/d94/d126 39 2024-05-09T06:30:55.734 INFO:tasks.workunit.client.0.smithi046.stdout:3/985: chown d4/d20/d24/d29/d2b/d94/d5c/f67 3 1 2024-05-09T06:30:55.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/917: mkdir d7/daf/dd6/d127 0 2024-05-09T06:30:55.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/918: chown d7/df/d3a/d116 452228613 1 2024-05-09T06:30:55.739 INFO:tasks.workunit.client.0.smithi046.stdout:2/908: mkdir da/de/d14/d1f/d20/d11c 0 2024-05-09T06:30:55.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/971: dread d7/d10/d28/d30/dcf/d76/f7a [0,4194304] 0 2024-05-09T06:30:55.740 INFO:tasks.workunit.client.0.smithi046.stdout:3/986: mkdir d4/d20/d24/d29/d2b/d94/d14b/d15e 0 2024-05-09T06:30:55.740 INFO:tasks.workunit.client.0.smithi046.stdout:3/987: fsync d4/d20/d41/d4a/f105 0 2024-05-09T06:30:55.741 INFO:tasks.workunit.client.0.smithi046.stdout:2/909: mknod da/d2d/d43/dc2/ddb/c11d 0 2024-05-09T06:30:55.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/972: unlink d7/d10/d28/d30/dcf/d7f/d10e/d117/f11a 0 2024-05-09T06:30:55.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/973: chown d7/d10/d28/d30/dcf/d7f/d10e/d117/d119 162944272 1 2024-05-09T06:30:55.744 INFO:tasks.workunit.client.0.smithi046.stdout:3/988: mkdir d4/d20/d24/d29/d2b/d94/d126/d15f 0 2024-05-09T06:30:55.746 INFO:tasks.workunit.client.0.smithi046.stdout:2/910: creat da/d2d/d43/dc2/ddb/f11e x:0 0 0 2024-05-09T06:30:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/911: mknod da/de/d14/d1f/d3b/d9f/c11f 0 2024-05-09T06:30:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/912: chown da/de/d14/d1f/d3b/d9f/c11f 737980731 1 2024-05-09T06:30:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/913: write da/de/d1c/f3e [1132945,124562] 0 2024-05-09T06:30:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/914: readlink da/dcb/dcc/dee/dcd/d7d/dc5/l73 0 2024-05-09T06:30:55.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/915: dread - da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d70/f98 zero size 2024-05-09T06:30:55.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/916: mknod da/de/d14/d1f/d20/d4e/c120 0 2024-05-09T06:30:55.756 INFO:tasks.workunit.client.0.smithi046.stdout:4/919: dwrite d7/df/d3a/d45/d96/f58 [4194304,4194304] 0 2024-05-09T06:30:55.772 INFO:tasks.workunit.client.0.smithi046.stdout:4/920: write d7/df/d3a/d25/f5f [1469919,28696] 0 2024-05-09T06:30:55.772 INFO:tasks.workunit.client.0.smithi046.stdout:4/921: fdatasync d7/df/d3a/d25/d81/d98/fbc 0 2024-05-09T06:30:55.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/922: symlink d7/df/d3a/d25/d86/de1/d125/l128 0 2024-05-09T06:30:55.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/923: write d7/df/d3a/f83 [4294935,113373] 0 2024-05-09T06:30:55.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/924: creat d7/df/d3a/dee/f129 x:0 0 0 2024-05-09T06:30:55.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/989: dwrite d4/d48/d49/fed [0,4194304] 0 2024-05-09T06:30:55.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/974: dwrite d7/d10/d84/da8/ffa [0,4194304] 0 2024-05-09T06:30:55.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/975: readlink d7/d10/d28/d30/dcf/lc0 0 2024-05-09T06:30:55.775 INFO:tasks.workunit.client.0.smithi046.stdout:4/925: truncate d7/f90 1237707 0 2024-05-09T06:30:55.775 INFO:tasks.workunit.client.0.smithi046.stdout:2/917: dwrite da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/fa6 [4194304,4194304] 0 2024-05-09T06:30:55.775 INFO:tasks.workunit.client.0.smithi046.stdout:2/918: readlink da/de/d14/l52 0 2024-05-09T06:30:55.779 INFO:tasks.workunit.client.0.smithi046.stdout:1/976: unlink d7/d10/d34/d46/d86/f7c 0 2024-05-09T06:30:55.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/919: creat da/de/d14/d1f/d3b/da2/f121 x:0 0 0 2024-05-09T06:30:55.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/990: rmdir d4/d20/d24/d2a/d55/d6a/dd5 39 2024-05-09T06:30:55.784 INFO:tasks.workunit.client.0.smithi046.stdout:1/977: mknod d7/d10/d84/d127/d139/c13a 0 2024-05-09T06:30:55.789 INFO:tasks.workunit.client.0.smithi046.stdout:4/926: rmdir d7/df/d3a/d45/d96/db3 39 2024-05-09T06:30:55.793 INFO:tasks.workunit.client.0.smithi046.stdout:4/927: mkdir d7/df/d12a 0 2024-05-09T06:30:55.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/920: mknod da/dcb/dcc/dee/dcd/c122 0 2024-05-09T06:30:55.795 INFO:tasks.workunit.client.0.smithi046.stdout:1/978: getdents d7/d6d/ddd 0 2024-05-09T06:30:55.796 INFO:tasks.workunit.client.0.smithi046.stdout:4/928: creat d7/df/d12a/f12b x:0 0 0 2024-05-09T06:30:55.799 INFO:tasks.workunit.client.0.smithi046.stdout:3/991: dwrite d4/d20/d24/d2a/d46/f157 [0,4194304] 0 2024-05-09T06:30:55.800 INFO:tasks.workunit.client.0.smithi046.stdout:3/992: dread - d4/d20/d24/d29/d2b/d94/dd3/ff4 zero size 2024-05-09T06:30:55.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/979: symlink d7/l13b 0 2024-05-09T06:30:55.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/980: fdatasync d7/d10/f54 0 2024-05-09T06:30:55.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/981: chown d7/d10/d28/d30/dcf/c6b 503042 1 2024-05-09T06:30:55.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/929: unlink d7/fc0 0 2024-05-09T06:30:55.804 INFO:tasks.workunit.client.0.smithi046.stdout:3/993: unlink d4/fc 0 2024-05-09T06:30:55.805 INFO:tasks.workunit.client.0.smithi046.stdout:1/982: truncate d7/d10/d28/d30/dcf/d76/de8/ffc 182990 0 2024-05-09T06:30:55.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/930: rename d7/df/d3a/d25/d81/d98/l9a to d7/df/d3a/d25/d86/de1/l12c 0 2024-05-09T06:30:55.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/931: getdents d7/df/d3a/d45/d96/db3/de4/d104 0 2024-05-09T06:30:55.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/932: chown d7/df/d10/d1d/d77/cca 3 1 2024-05-09T06:30:55.812 INFO:tasks.workunit.client.0.smithi046.stdout:3/994: write d4/d20/d24/d29/d2b/f90 [4583916,109519] 0 2024-05-09T06:30:55.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/933: mknod d7/df/d3a/d45/c12d 0 2024-05-09T06:30:55.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/934: readlink d7/df/d3a/d25/d81/d98/db7/lef 0 2024-05-09T06:30:55.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/935: mknod d7/df/d3a/d25/c12e 0 2024-05-09T06:30:55.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/936: readlink d7/df/d10/d1d/d77/l80 0 2024-05-09T06:30:55.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/937: fdatasync d7/df/d10/d1d/d77/d87/dac/fba 0 2024-05-09T06:30:55.821 INFO:tasks.workunit.client.0.smithi046.stdout:2/921: write da/dc/f5b [804316,51155] 0 2024-05-09T06:30:55.822 INFO:tasks.workunit.client.0.smithi046.stdout:2/922: getdents da/dcb/df5 0 2024-05-09T06:30:55.824 INFO:tasks.workunit.client.0.smithi046.stdout:2/923: rename da/l6b to da/de/d14/d1f/d20/d7c/l123 0 2024-05-09T06:30:55.825 INFO:tasks.workunit.client.0.smithi046.stdout:2/924: unlink da/de/d14/d1f/d3b/d9f/c11f 0 2024-05-09T06:30:55.826 INFO:tasks.workunit.client.0.smithi046.stdout:2/925: symlink da/de/d1c/db1/l124 0 2024-05-09T06:30:55.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/995: dwrite d4/d20/d24/d29/fc7 [0,4194304] 0 2024-05-09T06:30:55.828 INFO:tasks.workunit.client.0.smithi046.stdout:2/926: creat da/de/d14/d1f/d20/d5c/f125 x:0 0 0 2024-05-09T06:30:55.829 INFO:tasks.workunit.client.0.smithi046.stdout:4/938: dread d7/df/d3a/d45/d96/f67 [4194304,4194304] 0 2024-05-09T06:30:55.831 INFO:tasks.workunit.client.0.smithi046.stdout:2/927: dread da/de/d14/d1f/d20/d7c/d8b/fc7 [0,4194304] 0 2024-05-09T06:30:55.834 INFO:tasks.workunit.client.0.smithi046.stdout:4/939: rename d7/df/cad to d7/df/c12f 0 2024-05-09T06:30:55.838 INFO:tasks.workunit.client.0.smithi046.stdout:3/996: rmdir d4/d20/d24/d29/d2b/d94/d5c 39 2024-05-09T06:30:55.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/940: link d7/df/d3a/d25/df6/lf9 d7/df/d3a/d45/d96/l130 0 2024-05-09T06:30:55.843 INFO:tasks.workunit.client.0.smithi046.stdout:4/941: stat d7/df/d3a/d25/da5/dfd/l11a 0 2024-05-09T06:30:55.847 INFO:tasks.workunit.client.0.smithi046.stdout:4/942: symlink d7/daf/dd6/df2/l131 0 2024-05-09T06:30:55.858 INFO:tasks.workunit.client.0.smithi046.stdout:1/983: dwrite d7/d10/d28/d30/dcf/f41 [0,4194304] 0 2024-05-09T06:30:55.862 INFO:tasks.workunit.client.0.smithi046.stdout:1/984: link d7/da3/dc5/c100 d7/d6d/ddd/c13c 0 2024-05-09T06:30:55.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/985: creat d7/d10/f13d x:0 0 0 2024-05-09T06:30:55.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/986: fsync d7/f42 0 2024-05-09T06:30:55.865 INFO:tasks.workunit.client.0.smithi046.stdout:1/987: mknod d7/da3/c13e 0 2024-05-09T06:30:55.866 INFO:tasks.workunit.client.0.smithi046.stdout:1/988: dread - d7/d10/d28/d30/da0/dd9/f10d zero size 2024-05-09T06:30:55.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/989: link d7/da3/fb4 d7/d10/d34/f13f 0 2024-05-09T06:30:55.869 INFO:tasks.workunit.client.0.smithi046.stdout:3/997: dwrite d4/d5/f3a [0,4194304] 0 2024-05-09T06:30:55.869 INFO:tasks.workunit.client.0.smithi046.stdout:2/928: dwrite da/de/d14/d1f/d3b/f37 [0,4194304] 0 2024-05-09T06:30:55.870 INFO:tasks.workunit.client.0.smithi046.stdout:1/990: creat d7/d10/d28/d30/da0/d138/f140 x:0 0 0 2024-05-09T06:30:55.870 INFO:tasks.workunit.client.0.smithi046.stdout:4/943: dwrite d7/df/d10/d1d/f62 [0,4194304] 0 2024-05-09T06:30:55.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/929: dread da/de/d1c/fe7 [0,4194304] 0 2024-05-09T06:30:55.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/930: creat da/dc/dd0/f126 x:0 0 0 2024-05-09T06:30:55.877 INFO:tasks.workunit.client.0.smithi046.stdout:1/991: write d7/d10/f24 [1356205,80337] 0 2024-05-09T06:30:55.888 INFO:tasks.workunit.client.0.smithi046.stdout:2/931: rmdir da/dcb/dcc/dee/dae 39 2024-05-09T06:30:55.890 INFO:tasks.workunit.client.0.smithi046.stdout:1/992: truncate d7/d10/d34/feb 1582530 0 2024-05-09T06:30:55.890 INFO:tasks.workunit.client.0.smithi046.stdout:3/998: dwrite d4/d20/d24/f135 [0,4194304] 0 2024-05-09T06:30:55.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/944: write d7/df/d3a/f28 [3557344,80846] 0 2024-05-09T06:30:55.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/945: write d7/f1e [2070624,27498] 0 2024-05-09T06:30:55.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/946: creat d7/df/d53/d91/f132 x:0 0 0 2024-05-09T06:30:55.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/932: creat da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d6c/f127 x:0 0 0 2024-05-09T06:30:55.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/933: write da/dcb/dcc/dee/dcd/d7d/dc5/d3d/fe0 [896609,102745] 0 2024-05-09T06:30:55.894 INFO:tasks.workunit.client.0.smithi046.stdout:1/993: rename f6 to d7/d10/d84/d127/d139/f141 0 2024-05-09T06:30:55.894 INFO:tasks.workunit.client.0.smithi046.stdout:1/994: chown d7/d10/d28/d30/f12e 430100 1 2024-05-09T06:30:55.895 INFO:tasks.workunit.client.0.smithi046.stdout:3/999: mkdir d4/d5/dac/d160 0 2024-05-09T06:30:55.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/934: getdents da/dc 0 2024-05-09T06:30:55.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/995: unlink d7/d6d/ddd/l125 0 2024-05-09T06:30:55.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/996: fsync d7/d10/d28/d30/f12e 0 2024-05-09T06:30:55.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/997: fsync d7/d6d/ddd/f129 0 2024-05-09T06:30:55.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/998: creat d7/d10/d28/d30/dcf/d76/de8/f142 x:0 0 0 2024-05-09T06:30:55.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/935: mknod da/de/d14/d1f/d20/d5c/dcf/c128 0 2024-05-09T06:30:55.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/936: read - da/dcb/dcc/dee/dcd/d7d/dfc/f10d zero size 2024-05-09T06:30:55.904 INFO:tasks.workunit.client.0.smithi046.stdout:2/937: rename da/d2d/f42 to da/de/d14/d1f/d20/d7c/d8b/d95/f129 0 2024-05-09T06:30:55.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/938: symlink da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d70/l12a 0 2024-05-09T06:30:55.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/939: mkdir da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/dbc/df7/d12b 0 2024-05-09T06:30:55.927 INFO:tasks.workunit.client.0.smithi046.stdout:1/999: dwrite d7/d10/d28/d30/dcf/f41 [0,4194304] 0 2024-05-09T06:30:55.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/940: dwrite da/dc/dd0/fe8 [0,4194304] 0 2024-05-09T06:30:55.930 INFO:tasks.workunit.client.0.smithi046.stdout:2/941: mkdir da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/dbc/df7/d12c 0 2024-05-09T06:30:55.931 INFO:tasks.workunit.client.0.smithi046.stdout:2/942: chown da/dcb/dcc/dee/dcd/d7d/dc5/f69 121759 1 2024-05-09T06:30:55.934 INFO:tasks.workunit.client.0.smithi046.stdout:2/943: mkdir da/d2d/d43/dc2/dec/d12d 0 2024-05-09T06:30:55.934 INFO:tasks.workunit.client.0.smithi046.stdout:2/944: fdatasync da/dcb/dcc/dee/dcd/d7d/dfc/f10d 0 2024-05-09T06:30:55.936 INFO:tasks.workunit.client.0.smithi046.stdout:2/945: rename da/dcb/dcc/dee/dcd/d7d/dc5/f69 to da/d2d/d43/f12e 0 2024-05-09T06:30:55.938 INFO:tasks.workunit.client.0.smithi046.stdout:2/946: read da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d6c/fc0 [1189918,88528] 0 2024-05-09T06:30:55.951 INFO:tasks.workunit.client.0.smithi046.stdout:2/947: dwrite da/de/f7e [0,4194304] 0 2024-05-09T06:30:55.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/948: unlink da/d2d/d43/l87 0 2024-05-09T06:30:55.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/949: fsync da/dcb/dcc/dee/dcd/f88 0 2024-05-09T06:30:55.963 INFO:tasks.workunit.client.0.smithi046.stdout:2/950: symlink da/de/d14/d1f/d3b/d9f/l12f 0 2024-05-09T06:30:55.965 INFO:tasks.workunit.client.0.smithi046.stdout:2/951: mkdir da/de/d1c/db1/d115/d130 0 2024-05-09T06:30:56.109 INFO:tasks.workunit.client.0.smithi046.stdout:9/829: sync 2024-05-09T06:30:56.110 INFO:tasks.workunit.client.0.smithi046.stdout:5/886: sync 2024-05-09T06:30:56.110 INFO:tasks.workunit.client.0.smithi046.stdout:6/984: sync 2024-05-09T06:30:56.113 INFO:tasks.workunit.client.0.smithi046.stdout:5/887: mknod d0/dad/c141 0 2024-05-09T06:30:56.118 INFO:tasks.workunit.client.0.smithi046.stdout:5/888: creat d0/d58/f142 x:0 0 0 2024-05-09T06:30:56.118 INFO:tasks.workunit.client.0.smithi046.stdout:6/985: dread db/d10/d3f/d44/d134/f13f [4194304,4194304] 0 2024-05-09T06:30:56.118 INFO:tasks.workunit.client.0.smithi046.stdout:6/986: fdatasync db/d10/dfa/f121 0 2024-05-09T06:30:56.118 INFO:tasks.workunit.client.0.smithi046.stdout:6/987: chown db/d10/ldc 259680533 1 2024-05-09T06:30:56.120 INFO:tasks.workunit.client.0.smithi046.stdout:5/889: symlink d0/db3/d121/l143 0 2024-05-09T06:30:56.120 INFO:tasks.workunit.client.0.smithi046.stdout:5/890: write d0/d1b/d39/d8b/fb7 [4415973,40243] 0 2024-05-09T06:30:56.121 INFO:tasks.workunit.client.0.smithi046.stdout:6/988: mknod db/d10/d30/d53/d10f/c141 0 2024-05-09T06:30:56.124 INFO:tasks.workunit.client.0.smithi046.stdout:9/830: dwrite d2/dc/f11 [4194304,4194304] 0 2024-05-09T06:30:56.124 INFO:tasks.workunit.client.0.smithi046.stdout:9/831: stat d2/d26/d76/fd6 0 2024-05-09T06:30:56.124 INFO:tasks.workunit.client.0.smithi046.stdout:6/989: rename db/d93/d96/dd1/fd5 to db/d93/d96/f142 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/891: dread d0/dba/de7/fb5 [0,4194304] 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/892: write d0/dba/de7/d50/f70 [1237404,52564] 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:9/832: mkdir d2/d6/d7/d1a/d27/d56/d125 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:9/833: creat d2/d6/d8b/f126 x:0 0 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:9/834: write d2/dc/f89 [5094543,4712] 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:9/835: creat d2/d6/d38/de6/f127 x:0 0 0 2024-05-09T06:30:56.128 INFO:tasks.workunit.client.0.smithi046.stdout:9/836: creat d2/d6/d7/d1e/d115/f128 x:0 0 0 2024-05-09T06:30:56.133 INFO:tasks.workunit.client.0.smithi046.stdout:6/990: mknod db/d10/d76/c143 0 2024-05-09T06:30:56.141 INFO:tasks.workunit.client.0.smithi046.stdout:9/837: mkdir d2/d6/d7/d1e/d115/d129 0 2024-05-09T06:30:56.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/991: rename db/d10/d19/fab to db/d10/d3f/d44/d46/f144 0 2024-05-09T06:30:56.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/992: stat db/d10/d3f/d4f/d106 0 2024-05-09T06:30:56.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/993: readlink db/d10/d3f/d4f/d8a/l113 0 2024-05-09T06:30:56.143 INFO:tasks.workunit.client.0.smithi046.stdout:5/893: rmdir d0/d1b/d39/d8b 39 2024-05-09T06:30:56.146 INFO:tasks.workunit.client.0.smithi046.stdout:9/838: creat d2/d6/d7/d1a/d27/d56/df8/f12a x:0 0 0 2024-05-09T06:30:56.148 INFO:tasks.workunit.client.0.smithi046.stdout:6/994: symlink db/d10/d3c/dd4/d87/d12d/db7/l145 0 2024-05-09T06:30:56.150 INFO:tasks.workunit.client.0.smithi046.stdout:6/995: unlink db/d10/d19/cf7 0 2024-05-09T06:30:56.150 INFO:tasks.workunit.client.0.smithi046.stdout:6/996: fsync db/d10/d3f/dda/fe0 0 2024-05-09T06:30:56.152 INFO:tasks.workunit.client.0.smithi046.stdout:6/997: mknod db/d10/d3f/d4f/d106/c146 0 2024-05-09T06:30:56.154 INFO:tasks.workunit.client.0.smithi046.stdout:9/839: dread d2/d6/d7/d1a/d27/f98 [0,4194304] 0 2024-05-09T06:30:56.154 INFO:tasks.workunit.client.0.smithi046.stdout:6/998: unlink db/d10/d3f/l131 0 2024-05-09T06:30:56.155 INFO:tasks.workunit.client.0.smithi046.stdout:6/999: truncate db/d10/d76/fe2 1043975 0 2024-05-09T06:30:56.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/840: rename d2/d6/d7/d1a/d27/d2a/da5/fef to d2/d6/d7/d1e/d115/f12b 0 2024-05-09T06:30:56.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/841: fdatasync d2/d6/d7/fe0 0 2024-05-09T06:30:56.165 INFO:tasks.workunit.client.0.smithi046.stdout:5/894: write d0/d1b/d39/d8b/f9f [251961,41065] 0 2024-05-09T06:30:56.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/842: write f0 [4711366,44687] 0 2024-05-09T06:30:56.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/843: dread - d2/dc/d32/ff1 zero size 2024-05-09T06:30:56.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/844: write d2/d26/f43 [5065512,36109] 0 2024-05-09T06:30:56.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/895: mknod d0/db3/deb/c144 0 2024-05-09T06:30:56.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/896: mkdir d0/d58/d7a/d145 0 2024-05-09T06:30:56.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/897: mkdir d0/dba/de7/d146 0 2024-05-09T06:30:56.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/898: getdents d0/db3/deb/df4 0 2024-05-09T06:30:56.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/899: write d0/dba/de7/d50/fa8 [53135,47944] 0 2024-05-09T06:30:56.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/900: read - d0/dba/de7/d83/f9e zero size 2024-05-09T06:30:56.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/952: sync 2024-05-09T06:30:56.176 INFO:tasks.workunit.client.0.smithi046.stdout:4/947: sync 2024-05-09T06:30:56.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/953: rename da/f94 to da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/dbc/df7/d12c/f131 0 2024-05-09T06:30:56.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/948: symlink d7/df/d10/d1d/d77/l133 0 2024-05-09T06:30:56.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/949: dread - d7/df/d10/d1d/d77/d87/dbe/f10e zero size 2024-05-09T06:30:56.179 INFO:tasks.workunit.client.0.smithi046.stdout:5/901: dread d0/dba/de7/d53/fc2 [0,4194304] 0 2024-05-09T06:30:56.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/950: dread d7/df/f38 [0,4194304] 0 2024-05-09T06:30:56.182 INFO:tasks.workunit.client.0.smithi046.stdout:2/954: creat da/dcb/dcc/dee/dcd/d7d/dc5/f132 x:0 0 0 2024-05-09T06:30:56.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/902: dread d0/dba/de7/d50/fae [0,4194304] 0 2024-05-09T06:30:56.184 INFO:tasks.workunit.client.0.smithi046.stdout:2/955: symlink da/de/d1c/db1/d115/d130/l133 0 2024-05-09T06:30:56.187 INFO:tasks.workunit.client.0.smithi046.stdout:2/956: creat da/dcb/dcc/dee/dcd/d7d/dc5/f134 x:0 0 0 2024-05-09T06:30:56.187 INFO:tasks.workunit.client.0.smithi046.stdout:2/957: fsync da/de/d14/fb8 0 2024-05-09T06:30:56.189 INFO:tasks.workunit.client.0.smithi046.stdout:9/845: dwrite d2/d26/d2c/f7a [0,4194304] 0 2024-05-09T06:30:56.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/846: symlink d2/d26/d2c/daf/l12c 0 2024-05-09T06:30:56.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/847: truncate d2/d6/d7/d1a/f59 220927 0 2024-05-09T06:30:56.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/958: dwrite da/de/f46 [0,4194304] 0 2024-05-09T06:30:56.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/959: chown da/dcb/df5 682246 1 2024-05-09T06:30:56.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/903: dwrite d0/d58/d7a/f8e [0,4194304] 0 2024-05-09T06:30:56.213 INFO:tasks.workunit.client.0.smithi046.stdout:9/848: dwrite d2/d26/fa1 [0,4194304] 0 2024-05-09T06:30:56.216 INFO:tasks.workunit.client.0.smithi046.stdout:9/849: dread d2/d26/d2c/f75 [0,4194304] 0 2024-05-09T06:30:56.216 INFO:tasks.workunit.client.0.smithi046.stdout:2/960: mkdir da/d2d/d43/d135 0 2024-05-09T06:30:56.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/904: creat d0/f147 x:0 0 0 2024-05-09T06:30:56.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/905: fdatasync d0/dba/de7/d50/fc5 0 2024-05-09T06:30:56.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/906: chown d0/d58/d7a/fa1 14225429 1 2024-05-09T06:30:56.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/907: creat d0/f148 x:0 0 0 2024-05-09T06:30:56.222 INFO:tasks.workunit.client.0.smithi046.stdout:9/850: dread d2/d6/d7/f1b [0,4194304] 0 2024-05-09T06:30:56.223 INFO:tasks.workunit.client.0.smithi046.stdout:2/961: creat da/dcb/dcc/dee/dcd/dd2/f136 x:0 0 0 2024-05-09T06:30:56.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/908: mkdir d0/dba/d149 0 2024-05-09T06:30:56.228 INFO:tasks.workunit.client.0.smithi046.stdout:5/909: symlink d0/dba/de7/l14a 0 2024-05-09T06:30:56.228 INFO:tasks.workunit.client.0.smithi046.stdout:5/910: chown d0/fa 36794 1 2024-05-09T06:30:56.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/851: write d2/d26/d76/dfb/fc0 [3268974,10531] 0 2024-05-09T06:30:56.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/962: dread da/de/d14/d1f/d20/f5a [0,4194304] 0 2024-05-09T06:30:56.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/852: unlink d2/d6/l14 0 2024-05-09T06:30:56.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/853: chown d2/d6/d7/d1a/d27/d65 176 1 2024-05-09T06:30:56.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/911: write d0/dba/de7/f10c [1466829,14940] 0 2024-05-09T06:30:56.237 INFO:tasks.workunit.client.0.smithi046.stdout:9/854: dread d2/d6/d7/d1e/f58 [0,4194304] 0 2024-05-09T06:30:56.237 INFO:tasks.workunit.client.0.smithi046.stdout:9/855: chown d2/d6/d7/d1a/f2e 53734 1 2024-05-09T06:30:56.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/963: rename da/f45 to da/dcb/dcc/dee/dcd/f137 0 2024-05-09T06:30:56.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/964: chown da/de/d14/d1f/d3b/da2 44 1 2024-05-09T06:30:56.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/912: symlink d0/db3/dc0/d11f/l14b 0 2024-05-09T06:30:56.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/913: chown d0/d1b/d39/d8a/f108 43 1 2024-05-09T06:30:56.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/914: write d0/d58/d7a/fbc [1007242,13288] 0 2024-05-09T06:30:56.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/965: mkdir da/de/d14/d1f/d3b/d138 0 2024-05-09T06:30:56.244 INFO:tasks.workunit.client.0.smithi046.stdout:5/915: symlink d0/dba/de7/d53/l14c 0 2024-05-09T06:30:56.246 INFO:tasks.workunit.client.0.smithi046.stdout:2/966: rename da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d6c/cea to da/d2d/d43/dc2/dec/d12d/c139 0 2024-05-09T06:30:56.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/916: rename d0/d1b/d21/d81/d115/l137 to d0/d1b/l14d 0 2024-05-09T06:30:56.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/967: rename da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d6c/cb0 to da/dcb/dcc/c13a 0 2024-05-09T06:30:56.251 INFO:tasks.workunit.client.0.smithi046.stdout:5/917: rename d0/d1b/d21/f79 to d0/d1b/d21/d81/f14e 0 2024-05-09T06:30:56.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/856: dwrite d2/fc4 [0,4194304] 0 2024-05-09T06:30:56.263 INFO:tasks.workunit.client.0.smithi046.stdout:9/857: write d2/d26/d76/dfb/fba [1642401,850] 0 2024-05-09T06:30:56.265 INFO:tasks.workunit.client.0.smithi046.stdout:9/858: getdents d2/d6/d7/d1a/d86/ddf 0 2024-05-09T06:30:56.265 INFO:tasks.workunit.client.0.smithi046.stdout:9/859: fsync d2/d26/dab/ffa 0 2024-05-09T06:30:56.268 INFO:tasks.workunit.client.0.smithi046.stdout:5/918: dwrite d0/d58/d7a/f7b [0,4194304] 0 2024-05-09T06:30:56.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/968: dwrite da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/dbc/f101 [0,4194304] 0 2024-05-09T06:30:56.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/969: unlink da/de/d14/d1f/d3b/ldc 0 2024-05-09T06:30:56.282 INFO:tasks.workunit.client.0.smithi046.stdout:5/919: mknod d0/db3/deb/dfc/c14f 0 2024-05-09T06:30:56.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/920: dread d0/d58/d7a/f86 [0,4194304] 0 2024-05-09T06:30:56.292 INFO:tasks.workunit.client.0.smithi046.stdout:5/921: write d0/dba/de7/d50/fa8 [2639122,91792] 0 2024-05-09T06:30:56.293 INFO:tasks.workunit.client.0.smithi046.stdout:5/922: truncate d0/dba/de7/dfb/f10a 296286 0 2024-05-09T06:30:56.294 INFO:tasks.workunit.client.0.smithi046.stdout:5/923: mknod d0/db3/dc0/c150 0 2024-05-09T06:30:56.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/924: dwrite d0/d1b/f20 [0,4194304] 0 2024-05-09T06:30:56.318 INFO:tasks.workunit.client.0.smithi046.stdout:5/925: link d0/d1b/d39/c66 d0/d58/d119/c151 0 2024-05-09T06:30:56.321 INFO:tasks.workunit.client.0.smithi046.stdout:5/926: symlink d0/d1b/d21/d81/l152 0 2024-05-09T06:30:56.321 INFO:tasks.workunit.client.0.smithi046.stdout:5/927: write d0/f2d [3141236,3669] 0 2024-05-09T06:30:56.321 INFO:tasks.workunit.client.0.smithi046.stdout:5/928: dread - d0/dad/fc3 zero size 2024-05-09T06:30:56.324 INFO:tasks.workunit.client.0.smithi046.stdout:5/929: truncate d0/dba/de7/d53/f59 2546336 0 2024-05-09T06:30:56.326 INFO:tasks.workunit.client.0.smithi046.stdout:5/930: symlink d0/l153 0 2024-05-09T06:30:56.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/931: dwrite d0/db3/dc0/f122 [0,4194304] 0 2024-05-09T06:30:56.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/932: stat d0/dba/de7/l46 0 2024-05-09T06:30:56.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/933: chown d0/d1b/d21/d81/f136 2 1 2024-05-09T06:30:56.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/934: write d0/d58/faf [877524,119540] 0 2024-05-09T06:30:56.351 INFO:tasks.workunit.client.0.smithi046.stdout:5/935: rmdir d0/dba/de7/d50 39 2024-05-09T06:30:56.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/936: getdents d0/dad/d127/d12f 0 2024-05-09T06:30:56.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/937: creat d0/d1b/d39/d8b/f154 x:0 0 0 2024-05-09T06:30:56.360 INFO:tasks.workunit.client.0.smithi046.stdout:5/938: read d0/dba/de7/fb5 [2122508,36639] 0 2024-05-09T06:30:56.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/939: dwrite d0/d1b/d39/dcf/f105 [0,4194304] 0 2024-05-09T06:30:56.377 INFO:tasks.workunit.client.0.smithi046.stdout:5/940: creat d0/db3/dc0/d10e/f155 x:0 0 0 2024-05-09T06:30:56.380 INFO:tasks.workunit.client.0.smithi046.stdout:5/941: rename d0/fa to d0/d1b/d39/dcf/f156 0 2024-05-09T06:30:56.380 INFO:tasks.workunit.client.0.smithi046.stdout:5/942: creat d0/f157 x:0 0 0 2024-05-09T06:30:56.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/943: dwrite d0/dba/de7/d53/f59 [0,4194304] 0 2024-05-09T06:30:56.397 INFO:tasks.workunit.client.0.smithi046.stdout:5/944: mknod d0/dba/de7/c158 0 2024-05-09T06:30:56.397 INFO:tasks.workunit.client.0.smithi046.stdout:5/945: chown d0/db3/ldd 8540 1 2024-05-09T06:30:56.399 INFO:tasks.workunit.client.0.smithi046.stdout:5/946: rename d0/d58/l133 to d0/dba/de7/d83/l159 0 2024-05-09T06:30:56.399 INFO:tasks.workunit.client.0.smithi046.stdout:5/947: dread - d0/dba/f11a zero size 2024-05-09T06:30:56.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/948: creat d0/dad/d127/d12f/f15a x:0 0 0 2024-05-09T06:30:56.401 INFO:tasks.workunit.client.0.smithi046.stdout:5/949: readlink d0/le 0 2024-05-09T06:30:56.401 INFO:tasks.workunit.client.0.smithi046.stdout:5/950: readlink d0/d1b/d21/d81/lb8 0 2024-05-09T06:30:56.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/951: dread d0/dba/de7/d83/f90 [0,4194304] 0 2024-05-09T06:30:56.417 INFO:tasks.workunit.client.0.smithi046.stdout:5/952: dread d0/dba/de7/d50/fa8 [0,4194304] 0 2024-05-09T06:30:56.418 INFO:tasks.workunit.client.0.smithi046.stdout:5/953: symlink d0/d58/d119/d138/l15b 0 2024-05-09T06:30:56.418 INFO:tasks.workunit.client.0.smithi046.stdout:5/954: chown d0/db3/deb/dfc/d13a/l126 28564 1 2024-05-09T06:30:56.418 INFO:tasks.workunit.client.0.smithi046.stdout:5/955: chown d0/db3/deb/lf8 177950 1 2024-05-09T06:30:56.423 INFO:tasks.workunit.client.0.smithi046.stdout:5/956: dread d0/dad/ff1 [0,4194304] 0 2024-05-09T06:30:56.423 INFO:tasks.workunit.client.0.smithi046.stdout:5/957: creat d0/f15c x:0 0 0 2024-05-09T06:30:56.440 INFO:tasks.workunit.client.0.smithi046.stdout:5/958: dwrite d0/d1b/d39/d8b/fb7 [0,4194304] 0 2024-05-09T06:30:56.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/959: stat d0/db3/deb/dfc/l123 0 2024-05-09T06:30:56.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/960: mknod d0/c15d 0 2024-05-09T06:30:56.443 INFO:tasks.workunit.client.0.smithi046.stdout:5/961: symlink d0/dba/l15e 0 2024-05-09T06:30:56.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/962: truncate d0/dba/de7/d53/f6f 4440199 0 2024-05-09T06:30:56.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/963: dread d0/d1b/d39/f47 [0,4194304] 0 2024-05-09T06:30:56.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/964: symlink d0/db3/dc0/d11f/l15f 0 2024-05-09T06:30:56.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/965: rename d0/f157 to d0/dba/de7/dc7/f160 0 2024-05-09T06:30:56.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/966: creat d0/db3/deb/dfc/f161 x:0 0 0 2024-05-09T06:30:56.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/967: mkdir d0/d1b/d39/d162 0 2024-05-09T06:30:56.458 INFO:tasks.workunit.client.0.smithi046.stdout:5/968: rename d0/d1b/d21/f5d to d0/dad/d127/f163 0 2024-05-09T06:30:56.458 INFO:tasks.workunit.client.0.smithi046.stdout:5/969: chown d0/dad/d127 116154 1 2024-05-09T06:30:56.459 INFO:tasks.workunit.client.0.smithi046.stdout:5/970: link d0/d1b/d39/d8a/c8d d0/db3/dc0/d11f/c164 0 2024-05-09T06:30:56.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/971: truncate d0/d1b/d39/f3c 4211966 0 2024-05-09T06:30:56.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/972: rmdir d0/dba/de7/dc7 39 2024-05-09T06:30:56.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/973: readlink d0/d1b/l49 0 2024-05-09T06:30:56.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/974: truncate d0/d1b/d39/dcf/fd1 791136 0 2024-05-09T06:30:56.479 INFO:tasks.workunit.client.0.smithi046.stdout:5/975: truncate d0/db3/dc0/f122 3526799 0 2024-05-09T06:30:56.479 INFO:tasks.workunit.client.0.smithi046.stdout:5/976: chown d0/dba/de7/d53/c103 71838 1 2024-05-09T06:30:56.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/977: write d0/d1b/f3d [989263,11544] 0 2024-05-09T06:30:56.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/978: unlink d0/d1b/d21/d81/l106 0 2024-05-09T06:30:56.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/979: symlink d0/dba/de7/d83/l165 0 2024-05-09T06:30:56.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/980: dread - d0/d58/fa9 zero size 2024-05-09T06:30:56.512 INFO:tasks.workunit.client.0.smithi046.stdout:5/981: dread d0/d1b/d21/d81/fa4 [0,4194304] 0 2024-05-09T06:30:56.512 INFO:tasks.workunit.client.0.smithi046.stdout:5/982: stat d0/d1b/d21/d81/f14e 0 2024-05-09T06:30:56.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/951: sync 2024-05-09T06:30:56.635 INFO:tasks.workunit.client.0.smithi046.stdout:4/952: chown d7/df/d3a/d45/d96/l3e 252001 1 2024-05-09T06:30:56.642 INFO:tasks.workunit.client.0.smithi046.stdout:4/953: dread d7/fd9 [0,4194304] 0 2024-05-09T06:30:56.652 INFO:tasks.workunit.client.0.smithi046.stdout:4/954: dread d7/df/f1b [4194304,4194304] 0 2024-05-09T06:30:56.652 INFO:tasks.workunit.client.0.smithi046.stdout:4/955: stat d7/df/d53/caa 0 2024-05-09T06:30:56.664 INFO:tasks.workunit.client.0.smithi046.stdout:4/956: dwrite d7/df/d3a/d25/d81/d98/db7/f115 [0,4194304] 0 2024-05-09T06:30:56.667 INFO:tasks.workunit.client.0.smithi046.stdout:4/957: symlink d7/df/d53/d91/dc8/l134 0 2024-05-09T06:30:56.667 INFO:tasks.workunit.client.0.smithi046.stdout:4/958: stat d7/df/d10/d2f/cc5 0 2024-05-09T06:30:56.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/959: link d7/dd8/df7/d110/f103 d7/dd8/df7/d110/f135 0 2024-05-09T06:30:56.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/960: write d7/df/d10/d2f/fdb [1038186,75095] 0 2024-05-09T06:30:56.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/961: link d7/df/d3a/d25/f70 d7/df/d3a/d45/d96/db3/dd5/f136 0 2024-05-09T06:30:56.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/962: creat d7/df/d10/f137 x:0 0 0 2024-05-09T06:30:56.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/963: link d7/df/d3a/d45/d96/db3/l108 d7/df/d3a/d45/d96/db3/l138 0 2024-05-09T06:30:56.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/964: rmdir d7/df/d3a/d25/d86/de1 39 2024-05-09T06:30:56.683 INFO:tasks.workunit.client.0.smithi046.stdout:4/965: write d7/f9 [4656493,12952] 0 2024-05-09T06:30:56.689 INFO:tasks.workunit.client.0.smithi046.stdout:4/966: dread d7/df/d10/f122 [4194304,4194304] 0 2024-05-09T06:30:56.697 INFO:tasks.workunit.client.0.smithi046.stdout:4/967: dread d7/df/d10/d2f/f89 [0,4194304] 0 2024-05-09T06:30:56.701 INFO:tasks.workunit.client.0.smithi046.stdout:4/968: dread d7/df/d10/d2f/fdb [0,4194304] 0 2024-05-09T06:30:56.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/969: creat d7/df/d53/d91/dc3/f139 x:0 0 0 2024-05-09T06:30:56.703 INFO:tasks.workunit.client.0.smithi046.stdout:4/970: creat d7/df/d3a/d45/d96/db3/f13a x:0 0 0 2024-05-09T06:30:56.705 INFO:tasks.workunit.client.0.smithi046.stdout:4/971: symlink d7/df/d3a/d45/d96/l13b 0 2024-05-09T06:30:56.921 INFO:tasks.workunit.client.0.smithi046.stdout:5/983: sync 2024-05-09T06:30:56.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/970: sync 2024-05-09T06:30:56.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/860: sync 2024-05-09T06:30:56.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/971: dread - da/dcb/dcc/dee/fda zero size 2024-05-09T06:30:56.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/972: dread - da/dcb/dcc/dee/dcd/dd2/f136 zero size 2024-05-09T06:30:56.922 INFO:tasks.workunit.client.0.smithi046.stdout:5/984: mknod d0/dba/de7/dfb/c166 0 2024-05-09T06:30:56.922 INFO:tasks.workunit.client.0.smithi046.stdout:5/985: write d0/f14 [1457668,24067] 0 2024-05-09T06:30:56.927 INFO:tasks.workunit.client.0.smithi046.stdout:5/986: rename d0/d1b/d21/led to d0/d1b/d39/d8a/l167 0 2024-05-09T06:30:56.928 INFO:tasks.workunit.client.0.smithi046.stdout:9/861: write d2/d26/f68 [3942865,13037] 0 2024-05-09T06:30:56.928 INFO:tasks.workunit.client.0.smithi046.stdout:9/862: fdatasync d2/f47 0 2024-05-09T06:30:56.929 INFO:tasks.workunit.client.0.smithi046.stdout:2/973: write da/de/d14/d1f/d20/d7c/ffb [2763290,48595] 0 2024-05-09T06:30:56.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/863: symlink d2/d26/d2c/daf/ded/l12d 0 2024-05-09T06:30:56.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/864: write d2/d6/d38/de6/fea [657456,43348] 0 2024-05-09T06:30:56.935 INFO:tasks.workunit.client.0.smithi046.stdout:2/974: truncate da/dcb/dcc/dee/dcd/d7d/dc5/d3d/faf 3115264 0 2024-05-09T06:30:56.935 INFO:tasks.workunit.client.0.smithi046.stdout:2/975: readlink da/de/d14/l36 0 2024-05-09T06:30:56.936 INFO:tasks.workunit.client.0.smithi046.stdout:2/976: chown da/dcb/dcc/dee/dcd/d7d/dc5/f72 1155773793 1 2024-05-09T06:30:56.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/977: rename da/dcb/dcc/dee/dcd/d7d/dc5/d3a to da/de/d14/d1f/d20/d13b 0 2024-05-09T06:30:56.944 INFO:tasks.workunit.client.0.smithi046.stdout:2/978: rmdir da/dcb/dcc/dee/dcd/d7d/dfc 39 2024-05-09T06:30:56.954 INFO:tasks.workunit.client.0.smithi046.stdout:5/987: dwrite d0/d1b/d21/f84 [0,4194304] 0 2024-05-09T06:30:56.954 INFO:tasks.workunit.client.0.smithi046.stdout:9/865: dwrite d2/d6/d7/f45 [4194304,4194304] 0 2024-05-09T06:30:56.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/979: dwrite da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d6c/fc0 [0,4194304] 0 2024-05-09T06:30:56.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/980: chown da/de/d14/d1f/d3b/d9f/ldf 28406833 1 2024-05-09T06:30:56.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/866: rmdir d2/d26/d76 39 2024-05-09T06:30:56.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/981: link da/dcb/dcc/dee/dcd/d7d/d6d/f8d da/dcb/f13c 0 2024-05-09T06:30:56.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/982: chown da/dc/f5b 13 1 2024-05-09T06:30:56.970 INFO:tasks.workunit.client.0.smithi046.stdout:9/867: dread f0 [4194304,4194304] 0 2024-05-09T06:30:56.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/868: link d2/d26/d76/dfb/l44 d2/d6/d7/d1a/d27/d56/l12e 0 2024-05-09T06:30:56.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/869: symlink d2/d26/d76/l12f 0 2024-05-09T06:30:56.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/870: symlink d2/d6/d7/d1a/d27/d56/df8/d106/l130 0 2024-05-09T06:30:56.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/871: unlink d2/d6/c16 0 2024-05-09T06:30:56.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/872: fdatasync d2/d26/f92 0 2024-05-09T06:30:56.978 INFO:tasks.workunit.client.0.smithi046.stdout:9/873: unlink d2/d26/cf4 0 2024-05-09T06:30:56.978 INFO:tasks.workunit.client.0.smithi046.stdout:9/874: creat d2/d6/d7/d1e/d115/f131 x:0 0 0 2024-05-09T06:30:56.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/875: unlink d2/d6/d7/f45 0 2024-05-09T06:30:56.988 INFO:tasks.workunit.client.0.smithi046.stdout:2/983: dwrite da/dcb/dcc/dee/dcd/d7d/dc5/f132 [0,4194304] 0 2024-05-09T06:30:56.988 INFO:tasks.workunit.client.0.smithi046.stdout:2/984: fdatasync da/de/d14/d1f/d20/d7c/d8b/d95/f129 0 2024-05-09T06:30:56.988 INFO:tasks.workunit.client.0.smithi046.stdout:2/985: write da/dcb/dcc/dee/dcd/d7d/dc5/d3d/faf [4030396,86479] 0 2024-05-09T06:30:56.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/876: dwrite d2/d6/d7/d1a/d86/ddf/fee [0,4194304] 0 2024-05-09T06:30:56.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/877: chown d2/d6/d7/d1a/d27/d2a/da5/fac 19 1 2024-05-09T06:30:57.008 INFO:tasks.workunit.client.0.smithi046.stdout:9/878: mknod d2/d6/d7/d1a/d27/d56/df8/d106/d10c/c132 0 2024-05-09T06:30:57.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/986: rename da/d2d/d43/dc2/dec to da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d13d 0 2024-05-09T06:30:57.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/987: write da/de/d14/d1f/d20/d7c/ffb [2537454,5256] 0 2024-05-09T06:30:57.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/988: dread f6 [4194304,4194304] 0 2024-05-09T06:30:57.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/989: chown da/dc/fe9 271125 1 2024-05-09T06:30:57.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/990: chown da/dcb/dcc/dee/dcd/d7d/d6d/f8d 19 1 2024-05-09T06:30:57.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/991: stat da/dcb/dcc/dee/dcd/dd2/c116 0 2024-05-09T06:30:57.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/992: dread da/de/d1c/fd3 [0,4194304] 0 2024-05-09T06:30:57.027 INFO:tasks.workunit.client.0.smithi046.stdout:9/879: symlink d2/d26/d2c/daf/ded/l133 0 2024-05-09T06:30:57.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/993: rename da/de/d14/d1f/d20/d5c/led to da/d2d/d43/d135/l13e 0 2024-05-09T06:30:57.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/994: chown da/de/d14/d1f/f113 18166174 1 2024-05-09T06:30:57.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/880: creat d2/d6/d7/d1a/d86/f134 x:0 0 0 2024-05-09T06:30:57.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/881: stat d2/d6/d7/d1a/d27/d56/df8/f12a 0 2024-05-09T06:30:57.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/882: write d2/d6/d38/de6/f127 [589853,127873] 0 2024-05-09T06:30:57.032 INFO:tasks.workunit.client.0.smithi046.stdout:2/995: mknod da/dcb/c13f 0 2024-05-09T06:30:57.034 INFO:tasks.workunit.client.0.smithi046.stdout:2/996: mkdir da/de/d140 0 2024-05-09T06:30:57.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/883: link d2/d26/dab/c11a d2/d6/d7/d1a/d27/d56/d125/c135 0 2024-05-09T06:30:57.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/884: link d2/d6/d33/f79 d2/d6/d7/d1a/d86/ddf/d111/f136 0 2024-05-09T06:30:57.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/885: chown f0 890741 1 2024-05-09T06:30:57.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/886: dread - d2/d6/d8b/f126 zero size 2024-05-09T06:30:57.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/887: dread - d2/d26/d76/dfb/f87 zero size 2024-05-09T06:30:57.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/888: write d2/d26/d76/fd9 [3439353,125725] 0 2024-05-09T06:30:57.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/889: write d2/d6/d8b/fb6 [4683678,28344] 0 2024-05-09T06:30:57.042 INFO:tasks.workunit.client.0.smithi046.stdout:9/890: rename d2/d6/d33/da8/cda to d2/d26/d2c/d114/c137 0 2024-05-09T06:30:57.042 INFO:tasks.workunit.client.0.smithi046.stdout:2/997: dread da/dcb/dcc/dee/dcd/d7d/dc5/d3d/faf [0,4194304] 0 2024-05-09T06:30:57.042 INFO:tasks.workunit.client.0.smithi046.stdout:2/998: write da/dcb/dcc/dee/dcd/d7d/dc5/d3d/d114/d65/d6c/f127 [946063,69671] 0 2024-05-09T06:30:57.043 INFO:tasks.workunit.client.0.smithi046.stdout:9/891: write d2/d6/d7/d1e/fb9 [1039662,120936] 0 2024-05-09T06:30:57.044 INFO:tasks.workunit.client.0.smithi046.stdout:9/892: fsync d2/dc/f41 0 2024-05-09T06:30:57.045 INFO:tasks.workunit.client.0.smithi046.stdout:2/999: rename da/dcb/c13f to da/dc/dd0/c141 0 2024-05-09T06:30:57.046 INFO:tasks.workunit.client.0.smithi046.stdout:9/893: stat d2/d6/d33/da8/cd8 0 2024-05-09T06:30:57.048 INFO:tasks.workunit.client.0.smithi046.stdout:9/894: mkdir d2/d26/d76/dfb/d138 0 2024-05-09T06:30:57.056 INFO:tasks.workunit.client.0.smithi046.stdout:4/972: sync 2024-05-09T06:30:57.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/973: write d7/df/d10/d2f/fce [1158833,68763] 0 2024-05-09T06:30:57.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/974: truncate d7/df/d3a/d25/da5/f124 771227 0 2024-05-09T06:30:57.080 INFO:tasks.workunit.client.0.smithi046.stdout:4/975: dwrite d7/df/d10/d1d/f8e [4194304,4194304] 0 2024-05-09T06:30:57.083 INFO:tasks.workunit.client.0.smithi046.stdout:4/976: mkdir d7/df/d3a/d25/d81/d13c 0 2024-05-09T06:30:57.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/977: dwrite d7/df/d53/d91/f132 [0,4194304] 0 2024-05-09T06:30:57.106 INFO:tasks.workunit.client.0.smithi046.stdout:4/978: write d7/df/d10/d1d/f118 [157018,62260] 0 2024-05-09T06:30:57.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/979: rename d7/df/cc7 to d7/df/d3a/c13d 0 2024-05-09T06:30:57.117 INFO:tasks.workunit.client.0.smithi046.stdout:4/980: dread d7/df/d10/d2f/fce [0,4194304] 0 2024-05-09T06:30:57.118 INFO:tasks.workunit.client.0.smithi046.stdout:4/981: dread d7/df/d3a/d45/d96/db3/dd5/f136 [0,4194304] 0 2024-05-09T06:30:57.124 INFO:tasks.workunit.client.0.smithi046.stdout:4/982: rename d7/df/d53/d91/dc8 to d7/daf/d13e 0 2024-05-09T06:30:57.130 INFO:tasks.workunit.client.0.smithi046.stdout:4/983: read d7/df/d3a/d116/fec [1926042,105186] 0 2024-05-09T06:30:57.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/984: unlink d7/df/d53/d91/lb2 0 2024-05-09T06:30:57.138 INFO:tasks.workunit.client.0.smithi046.stdout:4/985: mknod d7/df/d3a/d25/d81/d98/db7/c13f 0 2024-05-09T06:30:57.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/986: truncate d7/f15 2439483 0 2024-05-09T06:30:57.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/987: fdatasync d7/df/d3a/d116/fec 0 2024-05-09T06:30:57.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/988: creat d7/dd8/df7/f140 x:0 0 0 2024-05-09T06:30:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/989: dwrite d7/df/d3a/d25/f54 [0,4194304] 0 2024-05-09T06:30:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/990: chown d7/df/d3a/d25/df6/f105 53904752 1 2024-05-09T06:30:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/991: chown d7/df/d3a/d25/da5/cbb 609 1 2024-05-09T06:30:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/992: chown d7/df/d3a/d25/df6/f105 0 1 2024-05-09T06:30:57.166 INFO:tasks.workunit.client.0.smithi046.stdout:4/993: creat d7/daf/d13e/f141 x:0 0 0 2024-05-09T06:30:57.166 INFO:tasks.workunit.client.0.smithi046.stdout:4/994: creat d7/df/d10/d1d/d77/d87/dac/f142 x:0 0 0 2024-05-09T06:30:57.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/995: dwrite d7/df/d3a/d25/d86/de1/ff4 [0,4194304] 0 2024-05-09T06:30:57.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/996: symlink d7/df/d3a/d45/l143 0 2024-05-09T06:30:57.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/997: truncate d7/dd8/df7/f140 335171 0 2024-05-09T06:30:57.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/998: fdatasync d7/df/d3a/d45/d96/f67 0 2024-05-09T06:30:57.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/999: rmdir d7/df/d10/d1d/d77/d87/dbe/dff 0 2024-05-09T06:30:57.299 INFO:tasks.workunit.client.0.smithi046.stdout:9/895: sync 2024-05-09T06:30:57.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/988: sync 2024-05-09T06:30:57.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/896: rename d2/dc/d32/d70 to d2/d139 0 2024-05-09T06:30:57.316 INFO:tasks.workunit.client.0.smithi046.stdout:9/897: mknod d2/d139/c13a 0 2024-05-09T06:30:57.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/898: mknod d2/d6/c13b 0 2024-05-09T06:30:57.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/899: chown d2/d20/l7f 13917 1 2024-05-09T06:30:57.319 INFO:tasks.workunit.client.0.smithi046.stdout:5/989: dwrite d0/d1b/d39/d8a/f108 [0,4194304] 0 2024-05-09T06:30:57.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/900: mkdir d2/d26/d2c/daf/d13c 0 2024-05-09T06:30:57.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:57 smithi106 ceph-mon[34679]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 113 MiB/s rd, 130 MiB/s wr, 247 op/s 2024-05-09T06:30:57.327 INFO:tasks.workunit.client.0.smithi046.stdout:9/901: mknod d2/d6/d7/d1a/d27/d56/df8/d106/d10c/c13d 0 2024-05-09T06:30:57.330 INFO:tasks.workunit.client.0.smithi046.stdout:9/902: mkdir d2/dc/d13e 0 2024-05-09T06:30:57.334 INFO:tasks.workunit.client.0.smithi046.stdout:5/990: dwrite d0/db3/fde [0,4194304] 0 2024-05-09T06:30:57.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:57 smithi046 ceph-mon[26924]: pgmap v35: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 113 MiB/s rd, 130 MiB/s wr, 247 op/s 2024-05-09T06:30:57.344 INFO:tasks.workunit.client.0.smithi046.stdout:9/903: dwrite d2/d26/d76/dfb/f87 [0,4194304] 0 2024-05-09T06:30:57.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/991: dwrite d0/d58/d7a/f125 [0,4194304] 0 2024-05-09T06:30:57.352 INFO:tasks.workunit.client.0.smithi046.stdout:9/904: dread d2/d26/d76/dfb/fdd [0,4194304] 0 2024-05-09T06:30:57.354 INFO:tasks.workunit.client.0.smithi046.stdout:9/905: dread d2/d6/d38/de6/f127 [0,4194304] 0 2024-05-09T06:30:57.354 INFO:tasks.workunit.client.0.smithi046.stdout:9/906: fsync d2/dc/ff5 0 2024-05-09T06:30:57.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/992: getdents d0/d1b/d39 0 2024-05-09T06:30:57.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/993: creat d0/d58/f168 x:0 0 0 2024-05-09T06:30:57.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/994: chown d0/dba/de7/d50/c51 97 1 2024-05-09T06:30:57.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/995: chown d0/dba/de7/d83/l117 92116 1 2024-05-09T06:30:57.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/996: write d0/d58/d7a/fa7 [602954,45027] 0 2024-05-09T06:30:57.364 INFO:tasks.workunit.client.0.smithi046.stdout:5/997: creat d0/dba/de7/d50/d107/f169 x:0 0 0 2024-05-09T06:30:57.364 INFO:tasks.workunit.client.0.smithi046.stdout:5/998: stat d0/dba/de7/d50/fe0 0 2024-05-09T06:30:57.365 INFO:tasks.workunit.client.0.smithi046.stdout:5/999: mkdir d0/d58/d119/d138/d16a 0 2024-05-09T06:30:57.366 INFO:tasks.workunit.client.0.smithi046.stdout:9/907: dwrite d2/d26/d76/dfb/f87 [0,4194304] 0 2024-05-09T06:30:57.368 INFO:tasks.workunit.client.0.smithi046.stdout:9/908: rmdir d2/d6/d33/da8 39 2024-05-09T06:30:57.377 INFO:tasks.workunit.client.0.smithi046.stdout:9/909: dread d2/d26/d2c/f7a [0,4194304] 0 2024-05-09T06:30:57.377 INFO:tasks.workunit.client.0.smithi046.stdout:9/910: write d2/d6/d8b/fa9 [1243421,65572] 0 2024-05-09T06:30:57.379 INFO:tasks.workunit.client.0.smithi046.stdout:9/911: unlink d2/d6/l83 0 2024-05-09T06:30:57.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/912: dread - d2/d6/d7/d1e/ff9 zero size 2024-05-09T06:30:57.383 INFO:tasks.workunit.client.0.smithi046.stdout:9/913: truncate d2/d6/d7/d1a/d27/d2a/f72 1070327 0 2024-05-09T06:30:57.400 INFO:tasks.workunit.client.0.smithi046.stdout:9/914: dwrite d2/d6/d7/d1e/d115/f124 [0,4194304] 0 2024-05-09T06:30:57.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/915: symlink d2/d26/d2c/daf/d13c/l13f 0 2024-05-09T06:30:57.425 INFO:tasks.workunit.client.0.smithi046.stdout:9/916: write d2/d6/d7/d1a/d27/d2a/f72 [292143,120337] 0 2024-05-09T06:30:57.427 INFO:tasks.workunit.client.0.smithi046.stdout:9/917: link d2/d6/d7/d1a/d27/c6b d2/d26/d2c/d114/c140 0 2024-05-09T06:30:57.437 INFO:tasks.workunit.client.0.smithi046.stdout:9/918: write d2/f47 [344666,129423] 0 2024-05-09T06:30:57.725 INFO:tasks.workunit.client.0.smithi046.stdout:9/919: sync 2024-05-09T06:30:58.044 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T06:30:58.044 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-09T06:30:58.098 INFO:tasks.workunit.client.0.smithi046.stdout:9/920: sync 2024-05-09T06:30:58.099 INFO:tasks.workunit.client.0.smithi046.stdout:9/921: write d2/d26/d76/f8f [553666,14549] 0 2024-05-09T06:30:58.105 INFO:tasks.workunit.client.0.smithi046.stdout:9/922: write d2/d26/d2c/f121 [3004609,84500] 0 2024-05-09T06:30:58.107 INFO:tasks.workunit.client.0.smithi046.stdout:9/923: creat d2/d6/f141 x:0 0 0 2024-05-09T06:30:58.111 INFO:tasks.workunit.client.0.smithi046.stdout:9/924: dread d2/dc/f41 [0,4194304] 0 2024-05-09T06:30:58.111 INFO:tasks.workunit.client.0.smithi046.stdout:9/925: read - d2/d6/fdc zero size 2024-05-09T06:30:58.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/926: creat d2/d6/d7/d1a/d27/d2a/f142 x:0 0 0 2024-05-09T06:30:58.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/927: write d2/d6/d7/d1a/d86/ddf/f105 [359507,123600] 0 2024-05-09T06:30:58.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/928: creat d2/d6/f143 x:0 0 0 2024-05-09T06:30:58.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/929: symlink d2/d26/d2c/l144 0 2024-05-09T06:30:58.118 INFO:tasks.workunit.client.0.smithi046.stdout:9/930: rename d2/d6/d7/d1a/d27/d56/df8/d106 to d2/d6/d7/d1a/d27/d65/d145 0 2024-05-09T06:30:58.118 INFO:tasks.workunit.client.0.smithi046.stdout:9/931: creat d2/d6/d7/d1e/d115/f146 x:0 0 0 2024-05-09T06:30:58.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/932: fdatasync d2/d6/d7/d1a/d86/f67 0 2024-05-09T06:30:58.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/933: chown d2/d26/d76/dfb 0 1 2024-05-09T06:30:58.120 INFO:tasks.workunit.client.0.smithi046.stdout:9/934: truncate d2/d6/d7/d1e/fa7 717473 0 2024-05-09T06:30:58.120 INFO:tasks.workunit.client.0.smithi046.stdout:9/935: write d2/d6/d7/d1a/d27/fc2 [4586977,75540] 0 2024-05-09T06:30:58.124 INFO:tasks.workunit.client.0.smithi046.stdout:9/936: rename d2/d26/d2c/daf/d13c/l13f to d2/d6/d7/l147 0 2024-05-09T06:30:58.126 INFO:tasks.workunit.client.0.smithi046.stdout:9/937: truncate d2/d6/d38/f48 4671944 0 2024-05-09T06:30:58.126 INFO:tasks.workunit.client.0.smithi046.stdout:9/938: dread - d2/d6/d8b/ff2 zero size 2024-05-09T06:30:58.127 INFO:tasks.workunit.client.0.smithi046.stdout:9/939: mkdir d2/d6/d7/d1a/d27/d65/dd1/d10f/d148 0 2024-05-09T06:30:58.127 INFO:tasks.workunit.client.0.smithi046.stdout:9/940: write d2/d26/d2c/f11b [663611,64532] 0 2024-05-09T06:30:58.147 INFO:tasks.workunit.client.0.smithi046.stdout:9/941: dwrite d2/d26/d76/dfb/fba [4194304,4194304] 0 2024-05-09T06:30:58.149 INFO:tasks.workunit.client.0.smithi046.stdout:9/942: symlink d2/d6/d7/d1e/d115/d129/l149 0 2024-05-09T06:30:58.151 INFO:tasks.workunit.client.0.smithi046.stdout:9/943: link d2/d6/d38/de6/f11f d2/d6/d7/d1a/d27/d56/df8/f14a 0 2024-05-09T06:30:58.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/944: truncate d2/d26/d76/dfb/f87 3278127 0 2024-05-09T06:30:58.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/945: chown d2/dc/f11 3525816 1 2024-05-09T06:30:58.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/946: write f0 [6562206,83638] 0 2024-05-09T06:30:58.155 INFO:tasks.workunit.client.0.smithi046.stdout:9/947: write d2/d6/d7/d1e/fd2 [673699,10742] 0 2024-05-09T06:30:58.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/948: link d2/lc6 d2/d26/d76/dfb/l14b 0 2024-05-09T06:30:58.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/949: creat d2/d6/d7/d1a/d86/ddf/d111/f14c x:0 0 0 2024-05-09T06:30:58.160 INFO:tasks.workunit.client.0.smithi046.stdout:9/950: dread d2/d6/d38/de6/f127 [0,4194304] 0 2024-05-09T06:30:58.168 INFO:tasks.workunit.client.0.smithi046.stdout:9/951: dread d2/fb0 [0,4194304] 0 2024-05-09T06:30:58.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/952: rename d2/d6/d7/d1a/d27/d56/l12e to d2/d26/l14d 0 2024-05-09T06:30:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/953: dwrite d2/dc/f89 [4194304,4194304] 0 2024-05-09T06:30:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/954: creat d2/d20/f14e x:0 0 0 2024-05-09T06:30:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/955: read d2/d6/dbb/fd5 [1098760,79925] 0 2024-05-09T06:30:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/956: chown d2/d6/d7/d1a/d27/d65/d145/l130 15339 1 2024-05-09T06:30:58.206 INFO:tasks.workunit.client.0.smithi046.stdout:9/957: dwrite d2/d26/d76/dfb/fba [0,4194304] 0 2024-05-09T06:30:58.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/958: truncate d2/d6/d7/ff 3256214 0 2024-05-09T06:30:58.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/959: chown d2/d6/d7/d1a/d27/d56/df8/f14a 152339 1 2024-05-09T06:30:58.217 INFO:tasks.workunit.client.0.smithi046.stdout:9/960: dread d2/d6/d33/f52 [0,4194304] 0 2024-05-09T06:30:58.219 INFO:tasks.workunit.client.0.smithi046.stdout:9/961: symlink d2/d6/d7/d1a/d86/ddf/l14f 0 2024-05-09T06:30:58.221 INFO:tasks.workunit.client.0.smithi046.stdout:9/962: rename d2/d6/d7/d1a/d27/f88 to d2/d6/d7/d1a/d86/ddf/d111/f150 0 2024-05-09T06:30:58.221 INFO:tasks.workunit.client.0.smithi046.stdout:9/963: stat d2/d6/d7/d1a/d27 0 2024-05-09T06:30:58.225 INFO:tasks.workunit.client.0.smithi046.stdout:9/964: rmdir d2/d26/d2c/daf/d13c 0 2024-05-09T06:30:58.225 INFO:tasks.workunit.client.0.smithi046.stdout:9/965: dread - d2/dc/d32/ff1 zero size 2024-05-09T06:30:58.226 INFO:tasks.workunit.client.0.smithi046.stdout:9/966: stat d2/d6/d7/d1a/d27/d56/ce5 0 2024-05-09T06:30:58.226 INFO:tasks.workunit.client.0.smithi046.stdout:9/967: chown d2/d6/d33/da8/cd8 150960 1 2024-05-09T06:30:58.228 INFO:tasks.workunit.client.0.smithi046.stdout:9/968: link d2/d26/f73 d2/d6/d7/d1a/d27/d65/dd1/d10f/f151 0 2024-05-09T06:30:58.228 INFO:tasks.workunit.client.0.smithi046.stdout:9/969: chown d2/d6/d38/de6/fea 3 1 2024-05-09T06:30:58.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/970: mknod d2/dc/d32/c152 0 2024-05-09T06:30:58.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/971: stat d2/d6/d8b/la0 0 2024-05-09T06:30:58.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/972: dwrite d2/d6/d38/de6/fea [0,4194304] 0 2024-05-09T06:30:58.258 INFO:tasks.workunit.client.0.smithi046.stdout:9/973: getdents d2/d26/dab 0 2024-05-09T06:30:58.260 INFO:tasks.workunit.client.0.smithi046.stdout:9/974: rename d2/d6/d8b/lb5 to d2/d139/l153 0 2024-05-09T06:30:58.261 INFO:tasks.workunit.client.0.smithi046.stdout:9/975: creat d2/f154 x:0 0 0 2024-05-09T06:30:58.261 INFO:tasks.workunit.client.0.smithi046.stdout:9/976: creat d2/d6/d7/d1a/d27/d2a/f155 x:0 0 0 2024-05-09T06:30:58.282 INFO:tasks.workunit.client.0.smithi046.stdout:9/977: dwrite d2/dc/d32/ff1 [0,4194304] 0 2024-05-09T06:30:58.297 INFO:tasks.workunit.client.0.smithi046.stdout:9/978: dwrite d2/d6/d7/d1a/d27/f98 [0,4194304] 0 2024-05-09T06:30:58.297 INFO:tasks.workunit.client.0.smithi046.stdout:9/979: truncate d2/d26/d2c/daf/fc8 72628 0 2024-05-09T06:30:58.298 INFO:tasks.workunit.client.0.smithi046.stdout:9/980: rename d2/d6/l9 to d2/d6/d7/d1e/d115/d129/l156 0 2024-05-09T06:30:58.298 INFO:tasks.workunit.client.0.smithi046.stdout:9/981: chown d2/d6/d8b/l10e 16724233 1 2024-05-09T06:30:58.298 INFO:tasks.workunit.client.0.smithi046.stdout:9/982: stat d2/d6/d7/d1a/d86/ddf/f105 0 2024-05-09T06:30:58.299 INFO:tasks.workunit.client.0.smithi046.stdout:9/983: write d2/d26/fa1 [4825340,9305] 0 2024-05-09T06:30:58.299 INFO:tasks.workunit.client.0.smithi046.stdout:9/984: write d2/d6/f141 [981860,107035] 0 2024-05-09T06:30:58.306 INFO:tasks.workunit.client.0.smithi046.stdout:9/985: dread d2/d6/d7/d1a/d86/ddf/fee [0,4194304] 0 2024-05-09T06:30:58.308 INFO:tasks.workunit.client.0.smithi046.stdout:9/986: link d2/d6/d8b/ff2 d2/d6/d7/d1a/d86/ddf/f157 0 2024-05-09T06:30:58.324 INFO:tasks.workunit.client.0.smithi046.stdout:9/987: dwrite d2/d6/d8b/fde [0,4194304] 0 2024-05-09T06:30:58.337 INFO:tasks.workunit.client.0.smithi046.stdout:9/988: write d2/d6/d7/d1e/d115/f124 [3530843,62606] 0 2024-05-09T06:30:58.337 INFO:tasks.workunit.client.0.smithi046.stdout:9/989: dread - d2/d26/d76/dfb/f10b zero size 2024-05-09T06:30:58.338 INFO:tasks.workunit.client.0.smithi046.stdout:9/990: write d2/dc/f41 [1393913,122641] 0 2024-05-09T06:30:58.354 INFO:tasks.workunit.client.0.smithi046.stdout:9/991: dwrite d2/d6/f141 [0,4194304] 0 2024-05-09T06:30:58.368 INFO:tasks.workunit.client.0.smithi046.stdout:9/992: dwrite d2/d6/d7/d1e/fa7 [0,4194304] 0 2024-05-09T06:30:58.376 INFO:tasks.workunit.client.0.smithi046.stdout:9/993: dread d2/d6/d8b/fb6 [0,4194304] 0 2024-05-09T06:30:58.377 INFO:tasks.workunit.client.0.smithi046.stdout:9/994: truncate d2/d6/d38/f48 2020728 0 2024-05-09T06:30:58.379 INFO:tasks.workunit.client.0.smithi046.stdout:9/995: rename d2/d20/l7f to d2/d6/d7/d1a/d27/d56/d125/l158 0 2024-05-09T06:30:58.388 INFO:tasks.workunit.client.0.smithi046.stdout:9/996: dread d2/d6/d7/fd [0,4194304] 0 2024-05-09T06:30:58.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/997: read d2/d6/d7/d1e/f78 [758182,32020] 0 2024-05-09T06:30:58.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/998: creat d2/d26/d76/f159 x:0 0 0 2024-05-09T06:30:58.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/999: creat d2/d26/d76/dfb/f15a x:0 0 0 2024-05-09T06:30:58.401 INFO:tasks.workunit.client.0.smithi046.stderr:+ rm -rf -- ./tmp.qblNkpa2pn 2024-05-09T06:30:59.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:30:59 smithi106 ceph-mon[34679]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 142 MiB/s rd, 158 MiB/s wr, 310 op/s 2024-05-09T06:30:59.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:30:59 smithi046 ceph-mon[26924]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 142 MiB/s rd, 158 MiB/s wr, 310 op/s 2024-05-09T06:31:01.294 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:01 smithi106 ceph-mon[34679]: pgmap v37: 65 pgs: 65 active+clean; 2.4 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 131 MiB/s rd, 146 MiB/s wr, 312 op/s 2024-05-09T06:31:01.294 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:01 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:01.294 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:01 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:01 smithi046 ceph-mon[26924]: pgmap v37: 65 pgs: 65 active+clean; 2.4 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 131 MiB/s rd, 146 MiB/s wr, 312 op/s 2024-05-09T06:31:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:01 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:01 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:02.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:02 smithi106 ceph-mon[34679]: Reconfiguring node-exporter.smithi106 (dependencies changed)... 2024-05-09T06:31:02.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:02 smithi106 ceph-mon[34679]: Reconfiguring daemon node-exporter.smithi106 on smithi106 2024-05-09T06:31:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:02 smithi046 ceph-mon[26924]: Reconfiguring node-exporter.smithi106 (dependencies changed)... 2024-05-09T06:31:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:02 smithi046 ceph-mon[26924]: Reconfiguring daemon node-exporter.smithi106 on smithi106 2024-05-09T06:31:03.122 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:03 smithi106 ceph-mon[34679]: pgmap v38: 65 pgs: 65 active+clean; 2.4 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 111 MiB/s wr, 234 op/s 2024-05-09T06:31:03.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:03 smithi046 ceph-mon[26924]: pgmap v38: 65 pgs: 65 active+clean; 2.4 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 111 MiB/s wr, 234 op/s 2024-05-09T06:31:04.369 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:04.626 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:04.626 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:31:04.626 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: Upgrade: Need to upgrade myself (mgr.smithi106.nlgnpx) 2024-05-09T06:31:04.627 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:04 smithi046 ceph-mon[26924]: Upgrade: Need to upgrade myself (mgr.smithi106.nlgnpx) 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: Upgrade: Need to upgrade myself (mgr.smithi106.nlgnpx) 2024-05-09T06:31:04.628 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:04 smithi106 ceph-mon[34679]: Upgrade: Need to upgrade myself (mgr.smithi106.nlgnpx) 2024-05-09T06:31:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:05 smithi106 ceph-mon[34679]: pgmap v39: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 104 MiB/s rd, 115 MiB/s wr, 345 op/s 2024-05-09T06:31:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:05 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:05 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:31:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:05 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:31:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:05 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:31:05.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:05 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:05.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:05 smithi046 ceph-mon[26924]: pgmap v39: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 104 MiB/s rd, 115 MiB/s wr, 345 op/s 2024-05-09T06:31:05.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:05 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:05.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:05 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:31:05.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:05 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:31:05.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:05 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:31:05.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:05 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:06.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:06 smithi106 ceph-mon[34679]: Upgrade: Updating mgr.smithi046.nvpcui 2024-05-09T06:31:06.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:06 smithi106 ceph-mon[34679]: Deploying daemon mgr.smithi046.nvpcui on smithi046 2024-05-09T06:31:06.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:06 smithi046 ceph-mon[26924]: Upgrade: Updating mgr.smithi046.nvpcui 2024-05-09T06:31:06.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:06 smithi046 ceph-mon[26924]: Deploying daemon mgr.smithi046.nvpcui on smithi046 2024-05-09T06:31:07.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:07 smithi106 ceph-mon[34679]: pgmap v40: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 47 MiB/s rd, 50 MiB/s wr, 228 op/s 2024-05-09T06:31:07.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:07 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:07.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:07 smithi046 ceph-mon[26924]: pgmap v40: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 47 MiB/s rd, 50 MiB/s wr, 228 op/s 2024-05-09T06:31:07.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:07 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 -- 172.21.15.46:0/1515491996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720066260 msgr2=0x7fb720101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 --2- 172.21.15.46:0/1515491996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720066260 0x7fb720101e00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb710004940 tx=0x7fb710009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 -- 172.21.15.46:0/1515491996 shutdown_connections 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 --2- 172.21.15.46:0/1515491996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb720102340 0x7fb720104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 --2- 172.21.15.46:0/1515491996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720066260 0x7fb720101e00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 -- 172.21.15.46:0/1515491996 >> 172.21.15.46:0/1515491996 conn(0x7fb7200f7430 msgr2=0x7fb7200f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 -- 172.21.15.46:0/1515491996 shutdown_connections 2024-05-09T06:31:08.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.597+0000 7fb724c86700 1 -- 172.21.15.46:0/1515491996 wait complete. 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb724c86700 1 Processor -- start 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb724c86700 1 -- start start 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb724c86700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb720066260 0x7fb72010f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb724c86700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 0x7fb72010fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb724c86700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201104e0 con 0x7fb720102340 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb724c86700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720110d30 con 0x7fb720066260 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb71e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 0x7fb72010fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb71e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 0x7fb72010fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46508/0 (socket says 172.21.15.46:46508) 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb71e59c700 1 -- 172.21.15.46:0/736800571 learned_addr learned my addr 172.21.15.46:0/736800571 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb71659c700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb720066260 0x7fb72010f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb71e59c700 1 -- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb720066260 msgr2=0x7fb72010f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.598+0000 7fb71e59c700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb720066260 0x7fb72010f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb71e59c700 1 -- 172.21.15.46:0/736800571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710005040 con 0x7fb720102340 2024-05-09T06:31:08.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb71e59c700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 0x7fb72010fee0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb708002a50 tx=0x7fb7080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb708007cc0 con 0x7fb720102340 2024-05-09T06:31:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720111010 con 0x7fb720102340 2024-05-09T06:31:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb70800f040 con 0x7fb720102340 2024-05-09T06:31:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70800da30 con 0x7fb720102340 2024-05-09T06:31:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.599+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720111550 con 0x7fb720102340 2024-05-09T06:31:08.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.600+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72005f5c0 con 0x7fb720102340 2024-05-09T06:31:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.601+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7fb70800db90 con 0x7fb720102340 2024-05-09T06:31:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.602+0000 7fb7177fe700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb70c070bb0 0x7fb70c073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.602+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb7080907f0 con 0x7fb720102340 2024-05-09T06:31:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.602+0000 7fb71659c700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb70c070bb0 0x7fb70c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:08.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.603+0000 7fb71659c700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb70c070bb0 0x7fb70c073060 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb710004890 tx=0x7fb710009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:08.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:08.607+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fb708058ba0 con 0x7fb720102340 2024-05-09T06:31:09.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.042+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7201118b0 con 0x7fb70c070bb0 2024-05-09T06:31:09.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.043+0000 7fb7177fe700 1 -- 172.21.15.46:0/736800571 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fb7201118b0 con 0x7fb70c070bb0 2024-05-09T06:31:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.045+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb70c070bb0 msgr2=0x7fb70c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb70c070bb0 0x7fb70c073060 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb710004890 tx=0x7fb710009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 msgr2=0x7fb72010fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 0x7fb72010fee0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb708002a50 tx=0x7fb7080046b0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 shutdown_connections 2024-05-09T06:31:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fb70c070bb0 0x7fb70c073060 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb720066260 0x7fb72010f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 --2- 172.21.15.46:0/736800571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb720102340 0x7fb72010fee0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 >> 172.21.15.46:0/736800571 conn(0x7fb7200f7430 msgr2=0x7fb7200f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:09.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 shutdown_connections 2024-05-09T06:31:09.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.046+0000 7fb724c86700 1 -- 172.21.15.46:0/736800571 wait complete. 2024-05-09T06:31:09.039 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:31:09.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 -- 172.21.15.46:0/100562907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 msgr2=0x7fda9c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/100562907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c0fd270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda8c004940 tx=0x7fda8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 -- 172.21.15.46:0/100562907 shutdown_connections 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/100562907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0fdfd0 0x7fda9c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/100562907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c0fd270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 -- 172.21.15.46:0/100562907 >> 172.21.15.46:0/100562907 conn(0x7fda9c0f8560 msgr2=0x7fda9c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.168+0000 7fdaa0f49700 1 -- 172.21.15.46:0/100562907 shutdown_connections 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 -- 172.21.15.46:0/100562907 wait complete. 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 Processor -- start 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 -- start start 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:09.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0fdfd0 0x7fda9c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0708f0 con 0x7fda9c0fce60 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fdaa0f49700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c070a60 con 0x7fda9c0fdfd0 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fda9a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fda9a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46526/0 (socket says 172.21.15.46:46526) 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.169+0000 7fda9a59c700 1 -- 172.21.15.46:0/356760720 learned_addr learned my addr 172.21.15.46:0/356760720 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda99d9b700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0fdfd0 0x7fda9c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda9a59c700 1 -- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0fdfd0 msgr2=0x7fda9c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda9a59c700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0fdfd0 0x7fda9c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda9a59c700 1 -- 172.21.15.46:0/356760720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c005040 con 0x7fda9c0fce60 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda9a59c700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c071de0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b3b0 tx=0x7fda8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8c00e040 con 0x7fda9c0fce60 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.170+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda8c004290 con 0x7fda9c0fce60 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.171+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8c01c3f0 con 0x7fda9c0fce60 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.171+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c070ce0 con 0x7fda9c0fce60 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.171+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c115a10 con 0x7fda9c0fce60 2024-05-09T06:31:09.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.172+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c05f5c0 con 0x7fda9c0fce60 2024-05-09T06:31:09.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.173+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7fda8c00bbf0 con 0x7fda9c0fce60 2024-05-09T06:31:09.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.173+0000 7fda8affd700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fda840709a0 0x7fda84072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:09.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.173+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fda8c0916b0 con 0x7fda9c0fce60 2024-05-09T06:31:09.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.174+0000 7fda99d9b700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fda840709a0 0x7fda84072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:09.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.174+0000 7fda99d9b700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fda840709a0 0x7fda84072e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda90009d30 tx=0x7fda900091a0 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:09.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.182+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fda8c059b90 con 0x7fda9c0fce60 2024-05-09T06:31:09.377 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:09 smithi046 ceph-mon[26924]: pgmap v41: 65 pgs: 65 active+clean; 1.5 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 47 MiB/s rd, 50 MiB/s wr, 327 op/s 2024-05-09T06:31:09.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.495+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda9c1022f0 con 0x7fda840709a0 2024-05-09T06:31:09.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.497+0000 7fda8affd700 1 -- 172.21.15.46:0/356760720 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fda9c1022f0 con 0x7fda840709a0 2024-05-09T06:31:09.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fda840709a0 msgr2=0x7fda84072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fda840709a0 0x7fda84072e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda90009d30 tx=0x7fda900091a0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 msgr2=0x7fda9c071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c071de0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b3b0 tx=0x7fda8c009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 shutdown_connections 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7fda840709a0 0x7fda84072e50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda9c0fce60 0x7fda9c071de0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 --2- 172.21.15.46:0/356760720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0fdfd0 0x7fda9c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 >> 172.21.15.46:0/356760720 conn(0x7fda9c0f8560 msgr2=0x7fda9c0f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 shutdown_connections 2024-05-09T06:31:09.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.500+0000 7fdaa0f49700 1 -- 172.21.15.46:0/356760720 wait complete. 2024-05-09T06:31:09.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:09 smithi106 ceph-mon[34679]: pgmap v41: 65 pgs: 65 active+clean; 1.5 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 47 MiB/s rd, 50 MiB/s wr, 327 op/s 2024-05-09T06:31:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.623+0000 7f930faa6700 1 -- 172.21.15.46:0/3597041218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308070830 msgr2=0x7f9308070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.623+0000 7f930faa6700 1 --2- 172.21.15.46:0/3597041218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308070830 0x7f9308070ca0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92f8004940 tx=0x7f92f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 -- 172.21.15.46:0/3597041218 shutdown_connections 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 --2- 172.21.15.46:0/3597041218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308070830 0x7f9308070ca0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 --2- 172.21.15.46:0/3597041218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308071de0 0x7f93080702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 -- 172.21.15.46:0/3597041218 >> 172.21.15.46:0/3597041218 conn(0x7f93080f85c0 msgr2=0x7f93080fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 -- 172.21.15.46:0/3597041218 shutdown_connections 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 -- 172.21.15.46:0/3597041218 wait complete. 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.624+0000 7f930faa6700 1 Processor -- start 2024-05-09T06:31:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930faa6700 1 -- start start 2024-05-09T06:31:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930faa6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308070830 0x7f930810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930faa6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 0x7f93081100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930faa6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93081106e0 con 0x7f9308071de0 2024-05-09T06:31:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930faa6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308110f30 con 0x7f9308070830 2024-05-09T06:31:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d041700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 0x7f93081100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d041700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 0x7f93081100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46542/0 (socket says 172.21.15.46:46542) 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d041700 1 -- 172.21.15.46:0/400435912 learned_addr learned my addr 172.21.15.46:0/400435912 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d842700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308070830 0x7f930810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d041700 1 -- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308070830 msgr2=0x7f930810fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d041700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308070830 0x7f930810fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d041700 1 -- 172.21.15.46:0/400435912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8005040 con 0x7f9308071de0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.625+0000 7f930d842700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308070830 0x7f930810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.626+0000 7f930d041700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 0x7f93081100e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92f80043d0 tx=0x7f92f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.626+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f8020070 con 0x7f9308071de0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.626+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93081111b0 con 0x7f9308071de0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.626+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92f8009430 con 0x7f9308071de0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.626+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f800e070 con 0x7f9308071de0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.626+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308111690 con 0x7f9308071de0 2024-05-09T06:31:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.627+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930805f5c0 con 0x7f9308071de0 2024-05-09T06:31:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.628+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f92f801c770 con 0x7f9308071de0 2024-05-09T06:31:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.629+0000 7f92fe7fc700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f92f4070bb0 0x7f92f4073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.629+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f92f80919f0 con 0x7f9308071de0 2024-05-09T06:31:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.629+0000 7f930d842700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f92f4070bb0 0x7f92f4073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.630+0000 7f930d842700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f92f4070bb0 0x7f92f4073060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9304009b80 tx=0x7f930400b040 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:09.636+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f92f8093e60 con 0x7f9308071de0 2024-05-09T06:31:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.038+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9308111a30 con 0x7f92f4070bb0 2024-05-09T06:31:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.047+0000 7f92fe7fc700 1 -- 172.21.15.46:0/400435912 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9308111a30 con 0x7f92f4070bb0 2024-05-09T06:31:10.029 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:31:10.029 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 starting - - - - 2024-05-09T06:31:10.029 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 62s ago 9m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (8m) 69s ago 8m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 starting - - - - 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (3m) 62s ago 3m 11.2M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (3m) 62s ago 3m 154M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (3m) 69s ago 3m 15.4M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (3m) 69s ago 3m 13.0M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 starting - - - - 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (86s) 69s ago 7m 504M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb1059f4aba5 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 62s ago 10m 46.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (7m) 69s ago 7m 36.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 starting - - - - 2024-05-09T06:31:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 starting - - - - 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 62s ago 7m 88.9M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 62s ago 6m 103M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 62s ago 6m 86.6M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (5m) 69s ago 5m 95.5M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (5m) 69s ago 5m 85.7M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (5m) 69s ago 5m 88.7M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:31:10.031 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 starting - - - - 2024-05-09T06:31:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f92f4070bb0 msgr2=0x7f92f4073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f92f4070bb0 0x7f92f4073060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9304009b80 tx=0x7f930400b040 comp rx=0 tx=0).stop 2024-05-09T06:31:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 msgr2=0x7f93081100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 0x7f93081100e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92f80043d0 tx=0x7f92f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 shutdown_connections 2024-05-09T06:31:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f92f4070bb0 0x7f92f4073060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9308070830 0x7f930810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 --2- 172.21.15.46:0/400435912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308071de0 0x7f93081100e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 >> 172.21.15.46:0/400435912 conn(0x7f93080f85c0 msgr2=0x7f93080f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 shutdown_connections 2024-05-09T06:31:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.050+0000 7f930faa6700 1 -- 172.21.15.46:0/400435912 wait complete. 2024-05-09T06:31:10.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 -- 172.21.15.46:0/3561306985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 msgr2=0x7f8d600ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 --2- 172.21.15.46:0/3561306985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 0x7f8d600ffab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8d50004940 tx=0x7f8d50009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 -- 172.21.15.46:0/3561306985 shutdown_connections 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 --2- 172.21.15.46:0/3561306985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d601023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 --2- 172.21.15.46:0/3561306985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 0x7f8d600ffab0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 -- 172.21.15.46:0/3561306985 >> 172.21.15.46:0/3561306985 conn(0x7f8d600f74c0 msgr2=0x7f8d600f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 -- 172.21.15.46:0/3561306985 shutdown_connections 2024-05-09T06:31:10.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.197+0000 7f8d66881700 1 -- 172.21.15.46:0/3561306985 wait complete. 2024-05-09T06:31:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.198+0000 7f8d66881700 1 Processor -- start 2024-05-09T06:31:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.198+0000 7f8d66881700 1 -- start start 2024-05-09T06:31:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.198+0000 7f8d66881700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 0x7f8d6010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.198+0000 7f8d66881700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d60110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.198+0000 7f8d66881700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60110780 con 0x7f8d60066ad0 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.198+0000 7f8d66881700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60110f80 con 0x7f8d600ffff0 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d60110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d60110180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:44492/0 (socket says 172.21.15.46:44492) 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 -- 172.21.15.46:0/3847227249 learned_addr learned my addr 172.21.15.46:0/3847227249 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d5ffff700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 0x7f8d6010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 -- 172.21.15.46:0/3847227249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 msgr2=0x7f8d6010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 0x7f8d6010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 -- 172.21.15.46:0/3847227249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50005040 con 0x7f8d600ffff0 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.199+0000 7f8d57fff700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d60110180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800eb40 tx=0x7f8d4800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:10.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.200+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d48007cc0 con 0x7f8d600ffff0 2024-05-09T06:31:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.200+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d60111200 con 0x7f8d600ffff0 2024-05-09T06:31:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.200+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d60111740 con 0x7f8d600ffff0 2024-05-09T06:31:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.200+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d4800f040 con 0x7f8d600ffff0 2024-05-09T06:31:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.200+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4800ca10 con 0x7f8d600ffff0 2024-05-09T06:31:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.201+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d400052e0 con 0x7f8d600ffff0 2024-05-09T06:31:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.201+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f8d4800cb70 con 0x7f8d600ffff0 2024-05-09T06:31:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.202+0000 7f8d5d7fa700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f8d4c070c80 0x7f8d4c073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.202+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8d48090560 con 0x7f8d600ffff0 2024-05-09T06:31:10.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.202+0000 7f8d5ffff700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f8d4c070c80 0x7f8d4c073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:10.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.203+0000 7f8d5ffff700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f8d4c070c80 0x7f8d4c073130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d50013870 tx=0x7f8d50009e30 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:10.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.207+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f8d480516c0 con 0x7f8d600ffff0 2024-05-09T06:31:10.270 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:10 smithi046 ceph-mon[26924]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:10.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:10 smithi106 ceph-mon[34679]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:10.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:10 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:10.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:10 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:10.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:10 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:10.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:10 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:10.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:10 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:10.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:10 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:10.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.742+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d40005860 con 0x7f8d600ffff0 2024-05-09T06:31:10.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.743+0000 7f8d5d7fa700 1 -- 172.21.15.46:0/3847227249 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f8d48058540 con 0x7f8d600ffff0 2024-05-09T06:31:10.725 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:31:10.725 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:31:10.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 13, 2024-05-09T06:31:10.727 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:31:10.727 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:31:10.727 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:31:10.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f8d4c070c80 msgr2=0x7f8d4c073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f8d4c070c80 0x7f8d4c073130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d50013870 tx=0x7f8d50009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 msgr2=0x7f8d60110180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d60110180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800eb40 tx=0x7f8d4800b040 comp rx=0 tx=0).stop 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 shutdown_connections 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f8d4c070c80 0x7f8d4c073130 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d60066ad0 0x7f8d6010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 --2- 172.21.15.46:0/3847227249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d600ffff0 0x7f8d60110180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 >> 172.21.15.46:0/3847227249 conn(0x7f8d600f74c0 msgr2=0x7f8d600f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 shutdown_connections 2024-05-09T06:31:10.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.746+0000 7f8d66881700 1 -- 172.21.15.46:0/3847227249 wait complete. 2024-05-09T06:31:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 -- 172.21.15.46:0/1059008463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 msgr2=0x7f6b940fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/1059008463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b940fd3d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6b84004940 tx=0x7f6b84009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 -- 172.21.15.46:0/1059008463 shutdown_connections 2024-05-09T06:31:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/1059008463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b940fd3d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/1059008463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 0x7f6b940fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 -- 172.21.15.46:0/1059008463 >> 172.21.15.46:0/1059008463 conn(0x7f6b940f7430 msgr2=0x7f6b940f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 -- 172.21.15.46:0/1059008463 shutdown_connections 2024-05-09T06:31:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.927+0000 7f6b9c15d700 1 -- 172.21.15.46:0/1059008463 wait complete. 2024-05-09T06:31:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b9c15d700 1 Processor -- start 2024-05-09T06:31:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b9c15d700 1 -- start start 2024-05-09T06:31:10.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b9c15d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 0x7f6b9410fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b9c15d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b94110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b9c15d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94110710 con 0x7f6b940fcf60 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b9c15d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94110f10 con 0x7f6b940fbcb0 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b996f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b94110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b996f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b94110110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34666/0 (socket says 172.21.15.46:34666) 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.928+0000 7f6b996f8700 1 -- 172.21.15.46:0/3346428265 learned_addr learned my addr 172.21.15.46:0/3346428265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b99ef9700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 0x7f6b9410fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b996f8700 1 -- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 msgr2=0x7f6b9410fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b996f8700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 0x7f6b9410fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b996f8700 1 -- 172.21.15.46:0/3346428265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84005040 con 0x7f6b940fcf60 2024-05-09T06:31:10.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b996f8700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b94110110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009fd0 tx=0x7f6b84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b99ef9700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 0x7f6b9410fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:31:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8400e070 con 0x7f6b940fcf60 2024-05-09T06:31:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b8401c400 con 0x7f6b940fcf60 2024-05-09T06:31:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b94111190 con 0x7f6b940fcf60 2024-05-09T06:31:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.929+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8400b670 con 0x7f6b940fcf60 2024-05-09T06:31:10.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.930+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b94111620 con 0x7f6b940fcf60 2024-05-09T06:31:10.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.931+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b941018f0 con 0x7f6b940fcf60 2024-05-09T06:31:10.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.932+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 93316+0+0 (secure 0 0 0) 0x7f6b8400b8f0 con 0x7f6b940fcf60 2024-05-09T06:31:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.932+0000 7f6b8a7fc700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6b80070c00 0x7f6b800730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.932+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6b840920b0 con 0x7f6b940fcf60 2024-05-09T06:31:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.933+0000 7f6b99ef9700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6b80070c00 0x7f6b800730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:10.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.933+0000 7f6b99ef9700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6b80070c00 0x7f6b800730b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b90004600 tx=0x7f6b9000b040 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:10.941+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f6b8405a4e0 con 0x7f6b940fcf60 2024-05-09T06:31:11.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.228+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 --> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b94111890 con 0x7f6b80070c00 2024-05-09T06:31:11.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.230+0000 7f6b8a7fc700 1 -- 172.21.15.46:0/3346428265 <== mgr.14590 v2:172.21.15.106:6828/2678165061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f6b94111890 con 0x7f6b80070c00 2024-05-09T06:31:11.212 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:31:11.212 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:31:11.212 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:31:11.212 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:31:11.213 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-05-09T06:31:11.213 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "", 2024-05-09T06:31:11.213 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mgr daemons", 2024-05-09T06:31:11.213 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:31:11.213 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6b80070c00 msgr2=0x7f6b800730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6b80070c00 0x7f6b800730b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b90004600 tx=0x7f6b9000b040 comp rx=0 tx=0).stop 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 msgr2=0x7f6b94110110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b94110110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009fd0 tx=0x7f6b84009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 shutdown_connections 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:6828/2678165061,v1:172.21.15.106:6829/2678165061] conn(0x7f6b80070c00 0x7f6b800730b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b940fbcb0 0x7f6b9410fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 --2- 172.21.15.46:0/3346428265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b940fcf60 0x7f6b94110110 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 >> 172.21.15.46:0/3346428265 conn(0x7f6b940f7430 msgr2=0x7f6b94065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:11.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 shutdown_connections 2024-05-09T06:31:11.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:11.233+0000 7f6b9c15d700 1 -- 172.21.15.46:0/3346428265 wait complete. 2024-05-09T06:31:11.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:11 smithi046 ceph-mon[26924]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:11.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:11 smithi046 ceph-mon[26924]: pgmap v42: 65 pgs: 65 active+clean; 1.3 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 282 op/s 2024-05-09T06:31:11.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:11 smithi046 ceph-mon[26924]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:11.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:11 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3847227249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:11.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:11 smithi106 ceph-mon[34679]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:11 smithi106 ceph-mon[34679]: pgmap v42: 65 pgs: 65 active+clean; 1.3 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 18 MiB/s rd, 22 MiB/s wr, 282 op/s 2024-05-09T06:31:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:11 smithi106 ceph-mon[34679]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:11 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3847227249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:12.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:12 smithi106 ceph-mon[34679]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:12 smithi046 ceph-mon[26924]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:13 smithi106 ceph-mon[34679]: pgmap v43: 65 pgs: 65 active+clean; 1.3 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-05-09T06:31:13.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:13 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:13.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:13 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:13.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:13 smithi046 ceph-mon[26924]: pgmap v43: 65 pgs: 65 active+clean; 1.3 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-05-09T06:31:13.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:13 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:13.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:13 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:15.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:15 smithi046 ceph-mon[26924]: pgmap v44: 65 pgs: 65 active+clean; 834 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 323 op/s 2024-05-09T06:31:15.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:15 smithi106 ceph-mon[34679]: pgmap v44: 65 pgs: 65 active+clean; 834 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 323 op/s 2024-05-09T06:31:17.440 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:17 smithi046 ceph-mon[26924]: pgmap v45: 65 pgs: 65 active+clean; 834 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-05-09T06:31:17.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:17 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:17.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:17 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:17.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:17 smithi106 ceph-mon[34679]: pgmap v45: 65 pgs: 65 active+clean; 834 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-05-09T06:31:17.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:17 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:17.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:17 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:17.608 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T06:31:17.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T06:31:18.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:18 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:18.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:18 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:18.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:18 smithi046 ceph-mon[26924]: pgmap v46: 65 pgs: 65 active+clean; 494 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 330 op/s 2024-05-09T06:31:19.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:18 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:19.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:18 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:19.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:18 smithi106 ceph-mon[34679]: pgmap v46: 65 pgs: 65 active+clean; 494 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 330 op/s 2024-05-09T06:31:20.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:19 smithi106 ceph-mon[34679]: Standby manager daemon smithi046.nvpcui restarted 2024-05-09T06:31:20.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:19 smithi106 ceph-mon[34679]: Standby manager daemon smithi046.nvpcui started 2024-05-09T06:31:20.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:19 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/crt"}]: dispatch 2024-05-09T06:31:20.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:19 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:20.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:19 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/key"}]: dispatch 2024-05-09T06:31:20.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:19 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:19 smithi046 ceph-mon[26924]: Standby manager daemon smithi046.nvpcui restarted 2024-05-09T06:31:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:19 smithi046 ceph-mon[26924]: Standby manager daemon smithi046.nvpcui started 2024-05-09T06:31:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:19 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/crt"}]: dispatch 2024-05-09T06:31:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:19 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:19 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.nvpcui/key"}]: dispatch 2024-05-09T06:31:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:19 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:21.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:20 smithi106 ceph-mon[34679]: mgrmap e25: smithi106.nlgnpx(active, since 87s), standbys: smithi046.nvpcui 2024-05-09T06:31:21.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:20 smithi106 ceph-mon[34679]: pgmap v47: 65 pgs: 65 active+clean; 494 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-05-09T06:31:21.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:20 smithi046 ceph-mon[26924]: mgrmap e25: smithi106.nlgnpx(active, since 87s), standbys: smithi046.nvpcui 2024-05-09T06:31:21.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:20 smithi046 ceph-mon[26924]: pgmap v47: 65 pgs: 65 active+clean; 494 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-05-09T06:31:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:23 smithi106 ceph-mon[34679]: pgmap v48: 65 pgs: 65 active+clean; 494 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-05-09T06:31:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:23 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:23 smithi046 ceph-mon[26924]: pgmap v48: 65 pgs: 65 active+clean; 494 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-05-09T06:31:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:23 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:25.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: mgrmap e26: smithi106.nlgnpx(active, since 92s), standbys: smithi046.nvpcui 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr fail", "who": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr fail", "who": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd='[{"prefix": "mgr fail", "who": "smithi106.nlgnpx"}]': finished 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: mgrmap e27: smithi046.nvpcui(active, starting, since 0.00684771s) 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:31:25.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:31:25.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:25.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:25.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:31:25.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:31:25.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: mgrmap e26: smithi106.nlgnpx(active, since 92s), standbys: smithi046.nvpcui 2024-05-09T06:31:25.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 172.21.15.106:0/1144715764' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr fail", "who": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "mgr fail", "who": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14590 ' entity='mgr.smithi106.nlgnpx' cmd='[{"prefix": "mgr fail", "who": "smithi106.nlgnpx"}]': finished 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: mgrmap e27: smithi046.nvpcui(active, starting, since 0.00684771s) 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:31:25.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:31:25.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:31:25.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:31:25.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:25.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:31:25.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:31:26.471 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:26 smithi106 ceph-mon[34679]: mgrmap e28: smithi046.nvpcui(active, since 1.0108s) 2024-05-09T06:31:26.472 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:26 smithi106 ceph-mon[34679]: pgmap v3: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:26.472 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:26 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:26.472 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:26 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:26.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:26 smithi046 ceph-mon[26924]: mgrmap e28: smithi046.nvpcui(active, since 1.0108s) 2024-05-09T06:31:26.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:26 smithi046 ceph-mon[26924]: pgmap v3: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:26.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:26 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:26.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:26 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:27.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:27 smithi046 ceph-mon[26924]: [09/May/2024:06:31:25] ENGINE Bus STARTING 2024-05-09T06:31:27.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:27 smithi046 ceph-mon[26924]: [09/May/2024:06:31:25] ENGINE Serving on http://172.21.15.46:8765 2024-05-09T06:31:27.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:27 smithi046 ceph-mon[26924]: [09/May/2024:06:31:25] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:31:27.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:27 smithi046 ceph-mon[26924]: [09/May/2024:06:31:25] ENGINE Bus STARTED 2024-05-09T06:31:27.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:27 smithi046 ceph-mon[26924]: pgmap v4: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:27.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:27 smithi046 ceph-mon[26924]: mgrmap e29: smithi046.nvpcui(active, since 2s) 2024-05-09T06:31:27.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:27 smithi106 ceph-mon[34679]: [09/May/2024:06:31:25] ENGINE Bus STARTING 2024-05-09T06:31:27.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:27 smithi106 ceph-mon[34679]: [09/May/2024:06:31:25] ENGINE Serving on http://172.21.15.46:8765 2024-05-09T06:31:27.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:27 smithi106 ceph-mon[34679]: [09/May/2024:06:31:25] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:31:27.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:27 smithi106 ceph-mon[34679]: [09/May/2024:06:31:25] ENGINE Bus STARTED 2024-05-09T06:31:27.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:27 smithi106 ceph-mon[34679]: pgmap v4: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:27.806 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:27 smithi106 ceph-mon[34679]: mgrmap e29: smithi046.nvpcui(active, since 2s) 2024-05-09T06:31:29.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:28 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:29.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:28 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:29.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:28 smithi106 ceph-mon[34679]: pgmap v5: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:29.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:28 smithi106 ceph-mon[34679]: mgrmap e30: smithi046.nvpcui(active, since 4s) 2024-05-09T06:31:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:28 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:28 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:28 smithi046 ceph-mon[26924]: pgmap v5: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:31:29.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:28 smithi046 ceph-mon[26924]: mgrmap e30: smithi046.nvpcui(active, since 4s) 2024-05-09T06:31:30.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:30 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:30.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:30 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:30.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:30 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:30.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:30 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:31.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:31 smithi106 ceph-mon[34679]: pgmap v6: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s wr, 43 op/s 2024-05-09T06:31:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:31 smithi046 ceph-mon[26924]: pgmap v6: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s wr, 43 op/s 2024-05-09T06:31:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:32 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:31:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:32 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:31:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:32 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:32 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:31:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:32 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:32.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:32 smithi046 ceph-mon[26924]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:31:32.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:32 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:31:32.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:32 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:31:32.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:32 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:31:32.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:32 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/325062361' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:31:33.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:33 smithi046 ceph-mon[26924]: mgrmap e31: smithi046.nvpcui(active, since 7s), standbys: smithi106.nlgnpx 2024-05-09T06:31:33.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:33 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:31:33.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:33 smithi046 ceph-mon[26924]: pgmap v7: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-05-09T06:31:33.516 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:33 smithi106 ceph-mon[34679]: mgrmap e31: smithi046.nvpcui(active, since 7s), standbys: smithi106.nlgnpx 2024-05-09T06:31:33.516 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:33 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:31:33.516 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:33 smithi106 ceph-mon[34679]: pgmap v7: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-05-09T06:31:35.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:35 smithi106 ceph-mon[34679]: pgmap v8: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 107 op/s 2024-05-09T06:31:35.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:35 smithi046 ceph-mon[26924]: pgmap v8: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 107 op/s 2024-05-09T06:31:37.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:37 smithi106 ceph-mon[34679]: pgmap v9: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 241 op/s 2024-05-09T06:31:37.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:37 smithi046 ceph-mon[26924]: pgmap v9: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 241 op/s 2024-05-09T06:31:39.759 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:39 smithi046 ceph-mon[26924]: pgmap v10: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-05-09T06:31:39.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:39 smithi106 ceph-mon[34679]: pgmap v10: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-05-09T06:31:40.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:40 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:40.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:40 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.398+0000 7fa8b8916700 1 -- 172.21.15.46:0/2494433003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b40fb420 msgr2=0x7fa8b40fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.398+0000 7fa8b8916700 1 --2- 172.21.15.46:0/2494433003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b40fb420 0x7fa8b40fb830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4004e50 tx=0x7fa8a40048d0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.398+0000 7fa8b8916700 1 -- 172.21.15.46:0/2494433003 shutdown_connections 2024-05-09T06:31:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.398+0000 7fa8b8916700 1 --2- 172.21.15.46:0/2494433003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8b40fc6d0 0x7fa8b40fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.398+0000 7fa8b8916700 1 --2- 172.21.15.46:0/2494433003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b40fb420 0x7fa8b40fb830 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4004e50 tx=0x7fa8a40048d0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.398+0000 7fa8b8916700 1 -- 172.21.15.46:0/2494433003 >> 172.21.15.46:0/2494433003 conn(0x7fa8b40f6b80 msgr2=0x7fa8b40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.399+0000 7fa8b8916700 1 -- 172.21.15.46:0/2494433003 shutdown_connections 2024-05-09T06:31:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.400+0000 7fa8b8916700 1 -- 172.21.15.46:0/2494433003 wait complete. 2024-05-09T06:31:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.400+0000 7fa8b8916700 1 Processor -- start 2024-05-09T06:31:41.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.401+0000 7fa8b8916700 1 -- start start 2024-05-09T06:31:41.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.401+0000 7fa8b8916700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8b40fc6d0 0x7fa8b406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:41.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.401+0000 7fa8b8916700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 0x7fa8b406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:41.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.401+0000 7fa8b8916700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4119af0 con 0x7fa8b40fc6d0 2024-05-09T06:31:41.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.401+0000 7fa8b8916700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4119c30 con 0x7fa8b406eaa0 2024-05-09T06:31:41.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.402+0000 7fa8b1d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 0x7fa8b406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:41.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.402+0000 7fa8b1d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 0x7fa8b406ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:50700/0 (socket says 172.21.15.46:50700) 2024-05-09T06:31:41.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.402+0000 7fa8b1d9b700 1 -- 172.21.15.46:0/3418062656 learned_addr learned my addr 172.21.15.46:0/3418062656 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:41.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.402+0000 7fa8b259c700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8b40fc6d0 0x7fa8b406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:41.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.403+0000 7fa8b1d9b700 1 -- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8b40fc6d0 msgr2=0x7fa8b406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:41.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.403+0000 7fa8b1d9b700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8b40fc6d0 0x7fa8b406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.403+0000 7fa8b1d9b700 1 -- 172.21.15.46:0/3418062656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4005040 con 0x7fa8b406eaa0 2024-05-09T06:31:41.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.403+0000 7fa8b1d9b700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 0x7fa8b406ef10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800fa30 tx=0x7fa8a800f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:41.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.405+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a8007c90 con 0x7fa8b406eaa0 2024-05-09T06:31:41.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.405+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b412ad80 con 0x7fa8b406eaa0 2024-05-09T06:31:41.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.405+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b412b2b0 con 0x7fa8b406eaa0 2024-05-09T06:31:41.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.405+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8a8007df0 con 0x7fa8b406eaa0 2024-05-09T06:31:41.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.406+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a800bc30 con 0x7fa8b406eaa0 2024-05-09T06:31:41.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.408+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7fa8a8014070 con 0x7fa8b406eaa0 2024-05-09T06:31:41.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.407+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8940052e0 con 0x7fa8b406eaa0 2024-05-09T06:31:41.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.409+0000 7fa8a2ffd700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa89c078470 0x7fa89c07a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:41.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.409+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa8a8099980 con 0x7fa8b406eaa0 2024-05-09T06:31:41.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.409+0000 7fa8b259c700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa89c078470 0x7fa89c07a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:41.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.410+0000 7fa8b259c700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa89c078470 0x7fa89c07a920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4000c00 tx=0x7fa8a40048d0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.418+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fa8a8061c00 con 0x7fa8b406eaa0 2024-05-09T06:31:41.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.693+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa894000bf0 con 0x7fa89c078470 2024-05-09T06:31:41.674 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:41 smithi046 ceph-mon[26924]: pgmap v11: 65 pgs: 65 active+clean; 320 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.9 MiB/s wr, 306 op/s 2024-05-09T06:31:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.695+0000 7fa8a2ffd700 1 -- 172.21.15.46:0/3418062656 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fa894000bf0 con 0x7fa89c078470 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa89c078470 msgr2=0x7fa89c07a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa89c078470 0x7fa89c07a920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4000c00 tx=0x7fa8a40048d0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 msgr2=0x7fa8b406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 0x7fa8b406ef10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800fa30 tx=0x7fa8a800f040 comp rx=0 tx=0).stop 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 shutdown_connections 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8b40fc6d0 0x7fa8b406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa89c078470 0x7fa89c07a920 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 --2- 172.21.15.46:0/3418062656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8b406eaa0 0x7fa8b406ef10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 >> 172.21.15.46:0/3418062656 conn(0x7fa8b40f6b80 msgr2=0x7fa8b40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 shutdown_connections 2024-05-09T06:31:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.699+0000 7fa8b8916700 1 -- 172.21.15.46:0/3418062656 wait complete. 2024-05-09T06:31:41.695 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 -- 172.21.15.46:0/3494446042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d4066240 msgr2=0x7f39d40ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 --2- 172.21.15.46:0/3494446042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d4066240 0x7f39d40ffa20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004940 tx=0x7f39d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 -- 172.21.15.46:0/3494446042 shutdown_connections 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 --2- 172.21.15.46:0/3494446042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39d40fff60 0x7f39d4102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 --2- 172.21.15.46:0/3494446042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d4066240 0x7f39d40ffa20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 -- 172.21.15.46:0/3494446042 >> 172.21.15.46:0/3494446042 conn(0x7f39d40f7430 msgr2=0x7f39d40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 -- 172.21.15.46:0/3494446042 shutdown_connections 2024-05-09T06:31:41.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 -- 172.21.15.46:0/3494446042 wait complete. 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.826+0000 7f39dc23c700 1 Processor -- start 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39dc23c700 1 -- start start 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39dc23c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39d4066240 0x7f39d410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39dc23c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 0x7f39d4110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39dc23c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4110850 con 0x7f39d40fff60 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39dc23c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4110f90 con 0x7f39d4066240 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d97d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 0x7f39d4110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d97d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 0x7f39d4110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35606/0 (socket says 172.21.15.46:35606) 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d97d7700 1 -- 172.21.15.46:0/411785685 learned_addr learned my addr 172.21.15.46:0/411785685 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d9fd8700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39d4066240 0x7f39d410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:41.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d97d7700 1 -- 172.21.15.46:0/411785685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39d4066240 msgr2=0x7f39d410fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d97d7700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39d4066240 0x7f39d410fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.827+0000 7f39d97d7700 1 -- 172.21.15.46:0/411785685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0005040 con 0x7f39d40fff60 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.828+0000 7f39d97d7700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 0x7f39d4110250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c830 tx=0x7f39c4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.828+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c40106f0 con 0x7f39d40fff60 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.828+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4111270 con 0x7f39d40fff60 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.828+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39c4010d20 con 0x7f39d40fff60 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.828+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c40113a0 con 0x7f39d40fff60 2024-05-09T06:31:41.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.828+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4111830 con 0x7f39d40fff60 2024-05-09T06:31:41.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.829+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d40f8f60 con 0x7f39d40fff60 2024-05-09T06:31:41.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.830+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f39c4012400 con 0x7f39d40fff60 2024-05-09T06:31:41.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.831+0000 7f39ca7fc700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39c00783a0 0x7f39c007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:41.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.831+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f39c4099db0 con 0x7f39d40fff60 2024-05-09T06:31:41.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.831+0000 7f39d9fd8700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39c00783a0 0x7f39c007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:41.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.831+0000 7f39d9fd8700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39c00783a0 0x7f39c007a850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004890 tx=0x7f39d0009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:41.835+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f39c4062280 con 0x7f39d40fff60 2024-05-09T06:31:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:41 smithi106 ceph-mon[34679]: pgmap v11: 65 pgs: 65 active+clean; 320 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.9 MiB/s wr, 306 op/s 2024-05-09T06:31:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.085+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d4111b00 con 0x7f39c00783a0 2024-05-09T06:31:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.087+0000 7f39ca7fc700 1 -- 172.21.15.46:0/411785685 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f39d4111b00 con 0x7f39c00783a0 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39c00783a0 msgr2=0x7f39c007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39c00783a0 0x7f39c007a850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004890 tx=0x7f39d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 msgr2=0x7f39d4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 0x7f39d4110250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c830 tx=0x7f39c4004470 comp rx=0 tx=0).stop 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 shutdown_connections 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39c00783a0 0x7f39c007a850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39d4066240 0x7f39d410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 --2- 172.21.15.46:0/411785685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d40fff60 0x7f39d4110250 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 >> 172.21.15.46:0/411785685 conn(0x7f39d40f7430 msgr2=0x7f39d40fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 shutdown_connections 2024-05-09T06:31:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.089+0000 7f39dc23c700 1 -- 172.21.15.46:0/411785685 wait complete. 2024-05-09T06:31:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 -- 172.21.15.46:0/1673952638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 msgr2=0x7ffafc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 --2- 172.21.15.46:0/1673952638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc0fe440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffae4004940 tx=0x7ffae4009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 -- 172.21.15.46:0/1673952638 shutdown_connections 2024-05-09T06:31:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 --2- 172.21.15.46:0/1673952638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc0fe440 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 --2- 172.21.15.46:0/1673952638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 -- 172.21.15.46:0/1673952638 >> 172.21.15.46:0/1673952638 conn(0x7ffafc0f8540 msgr2=0x7ffafc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 -- 172.21.15.46:0/1673952638 shutdown_connections 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.209+0000 7ffb023b8700 1 -- 172.21.15.46:0/1673952638 wait complete. 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffb023b8700 1 Processor -- start 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffb023b8700 1 -- start start 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffb023b8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc10d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffb023b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc10de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffb023b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc10e480 con 0x7ffafc0fdfd0 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffb023b8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc10ecd0 con 0x7ffafc0fce60 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffaf3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc10de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:42.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffafbfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc10d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffafbfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc10d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:50748/0 (socket says 172.21.15.46:50748) 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.210+0000 7ffafbfff700 1 -- 172.21.15.46:0/4237641782 learned_addr learned my addr 172.21.15.46:0/4237641782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffafbfff700 1 -- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 msgr2=0x7ffafc10de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffafbfff700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc10de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffafbfff700 1 -- 172.21.15.46:0/4237641782 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4005040 con 0x7ffafc0fce60 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffaf3fff700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffafbfff700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc10d940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00eb40 tx=0x7ffaec00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaec007cc0 con 0x7ffafc0fce60 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc10ef50 con 0x7ffafc0fce60 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaec00f040 con 0x7ffafc0fce60 2024-05-09T06:31:42.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaec00ca10 con 0x7ffafc0fce60 2024-05-09T06:31:42.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.211+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc10f490 con 0x7ffafc0fce60 2024-05-09T06:31:42.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.212+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc05f5c0 con 0x7ffafc0fce60 2024-05-09T06:31:42.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.213+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7ffaec00cb70 con 0x7ffafc0fce60 2024-05-09T06:31:42.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.213+0000 7ffaf97fa700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ffae80783a0 0x7ffae807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:42.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.214+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ffaec099af0 con 0x7ffafc0fce60 2024-05-09T06:31:42.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.214+0000 7ffaf3fff700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ffae80783a0 0x7ffae807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:42.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.214+0000 7ffaf3fff700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ffae80783a0 0x7ffae807a850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009b30 tx=0x7ffae4009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:42.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.218+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7ffaec061ec0 con 0x7ffafc0fce60 2024-05-09T06:31:42.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.480+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffafc10f860 con 0x7ffae80783a0 2024-05-09T06:31:42.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.490+0000 7ffaf97fa700 1 -- 172.21.15.46:0/4237641782 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ffafc10f860 con 0x7ffae80783a0 2024-05-09T06:31:42.471 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:31:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (78s) 26s ago 9m 16.7M - 0.25.0 c8568f914cd2 b54d1522980b 2024-05-09T06:31:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 26s ago 9m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:31:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (8m) 14s ago 8m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:31:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (63s) 26s ago 9m 82.2M - 9.4.7 954c08fa6188 6732b976122e 2024-05-09T06:31:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (4m) 26s ago 4m 11.7M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:31:42.472 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (4m) 26s ago 4m 229M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (4m) 14s ago 4m 16.3M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (4m) 14s ago 3m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (33s) 26s ago 10m 67.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283 running (119s) 14s ago 8m 79.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb1059f4aba5 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 26s ago 11m 50.9M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (8m) 14s ago 8m 39.8M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:31:42.473 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (88s) 26s ago 9m 17.0M - 1.5.0 0da6a335fe13 2b60ab9960da 2024-05-09T06:31:42.474 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (39s) 14s ago 8m 7977k - 1.5.0 0da6a335fe13 d63db2364368 2024-05-09T06:31:42.474 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 26s ago 7m 202M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:31:42.474 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 26s ago 7m 212M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:31:42.474 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 26s ago 6m 179M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:31:42.474 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (6m) 14s ago 6m 230M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:31:42.475 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (6m) 14s ago 6m 209M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:31:42.475 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (5m) 14s ago 5m 197M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:31:42.475 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (42s) 26s ago 8m 39.6M - 2.43.0 a07b618ecd1d 5577edfe242a 2024-05-09T06:31:42.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ffae80783a0 msgr2=0x7ffae807a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ffae80783a0 0x7ffae807a850 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009b30 tx=0x7ffae4009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:42.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 msgr2=0x7ffafc10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc10d940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00eb40 tx=0x7ffaec00b040 comp rx=0 tx=0).stop 2024-05-09T06:31:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 shutdown_connections 2024-05-09T06:31:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ffae80783a0 0x7ffae807a850 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffafc0fce60 0x7ffafc10d940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 --2- 172.21.15.46:0/4237641782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffafc0fdfd0 0x7ffafc10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 >> 172.21.15.46:0/4237641782 conn(0x7ffafc0f8540 msgr2=0x7ffafc0f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 shutdown_connections 2024-05-09T06:31:42.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.492+0000 7ffb023b8700 1 -- 172.21.15.46:0/4237641782 wait complete. 2024-05-09T06:31:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 -- 172.21.15.46:0/2191554517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fbcb0 msgr2=0x7f581c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 --2- 172.21.15.46:0/2191554517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fbcb0 0x7f581c0fc0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f580c004940 tx=0x7f580c009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 -- 172.21.15.46:0/2191554517 shutdown_connections 2024-05-09T06:31:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 --2- 172.21.15.46:0/2191554517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fcf60 0x7f581c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 --2- 172.21.15.46:0/2191554517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fbcb0 0x7f581c0fc0c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 -- 172.21.15.46:0/2191554517 >> 172.21.15.46:0/2191554517 conn(0x7f581c0f7430 msgr2=0x7f581c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 -- 172.21.15.46:0/2191554517 shutdown_connections 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.606+0000 7f582202f700 1 -- 172.21.15.46:0/2191554517 wait complete. 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.607+0000 7f582202f700 1 Processor -- start 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.607+0000 7f582202f700 1 -- start start 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.607+0000 7f582202f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fbcb0 0x7f581c10d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f582202f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 0x7f581c10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f582202f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c10e530 con 0x7f581c0fcf60 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f582202f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c10ed30 con 0x7f581c0fbcb0 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 0x7f581c10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 0x7f581c10df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35638/0 (socket says 172.21.15.46:35638) 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 -- 172.21.15.46:0/842100265 learned_addr learned my addr 172.21.15.46:0/842100265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581b7fe700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fbcb0 0x7f581c10d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 -- 172.21.15.46:0/842100265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fbcb0 msgr2=0x7f581c10d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fbcb0 0x7f581c10d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 -- 172.21.15.46:0/842100265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c005040 con 0x7f581c0fcf60 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581b7fe700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fbcb0 0x7f581c10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f581affd700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 0x7f581c10df30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5810002a80 tx=0x7f58100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.608+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5810007cc0 con 0x7f581c0fcf60 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.609+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f581000f040 con 0x7f581c0fcf60 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.609+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58100096f0 con 0x7f581c0fcf60 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.609+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c10f010 con 0x7f581c0fcf60 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.609+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c10f550 con 0x7f581c0fcf60 2024-05-09T06:31:42.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.610+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c101af0 con 0x7f581c0fcf60 2024-05-09T06:31:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.611+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f581000d690 con 0x7f581c0fcf60 2024-05-09T06:31:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.611+0000 7f5803fff700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f58040783a0 0x7f580407a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.611+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5810099870 con 0x7f581c0fcf60 2024-05-09T06:31:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.612+0000 7f581b7fe700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f58040783a0 0x7f580407a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:42.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.612+0000 7f581b7fe700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f58040783a0 0x7f580407a850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f580c00b3b0 tx=0x7f580c009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:42.616+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f5810061a70 con 0x7f581c0fcf60 2024-05-09T06:31:43.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.021+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f581c04bed0 con 0x7f581c0fcf60 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.022+0000 7f5803fff700 1 -- 172.21.15.46:0/842100265 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f5810061410 con 0x7f581c0fcf60 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:31:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:31:43.004 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:31:43.004 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:31:43.004 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:31:43.004 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:31:43.004 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:31:43.004 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:31:43.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f58040783a0 msgr2=0x7f580407a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:43.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f58040783a0 0x7f580407a850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f580c00b3b0 tx=0x7f580c009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:43.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 msgr2=0x7f581c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 0x7f581c10df30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5810002a80 tx=0x7f58100046b0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 shutdown_connections 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f58040783a0 0x7f580407a850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f581c0fbcb0 0x7f581c10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 --2- 172.21.15.46:0/842100265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f581c0fcf60 0x7f581c10df30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.025+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 >> 172.21.15.46:0/842100265 conn(0x7f581c0f7430 msgr2=0x7f581c065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.026+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 shutdown_connections 2024-05-09T06:31:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.026+0000 7f582202f700 1 -- 172.21.15.46:0/842100265 wait complete. 2024-05-09T06:31:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 -- 172.21.15.46:0/3197944487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2970066ba0 msgr2=0x7f29700ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 --2- 172.21.15.46:0/3197944487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2970066ba0 0x7f29700ffa30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2964004940 tx=0x7f2964009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 -- 172.21.15.46:0/3197944487 shutdown_connections 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 --2- 172.21.15.46:0/3197944487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29700fff70 0x7f29701023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 --2- 172.21.15.46:0/3197944487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2970066ba0 0x7f29700ffa30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 -- 172.21.15.46:0/3197944487 >> 172.21.15.46:0/3197944487 conn(0x7f29700f7440 msgr2=0x7f29700f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 -- 172.21.15.46:0/3197944487 shutdown_connections 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 -- 172.21.15.46:0/3197944487 wait complete. 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 Processor -- start 2024-05-09T06:31:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.154+0000 7f29770ed700 1 -- start start 2024-05-09T06:31:43.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f29770ed700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29700fff70 0x7f2970114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:43.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f29770ed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 0x7f2970115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:43.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f29770ed700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970114a90 con 0x7f29701145d0 2024-05-09T06:31:43.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f29770ed700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970114bd0 con 0x7f29700fff70 2024-05-09T06:31:43.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f296ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 0x7f2970115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:43.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f296ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 0x7f2970115410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35650/0 (socket says 172.21.15.46:35650) 2024-05-09T06:31:43.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f296ffff700 1 -- 172.21.15.46:0/2517340447 learned_addr learned my addr 172.21.15.46:0/2517340447 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:31:43.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f296ffff700 1 -- 172.21.15.46:0/2517340447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29700fff70 msgr2=0x7f2970114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:43.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f296ffff700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29700fff70 0x7f2970114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.155+0000 7f296ffff700 1 -- 172.21.15.46:0/2517340447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964005040 con 0x7f29701145d0 2024-05-09T06:31:43.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.156+0000 7f296ffff700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 0x7f2970115410 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f295c002a50 tx=0x7f295c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:43.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.156+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c007cc0 con 0x7f29701145d0 2024-05-09T06:31:43.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.156+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2970115a70 con 0x7f29701145d0 2024-05-09T06:31:43.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.156+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970116000 con 0x7f29701145d0 2024-05-09T06:31:43.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.156+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f295c00f040 con 0x7f29701145d0 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.156+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c009640 con 0x7f29701145d0 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.158+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297005f5c0 con 0x7f29701145d0 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.159+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f295c0097a0 con 0x7f29701145d0 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.159+0000 7f296d7fa700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29600783a0 0x7f296007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.160+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f295c099cf0 con 0x7f29701145d0 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.160+0000 7f2974e89700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29600783a0 0x7f296007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:31:43.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.160+0000 7f2974e89700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29600783a0 0x7f296007a850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2964004f90 tx=0x7f2964009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:31:43.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.165+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f295c062010 con 0x7f29701145d0 2024-05-09T06:31:43.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.484+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2970066c10 con 0x7f29600783a0 2024-05-09T06:31:43.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.487+0000 7f296d7fa700 1 -- 172.21.15.46:0/2517340447 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f2970066c10 con 0x7f29600783a0 2024-05-09T06:31:43.468 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:31:43.468 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:31:43.469 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:31:43.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.492+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29600783a0 msgr2=0x7f296007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:43.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.492+0000 7f29770ed700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29600783a0 0x7f296007a850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2964004f90 tx=0x7f2964009e30 comp rx=0 tx=0).stop 2024-05-09T06:31:43.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.492+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 msgr2=0x7f2970115410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:31:43.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.492+0000 7f29770ed700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 0x7f2970115410 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f295c002a50 tx=0x7f295c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 shutdown_connections 2024-05-09T06:31:43.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29600783a0 0x7f296007a850 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29700fff70 0x7f2970114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 --2- 172.21.15.46:0/2517340447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29701145d0 0x7f2970115410 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:31:43.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 >> 172.21.15.46:0/2517340447 conn(0x7f29700f7440 msgr2=0x7f29700fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:31:43.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 shutdown_connections 2024-05-09T06:31:43.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:31:43.493+0000 7f29770ed700 1 -- 172.21.15.46:0/2517340447 wait complete. 2024-05-09T06:31:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:43 smithi106 ceph-mon[34679]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:43 smithi106 ceph-mon[34679]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:43 smithi106 ceph-mon[34679]: pgmap v12: 65 pgs: 65 active+clean; 320 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 688 op/s 2024-05-09T06:31:43.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:43 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/842100265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:43.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:43 smithi046 ceph-mon[26924]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:43.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:43 smithi046 ceph-mon[26924]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:43.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:43 smithi046 ceph-mon[26924]: pgmap v12: 65 pgs: 65 active+clean; 320 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 688 op/s 2024-05-09T06:31:43.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:43 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/842100265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:31:44.600 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:44 smithi046 ceph-mon[26924]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:44.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:44 smithi106 ceph-mon[34679]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:45.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:45 smithi046 ceph-mon[26924]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:45.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:45 smithi046 ceph-mon[26924]: pgmap v13: 65 pgs: 65 active+clean; 320 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 625 op/s 2024-05-09T06:31:45.725 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:45 smithi106 ceph-mon[34679]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:31:45.725 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:45 smithi106 ceph-mon[34679]: pgmap v13: 65 pgs: 65 active+clean; 320 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 625 op/s 2024-05-09T06:31:47.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:47 smithi106 ceph-mon[34679]: pgmap v14: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 796 op/s 2024-05-09T06:31:47.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:47 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:47.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:47 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:47.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:47 smithi046 ceph-mon[26924]: pgmap v14: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 796 op/s 2024-05-09T06:31:47.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:47 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:47.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:47 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:49.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:49 smithi106 ceph-mon[34679]: pgmap v15: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 655 op/s 2024-05-09T06:31:49.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:49 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:49.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:49 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:49.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:49 smithi046 ceph-mon[26924]: pgmap v15: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 655 op/s 2024-05-09T06:31:49.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:49 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:49.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:49 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:51.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:51 smithi046 ceph-mon[26924]: pgmap v16: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 727 op/s 2024-05-09T06:31:51.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:51 smithi106 ceph-mon[34679]: pgmap v16: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 727 op/s 2024-05-09T06:31:53.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:53 smithi046 ceph-mon[26924]: pgmap v17: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 980 op/s 2024-05-09T06:31:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:53 smithi106 ceph-mon[34679]: pgmap v17: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 980 op/s 2024-05-09T06:31:55.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:55 smithi046 ceph-mon[26924]: pgmap v18: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 580 op/s 2024-05-09T06:31:55.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:55 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:55.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:55 smithi106 ceph-mon[34679]: pgmap v18: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 580 op/s 2024-05-09T06:31:55.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:55 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:31:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:57 smithi046 ceph-mon[26924]: pgmap v19: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.1 MiB/s wr, 950 op/s 2024-05-09T06:31:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:57 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:57 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:57 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:57 smithi106 ceph-mon[34679]: pgmap v19: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.1 MiB/s wr, 950 op/s 2024-05-09T06:31:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:57 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:57 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:57.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:57 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:31:58.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:58 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:58.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:58 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:31:58.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:58 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:31:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:58 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:31:58.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:58 smithi106 ceph-mon[34679]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:31:58.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:58 smithi106 ceph-mon[34679]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: pgmap v20: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 779 op/s 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:31:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: pgmap v20: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.4 MiB/s wr, 779 op/s 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:31:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:31:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:00.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:00 smithi046 ceph-mon[26924]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-05-09T06:32:00.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:00 smithi046 ceph-mon[26924]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-05-09T06:32:00.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:00 smithi106 ceph-mon[34679]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-05-09T06:32:00.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:00 smithi106 ceph-mon[34679]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-05-09T06:32:01.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:01 smithi046 ceph-mon[26924]: pgmap v21: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 865 op/s 2024-05-09T06:32:01.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:01 smithi106 ceph-mon[34679]: pgmap v21: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.7 MiB/s wr, 865 op/s 2024-05-09T06:32:03.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:03 smithi046 ceph-mon[26924]: pgmap v22: 65 pgs: 65 active+clean; 287 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 1.22k op/s 2024-05-09T06:32:03.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:03 smithi106 ceph-mon[34679]: pgmap v22: 65 pgs: 65 active+clean; 287 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 1.22k op/s 2024-05-09T06:32:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:05 smithi106 ceph-mon[34679]: pgmap v23: 65 pgs: 65 active+clean; 287 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.5 MiB/s wr, 881 op/s 2024-05-09T06:32:05.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:05 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:05.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:05 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:05.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:05 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:05.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:05 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:05.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:05 smithi046 ceph-mon[26924]: pgmap v23: 65 pgs: 65 active+clean; 287 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.5 MiB/s wr, 881 op/s 2024-05-09T06:32:05.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:05 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:05.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:05 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:05.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:05 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:05.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:05 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:06.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:06 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:06.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:06 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:32:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:07 smithi106 ceph-mon[34679]: pgmap v24: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 1.27k op/s 2024-05-09T06:32:07.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:07 smithi046 ceph-mon[26924]: pgmap v24: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 1.27k op/s 2024-05-09T06:32:08.767 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:08 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:32:08.767 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:08 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:32:08.768 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:08 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:08.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:08 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:32:08.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:08 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:32:08.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:08 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:09.617 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:09 smithi046 ceph-mon[26924]: Upgrade: Updating mgr.smithi106.nlgnpx 2024-05-09T06:32:09.617 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:09 smithi046 ceph-mon[26924]: Deploying daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:32:09.617 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:09 smithi046 ceph-mon[26924]: pgmap v25: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 899 op/s 2024-05-09T06:32:09.729 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:09 smithi106 ceph-mon[34679]: Upgrade: Updating mgr.smithi106.nlgnpx 2024-05-09T06:32:09.729 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:09 smithi106 ceph-mon[34679]: Deploying daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:32:09.729 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:09 smithi106 ceph-mon[34679]: pgmap v25: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 899 op/s 2024-05-09T06:32:10.684 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:10 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:10.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:10 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:11.681 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:11 smithi106 ceph-mon[34679]: pgmap v26: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 963 op/s 2024-05-09T06:32:11.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:11 smithi046 ceph-mon[26924]: pgmap v26: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 963 op/s 2024-05-09T06:32:13.359 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:13 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:13.359 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:13 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:13.360 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:13 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:13.360 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:13 smithi046 ceph-mon[26924]: pgmap v27: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 1.11k op/s 2024-05-09T06:32:13.561 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:13 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:13.561 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:13 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:13.562 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:13 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:13.562 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:13 smithi106 ceph-mon[34679]: pgmap v27: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 1.11k op/s 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 -- 172.21.15.46:0/1519157578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 msgr2=0x7f5d180fc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1519157578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d180fc720 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c004940 tx=0x7f5d0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 -- 172.21.15.46:0/1519157578 shutdown_connections 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1519157578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 0x7f5d180fd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1519157578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d180fc720 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 -- 172.21.15.46:0/1519157578 >> 172.21.15.46:0/1519157578 conn(0x7f5d180f6b80 msgr2=0x7f5d180f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 -- 172.21.15.46:0/1519157578 shutdown_connections 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.631+0000 7f5d1f057700 1 -- 172.21.15.46:0/1519157578 wait complete. 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1f057700 1 Processor -- start 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1f057700 1 -- start start 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1f057700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d1810fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1f057700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 0x7f5d18110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1f057700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d18110710 con 0x7f5d180fc310 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1f057700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d18110f10 con 0x7f5d180fcc60 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1cdf3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d1810fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1cdf3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d1810fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56126/0 (socket says 172.21.15.46:56126) 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d17fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 0x7f5d18110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.632+0000 7f5d1cdf3700 1 -- 172.21.15.46:0/1408930505 learned_addr learned my addr 172.21.15.46:0/1408930505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d1cdf3700 1 -- 172.21.15.46:0/1408930505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 msgr2=0x7f5d18110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d1cdf3700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 0x7f5d18110110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d1cdf3700 1 -- 172.21.15.46:0/1408930505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c005040 con 0x7f5d180fc310 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d17fff700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 0x7f5d18110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d1cdf3700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d1810fbd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c013870 tx=0x7f5d0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d0c021070 con 0x7f5d180fc310 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d0c009430 con 0x7f5d180fc310 2024-05-09T06:32:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d18111190 con 0x7f5d180fc310 2024-05-09T06:32:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d0c00e070 con 0x7f5d180fc310 2024-05-09T06:32:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.633+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d181116d0 con 0x7f5d180fc310 2024-05-09T06:32:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.635+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f5d0c026410 con 0x7f5d180fc310 2024-05-09T06:32:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.635+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d18101a60 con 0x7f5d180fc310 2024-05-09T06:32:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.636+0000 7f5d157fa700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5d080783a0 0x7f5d0807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.636+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5d0c09b250 con 0x7f5d180fc310 2024-05-09T06:32:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.636+0000 7f5d17fff700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5d080783a0 0x7f5d0807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.636+0000 7f5d17fff700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5d080783a0 0x7f5d0807a850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009b80 tx=0x7f5d0400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:13.642+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f5d0c064600 con 0x7f5d180fc310 2024-05-09T06:32:13.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.008+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d181048b0 con 0x7f5d080783a0 2024-05-09T06:32:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.009+0000 7f5d157fa700 1 -- 172.21.15.46:0/1408930505 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f5d181048b0 con 0x7f5d080783a0 2024-05-09T06:32:13.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5d080783a0 msgr2=0x7f5d0807a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:13.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5d080783a0 0x7f5d0807a850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009b80 tx=0x7f5d0400b040 comp rx=0 tx=0).stop 2024-05-09T06:32:13.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 msgr2=0x7f5d1810fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d1810fbd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c013870 tx=0x7f5d0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 shutdown_connections 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d180fc310 0x7f5d1810fbd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5d080783a0 0x7f5d0807a850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 --2- 172.21.15.46:0/1408930505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d180fcc60 0x7f5d18110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 >> 172.21.15.46:0/1408930505 conn(0x7f5d180f6b80 msgr2=0x7f5d180f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 shutdown_connections 2024-05-09T06:32:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.012+0000 7f5d1f057700 1 -- 172.21.15.46:0/1408930505 wait complete. 2024-05-09T06:32:14.007 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:32:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.188+0000 7f60937fe700 1 -- 172.21.15.46:0/2426519788 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6084012410 con 0x7f6094070890 2024-05-09T06:32:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 -- 172.21.15.46:0/2426519788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094070890 msgr2=0x7f6094070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 --2- 172.21.15.46:0/2426519788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094070890 0x7f6094070d00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6084009ce0 tx=0x7f6084004d10 comp rx=0 tx=0).stop 2024-05-09T06:32:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 -- 172.21.15.46:0/2426519788 shutdown_connections 2024-05-09T06:32:14.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 --2- 172.21.15.46:0/2426519788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094070890 0x7f6094070d00 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6084009ce0 tx=0x7f6084004d10 comp rx=0 tx=0).stop 2024-05-09T06:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 --2- 172.21.15.46:0/2426519788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6094071e40 0x7f6094070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 -- 172.21.15.46:0/2426519788 >> 172.21.15.46:0/2426519788 conn(0x7f60940f85c0 msgr2=0x7f60940fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 -- 172.21.15.46:0/2426519788 shutdown_connections 2024-05-09T06:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.189+0000 7f609b1e6700 1 -- 172.21.15.46:0/2426519788 wait complete. 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.190+0000 7f609b1e6700 1 Processor -- start 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.190+0000 7f609b1e6700 1 -- start start 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f609b1e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 0x7f609410ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f609b1e6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f609410bf70 0x7f609410cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f609b1e6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609410c430 con 0x7f6094071e40 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f609b1e6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609410c570 con 0x7f609410bf70 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6098f82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 0x7f609410ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:14.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6098f82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 0x7f609410ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56146/0 (socket says 172.21.15.46:56146) 2024-05-09T06:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6098f82700 1 -- 172.21.15.46:0/4203801799 learned_addr learned my addr 172.21.15.46:0/4203801799 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6093fff700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f609410bf70 0x7f609410cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6098f82700 1 -- 172.21.15.46:0/4203801799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f609410bf70 msgr2=0x7f609410cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6098f82700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f609410bf70 0x7f609410cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6098f82700 1 -- 172.21.15.46:0/4203801799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084009940 con 0x7f6094071e40 2024-05-09T06:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.191+0000 7f6093fff700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f609410bf70 0x7f609410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.192+0000 7f6098f82700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 0x7f609410ba30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f608c01fb40 tx=0x7f608c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.192+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608c018cd0 con 0x7f6094071e40 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.192+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f608c020040 con 0x7f6094071e40 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.192+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609410d3c0 con 0x7f6094071e40 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.192+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608c01a600 con 0x7f6094071e40 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.192+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609410d950 con 0x7f6094071e40 2024-05-09T06:32:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.193+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60740052e0 con 0x7f6094071e40 2024-05-09T06:32:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.194+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f608c01dce0 con 0x7f6094071e40 2024-05-09T06:32:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.195+0000 7f60917fa700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6080078470 0x7f608007a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.195+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f608c0aa900 con 0x7f6094071e40 2024-05-09T06:32:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.195+0000 7f6093fff700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6080078470 0x7f608007a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.196+0000 7f6093fff700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6080078470 0x7f608007a920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6084015040 tx=0x7f6084004d10 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:14.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.201+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f608c072d70 con 0x7f6094071e40 2024-05-09T06:32:14.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.555+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6074000bf0 con 0x7f6080078470 2024-05-09T06:32:14.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.556+0000 7f60917fa700 1 -- 172.21.15.46:0/4203801799 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f6074000bf0 con 0x7f6080078470 2024-05-09T06:32:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6080078470 msgr2=0x7f608007a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6080078470 0x7f608007a920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6084015040 tx=0x7f6084004d10 comp rx=0 tx=0).stop 2024-05-09T06:32:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 msgr2=0x7f609410ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 0x7f609410ba30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f608c01fb40 tx=0x7f608c01c040 comp rx=0 tx=0).stop 2024-05-09T06:32:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 shutdown_connections 2024-05-09T06:32:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6094071e40 0x7f609410ba30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6080078470 0x7f608007a920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 --2- 172.21.15.46:0/4203801799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f609410bf70 0x7f609410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 >> 172.21.15.46:0/4203801799 conn(0x7f60940f85c0 msgr2=0x7f60940fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 shutdown_connections 2024-05-09T06:32:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.560+0000 7f609b1e6700 1 -- 172.21.15.46:0/4203801799 wait complete. 2024-05-09T06:32:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.710+0000 7f75c5325700 1 -- 172.21.15.46:0/3602483657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fce60 msgr2=0x7f75c00fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.710+0000 7f75c5325700 1 --2- 172.21.15.46:0/3602483657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fce60 0x7f75c00fd270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75b0004c20 tx=0x7f75b0009ca0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.710+0000 7f75c5325700 1 -- 172.21.15.46:0/3602483657 shutdown_connections 2024-05-09T06:32:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.710+0000 7f75c5325700 1 --2- 172.21.15.46:0/3602483657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fdfd0 0x7f75c00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.710+0000 7f75c5325700 1 --2- 172.21.15.46:0/3602483657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fce60 0x7f75c00fd270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.710+0000 7f75c5325700 1 -- 172.21.15.46:0/3602483657 >> 172.21.15.46:0/3602483657 conn(0x7f75c00f8540 msgr2=0x7f75c00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.711+0000 7f75c5325700 1 -- 172.21.15.46:0/3602483657 shutdown_connections 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.711+0000 7f75c5325700 1 -- 172.21.15.46:0/3602483657 wait complete. 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.711+0000 7f75c5325700 1 Processor -- start 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.711+0000 7f75c5325700 1 -- start start 2024-05-09T06:32:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75c5325700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 0x7f75c010d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75c5325700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fdfd0 0x7f75c010dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75c5325700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c010e3a0 con 0x7f75c00fce60 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75c5325700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c010e510 con 0x7f75c00fdfd0 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 0x7f75c010d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 0x7f75c010d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56172/0 (socket says 172.21.15.46:56172) 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 -- 172.21.15.46:0/2706133083 learned_addr learned my addr 172.21.15.46:0/2706133083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75b67fc700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fdfd0 0x7f75c010dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 -- 172.21.15.46:0/2706133083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fdfd0 msgr2=0x7f75c010dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fdfd0 0x7f75c010dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 -- 172.21.15.46:0/2706133083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b00048f0 con 0x7f75c00fce60 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.712+0000 7f75beffd700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 0x7f75c010d860 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f75b000ba20 tx=0x7f75b0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.713+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b000e040 con 0x7f75c00fce60 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.713+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c0112f10 con 0x7f75c00fce60 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.713+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75b001cd00 con 0x7f75c00fce60 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.713+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b0012a50 con 0x7f75c00fce60 2024-05-09T06:32:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.713+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c0113440 con 0x7f75c00fce60 2024-05-09T06:32:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.714+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c004c710 con 0x7f75c00fce60 2024-05-09T06:32:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.715+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f75b001c830 con 0x7f75c00fce60 2024-05-09T06:32:14.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.716+0000 7f75b7fff700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f75ac0783a0 0x7f75ac07a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:14.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.717+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f75b009bfb0 con 0x7f75c00fce60 2024-05-09T06:32:14.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.717+0000 7f75b67fc700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f75ac0783a0 0x7f75ac07a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.717+0000 7f75b67fc700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f75ac0783a0 0x7f75ac07a850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009b80 tx=0x7f75a800b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:14.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:14.722+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f75b0064390 con 0x7f75c00fce60 2024-05-09T06:32:15.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.031+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75c0102270 con 0x7f75ac0783a0 2024-05-09T06:32:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.041+0000 7f75b7fff700 1 -- 172.21.15.46:0/2706133083 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f75c0102270 con 0x7f75ac0783a0 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (110s) 28s ago 10m 17.1M - 0.25.0 c8568f914cd2 b54d1522980b 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 28s ago 10m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (9m) 47s ago 9m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (95s) 28s ago 9m 82.3M - 9.4.7 954c08fa6188 6732b976122e 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (4m) 28s ago 4m 12.2M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (4m) 28s ago 4m 232M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (4m) 47s ago 4m 16.3M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (4m) 47s ago 4m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (66s) 28s ago 11m 494M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 starting - - - - 2024-05-09T06:32:15.023 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 28s ago 11m 53.7M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (8m) 47s ago 8m 39.8M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 28s ago 10m 16.5M - 1.5.0 0da6a335fe13 2b60ab9960da 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (72s) 47s ago 9m 7977k - 1.5.0 0da6a335fe13 d63db2364368 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 28s ago 8m 199M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 28s ago 7m 214M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 28s ago 7m 178M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (6m) 47s ago 6m 230M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (6m) 47s ago 6m 209M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (6m) 47s ago 6m 197M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:32:15.024 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 starting - - - - 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f75ac0783a0 msgr2=0x7f75ac07a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f75ac0783a0 0x7f75ac07a850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009b80 tx=0x7f75a800b040 comp rx=0 tx=0).stop 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 msgr2=0x7f75c010d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 0x7f75c010d860 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f75b000ba20 tx=0x7f75b0009ca0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 shutdown_connections 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75c00fce60 0x7f75c010d860 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f75ac0783a0 0x7f75ac07a850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 --2- 172.21.15.46:0/2706133083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75c00fdfd0 0x7f75c010dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 >> 172.21.15.46:0/2706133083 conn(0x7f75c00f8540 msgr2=0x7f75c00f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 shutdown_connections 2024-05-09T06:32:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.043+0000 7f75c5325700 1 -- 172.21.15.46:0/2706133083 wait complete. 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa778967700 1 -- 172.21.15.46:0/1085804349 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c012410 con 0x7fa7740fbcb0 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa77bbcd700 1 -- 172.21.15.46:0/1085804349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fbcb0 msgr2=0x7fa7740fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/1085804349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fbcb0 0x7fa7740fc0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009ce0 tx=0x7fa76c004d10 comp rx=0 tx=0).stop 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa77bbcd700 1 -- 172.21.15.46:0/1085804349 shutdown_connections 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/1085804349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fcf60 0x7fa7740fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/1085804349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fbcb0 0x7fa7740fc0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.199+0000 7fa77bbcd700 1 -- 172.21.15.46:0/1085804349 >> 172.21.15.46:0/1085804349 conn(0x7fa7740f7430 msgr2=0x7fa7740f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.200+0000 7fa77bbcd700 1 -- 172.21.15.46:0/1085804349 shutdown_connections 2024-05-09T06:32:15.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.200+0000 7fa77bbcd700 1 -- 172.21.15.46:0/1085804349 wait complete. 2024-05-09T06:32:15.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.200+0000 7fa77bbcd700 1 Processor -- start 2024-05-09T06:32:15.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.200+0000 7fa77bbcd700 1 -- start start 2024-05-09T06:32:15.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.201+0000 7fa77bbcd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 0x7fa77410b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:15.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.201+0000 7fa77bbcd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fcf60 0x7fa77410be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:15.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.201+0000 7fa77bbcd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77410c480 con 0x7fa7740fbcb0 2024-05-09T06:32:15.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.201+0000 7fa77bbcd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77410ccc0 con 0x7fa7740fcf60 2024-05-09T06:32:15.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.202+0000 7fa779969700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 0x7fa77410b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:15.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.202+0000 7fa779969700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 0x7fa77410b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56192/0 (socket says 172.21.15.46:56192) 2024-05-09T06:32:15.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.202+0000 7fa779969700 1 -- 172.21.15.46:0/978614020 learned_addr learned my addr 172.21.15.46:0/978614020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:15.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.202+0000 7fa779168700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fcf60 0x7fa77410be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:15.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.203+0000 7fa779969700 1 -- 172.21.15.46:0/978614020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fcf60 msgr2=0x7fa77410be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.203+0000 7fa779969700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fcf60 0x7fa77410be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.203+0000 7fa779969700 1 -- 172.21.15.46:0/978614020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009940 con 0x7fa7740fbcb0 2024-05-09T06:32:15.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.203+0000 7fa779168700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fcf60 0x7fa77410be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:32:15.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.203+0000 7fa779969700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 0x7fa77410b8f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009380 tx=0x7fa76c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:15.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.204+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c00e040 con 0x7fa7740fbcb0 2024-05-09T06:32:15.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.204+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa76c0128e0 con 0x7fa7740fbcb0 2024-05-09T06:32:15.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.204+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c01ca10 con 0x7fa7740fbcb0 2024-05-09T06:32:15.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.204+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77410cf40 con 0x7fa7740fbcb0 2024-05-09T06:32:15.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.204+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77410d500 con 0x7fa7740fbcb0 2024-05-09T06:32:15.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.206+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77405f5c0 con 0x7fa7740fbcb0 2024-05-09T06:32:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.207+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7fa76c012a50 con 0x7fa7740fbcb0 2024-05-09T06:32:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.208+0000 7fa7727fc700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa75c078460 0x7fa75c07a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:15.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.208+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa76c09ba80 con 0x7fa7740fbcb0 2024-05-09T06:32:15.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.209+0000 7fa779168700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa75c078460 0x7fa75c07a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.210+0000 7fa779168700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa75c078460 0x7fa75c07a910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa768009fd0 tx=0x7fa76800b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:15.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.216+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fa76c063e40 con 0x7fa7740fbcb0 2024-05-09T06:32:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:15 smithi046 ceph-mon[26924]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:15 smithi046 ceph-mon[26924]: pgmap v28: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 685 op/s 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.655+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa774101680 con 0x7fa7740fbcb0 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.658+0000 7fa7727fc700 1 -- 172.21.15.46:0/978614020 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fa76c012d00 con 0x7fa7740fbcb0 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:15.640 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:32:15.641 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:32:15.642 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.663+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa75c078460 msgr2=0x7fa75c07a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.663+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa75c078460 0x7fa75c07a910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa768009fd0 tx=0x7fa76800b040 comp rx=0 tx=0).stop 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.663+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 msgr2=0x7fa77410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.663+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 0x7fa77410b8f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009380 tx=0x7fa76c004d10 comp rx=0 tx=0).stop 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.664+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 shutdown_connections 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.664+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7740fbcb0 0x7fa77410b8f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.664+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa75c078460 0x7fa75c07a910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.664+0000 7fa77bbcd700 1 --2- 172.21.15.46:0/978614020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7740fcf60 0x7fa77410be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.664+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 >> 172.21.15.46:0/978614020 conn(0x7fa7740f7430 msgr2=0x7fa7741040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.664+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 shutdown_connections 2024-05-09T06:32:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.665+0000 7fa77bbcd700 1 -- 172.21.15.46:0/978614020 wait complete. 2024-05-09T06:32:15.725 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:15 smithi106 ceph-mon[34679]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:15.725 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:15 smithi106 ceph-mon[34679]: pgmap v28: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 685 op/s 2024-05-09T06:32:15.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f28327fc700 1 -- 172.21.15.46:0/322133846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828013b70 con 0x7f2834100280 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 -- 172.21.15.46:0/322133846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2834100280 msgr2=0x7f28341006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 --2- 172.21.15.46:0/322133846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2834100280 0x7f28341006f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2828004940 tx=0x7f2828009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 -- 172.21.15.46:0/322133846 shutdown_connections 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 --2- 172.21.15.46:0/322133846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2834100280 0x7f28341006f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 --2- 172.21.15.46:0/322133846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28340fefd0 0x7f28340ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 -- 172.21.15.46:0/322133846 >> 172.21.15.46:0/322133846 conn(0x7f28340faab0 msgr2=0x7f28340fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.827+0000 7f283a0a4700 1 -- 172.21.15.46:0/322133846 shutdown_connections 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.828+0000 7f283a0a4700 1 -- 172.21.15.46:0/322133846 wait complete. 2024-05-09T06:32:15.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.828+0000 7f283a0a4700 1 Processor -- start 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.828+0000 7f283a0a4700 1 -- start start 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f283a0a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28340fefd0 0x7f283410fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f283a0a4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 0x7f283410ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f283a0a4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834110550 con 0x7f28340fefd0 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f283a0a4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834110d50 con 0x7f2834100280 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 0x7f283410ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 0x7f283410ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.46:48764/0 (socket says 172.21.15.46:48764) 2024-05-09T06:32:15.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 -- 172.21.15.46:0/1971992810 learned_addr learned my addr 172.21.15.46:0/1971992810 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f28337fe700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28340fefd0 0x7f283410fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 -- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28340fefd0 msgr2=0x7f283410fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28340fefd0 0x7f283410fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 -- 172.21.15.46:0/1971992810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828005040 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.829+0000 7f2832ffd700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 0x7f283410ff50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2828004890 tx=0x7f2828009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.830+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828021070 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.830+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2828013d00 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.830+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2834110fd0 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.830+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282800e070 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.830+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2834111510 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.831+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283405f5c0 con 0x7f2834100280 2024-05-09T06:32:15.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.832+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 31) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f282801ca40 con 0x7f2834100280 2024-05-09T06:32:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.832+0000 7f281bfff700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f281c0783a0 0x7f281c07a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.833+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f282809b520 con 0x7f2834100280 2024-05-09T06:32:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.833+0000 7f28337fe700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f281c0783a0 0x7f281c07a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:15.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.833+0000 7f28337fe700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f281c0783a0 0x7f281c07a850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2824004600 tx=0x7f282400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:15.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:15.842+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f28280637a0 con 0x7f2834100280 2024-05-09T06:32:16.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.146+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2834111740 con 0x7f281c0783a0 2024-05-09T06:32:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.147+0000 7f281bfff700 1 -- 172.21.15.46:0/1971992810 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f2834111740 con 0x7f281c0783a0 2024-05-09T06:32:16.129 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:32:16.129 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:32:16.129 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:32:16.129 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:32:16.129 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:32:16.130 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:32:16.130 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:32:16.130 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:32:16.130 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mgr daemons", 2024-05-09T06:32:16.130 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:32:16.130 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f281c0783a0 msgr2=0x7f281c07a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f281c0783a0 0x7f281c07a850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2824004600 tx=0x7f282400b040 comp rx=0 tx=0).stop 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 msgr2=0x7f283410ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 0x7f283410ff50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2828004890 tx=0x7f2828009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 shutdown_connections 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28340fefd0 0x7f283410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f281c0783a0 0x7f281c07a850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 --2- 172.21.15.46:0/1971992810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2834100280 0x7f283410ff50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:16.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 >> 172.21.15.46:0/1971992810 conn(0x7f28340faab0 msgr2=0x7f28340fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 shutdown_connections 2024-05-09T06:32:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:16.150+0000 7f283a0a4700 1 -- 172.21.15.46:0/1971992810 wait complete. 2024-05-09T06:32:16.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:16 smithi046 ceph-mon[26924]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:16.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:16 smithi046 ceph-mon[26924]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:16.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:16 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:16.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:16 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:16.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:16 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/978614020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:16.638 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:16 smithi106 ceph-mon[34679]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:16.638 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:16 smithi106 ceph-mon[34679]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:16.638 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:16 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:16.638 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:16 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:16.638 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:16 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/978614020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:17.642 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:17 smithi106 ceph-mon[34679]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:17.642 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:17 smithi106 ceph-mon[34679]: pgmap v29: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 851 op/s 2024-05-09T06:32:17.642 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:17 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:17.642 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:17 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:17.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:17 smithi046 ceph-mon[26924]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:17.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:17 smithi046 ceph-mon[26924]: pgmap v29: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 851 op/s 2024-05-09T06:32:17.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:17 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:17.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:17 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:19.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:19 smithi106 ceph-mon[34679]: pgmap v30: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 463 op/s 2024-05-09T06:32:19.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:19 smithi046 ceph-mon[26924]: pgmap v30: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 463 op/s 2024-05-09T06:32:20.534 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:20 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx restarted 2024-05-09T06:32:20.534 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:20 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:32:20.534 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:20 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:32:20.534 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:20 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:32:20.534 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:20 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:32:20.534 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:20 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:32:20.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:20 smithi046 ceph-mon[26924]: Standby manager daemon smithi106.nlgnpx restarted 2024-05-09T06:32:20.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:20 smithi046 ceph-mon[26924]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:32:20.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:20 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:32:20.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:20 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:32:20.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:20 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:32:20.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:20 smithi046 ceph-mon[26924]: from='mgr.? 172.21.15.106:0/2834624156' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:32:21.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:21 smithi046 ceph-mon[26924]: pgmap v31: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 463 op/s 2024-05-09T06:32:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:21 smithi046 ceph-mon[26924]: mgrmap e32: smithi046.nvpcui(active, since 56s), standbys: smithi106.nlgnpx 2024-05-09T06:32:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:21 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:21.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:21 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:21.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:21 smithi106 ceph-mon[34679]: pgmap v31: 65 pgs: 65 active+clean; 244 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 463 op/s 2024-05-09T06:32:21.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:21 smithi106 ceph-mon[34679]: mgrmap e32: smithi046.nvpcui(active, since 56s), standbys: smithi106.nlgnpx 2024-05-09T06:32:21.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:21 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:21.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:21 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:23.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:23 smithi106 ceph-mon[34679]: pgmap v32: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 683 op/s 2024-05-09T06:32:23.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:23 smithi046 ceph-mon[26924]: pgmap v32: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 683 op/s 2024-05-09T06:32:25.328 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-05-09T06:32:25.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-09T06:32:25.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:25 smithi046 ceph-mon[26924]: pgmap v33: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.2 MiB/s wr, 449 op/s 2024-05-09T06:32:25.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:25.803 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:25 smithi106 ceph-mon[34679]: pgmap v33: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.2 MiB/s wr, 449 op/s 2024-05-09T06:32:25.804 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:25.805 DEBUG:teuthology.parallel:result is None 2024-05-09T06:32:27.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:27 smithi106 ceph-mon[34679]: pgmap v34: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 760 op/s 2024-05-09T06:32:27.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:27 smithi046 ceph-mon[26924]: pgmap v34: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 760 op/s 2024-05-09T06:32:29.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:29 smithi106 ceph-mon[34679]: pgmap v35: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 594 op/s 2024-05-09T06:32:29.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:29 smithi046 ceph-mon[26924]: pgmap v35: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 594 op/s 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: pgmap v36: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 594 op/s 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.nvpcui"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.nvpcui"}]': finished 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi106.nlgnpx"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi106.nlgnpx"}]': finished 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:31 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: pgmap v36: 65 pgs: 65 active+clean; 236 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 594 op/s 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.nvpcui"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.nvpcui"}]': finished 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi106.nlgnpx"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi106.nlgnpx"}]': finished 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:31.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:31.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:31 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:32.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all mgr 2024-05-09T06:32:32.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all rgw 2024-05-09T06:32:32.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:32:32.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-09T06:32:32.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:32:32.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:32:32.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all nfs 2024-05-09T06:32:32.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:32 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all mgr 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all rgw 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all nfs 2024-05-09T06:32:32.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:32 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:32:33.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:33 smithi106 ceph-mon[34679]: pgmap v37: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 940 op/s 2024-05-09T06:32:33.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:33 smithi046 ceph-mon[26924]: pgmap v37: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 940 op/s 2024-05-09T06:32:34.890 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-05-09T06:32:34.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T06:32:35.222 DEBUG:teuthology.parallel:result is None 2024-05-09T06:32:35.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T06:32:35.255 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T06:32:35.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T06:32:35.285 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-09T06:32:35.286 DEBUG:teuthology.parallel:result is None 2024-05-09T06:32:35.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:35 smithi106 ceph-mon[34679]: Upgrade: Updating node-exporter.smithi046 (1/2) 2024-05-09T06:32:35.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:35 smithi106 ceph-mon[34679]: Deploying daemon node-exporter.smithi046 on smithi046 2024-05-09T06:32:35.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:35 smithi106 ceph-mon[34679]: pgmap v38: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 656 op/s 2024-05-09T06:32:35.779 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:35 smithi046 ceph-mon[26924]: Upgrade: Updating node-exporter.smithi046 (1/2) 2024-05-09T06:32:35.780 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:35 smithi046 ceph-mon[26924]: Deploying daemon node-exporter.smithi046 on smithi046 2024-05-09T06:32:35.780 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:35 smithi046 ceph-mon[26924]: pgmap v38: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 656 op/s 2024-05-09T06:32:37.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:37 smithi106 ceph-mon[34679]: pgmap v39: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 882 op/s 2024-05-09T06:32:37.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:37 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:37.539 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:37 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:37.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:37 smithi046 ceph-mon[26924]: pgmap v39: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 882 op/s 2024-05-09T06:32:37.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:37 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:37.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:37 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:39.631 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:39 smithi106 ceph-mon[34679]: Upgrade: Updating node-exporter.smithi106 (2/2) 2024-05-09T06:32:39.631 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:39 smithi106 ceph-mon[34679]: Deploying daemon node-exporter.smithi106 on smithi106 2024-05-09T06:32:39.632 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:39 smithi106 ceph-mon[34679]: pgmap v40: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.0 MiB/s wr, 571 op/s 2024-05-09T06:32:39.632 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:39 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:39.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:39 smithi046 ceph-mon[26924]: Upgrade: Updating node-exporter.smithi106 (2/2) 2024-05-09T06:32:39.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:39 smithi046 ceph-mon[26924]: Deploying daemon node-exporter.smithi106 on smithi106 2024-05-09T06:32:39.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:39 smithi046 ceph-mon[26924]: pgmap v40: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.0 MiB/s wr, 571 op/s 2024-05-09T06:32:39.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:39 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:41.774 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:41 smithi106 ceph-mon[34679]: pgmap v41: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.0 MiB/s wr, 571 op/s 2024-05-09T06:32:41.774 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:41.774 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:41.774 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:41 smithi046 ceph-mon[26924]: pgmap v41: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.0 MiB/s wr, 571 op/s 2024-05-09T06:32:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:43.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:43 smithi106 ceph-mon[34679]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.0 MiB/s wr, 592 op/s 2024-05-09T06:32:43.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:43 smithi046 ceph-mon[26924]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.0 MiB/s wr, 592 op/s 2024-05-09T06:32:45.014 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:44 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:45.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:44 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:45.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:44 smithi046 ceph-mon[26924]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 579 KiB/s wr, 246 op/s 2024-05-09T06:32:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:44 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:44 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:44 smithi106 ceph-mon[34679]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 579 KiB/s wr, 246 op/s 2024-05-09T06:32:46.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.279+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1532016710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 msgr2=0x7fa3bc0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.279+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1532016710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc0fd290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8004940 tx=0x7fa3b8009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1532016710 shutdown_connections 2024-05-09T06:32:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1532016710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc0fdff0 0x7fa3bc0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1532016710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc0fd290 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1532016710 >> 172.21.15.46:0/1532016710 conn(0x7fa3bc0f8580 msgr2=0x7fa3bc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:46.262 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:46 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:46.262 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:46 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1532016710 shutdown_connections 2024-05-09T06:32:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1532016710 wait complete. 2024-05-09T06:32:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 Processor -- start 2024-05-09T06:32:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- start start 2024-05-09T06:32:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc0fdff0 0x7fa3bc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc072200 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.280+0000 7fa3c47b2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0707f0 con 0x7fa3bc0fdff0 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54486/0 (socket says 172.21.15.46:54486) 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 -- 172.21.15.46:0/1271620024 learned_addr learned my addr 172.21.15.46:0/1271620024 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c1d4d700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc0fdff0 0x7fa3bc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 -- 172.21.15.46:0/1271620024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc0fdff0 msgr2=0x7fa3bc0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc0fdff0 0x7fa3bc0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 -- 172.21.15.46:0/1271620024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8005040 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c254e700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc071c00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8013870 tx=0x7fa3b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3b8021070 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc070a40 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3b8009430 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.281+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3b800e070 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.282+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc070f80 con 0x7fa3bc0fce80 2024-05-09T06:32:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.282+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc04c710 con 0x7fa3bc0fce80 2024-05-09T06:32:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.283+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 99904+0+0 (secure 0 0 0) 0x7fa3b801c750 con 0x7fa3bc0fce80 2024-05-09T06:32:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.284+0000 7fa3b2ffd700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa3a80783a0 0x7fa3a807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:46.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.284+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa3b809b900 con 0x7fa3bc0fce80 2024-05-09T06:32:46.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.284+0000 7fa3c1d4d700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa3a80783a0 0x7fa3a807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:46.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.285+0000 7fa3c1d4d700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa3a80783a0 0x7fa3a807a850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009b80 tx=0x7fa3ac00b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:46.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.288+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fa3b8063c00 con 0x7fa3bc0fce80 2024-05-09T06:32:46.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:46 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:46.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:46 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.522+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3bc1022c0 con 0x7fa3a80783a0 2024-05-09T06:32:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.524+0000 7fa3b2ffd700 1 -- 172.21.15.46:0/1271620024 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fa3bc1022c0 con 0x7fa3a80783a0 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa3a80783a0 msgr2=0x7fa3a807a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa3a80783a0 0x7fa3a807a850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009b80 tx=0x7fa3ac00b040 comp rx=0 tx=0).stop 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 msgr2=0x7fa3bc071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc071c00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8013870 tx=0x7fa3b8009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 shutdown_connections 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3bc0fce80 0x7fa3bc071c00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa3a80783a0 0x7fa3a807a850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 --2- 172.21.15.46:0/1271620024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc0fdff0 0x7fa3bc0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 >> 172.21.15.46:0/1271620024 conn(0x7fa3bc0f8580 msgr2=0x7fa3bc0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:46.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 shutdown_connections 2024-05-09T06:32:46.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.526+0000 7fa3c47b2700 1 -- 172.21.15.46:0/1271620024 wait complete. 2024-05-09T06:32:46.520 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 -- 172.21.15.46:0/2757820215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 msgr2=0x7f86040fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 --2- 172.21.15.46:0/2757820215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f86040fe330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f85ec004940 tx=0x7f85ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:46.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 -- 172.21.15.46:0/2757820215 shutdown_connections 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 --2- 172.21.15.46:0/2757820215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f86040fe330 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 --2- 172.21.15.46:0/2757820215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86040fcc10 0x7f86040fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 -- 172.21.15.46:0/2757820215 >> 172.21.15.46:0/2757820215 conn(0x7f86040f8370 msgr2=0x7f86040fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 -- 172.21.15.46:0/2757820215 shutdown_connections 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 -- 172.21.15.46:0/2757820215 wait complete. 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.636+0000 7f860959f700 1 Processor -- start 2024-05-09T06:32:46.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f860959f700 1 -- start start 2024-05-09T06:32:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f860959f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86040fcc10 0x7f860410fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:46.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f860959f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f860410ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f860959f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604110580 con 0x7f86040fdec0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f860959f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604110dd0 con 0x7f86040fcc10 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f86037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f860410ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f86037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f860410ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54492/0 (socket says 172.21.15.46:54492) 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f86037fe700 1 -- 172.21.15.46:0/2930337981 learned_addr learned my addr 172.21.15.46:0/2930337981 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f8603fff700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86040fcc10 0x7f860410fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f86037fe700 1 -- 172.21.15.46:0/2930337981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86040fcc10 msgr2=0x7f860410fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f86037fe700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86040fcc10 0x7f860410fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.637+0000 7f86037fe700 1 -- 172.21.15.46:0/2930337981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec005040 con 0x7f86040fdec0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.638+0000 7f86037fe700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f860410ff80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00b3b0 tx=0x7f85ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.638+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85ec00e040 con 0x7f86040fdec0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.638+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604111050 con 0x7f86040fdec0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.638+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85ec004290 con 0x7f86040fdec0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.638+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85ec01c3f0 con 0x7f86040fdec0 2024-05-09T06:32:46.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.638+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8604111590 con 0x7f86040fdec0 2024-05-09T06:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.639+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8604101850 con 0x7f86040fdec0 2024-05-09T06:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.640+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f85ec00bbf0 con 0x7f86040fdec0 2024-05-09T06:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.640+0000 7f8600ff9700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f85f00783a0 0x7f85f007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.640+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f85ec09bd60 con 0x7f86040fdec0 2024-05-09T06:32:46.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.640+0000 7f8603fff700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f85f00783a0 0x7f85f007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:46.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.641+0000 7f8603fff700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f85f00783a0 0x7f85f007a850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85f4004f40 tx=0x7f85f400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:46.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.644+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f85ec064120 con 0x7f86040fdec0 2024-05-09T06:32:46.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.903+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8604111870 con 0x7f85f00783a0 2024-05-09T06:32:46.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.904+0000 7f8600ff9700 1 -- 172.21.15.46:0/2930337981 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f8604111870 con 0x7f85f00783a0 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f85f00783a0 msgr2=0x7f85f007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f85f00783a0 0x7f85f007a850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85f4004f40 tx=0x7f85f400b040 comp rx=0 tx=0).stop 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 msgr2=0x7f860410ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f860410ff80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00b3b0 tx=0x7f85ec009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 shutdown_connections 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f85f00783a0 0x7f85f007a850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86040fcc10 0x7f860410fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 --2- 172.21.15.46:0/2930337981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86040fdec0 0x7f860410ff80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 >> 172.21.15.46:0/2930337981 conn(0x7f86040f8370 msgr2=0x7f86040f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 shutdown_connections 2024-05-09T06:32:46.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:46.907+0000 7f860959f700 1 -- 172.21.15.46:0/2930337981 wait complete. 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 -- 172.21.15.46:0/2618343100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 msgr2=0x7f39440ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 --2- 172.21.15.46:0/2618343100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f39440ffda0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3940004940 tx=0x7f3940009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 -- 172.21.15.46:0/2618343100 shutdown_connections 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 --2- 172.21.15.46:0/2618343100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39441002e0 0x7f39441026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 --2- 172.21.15.46:0/2618343100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f39440ffda0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 -- 172.21.15.46:0/2618343100 >> 172.21.15.46:0/2618343100 conn(0x7f39440f7440 msgr2=0x7f39440f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 -- 172.21.15.46:0/2618343100 shutdown_connections 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.015+0000 7f394b987700 1 -- 172.21.15.46:0/2618343100 wait complete. 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.016+0000 7f394b987700 1 Processor -- start 2024-05-09T06:32:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.016+0000 7f394b987700 1 -- start start 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.016+0000 7f394b987700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f394410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.016+0000 7f394b987700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39441002e0 0x7f394410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.016+0000 7f394b987700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394410e660 con 0x7f39440fd9c0 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.016+0000 7f394b987700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394410ee00 con 0x7f39441002e0 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f394410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f394410da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54502/0 (socket says 172.21.15.46:54502) 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 -- 172.21.15.46:0/341471757 learned_addr learned my addr 172.21.15.46:0/341471757 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3948f22700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39441002e0 0x7f394410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 -- 172.21.15.46:0/341471757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39441002e0 msgr2=0x7f394410dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39441002e0 0x7f394410dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 -- 172.21.15.46:0/341471757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940005040 con 0x7f39440fd9c0 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3949723700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f394410da90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3940000c00 tx=0x7f3940009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f394000e040 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394410f080 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f394000bbf0 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.017+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f394001c630 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.018+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394410f640 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.018+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394405f5c0 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.019+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f394000bd60 con 0x7f39440fd9c0 2024-05-09T06:32:47.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.020+0000 7f3939ffb700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39300783a0 0x7f393007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.020+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f394009b220 con 0x7f39440fd9c0 2024-05-09T06:32:47.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.020+0000 7f3948f22700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39300783a0 0x7f393007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.020+0000 7f3948f22700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39300783a0 0x7f393007a850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3934009bf0 tx=0x7f39340091a0 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:47.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.025+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f39400635e0 con 0x7f39440fd9c0 2024-05-09T06:32:47.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.249+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f394410f9e0 con 0x7f39300783a0 2024-05-09T06:32:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.259+0000 7f3939ffb700 1 -- 172.21.15.46:0/341471757 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f394410f9e0 con 0x7f39300783a0 2024-05-09T06:32:47.241 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 1s ago 10m 27.7M - 0.25.0 c8568f914cd2 b54d1522980b 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 1s ago 10m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (9m) 3s ago 9m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 1s ago 10m 83.9M - 9.4.7 954c08fa6188 6732b976122e 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (5m) 1s ago 5m 12.5M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (5m) 1s ago 5m 160M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (5m) 3s ago 5m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (5m) 3s ago 5m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (98s) 1s ago 12m 514M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (35s) 3s ago 9m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 1s ago 12m 55.1M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (9m) 3s ago 9m 42.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (11s) 1s ago 10m 3594k - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:32:47.242 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (6s) 3s ago 9m 8070k - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 1s ago 8m 257M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 1s ago 8m 264M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 1s ago 7m 220M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (7m) 3s ago 7m 285M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (7m) 3s ago 7m 259M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (6m) 3s ago 6m 236M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:32:47.243 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (42s) 1s ago 10m 48.5M - 2.43.0 a07b618ecd1d cefaa4dbac27 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39300783a0 msgr2=0x7f393007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39300783a0 0x7f393007a850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3934009bf0 tx=0x7f39340091a0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 msgr2=0x7f394410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f394410da90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3940000c00 tx=0x7f3940009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 shutdown_connections 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39440fd9c0 0x7f394410da90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f39300783a0 0x7f393007a850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 --2- 172.21.15.46:0/341471757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39441002e0 0x7f394410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 >> 172.21.15.46:0/341471757 conn(0x7f39440f7440 msgr2=0x7f39440f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 shutdown_connections 2024-05-09T06:32:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.262+0000 7f394b987700 1 -- 172.21.15.46:0/341471757 wait complete. 2024-05-09T06:32:47.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 -- 172.21.15.46:0/2581925915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 msgr2=0x7f69480fc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 --2- 172.21.15.46:0/2581925915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69480fc6a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6944004940 tx=0x7f6944009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 -- 172.21.15.46:0/2581925915 shutdown_connections 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 --2- 172.21.15.46:0/2581925915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69480fcbe0 0x7f69480fd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 --2- 172.21.15.46:0/2581925915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69480fc6a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 -- 172.21.15.46:0/2581925915 >> 172.21.15.46:0/2581925915 conn(0x7f69480f6b80 msgr2=0x7f69480f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 -- 172.21.15.46:0/2581925915 shutdown_connections 2024-05-09T06:32:47.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.370+0000 7f694fbd4700 1 -- 172.21.15.46:0/2581925915 wait complete. 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.371+0000 7f694fbd4700 1 Processor -- start 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.371+0000 7f694fbd4700 1 -- start start 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.371+0000 7f694fbd4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69481106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.371+0000 7f694fbd4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69480fcbe0 0x7f6948112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.371+0000 7f694fbd4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480fbc80 con 0x7f69480fc290 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.371+0000 7f694fbd4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480fbdc0 con 0x7f69480fcbe0 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69481106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69481106d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54514/0 (socket says 172.21.15.46:54514) 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 -- 172.21.15.46:0/1187990412 learned_addr learned my addr 172.21.15.46:0/1187990412 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d16f700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69480fcbe0 0x7f6948112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 -- 172.21.15.46:0/1187990412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69480fcbe0 msgr2=0x7f6948112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69480fcbe0 0x7f6948112c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 -- 172.21.15.46:0/1187990412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944005040 con 0x7f69480fc290 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694d970700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69481106d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6944000c00 tx=0x7f6944009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694400e030 con 0x7f69480fc290 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6944013de0 con 0x7f69480fc290 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948113160 con 0x7f69480fc290 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694401ce50 con 0x7f69480fc290 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.372+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69481136a0 con 0x7f69480fc290 2024-05-09T06:32:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.373+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694805f5c0 con 0x7f69480fc290 2024-05-09T06:32:47.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.374+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f694401c400 con 0x7f69480fc290 2024-05-09T06:32:47.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.375+0000 7f693e7fc700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6934078330 0x7f693407a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.375+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f694409b980 con 0x7f69480fc290 2024-05-09T06:32:47.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.375+0000 7f694d16f700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6934078330 0x7f693407a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.375+0000 7f694d16f700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6934078330 0x7f693407a7e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6938009b80 tx=0x7f693800b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:47.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.379+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f6944063c20 con 0x7f69480fc290 2024-05-09T06:32:47.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:47 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:47.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:47 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:47.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:47 smithi106 ceph-mon[34679]: pgmap v44: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 579 KiB/s wr, 247 op/s 2024-05-09T06:32:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:47 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:47.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:47 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:47.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:47 smithi046 ceph-mon[26924]: pgmap v44: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 579 KiB/s wr, 247 op/s 2024-05-09T06:32:47.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.691+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6948104780 con 0x7f69480fc290 2024-05-09T06:32:47.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.691+0000 7f693e7fc700 1 -- 172.21.15.46:0/1187990412 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f69440635c0 con 0x7f69480fc290 2024-05-09T06:32:47.673 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:32:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:32:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:32:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:32:47.674 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:32:47.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6934078330 msgr2=0x7f693407a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6934078330 0x7f693407a7e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6938009b80 tx=0x7f693800b040 comp rx=0 tx=0).stop 2024-05-09T06:32:47.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 msgr2=0x7f69481106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69481106d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6944000c00 tx=0x7f6944009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 shutdown_connections 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69480fc290 0x7f69481106d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f6934078330 0x7f693407a7e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 --2- 172.21.15.46:0/1187990412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69480fcbe0 0x7f6948112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.694+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 >> 172.21.15.46:0/1187990412 conn(0x7f69480f6b80 msgr2=0x7f69480f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.695+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 shutdown_connections 2024-05-09T06:32:47.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.695+0000 7f694fbd4700 1 -- 172.21.15.46:0/1187990412 wait complete. 2024-05-09T06:32:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 -- 172.21.15.46:0/1652753142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fbcb0 msgr2=0x7f11040fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 --2- 172.21.15.46:0/1652753142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fbcb0 0x7f11040fc0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004940 tx=0x7f10f4009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 -- 172.21.15.46:0/1652753142 shutdown_connections 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 --2- 172.21.15.46:0/1652753142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11040fcf60 0x7f11040fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 --2- 172.21.15.46:0/1652753142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fbcb0 0x7f11040fc0c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 -- 172.21.15.46:0/1652753142 >> 172.21.15.46:0/1652753142 conn(0x7f11040f7430 msgr2=0x7f11040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 -- 172.21.15.46:0/1652753142 shutdown_connections 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.804+0000 7f1108e9d700 1 -- 172.21.15.46:0/1652753142 wait complete. 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1108e9d700 1 Processor -- start 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1108e9d700 1 -- start start 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1108e9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11040fbcb0 0x7f110410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1108e9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 0x7f110410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1108e9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110410e4b0 con 0x7f11040fcf60 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1108e9d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110410ed00 con 0x7f11040fbcb0 2024-05-09T06:32:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1101d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 0x7f110410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1101d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 0x7f110410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54534/0 (socket says 172.21.15.46:54534) 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1101d9b700 1 -- 172.21.15.46:0/172928805 learned_addr learned my addr 172.21.15.46:0/172928805 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f110259c700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11040fbcb0 0x7f110410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1101d9b700 1 -- 172.21.15.46:0/172928805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11040fbcb0 msgr2=0x7f110410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1101d9b700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11040fbcb0 0x7f110410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.805+0000 7f1101d9b700 1 -- 172.21.15.46:0/172928805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4005040 con 0x7f11040fcf60 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.806+0000 7f1101d9b700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 0x7f110410deb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00eb40 tx=0x7f10ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.806+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ec007cc0 con 0x7f11040fcf60 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.806+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110410ef80 con 0x7f11040fcf60 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.806+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10ec00f040 con 0x7f11040fcf60 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.806+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ec00ca10 con 0x7f11040fcf60 2024-05-09T06:32:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.806+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110410f4c0 con 0x7f11040fcf60 2024-05-09T06:32:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.807+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1104101af0 con 0x7f11040fcf60 2024-05-09T06:32:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.808+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 99904+0+0 (secure 0 0 0) 0x7f10ec00cc80 con 0x7f11040fcf60 2024-05-09T06:32:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.808+0000 7f10faffd700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f10f00783a0 0x7f10f007a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:32:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.808+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f10ec099bd0 con 0x7f11040fcf60 2024-05-09T06:32:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.808+0000 7f110259c700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f10f00783a0 0x7f10f007a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:32:47.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.809+0000 7f110259c700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f10f00783a0 0x7f10f007a850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009b30 tx=0x7f10f4009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:32:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:47.813+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f10ec061f20 con 0x7f11040fcf60 2024-05-09T06:32:48.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.080+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1104104910 con 0x7f10f00783a0 2024-05-09T06:32:48.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.081+0000 7f10faffd700 1 -- 172.21.15.46:0/172928805 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f1104104910 con 0x7f10f00783a0 2024-05-09T06:32:48.063 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:32:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:32:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:32:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:32:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:32:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:32:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:32:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:32:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading node-exporter daemons", 2024-05-09T06:32:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:32:48.065 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f10f00783a0 msgr2=0x7f10f007a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f10f00783a0 0x7f10f007a850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009b30 tx=0x7f10f4009e30 comp rx=0 tx=0).stop 2024-05-09T06:32:48.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 msgr2=0x7f110410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 0x7f110410deb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00eb40 tx=0x7f10ec00b040 comp rx=0 tx=0).stop 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 shutdown_connections 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f10f00783a0 0x7f10f007a850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11040fbcb0 0x7f110410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 --2- 172.21.15.46:0/172928805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11040fcf60 0x7f110410deb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 >> 172.21.15.46:0/172928805 conn(0x7f11040f7430 msgr2=0x7f1104065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:32:48.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 shutdown_connections 2024-05-09T06:32:48.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:32:48.083+0000 7f1108e9d700 1 -- 172.21.15.46:0/172928805 wait complete. 2024-05-09T06:32:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:48 smithi046 ceph-mon[26924]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:48 smithi046 ceph-mon[26924]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:48 smithi046 ceph-mon[26924]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:48 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:48 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:48 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1187990412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:48 smithi106 ceph-mon[34679]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:48 smithi106 ceph-mon[34679]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:48.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:48 smithi106 ceph-mon[34679]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:48.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:48 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:48.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:48 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:48.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:48 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1187990412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:49 smithi106 ceph-mon[34679]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:49.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:49 smithi106 ceph-mon[34679]: pgmap v45: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-05-09T06:32:49.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:49 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:49.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:49 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:49.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:49 smithi046 ceph-mon[26924]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:32:49.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:49 smithi046 ceph-mon[26924]: pgmap v45: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-05-09T06:32:49.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:49 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:49.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:49 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.802 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: pgmap v46: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-05-09T06:32:51.802 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.802 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.802 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:51.802 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:51 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: pgmap v46: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:51.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:51 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:32:53.750 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:53 smithi046 ceph-mon[26924]: pgmap v47: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-05-09T06:32:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:53 smithi106 ceph-mon[34679]: pgmap v47: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-05-09T06:32:54.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:54 smithi106 ceph-mon[34679]: Upgrade: Updating prometheus.smithi046 2024-05-09T06:32:54.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:54 smithi106 ceph-mon[34679]: Deploying daemon prometheus.smithi046 on smithi046 2024-05-09T06:32:54.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:54 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:54.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:54 smithi046 ceph-mon[26924]: Upgrade: Updating prometheus.smithi046 2024-05-09T06:32:54.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:54 smithi046 ceph-mon[26924]: Deploying daemon prometheus.smithi046 on smithi046 2024-05-09T06:32:54.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:54 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:32:55.485 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:55 smithi046 ceph-mon[26924]: pgmap v48: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 597 B/s wr, 1 op/s 2024-05-09T06:32:55.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:55 smithi106 ceph-mon[34679]: pgmap v48: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 597 B/s wr, 1 op/s 2024-05-09T06:32:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:57 smithi046 ceph-mon[26924]: pgmap v49: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 767 B/s wr, 1 op/s 2024-05-09T06:32:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:57 smithi046 ceph-mon[26924]: mgrmap e33: smithi046.nvpcui(active, since 92s), standbys: smithi106.nlgnpx 2024-05-09T06:32:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:57 smithi106 ceph-mon[34679]: pgmap v49: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 767 B/s wr, 1 op/s 2024-05-09T06:32:57.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:57 smithi106 ceph-mon[34679]: mgrmap e33: smithi046.nvpcui(active, since 92s), standbys: smithi106.nlgnpx 2024-05-09T06:32:59.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:59 smithi046 ceph-mon[26924]: pgmap v50: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:32:59.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:59.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:32:59 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:59 smithi106 ceph-mon[34679]: pgmap v50: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:32:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:32:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:32:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:32:59 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:00.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:00 smithi106 ceph-mon[34679]: pgmap v51: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:33:00.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:00 smithi046 ceph-mon[26924]: pgmap v51: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:33:03.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:03 smithi046 ceph-mon[26924]: pgmap v52: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:33:03.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:03 smithi106 ceph-mon[34679]: pgmap v52: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-05-09T06:33:05.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:05 smithi046 ceph-mon[26924]: pgmap v53: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:33:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:05 smithi106 ceph-mon[34679]: pgmap v53: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:33:06.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:06 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:06.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:06 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:06.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:06 smithi106 ceph-mon[34679]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:33:06.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:06 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:06.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:06 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:06.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:06 smithi046 ceph-mon[26924]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:33:08.016 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:07 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:08.016 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:07 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:07 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:07 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:08 smithi106 ceph-mon[34679]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:08 smithi046 ceph-mon[26924]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:09.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:09 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:10.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:09 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:11.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:11 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:11.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:11 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:13.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:13 smithi106 ceph-mon[34679]: Upgrade: Updating alertmanager.smithi046 2024-05-09T06:33:13.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:13 smithi106 ceph-mon[34679]: Deploying daemon alertmanager.smithi046 on smithi046 2024-05-09T06:33:13.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:13 smithi106 ceph-mon[34679]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:13.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:13 smithi046 ceph-mon[26924]: Upgrade: Updating alertmanager.smithi046 2024-05-09T06:33:13.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:13 smithi046 ceph-mon[26924]: Deploying daemon alertmanager.smithi046 on smithi046 2024-05-09T06:33:13.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:13 smithi046 ceph-mon[26924]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:15.539 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:15 smithi046 ceph-mon[26924]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:15.626 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:15 smithi106 ceph-mon[34679]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:17.643 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:17 smithi046 ceph-mon[26924]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:17.818 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:17 smithi106 ceph-mon[34679]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 -- 172.21.15.46:0/146906397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fbd40 msgr2=0x7f0f280fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/146906397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fbd40 0x7f0f280fc150 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f18004940 tx=0x7f0f18009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 -- 172.21.15.46:0/146906397 shutdown_connections 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/146906397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280fcff0 0x7f0f280fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/146906397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fbd40 0x7f0f280fc150 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 -- 172.21.15.46:0/146906397 >> 172.21.15.46:0/146906397 conn(0x7f0f280f74c0 msgr2=0x7f0f280f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 -- 172.21.15.46:0/146906397 shutdown_connections 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 -- 172.21.15.46:0/146906397 wait complete. 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 Processor -- start 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.207+0000 7f0f2ca05700 1 -- start start 2024-05-09T06:33:18.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f2ca05700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280fbd40 0x7f0f2810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f2ca05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 0x7f0f2810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f2ca05700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2810e5e0 con 0x7f0f280fcff0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f2ca05700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2810ee30 con 0x7f0f280fbd40 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 0x7f0f2810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 0x7f0f2810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36764/0 (socket says 172.21.15.46:36764) 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 -- 172.21.15.46:0/4137096794 learned_addr learned my addr 172.21.15.46:0/4137096794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f2659c700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280fbd40 0x7f0f2810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 -- 172.21.15.46:0/4137096794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280fbd40 msgr2=0x7f0f2810daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280fbd40 0x7f0f2810daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 -- 172.21.15.46:0/4137096794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18005040 con 0x7f0f280fcff0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f25d9b700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 0x7f0f2810dfe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c002a50 tx=0x7f0f1c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.208+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f1c007cc0 con 0x7f0f280fcff0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.209+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f1c00f040 con 0x7f0f280fcff0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.209+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f1c00da30 con 0x7f0f280fcff0 2024-05-09T06:33:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.209+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2810f110 con 0x7f0f280fcff0 2024-05-09T06:33:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.209+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2810f650 con 0x7f0f280fcff0 2024-05-09T06:33:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.210+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28107360 con 0x7f0f280fcff0 2024-05-09T06:33:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.211+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f0f1c00db90 con 0x7f0f280fcff0 2024-05-09T06:33:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.211+0000 7f0f16ffd700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f0f10078290 0x7f0f1007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.211+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0f1c099b60 con 0x7f0f280fcff0 2024-05-09T06:33:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.211+0000 7f0f2659c700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f0f10078290 0x7f0f1007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.212+0000 7f0f2659c700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f0f10078290 0x7f0f1007a740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800b3b0 tx=0x7f0f18009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:18.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.218+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f0f1c062020 con 0x7f0f280fcff0 2024-05-09T06:33:18.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.458+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f28104930 con 0x7f0f10078290 2024-05-09T06:33:18.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.459+0000 7f0f16ffd700 1 -- 172.21.15.46:0/4137096794 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f0f28104930 con 0x7f0f10078290 2024-05-09T06:33:18.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.461+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f0f10078290 msgr2=0x7f0f1007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.461+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f0f10078290 0x7f0f1007a740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800b3b0 tx=0x7f0f18009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:18.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.461+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 msgr2=0x7f0f2810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.461+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 0x7f0f2810dfe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c002a50 tx=0x7f0f1c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.461+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 shutdown_connections 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.461+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f0f10078290 0x7f0f1007a740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.462+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f280fbd40 0x7f0f2810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.462+0000 7f0f2ca05700 1 --2- 172.21.15.46:0/4137096794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f280fcff0 0x7f0f2810dfe0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.462+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 >> 172.21.15.46:0/4137096794 conn(0x7f0f280f74c0 msgr2=0x7f0f280f98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.462+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 shutdown_connections 2024-05-09T06:33:18.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.462+0000 7f0f2ca05700 1 -- 172.21.15.46:0/4137096794 wait complete. 2024-05-09T06:33:18.453 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:33:18.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 -- 172.21.15.46:0/3217300507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80662c0 msgr2=0x7f9ae80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 --2- 172.21.15.46:0/3217300507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80662c0 0x7f9ae80ff9a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009ce0 tx=0x7f9ad8004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:18.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 -- 172.21.15.46:0/3217300507 shutdown_connections 2024-05-09T06:33:18.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 --2- 172.21.15.46:0/3217300507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ae80ffee0 0x7f9ae8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 --2- 172.21.15.46:0/3217300507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80662c0 0x7f9ae80ff9a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 -- 172.21.15.46:0/3217300507 >> 172.21.15.46:0/3217300507 conn(0x7f9ae80f7430 msgr2=0x7f9ae80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 -- 172.21.15.46:0/3217300507 shutdown_connections 2024-05-09T06:33:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 -- 172.21.15.46:0/3217300507 wait complete. 2024-05-09T06:33:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.571+0000 7f9aef18f700 1 Processor -- start 2024-05-09T06:33:18.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9aef18f700 1 -- start start 2024-05-09T06:33:18.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9aef18f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ae80662c0 0x7f9ae80fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9aef18f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 0x7f9ae80fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9aef18f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80fbe30 con 0x7f9ae80ffee0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9aef18f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80fbf70 con 0x7f9ae80662c0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9ae7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 0x7f9ae80fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9ae7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 0x7f9ae80fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36780/0 (socket says 172.21.15.46:36780) 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9ae7fff700 1 -- 172.21.15.46:0/1816283205 learned_addr learned my addr 172.21.15.46:0/1816283205 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9aecf2b700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ae80662c0 0x7f9ae80fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9ae7fff700 1 -- 172.21.15.46:0/1816283205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ae80662c0 msgr2=0x7f9ae80fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9ae7fff700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ae80662c0 0x7f9ae80fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.572+0000 7f9ae7fff700 1 -- 172.21.15.46:0/1816283205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009940 con 0x7f9ae80ffee0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.573+0000 7f9ae7fff700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 0x7f9ae80fb8a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0002a80 tx=0x7f9ad00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.573+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad0007cc0 con 0x7f9ae80ffee0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.573+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ad000f040 con 0x7f9ae80ffee0 2024-05-09T06:33:18.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.573+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae80fc250 con 0x7f9ae80ffee0 2024-05-09T06:33:18.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.573+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ad000dac0 con 0x7f9ae80ffee0 2024-05-09T06:33:18.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.573+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae8115ba0 con 0x7f9ae80ffee0 2024-05-09T06:33:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.574+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae805f5c0 con 0x7f9ae80ffee0 2024-05-09T06:33:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.575+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9ad000dc20 con 0x7f9ae80ffee0 2024-05-09T06:33:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.575+0000 7f9ae57fa700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9ad4078290 0x7f9ad407a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.576+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9ad0099b30 con 0x7f9ae80ffee0 2024-05-09T06:33:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.576+0000 7f9aecf2b700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9ad4078290 0x7f9ad407a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.576+0000 7f9aecf2b700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9ad4078290 0x7f9ad407a740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009cb0 tx=0x7f9ad8004d10 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:18.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.580+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9ad0061fd0 con 0x7f9ae80ffee0 2024-05-09T06:33:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.857+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ae80f8f20 con 0x7f9ad4078290 2024-05-09T06:33:18.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.859+0000 7f9ae57fa700 1 -- 172.21.15.46:0/1816283205 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9ae80f8f20 con 0x7f9ad4078290 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9ad4078290 msgr2=0x7f9ad407a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9ad4078290 0x7f9ad407a740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009cb0 tx=0x7f9ad8004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 msgr2=0x7f9ae80fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 0x7f9ae80fb8a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0002a80 tx=0x7f9ad00046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 shutdown_connections 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9ad4078290 0x7f9ad407a740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ae80662c0 0x7f9ae80fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 --2- 172.21.15.46:0/1816283205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ae80ffee0 0x7f9ae80fb8a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 >> 172.21.15.46:0/1816283205 conn(0x7f9ae80f7430 msgr2=0x7f9ae80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 shutdown_connections 2024-05-09T06:33:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.862+0000 7f9aef18f700 1 -- 172.21.15.46:0/1816283205 wait complete. 2024-05-09T06:33:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.976+0000 7fc776961700 1 -- 172.21.15.46:0/2371988407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700ffee0 msgr2=0x7fc770102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.976+0000 7fc776961700 1 --2- 172.21.15.46:0/2371988407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700ffee0 0x7fc770102300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc764004940 tx=0x7fc764009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.976+0000 7fc776961700 1 -- 172.21.15.46:0/2371988407 shutdown_connections 2024-05-09T06:33:18.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.976+0000 7fc776961700 1 --2- 172.21.15.46:0/2371988407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700ffee0 0x7fc770102300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.976+0000 7fc776961700 1 --2- 172.21.15.46:0/2371988407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7700662c0 0x7fc7700ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 -- 172.21.15.46:0/2371988407 >> 172.21.15.46:0/2371988407 conn(0x7fc7700f7430 msgr2=0x7fc7700f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:18.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 -- 172.21.15.46:0/2371988407 shutdown_connections 2024-05-09T06:33:18.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 -- 172.21.15.46:0/2371988407 wait complete. 2024-05-09T06:33:18.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 Processor -- start 2024-05-09T06:33:18.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 -- start start 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 0x7fc77010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7700ffee0 0x7fc770110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770110780 con 0x7fc7700662c0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.977+0000 7fc776961700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770110fd0 con 0x7fc7700ffee0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 0x7fc77010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 0x7fc77010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36790/0 (socket says 172.21.15.46:36790) 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 -- 172.21.15.46:0/386630330 learned_addr learned my addr 172.21.15.46:0/386630330 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76f7fe700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7700ffee0 0x7fc770110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 -- 172.21.15.46:0/386630330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7700ffee0 msgr2=0x7fc770110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7700ffee0 0x7fc770110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 -- 172.21.15.46:0/386630330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764005040 con 0x7fc7700662c0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76ffff700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 0x7fc77010fc40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c7e0 tx=0x7fc760007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc760012810 con 0x7fc7700662c0 2024-05-09T06:33:18.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7701112b0 con 0x7fc7700662c0 2024-05-09T06:33:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc760012e40 con 0x7fc7700662c0 2024-05-09T06:33:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76000a550 con 0x7fc7700662c0 2024-05-09T06:33:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.978+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7701117f0 con 0x7fc7700662c0 2024-05-09T06:33:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.979+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7700f8f60 con 0x7fc7700662c0 2024-05-09T06:33:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.980+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fc760011380 con 0x7fc7700662c0 2024-05-09T06:33:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.981+0000 7fc76cff9700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fc758078280 0x7fc75807a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.981+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc76009a1d0 con 0x7fc7700662c0 2024-05-09T06:33:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.981+0000 7fc76f7fe700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fc758078280 0x7fc75807a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.981+0000 7fc76f7fe700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fc758078280 0x7fc75807a730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc76400b3b0 tx=0x7fc764009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:18.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:18.985+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fc760062690 con 0x7fc7700662c0 2024-05-09T06:33:19.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.210+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc770111a70 con 0x7fc758078280 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.221+0000 7fc76cff9700 1 -- 172.21.15.46:0/386630330 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc770111a70 con 0x7fc758078280 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 starting - - - - 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (11m) 13s ago 11m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (10m) 35s ago 10m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 13s ago 10m 82.6M - 9.4.7 954c08fa6188 6732b976122e 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (5m) 13s ago 5m 12.6M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (5m) 13s ago 5m 157M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (5m) 35s ago 5m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (5m) 35s ago 5m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:33:19.202 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (2m) 13s ago 12m 516M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (67s) 35s ago 10m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 13s ago 12m 56.3M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (10m) 35s ago 10m 42.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (43s) 13s ago 11m 7952k - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (38s) 35s ago 10m 8070k - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 13s ago 9m 257M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 13s ago 8m 264M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 13s ago 8m 220M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (8m) 35s ago 8m 285M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (7m) 35s ago 7m 259M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (7m) 35s ago 7m 236M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:33:19.203 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (21s) 13s ago 10m 42.7M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:33:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fc758078280 msgr2=0x7fc75807a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fc758078280 0x7fc75807a730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc76400b3b0 tx=0x7fc764009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 msgr2=0x7fc77010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 0x7fc77010fc40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc76000c7e0 tx=0x7fc760007f90 comp rx=0 tx=0).stop 2024-05-09T06:33:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 shutdown_connections 2024-05-09T06:33:19.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7700662c0 0x7fc77010fc40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fc758078280 0x7fc75807a730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 --2- 172.21.15.46:0/386630330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7700ffee0 0x7fc770110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.223+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 >> 172.21.15.46:0/386630330 conn(0x7fc7700f7430 msgr2=0x7fc7700fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.224+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 shutdown_connections 2024-05-09T06:33:19.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.224+0000 7fc776961700 1 -- 172.21.15.46:0/386630330 wait complete. 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 -- 172.21.15.46:0/1524398336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fce60 msgr2=0x7f29f00fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 --2- 172.21.15.46:0/1524398336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fce60 0x7f29f00fd270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f29e0004940 tx=0x7f29e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 -- 172.21.15.46:0/1524398336 shutdown_connections 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 --2- 172.21.15.46:0/1524398336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29f00fdfd0 0x7f29f00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 --2- 172.21.15.46:0/1524398336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fce60 0x7f29f00fd270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 -- 172.21.15.46:0/1524398336 >> 172.21.15.46:0/1524398336 conn(0x7f29f00f8540 msgr2=0x7f29f00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 -- 172.21.15.46:0/1524398336 shutdown_connections 2024-05-09T06:33:19.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.331+0000 7f29f4c44700 1 -- 172.21.15.46:0/1524398336 wait complete. 2024-05-09T06:33:19.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29f4c44700 1 Processor -- start 2024-05-09T06:33:19.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29f4c44700 1 -- start start 2024-05-09T06:33:19.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29f4c44700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29f00fce60 0x7f29f010fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:19.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29f4c44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 0x7f29f0110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:19.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29f4c44700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0110720 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29f4c44700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01150c0 con 0x7f29f00fce60 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29edd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 0x7f29f0110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29edd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 0x7f29f0110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36810/0 (socket says 172.21.15.46:36810) 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29edd9b700 1 -- 172.21.15.46:0/2572605109 learned_addr learned my addr 172.21.15.46:0/2572605109 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29ee59c700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29f00fce60 0x7f29f010fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29edd9b700 1 -- 172.21.15.46:0/2572605109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29f00fce60 msgr2=0x7f29f010fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29edd9b700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29f00fce60 0x7f29f010fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.332+0000 7f29edd9b700 1 -- 172.21.15.46:0/2572605109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0005040 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.333+0000 7f29edd9b700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 0x7f29f0110090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f29e400b790 tx=0x7f29e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.333+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e400f770 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.333+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e400fda0 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.333+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f0115320 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.333+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e400d310 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.333+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f0115890 con 0x7f29f00fdfd0 2024-05-09T06:33:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.334+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0101960 con 0x7f29f00fdfd0 2024-05-09T06:33:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.335+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f29e4010420 con 0x7f29f00fdfd0 2024-05-09T06:33:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.335+0000 7f29deffd700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29d8078290 0x7f29d807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.335+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f29e409a4b0 con 0x7f29f00fdfd0 2024-05-09T06:33:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.335+0000 7f29ee59c700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29d8078290 0x7f29d807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.336+0000 7f29ee59c700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29d8078290 0x7f29d807a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f29e000b3b0 tx=0x7f29e0009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:19.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.339+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f29e4062a90 con 0x7f29f00fdfd0 2024-05-09T06:33:19.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:19 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:19.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:19 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:19.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:19 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:19.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:19 smithi106 ceph-mon[34679]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:19.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:19 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:19.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:19 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:19.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:19 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:19.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:19 smithi046 ceph-mon[26924]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.662+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f29f004c710 con 0x7f29f00fdfd0 2024-05-09T06:33:19.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.662+0000 7f29deffd700 1 -- 172.21.15.46:0/2572605109 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f29e4062430 con 0x7f29f00fdfd0 2024-05-09T06:33:19.643 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:33:19.643 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:33:19.643 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:33:19.644 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:33:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29d8078290 msgr2=0x7f29d807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29d8078290 0x7f29d807a740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f29e000b3b0 tx=0x7f29e0009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 msgr2=0x7f29f0110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 0x7f29f0110090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f29e400b790 tx=0x7f29e4009250 comp rx=0 tx=0).stop 2024-05-09T06:33:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 shutdown_connections 2024-05-09T06:33:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f29d8078290 0x7f29d807a740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29f00fce60 0x7f29f010fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 --2- 172.21.15.46:0/2572605109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f00fdfd0 0x7f29f0110090 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 >> 172.21.15.46:0/2572605109 conn(0x7f29f00f8540 msgr2=0x7f29f00f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 shutdown_connections 2024-05-09T06:33:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.665+0000 7f29f4c44700 1 -- 172.21.15.46:0/2572605109 wait complete. 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 -- 172.21.15.46:0/3111932080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 msgr2=0x7f86b80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 --2- 172.21.15.46:0/3111932080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b80fd290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f86a8004940 tx=0x7f86a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 -- 172.21.15.46:0/3111932080 shutdown_connections 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 --2- 172.21.15.46:0/3111932080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86b80fdff0 0x7f86b80fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 --2- 172.21.15.46:0/3111932080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b80fd290 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 -- 172.21.15.46:0/3111932080 >> 172.21.15.46:0/3111932080 conn(0x7f86b80f8580 msgr2=0x7f86b80fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 -- 172.21.15.46:0/3111932080 shutdown_connections 2024-05-09T06:33:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 -- 172.21.15.46:0/3111932080 wait complete. 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.779+0000 7f86bdd86700 1 Processor -- start 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86bdd86700 1 -- start start 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86bdd86700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86bdd86700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86b80fdff0 0x7f86b80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86bdd86700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8072200 con 0x7f86b80fce80 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86bdd86700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80707f0 con 0x7f86b80fdff0 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b8071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36828/0 (socket says 172.21.15.46:36828) 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b77fe700 1 -- 172.21.15.46:0/1911681470 learned_addr learned my addr 172.21.15.46:0/1911681470 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b6ffd700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86b80fdff0 0x7f86b80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b77fe700 1 -- 172.21.15.46:0/1911681470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86b80fdff0 msgr2=0x7f86b80702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b77fe700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86b80fdff0 0x7f86b80702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.780+0000 7f86b77fe700 1 -- 172.21.15.46:0/1911681470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8005040 con 0x7f86b80fce80 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.781+0000 7f86b77fe700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b8071c00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b3b0 tx=0x7f86a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.781+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a800e040 con 0x7f86b80fce80 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.781+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86a800bcc0 con 0x7f86b80fce80 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.781+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8070a40 con 0x7f86b80fce80 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.781+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a801c630 con 0x7f86b80fce80 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.781+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b8071000 con 0x7f86b80fce80 2024-05-09T06:33:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.782+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b804c710 con 0x7f86b80fce80 2024-05-09T06:33:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.783+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f86a8013980 con 0x7f86b80fce80 2024-05-09T06:33:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.783+0000 7f869ffff700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f86a0078290 0x7f86a007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.783+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f86a809aad0 con 0x7f86b80fce80 2024-05-09T06:33:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.783+0000 7f86b6ffd700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f86a0078290 0x7f86a007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.784+0000 7f86b6ffd700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f86a0078290 0x7f86a007a740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009fd0 tx=0x7f86ac009f60 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:19.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:19.788+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f86a8062f90 con 0x7f86b80fce80 2024-05-09T06:33:20.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.022+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86b8102290 con 0x7f86a0078290 2024-05-09T06:33:20.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.024+0000 7f869ffff700 1 -- 172.21.15.46:0/1911681470 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f86b8102290 con 0x7f86a0078290 2024-05-09T06:33:20.004 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:33:20.004 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading alertmanager daemons", 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:33:20.005 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:33:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f86a0078290 msgr2=0x7f86a007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f86a0078290 0x7f86a007a740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009fd0 tx=0x7f86ac009f60 comp rx=0 tx=0).stop 2024-05-09T06:33:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 msgr2=0x7f86b8071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b8071c00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b3b0 tx=0x7f86a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 shutdown_connections 2024-05-09T06:33:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86b80fce80 0x7f86b8071c00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f86a0078290 0x7f86a007a740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 --2- 172.21.15.46:0/1911681470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86b80fdff0 0x7f86b80702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.026+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 >> 172.21.15.46:0/1911681470 conn(0x7f86b80f8580 msgr2=0x7f86b80f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.027+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 shutdown_connections 2024-05-09T06:33:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:20.027+0000 7f86bdd86700 1 -- 172.21.15.46:0/1911681470 wait complete. 2024-05-09T06:33:20.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:20 smithi106 ceph-mon[34679]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:20.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:20 smithi106 ceph-mon[34679]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:20.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:20 smithi106 ceph-mon[34679]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:20.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:20 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2572605109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:20.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:20 smithi046 ceph-mon[26924]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:20.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:20 smithi046 ceph-mon[26924]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:20.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:20 smithi046 ceph-mon[26924]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:20.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:20 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2572605109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:21.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:21 smithi046 ceph-mon[26924]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:21.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:21 smithi046 ceph-mon[26924]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:21.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:21 smithi106 ceph-mon[34679]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:21.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:21 smithi106 ceph-mon[34679]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:23.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:23 smithi106 ceph-mon[34679]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:23.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:23 smithi046 ceph-mon[26924]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:25.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:24 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:25.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:24 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:25.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:24 smithi106 ceph-mon[34679]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:25.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:24 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:24 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:24 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:24 smithi046 ceph-mon[26924]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:24 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:25.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:25.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:25 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:26.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:26.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:25 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:27.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:26 smithi106 ceph-mon[34679]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:27.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:26 smithi046 ceph-mon[26924]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:29.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:29 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:29.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:29 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:30.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:30 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:30.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:30 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-09T06:33:31.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:31 smithi106 ceph-mon[34679]: Upgrade: Updating grafana.smithi046 2024-05-09T06:33:31.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:31 smithi106 ceph-mon[34679]: Deploying daemon grafana.smithi046 on smithi046 2024-05-09T06:33:31.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:31 smithi106 ceph-mon[34679]: pgmap v66: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:31.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:31 smithi046 ceph-mon[26924]: Upgrade: Updating grafana.smithi046 2024-05-09T06:33:31.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:31 smithi046 ceph-mon[26924]: Deploying daemon grafana.smithi046 on smithi046 2024-05-09T06:33:31.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:31 smithi046 ceph-mon[26924]: pgmap v66: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:33.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:33 smithi106 ceph-mon[34679]: pgmap v67: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:33.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:33 smithi046 ceph-mon[26924]: pgmap v67: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:35.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:35 smithi046 ceph-mon[26924]: pgmap v68: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:35.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:35 smithi106 ceph-mon[34679]: pgmap v68: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:37.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:37 smithi106 ceph-mon[34679]: pgmap v69: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:37.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:37 smithi046 ceph-mon[26924]: pgmap v69: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:39.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:39 smithi106 ceph-mon[34679]: pgmap v70: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:39.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:39 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:39.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:39 smithi046 ceph-mon[26924]: pgmap v70: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:39.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:39 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:41.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:41 smithi046 ceph-mon[26924]: pgmap v71: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:41 smithi106 ceph-mon[34679]: pgmap v71: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:43.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:43 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:43.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:43 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:43.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:43 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:43.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:43 smithi046 ceph-mon[26924]: pgmap v72: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:43.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:43 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:43.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:43 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:43.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:43 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:43.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:43 smithi106 ceph-mon[34679]: pgmap v72: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:45.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:45 smithi046 ceph-mon[26924]: pgmap v73: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:45.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:45 smithi106 ceph-mon[34679]: pgmap v73: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:47.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:47 smithi106 ceph-mon[34679]: pgmap v74: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:47 smithi046 ceph-mon[26924]: pgmap v74: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:48 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:48 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:48.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:48 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:48.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:48 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:49.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:49 smithi046 ceph-mon[26924]: pgmap v75: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:49.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:49 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:49.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:49 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:49 smithi106 ceph-mon[34679]: pgmap v75: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:49.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:49 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:49.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:49 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:50.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.159+0000 7f4def930700 1 -- 172.21.15.46:0/1611919006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 msgr2=0x7f4de80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.159+0000 7f4def930700 1 --2- 172.21.15.46:0/1611919006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fd3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8004940 tx=0x7f4dd8009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.159+0000 7f4def930700 1 -- 172.21.15.46:0/1611919006 shutdown_connections 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.159+0000 7f4def930700 1 --2- 172.21.15.46:0/1611919006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fd3d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.159+0000 7f4def930700 1 --2- 172.21.15.46:0/1611919006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4de80fbcb0 0x7f4de80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.159+0000 7f4def930700 1 -- 172.21.15.46:0/1611919006 >> 172.21.15.46:0/1611919006 conn(0x7f4de80f7430 msgr2=0x7f4de80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 -- 172.21.15.46:0/1611919006 shutdown_connections 2024-05-09T06:33:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 -- 172.21.15.46:0/1611919006 wait complete. 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 Processor -- start 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 -- start start 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4de80fbcb0 0x7f4de80ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80fe830 con 0x7f4de80fcf60 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.160+0000 7f4def930700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80fe970 con 0x7f4de80fbcb0 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40618/0 (socket says 172.21.15.46:40618) 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 -- 172.21.15.46:0/3466278563 learned_addr learned my addr 172.21.15.46:0/3466278563 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4ded6cc700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4de80fbcb0 0x7f4de80ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 -- 172.21.15.46:0/3466278563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4de80fbcb0 msgr2=0x7f4de80ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4de80fbcb0 0x7f4de80ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 -- 172.21.15.46:0/3466278563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8005040 con 0x7f4de80fcf60 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dececb700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fe2a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009150 tx=0x7f4dd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.161+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd800e040 con 0x7f4de80fcf60 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.162+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de80febf0 con 0x7f4de80fcf60 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.162+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4dd800bbf0 con 0x7f4de80fcf60 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.162+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd801c630 con 0x7f4de80fcf60 2024-05-09T06:33:50.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.162+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de8115ab0 con 0x7f4de80fcf60 2024-05-09T06:33:50.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.163+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de8101af0 con 0x7f4de80fcf60 2024-05-09T06:33:50.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.164+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f4dd800bd60 con 0x7f4de80fcf60 2024-05-09T06:33:50.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.164+0000 7f4dddffb700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4dd4078280 0x7f4dd407a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.165+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4dd809b0f0 con 0x7f4de80fcf60 2024-05-09T06:33:50.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.165+0000 7f4ded6cc700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4dd4078280 0x7f4dd407a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.165+0000 7f4ded6cc700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4dd4078280 0x7f4dd407a730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4de80ffb10 tx=0x7f4de400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:50.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.173+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f4dd8063630 con 0x7f4de80fcf60 2024-05-09T06:33:50.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.420+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4de805e3a0 con 0x7f4dd4078280 2024-05-09T06:33:50.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.421+0000 7f4dddffb700 1 -- 172.21.15.46:0/3466278563 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f4de805e3a0 con 0x7f4dd4078280 2024-05-09T06:33:50.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4dd4078280 msgr2=0x7f4dd407a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4dd4078280 0x7f4dd407a730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4de80ffb10 tx=0x7f4de400b040 comp rx=0 tx=0).stop 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 msgr2=0x7f4de80fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fe2a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009150 tx=0x7f4dd8009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 shutdown_connections 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4dd4078280 0x7f4dd407a730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4de80fbcb0 0x7f4de80ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 --2- 172.21.15.46:0/3466278563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4de80fcf60 0x7f4de80fe2a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 >> 172.21.15.46:0/3466278563 conn(0x7f4de80f7430 msgr2=0x7f4de8065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 shutdown_connections 2024-05-09T06:33:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.424+0000 7f4def930700 1 -- 172.21.15.46:0/3466278563 wait complete. 2024-05-09T06:33:50.416 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:33:50.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 -- 172.21.15.46:0/2751105592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fce60 msgr2=0x7f9b640fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 --2- 172.21.15.46:0/2751105592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fce60 0x7f9b640fd270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009ce0 tx=0x7f9b54004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:50.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 -- 172.21.15.46:0/2751105592 shutdown_connections 2024-05-09T06:33:50.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 --2- 172.21.15.46:0/2751105592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b640fdfd0 0x7f9b640fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 --2- 172.21.15.46:0/2751105592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fce60 0x7f9b640fd270 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 -- 172.21.15.46:0/2751105592 >> 172.21.15.46:0/2751105592 conn(0x7f9b640f8560 msgr2=0x7f9b640fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:50.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 -- 172.21.15.46:0/2751105592 shutdown_connections 2024-05-09T06:33:50.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.536+0000 7f9b6b711700 1 -- 172.21.15.46:0/2751105592 wait complete. 2024-05-09T06:33:50.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b6b711700 1 Processor -- start 2024-05-09T06:33:50.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b6b711700 1 -- start start 2024-05-09T06:33:50.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b6b711700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b640fce60 0x7f9b6410db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b6b711700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 0x7f9b6410e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b6b711700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6410e6b0 con 0x7f9b640fdfd0 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b6b711700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6410ef00 con 0x7f9b640fce60 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b68cac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 0x7f9b6410e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b68cac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 0x7f9b6410e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40640/0 (socket says 172.21.15.46:40640) 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b68cac700 1 -- 172.21.15.46:0/3558902500 learned_addr learned my addr 172.21.15.46:0/3558902500 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.537+0000 7f9b694ad700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b640fce60 0x7f9b6410db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b68cac700 1 -- 172.21.15.46:0/3558902500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b640fce60 msgr2=0x7f9b6410db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b68cac700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b640fce60 0x7f9b6410db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b68cac700 1 -- 172.21.15.46:0/3558902500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009940 con 0x7f9b640fdfd0 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b68cac700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 0x7f9b6410e0b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b58002a50 tx=0x7f9b580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b58007cc0 con 0x7f9b640fdfd0 2024-05-09T06:33:50.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b5800f040 con 0x7f9b640fdfd0 2024-05-09T06:33:50.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6410f1e0 con 0x7f9b640fdfd0 2024-05-09T06:33:50.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5800db70 con 0x7f9b640fdfd0 2024-05-09T06:33:50.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.538+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6410f720 con 0x7f9b640fdfd0 2024-05-09T06:33:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.539+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6405f5c0 con 0x7f9b640fdfd0 2024-05-09T06:33:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.540+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9b5800dd10 con 0x7f9b640fdfd0 2024-05-09T06:33:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.540+0000 7f9b61ffb700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9b4c078290 0x7f9b4c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.540+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9b58099410 con 0x7f9b640fdfd0 2024-05-09T06:33:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.540+0000 7f9b694ad700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9b4c078290 0x7f9b4c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.541+0000 7f9b694ad700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9b4c078290 0x7f9b4c07a740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b540095a0 tx=0x7f9b54004d10 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:50.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.545+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9b58061950 con 0x7f9b640fdfd0 2024-05-09T06:33:50.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.785+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b6410faa0 con 0x7f9b4c078290 2024-05-09T06:33:50.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.787+0000 7f9b61ffb700 1 -- 172.21.15.46:0/3558902500 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f9b6410faa0 con 0x7f9b4c078290 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9b4c078290 msgr2=0x7f9b4c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9b4c078290 0x7f9b4c07a740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9b540095a0 tx=0x7f9b54004d10 comp rx=0 tx=0).stop 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 msgr2=0x7f9b6410e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 0x7f9b6410e0b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b58002a50 tx=0x7f9b580046b0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 shutdown_connections 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9b4c078290 0x7f9b4c07a740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b640fce60 0x7f9b6410db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 --2- 172.21.15.46:0/3558902500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b640fdfd0 0x7f9b6410e0b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 >> 172.21.15.46:0/3558902500 conn(0x7f9b640f8560 msgr2=0x7f9b640f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:50.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 shutdown_connections 2024-05-09T06:33:50.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.790+0000 7f9b6b711700 1 -- 172.21.15.46:0/3558902500 wait complete. 2024-05-09T06:33:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 -- 172.21.15.46:0/541646998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 msgr2=0x7fe8480fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 --2- 172.21.15.46:0/541646998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe8480fd270 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe838004940 tx=0x7fe838009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 -- 172.21.15.46:0/541646998 shutdown_connections 2024-05-09T06:33:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 --2- 172.21.15.46:0/541646998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 0x7fe8480fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 --2- 172.21.15.46:0/541646998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe8480fd270 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 -- 172.21.15.46:0/541646998 >> 172.21.15.46:0/541646998 conn(0x7fe8480f8540 msgr2=0x7fe8480fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 -- 172.21.15.46:0/541646998 shutdown_connections 2024-05-09T06:33:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.897+0000 7fe84d302700 1 -- 172.21.15.46:0/541646998 wait complete. 2024-05-09T06:33:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.898+0000 7fe84d302700 1 Processor -- start 2024-05-09T06:33:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.898+0000 7fe84d302700 1 -- start start 2024-05-09T06:33:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.898+0000 7fe84d302700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe84810d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.898+0000 7fe84d302700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 0x7fe84810de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.898+0000 7fe84d302700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84810e410 con 0x7fe8480fce60 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.898+0000 7fe84d302700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84810e580 con 0x7fe8480fdfd0 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe84810d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe84810d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46366/0 (socket says 172.21.15.46:46366) 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 -- 172.21.15.46:0/1527978151 learned_addr learned my addr 172.21.15.46:0/1527978151 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe8467fc700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 0x7fe84810de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 -- 172.21.15.46:0/1527978151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 msgr2=0x7fe84810de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 0x7fe84810de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 -- 172.21.15.46:0/1527978151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838005040 con 0x7fe8480fce60 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe8467fc700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 0x7fe84810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe846ffd700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe84810d8d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe838013870 tx=0x7fe838009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe838021070 con 0x7fe8480fce60 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe83801c400 con 0x7fe8480fce60 2024-05-09T06:33:50.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe848112f80 con 0x7fe8480fce60 2024-05-09T06:33:50.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83800e070 con 0x7fe8480fce60 2024-05-09T06:33:50.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.899+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe848113430 con 0x7fe8480fce60 2024-05-09T06:33:50.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.900+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84804c710 con 0x7fe8480fce60 2024-05-09T06:33:50.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.901+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fe83801ca20 con 0x7fe8480fce60 2024-05-09T06:33:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.902+0000 7fe82f7fe700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fe830078290 0x7fe83007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.902+0000 7fe8467fc700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fe830078290 0x7fe83007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.902+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe83809b6e0 con 0x7fe8480fce60 2024-05-09T06:33:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.902+0000 7fe8467fc700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fe830078290 0x7fe83007a740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe83c004600 tx=0x7fe83c00b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:50.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:50.906+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fe838063cc0 con 0x7fe8480fce60 2024-05-09T06:33:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.133+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8481022b0 con 0x7fe830078290 2024-05-09T06:33:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.143+0000 7fe82f7fe700 1 -- 172.21.15.46:0/1527978151 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe8481022b0 con 0x7fe830078290 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (33s) 3s ago 11m 16.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 3s ago 12m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (10m) 67s ago 10m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (9s) 3s ago 11m 54.9M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (6m) 3s ago 6m 12.8M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (6m) 3s ago 6m 156M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (6m) 67s ago 6m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (6m) 67s ago 6m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (2m) 3s ago 13m 525M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (99s) 67s ago 10m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 3s ago 13m 57.1M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:33:51.125 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (10m) 67s ago 10m 42.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (74s) 3s ago 11m 13.2M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (70s) 67s ago 10m 8070k - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 3s ago 9m 258M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 3s ago 9m 266M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 3s ago 8m 220M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (8m) 67s ago 8m 285M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (8m) 67s ago 8m 259M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (7m) 67s ago 7m 236M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:33:51.126 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (53s) 3s ago 11m 51.4M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:33:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.146+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fe830078290 msgr2=0x7fe83007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.146+0000 7fe84d302700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fe830078290 0x7fe83007a740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe83c004600 tx=0x7fe83c00b040 comp rx=0 tx=0).stop 2024-05-09T06:33:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 msgr2=0x7fe84810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe84810d8d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe838013870 tx=0x7fe838009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 shutdown_connections 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8480fce60 0x7fe84810d8d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fe830078290 0x7fe83007a740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 --2- 172.21.15.46:0/1527978151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8480fdfd0 0x7fe84810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 >> 172.21.15.46:0/1527978151 conn(0x7fe8480f8540 msgr2=0x7fe8480f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 shutdown_connections 2024-05-09T06:33:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.147+0000 7fe84d302700 1 -- 172.21.15.46:0/1527978151 wait complete. 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 -- 172.21.15.46:0/2386566878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 msgr2=0x7f4f340fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 --2- 172.21.15.46:0/2386566878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f340fe4f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4f28004940 tx=0x7f4f28009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 -- 172.21.15.46:0/2386566878 shutdown_connections 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 --2- 172.21.15.46:0/2386566878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f340fe4f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 --2- 172.21.15.46:0/2386566878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 0x7f4f340fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 -- 172.21.15.46:0/2386566878 >> 172.21.15.46:0/2386566878 conn(0x7f4f340f8590 msgr2=0x7f4f340fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 -- 172.21.15.46:0/2386566878 shutdown_connections 2024-05-09T06:33:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.275+0000 7f4f38f91700 1 -- 172.21.15.46:0/2386566878 wait complete. 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f38f91700 1 Processor -- start 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f38f91700 1 -- start start 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f38f91700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 0x7f4f3410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f38f91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f3410df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f38f91700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3410e5f0 con 0x7f4f340fe080 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f38f91700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3410ede0 con 0x7f4f340fce80 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f31d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f3410df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f31d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f3410df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46382/0 (socket says 172.21.15.46:46382) 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f31d9b700 1 -- 172.21.15.46:0/1918011672 learned_addr learned my addr 172.21.15.46:0/1918011672 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.276+0000 7f4f3259c700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 0x7f4f3410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f31d9b700 1 -- 172.21.15.46:0/1918011672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 msgr2=0x7f4f3410da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f31d9b700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 0x7f4f3410da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f31d9b700 1 -- 172.21.15.46:0/1918011672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28005040 con 0x7f4f340fe080 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f3259c700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 0x7f4f3410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f31d9b700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f3410df60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800b3b0 tx=0x7f4f28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2800e040 con 0x7f4f340fe080 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f2800bcc0 con 0x7f4f340fe080 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3410f060 con 0x7f4f340fe080 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3410f620 con 0x7f4f340fe080 2024-05-09T06:33:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.277+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2801c630 con 0x7f4f340fe080 2024-05-09T06:33:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.278+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3405f5c0 con 0x7f4f340fe080 2024-05-09T06:33:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.279+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f4f28013980 con 0x7f4f340fe080 2024-05-09T06:33:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.280+0000 7f4f22ffd700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4f1c078290 0x7f4f1c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.280+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4f2809b1d0 con 0x7f4f340fe080 2024-05-09T06:33:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.280+0000 7f4f3259c700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4f1c078290 0x7f4f1c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.281+0000 7f4f3259c700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4f1c078290 0x7f4f1c07a740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f340fdbf0 tx=0x7f4f24008040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.284+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f4f28063710 con 0x7f4f340fe080 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.602+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f34105940 con 0x7f4f340fe080 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.602+0000 7f4f22ffd700 1 -- 172.21.15.46:0/1918011672 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f4f280630b0 con 0x7f4f340fe080 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:33:51.584 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:33:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4f1c078290 msgr2=0x7f4f1c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4f1c078290 0x7f4f1c07a740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f340fdbf0 tx=0x7f4f24008040 comp rx=0 tx=0).stop 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 msgr2=0x7f4f3410df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f3410df60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800b3b0 tx=0x7f4f28009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 shutdown_connections 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4f1c078290 0x7f4f1c07a740 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f340fce80 0x7f4f3410da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 --2- 172.21.15.46:0/1918011672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f340fe080 0x7f4f3410df60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 >> 172.21.15.46:0/1918011672 conn(0x7f4f340f8590 msgr2=0x7f4f340f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 shutdown_connections 2024-05-09T06:33:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.605+0000 7f4f38f91700 1 -- 172.21.15.46:0/1918011672 wait complete. 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 -- 172.21.15.46:0/2398047480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 msgr2=0x7fb8e40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/2398047480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e40fd3e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc004940 tx=0x7fb8cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 -- 172.21.15.46:0/2398047480 shutdown_connections 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/2398047480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e40fd3e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/2398047480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e40fbcc0 0x7fb8e40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 -- 172.21.15.46:0/2398047480 >> 172.21.15.46:0/2398047480 conn(0x7fb8e40f7440 msgr2=0x7fb8e40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 -- 172.21.15.46:0/2398047480 shutdown_connections 2024-05-09T06:33:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.713+0000 7fb8e9c36700 1 -- 172.21.15.46:0/2398047480 wait complete. 2024-05-09T06:33:51.696 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:51 smithi046 ceph-mon[26924]: pgmap v76: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:51.696 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:51 smithi046 ceph-mon[26924]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e9c36700 1 Processor -- start 2024-05-09T06:33:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e9c36700 1 -- start start 2024-05-09T06:33:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e9c36700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e40fbcc0 0x7fb8e410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e9c36700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e9c36700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e410e4c0 con 0x7fb8e40fcf70 2024-05-09T06:33:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e9c36700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e410e630 con 0x7fb8e40fbcc0 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8daffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8daffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46398/0 (socket says 172.21.15.46:46398) 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8daffd700 1 -- 172.21.15.46:0/3167861031 learned_addr learned my addr 172.21.15.46:0/3167861031 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.714+0000 7fb8e37fe700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e40fbcc0 0x7fb8e410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8daffd700 1 -- 172.21.15.46:0/3167861031 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e40fbcc0 msgr2=0x7fb8e410d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8daffd700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e40fbcc0 0x7fb8e410d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8daffd700 1 -- 172.21.15.46:0/3167861031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc005040 con 0x7fb8e40fcf70 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8daffd700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e410dec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0040d0 tx=0x7fb8cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8cc021070 con 0x7fb8e40fcf70 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8cc009430 con 0x7fb8e40fcf70 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e4112f90 con 0x7fb8e40fcf70 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8cc00e070 con 0x7fb8e40fcf70 2024-05-09T06:33:51.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.715+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e4113440 con 0x7fb8e40fcf70 2024-05-09T06:33:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.716+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e4101b00 con 0x7fb8e40fcf70 2024-05-09T06:33:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.717+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fb8cc01c770 con 0x7fb8e40fcf70 2024-05-09T06:33:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.718+0000 7fb8e0ff9700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fb8d0078280 0x7fb8d007a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:33:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.718+0000 7fb8e37fe700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fb8d0078280 0x7fb8d007a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:33:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.718+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb8cc09b680 con 0x7fb8e40fcf70 2024-05-09T06:33:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.718+0000 7fb8e37fe700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fb8d0078280 0x7fb8d007a730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009fd0 tx=0x7fb8d400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:33:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.722+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fb8cc063c60 con 0x7fb8e40fcf70 2024-05-09T06:33:51.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:51 smithi106 ceph-mon[34679]: pgmap v76: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:51.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:51 smithi106 ceph-mon[34679]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.956+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e402b490 con 0x7fb8d0078280 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.957+0000 7fb8e0ff9700 1 -- 172.21.15.46:0/3167861031 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fb8e402b490 con 0x7fb8d0078280 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:33:51.939 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:33:51.940 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:33:51.940 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-05-09T06:33:51.940 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading grafana daemons", 2024-05-09T06:33:51.940 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:33:51.940 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:33:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fb8d0078280 msgr2=0x7fb8d007a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fb8d0078280 0x7fb8d007a730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009fd0 tx=0x7fb8d400b040 comp rx=0 tx=0).stop 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 msgr2=0x7fb8e410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e410dec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0040d0 tx=0x7fb8cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 shutdown_connections 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fb8d0078280 0x7fb8d007a730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8e40fbcc0 0x7fb8e410d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 --2- 172.21.15.46:0/3167861031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e40fcf70 0x7fb8e410dec0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 >> 172.21.15.46:0/3167861031 conn(0x7fb8e40f7440 msgr2=0x7fb8e40667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 shutdown_connections 2024-05-09T06:33:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:33:51.960+0000 7fb8e9c36700 1 -- 172.21.15.46:0/3167861031 wait complete. 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1918011672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:52.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:33:52.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:33:52.827 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:52 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1918011672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:33:52.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:33:52.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:33:52.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:33:52.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:52 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: Upgrade: Finalizing container_image settings 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: Upgrade: Complete! 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: pgmap v77: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:53.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:53.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:53.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:53.825 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: Upgrade: Finalizing container_image settings 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: Upgrade: Complete! 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: pgmap v77: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:33:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:54.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:54 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:54.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:54 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:54.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:54 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:33:54.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:54 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:33:55.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:55 smithi046 ceph-mon[26924]: pgmap v78: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:55.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:55 smithi106 ceph-mon[34679]: pgmap v78: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:57 smithi106 ceph-mon[34679]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:57.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:57 smithi046 ceph-mon[26924]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:33:59 smithi106 ceph-mon[34679]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:33:59.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:33:59 smithi046 ceph-mon[26924]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:01.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:01 smithi106 ceph-mon[34679]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:01.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:01 smithi046 ceph-mon[26924]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:03.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:03 smithi106 ceph-mon[34679]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:03.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:03 smithi046 ceph-mon[26924]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:05.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:05 smithi046 ceph-mon[26924]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:05 smithi106 ceph-mon[34679]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:06.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:06 smithi106 ceph-mon[34679]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:06.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:06 smithi046 ceph-mon[26924]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:09.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:09 smithi046 ceph-mon[26924]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:09.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:09 smithi106 ceph-mon[34679]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:10 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:10 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:11.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:11 smithi106 ceph-mon[34679]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:11.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:11 smithi046 ceph-mon[26924]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:13.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:13 smithi106 ceph-mon[34679]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:13.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:13 smithi046 ceph-mon[26924]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:15 smithi046 ceph-mon[26924]: pgmap v88: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:15.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:15 smithi106 ceph-mon[34679]: pgmap v88: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:17 smithi106 ceph-mon[34679]: pgmap v89: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:17.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:17 smithi046 ceph-mon[26924]: pgmap v89: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:19.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:19 smithi106 ceph-mon[34679]: pgmap v90: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:19.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:19 smithi046 ceph-mon[26924]: pgmap v90: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:21 smithi106 ceph-mon[34679]: pgmap v91: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:21.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:21 smithi046 ceph-mon[26924]: pgmap v91: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 -- 172.21.15.46:0/582922721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc0fff70 msgr2=0x7f24cc102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 --2- 172.21.15.46:0/582922721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc0fff70 0x7f24cc102350 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f24bc004940 tx=0x7f24bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 -- 172.21.15.46:0/582922721 shutdown_connections 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 --2- 172.21.15.46:0/582922721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc0fff70 0x7f24cc102350 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 --2- 172.21.15.46:0/582922721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24cc066ed0 0x7f24cc0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 -- 172.21.15.46:0/582922721 >> 172.21.15.46:0/582922721 conn(0x7f24cc0f7440 msgr2=0x7f24cc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 -- 172.21.15.46:0/582922721 shutdown_connections 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 -- 172.21.15.46:0/582922721 wait complete. 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 Processor -- start 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.081+0000 7f24d4445700 1 -- start start 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d4445700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 0x7f24cc10d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d4445700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24cc0fff70 0x7f24cc10dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d4445700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc10e4e0 con 0x7f24cc066ed0 2024-05-09T06:34:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d4445700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc10e650 con 0x7f24cc0fff70 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 0x7f24cc10d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 0x7f24cc10d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36692/0 (socket says 172.21.15.46:36692) 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 -- 172.21.15.46:0/3792414454 learned_addr learned my addr 172.21.15.46:0/3792414454 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d19e0700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24cc0fff70 0x7f24cc10dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 -- 172.21.15.46:0/3792414454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24cc0fff70 msgr2=0x7f24cc10dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24cc0fff70 0x7f24cc10dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 -- 172.21.15.46:0/3792414454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc005040 con 0x7f24cc066ed0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d21e1700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 0x7f24cc10d9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f24c800c8e0 tx=0x7f24c80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c800a940 con 0x7f24cc066ed0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc1130b0 con 0x7f24cc066ed0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.082+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24c800ce80 con 0x7f24cc066ed0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.083+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c80113a0 con 0x7f24cc066ed0 2024-05-09T06:34:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.083+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc113670 con 0x7f24cc066ed0 2024-05-09T06:34:22.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.084+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc04c710 con 0x7f24cc066ed0 2024-05-09T06:34:22.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.084+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f24c8012400 con 0x7f24cc066ed0 2024-05-09T06:34:22.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.085+0000 7f24c2ffd700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f24b8078290 0x7f24b807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:22.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.085+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f24c8099e70 con 0x7f24cc066ed0 2024-05-09T06:34:22.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.085+0000 7f24d19e0700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f24b8078290 0x7f24b807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:22.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.085+0000 7f24d19e0700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f24b8078290 0x7f24b807a740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f24bc004f90 tx=0x7f24bc009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:22.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.090+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f24c80623b0 con 0x7f24cc066ed0 2024-05-09T06:34:22.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.325+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24cc0f8f30 con 0x7f24b8078290 2024-05-09T06:34:22.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.326+0000 7f24c2ffd700 1 -- 172.21.15.46:0/3792414454 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f24cc0f8f30 con 0x7f24b8078290 2024-05-09T06:34:22.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f24b8078290 msgr2=0x7f24b807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:22.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f24b8078290 0x7f24b807a740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f24bc004f90 tx=0x7f24bc009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:22.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 msgr2=0x7f24cc10d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:22.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 0x7f24cc10d9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f24c800c8e0 tx=0x7f24c80044c0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 shutdown_connections 2024-05-09T06:34:22.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24cc066ed0 0x7f24cc10d9a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f24b8078290 0x7f24b807a740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 --2- 172.21.15.46:0/3792414454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24cc0fff70 0x7f24cc10dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:22.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.328+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 >> 172.21.15.46:0/3792414454 conn(0x7f24cc0f7440 msgr2=0x7f24cc0f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:22.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.329+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 shutdown_connections 2024-05-09T06:34:22.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:22.329+0000 7f24d4445700 1 -- 172.21.15.46:0/3792414454 wait complete. 2024-05-09T06:34:22.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-05-09T06:34:23.282 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:23.785 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:23 smithi046 ceph-mon[26924]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:23.785 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:23 smithi046 ceph-mon[26924]: pgmap v92: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:23.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:23 smithi106 ceph-mon[34679]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:23.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:23 smithi106 ceph-mon[34679]: pgmap v92: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:24.766 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:24 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:24.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:24 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 -- 172.21.15.46:0/284013657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 msgr2=0x7fbe240fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 --2- 172.21.15.46:0/284013657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe240fcdd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe14004940 tx=0x7fbe14009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 -- 172.21.15.46:0/284013657 shutdown_connections 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 --2- 172.21.15.46:0/284013657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe240fcdd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 --2- 172.21.15.46:0/284013657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 0x7fbe24103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 -- 172.21.15.46:0/284013657 >> 172.21.15.46:0/284013657 conn(0x7fbe240f8930 msgr2=0x7fbe240fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 -- 172.21.15.46:0/284013657 shutdown_connections 2024-05-09T06:34:24.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.891+0000 7fbe2c539700 1 -- 172.21.15.46:0/284013657 wait complete. 2024-05-09T06:34:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2c539700 1 Processor -- start 2024-05-09T06:34:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2c539700 1 -- start start 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2c539700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 0x7fbe24113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2c539700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe24113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2c539700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241144e0 con 0x7fbe24103760 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2c539700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2410dae0 con 0x7fbe24102dc0 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe29ad4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe24113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe29ad4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe24113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36704/0 (socket says 172.21.15.46:36704) 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe29ad4700 1 -- 172.21.15.46:0/487049613 learned_addr learned my addr 172.21.15.46:0/487049613 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe2a2d5700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 0x7fbe24113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe29ad4700 1 -- 172.21.15.46:0/487049613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 msgr2=0x7fbe24113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.892+0000 7fbe29ad4700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 0x7fbe24113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe29ad4700 1 -- 172.21.15.46:0/487049613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14005040 con 0x7fbe24103760 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe2a2d5700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 0x7fbe24113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe29ad4700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe24113e90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009180 tx=0x7fbe14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1400e040 con 0x7fbe24103760 2024-05-09T06:34:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe1400bbc0 con 0x7fbe24103760 2024-05-09T06:34:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2410dd60 con 0x7fbe24103760 2024-05-09T06:34:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe1401c3f0 con 0x7fbe24103760 2024-05-09T06:34:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.893+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2410e320 con 0x7fbe24103760 2024-05-09T06:34:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.894+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe240fe510 con 0x7fbe24103760 2024-05-09T06:34:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.895+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fbe1400bd30 con 0x7fbe24103760 2024-05-09T06:34:24.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.895+0000 7fbe1affd700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fbe10078290 0x7fbe1007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:24.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.895+0000 7fbe2a2d5700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fbe10078290 0x7fbe1007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:24.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.895+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbe1409afe0 con 0x7fbe24103760 2024-05-09T06:34:24.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.896+0000 7fbe2a2d5700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fbe10078290 0x7fbe1007a740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007fd0 tx=0x7fbe20009040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:24.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:24.900+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fbe140635c0 con 0x7fbe24103760 2024-05-09T06:34:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.210+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe24109ea0 con 0x7fbe24103760 2024-05-09T06:34:25.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.211+0000 7fbe1affd700 1 -- 172.21.15.46:0/487049613 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fbe14062f60 con 0x7fbe24103760 2024-05-09T06:34:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fbe10078290 msgr2=0x7fbe1007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fbe10078290 0x7fbe1007a740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007fd0 tx=0x7fbe20009040 comp rx=0 tx=0).stop 2024-05-09T06:34:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 msgr2=0x7fbe24113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe24113e90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009180 tx=0x7fbe14009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:25.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 shutdown_connections 2024-05-09T06:34:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fbe10078290 0x7fbe1007a740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe24102dc0 0x7fbe24113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.213+0000 7fbe2c539700 1 --2- 172.21.15.46:0/487049613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe24103760 0x7fbe24113e90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.214+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 >> 172.21.15.46:0/487049613 conn(0x7fbe240f8930 msgr2=0x7fbe240f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.214+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 shutdown_connections 2024-05-09T06:34:25.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:25.214+0000 7fbe2c539700 1 -- 172.21.15.46:0/487049613 wait complete. 2024-05-09T06:34:25.206 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:34:25.484 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:25 smithi046 ceph-mon[26924]: pgmap v93: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:25.485 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:25 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/487049613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:25.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-05-09T06:34:25.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:25 smithi106 ceph-mon[34679]: pgmap v93: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:25.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:25 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/487049613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:26.093 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:27.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:27 smithi046 ceph-mon[26924]: pgmap v94: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 -- 172.21.15.46:0/1154189272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 msgr2=0x7f20f40fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/1154189272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f40fc1b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f20dc004940 tx=0x7f20dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 -- 172.21.15.46:0/1154189272 shutdown_connections 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/1154189272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f40fc1b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/1154189272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20f4101d90 0x7f20f4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 -- 172.21.15.46:0/1154189272 >> 172.21.15.46:0/1154189272 conn(0x7f20f4071d00 msgr2=0x7f20f4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 -- 172.21.15.46:0/1154189272 shutdown_connections 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.745+0000 7f20f9cc5700 1 -- 172.21.15.46:0/1154189272 wait complete. 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f9cc5700 1 Processor -- start 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f9cc5700 1 -- start start 2024-05-09T06:34:27.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f9cc5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f4113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f9cc5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20f4101d90 0x7f20f41140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f9cc5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f41147a0 con 0x7f20f40fbd40 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f9cc5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f410db00 con 0x7f20f4101d90 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.746+0000 7f20f37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f4113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f4113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36722/0 (socket says 172.21.15.46:36722) 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f37fe700 1 -- 172.21.15.46:0/2646559278 learned_addr learned my addr 172.21.15.46:0/2646559278 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20eaffd700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20f4101d90 0x7f20f41140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f37fe700 1 -- 172.21.15.46:0/2646559278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20f4101d90 msgr2=0x7f20f41140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f37fe700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20f4101d90 0x7f20f41140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f37fe700 1 -- 172.21.15.46:0/2646559278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc005040 con 0x7f20f40fbd40 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f37fe700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f4113b80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f20e400b790 tx=0x7f20e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e400f6f0 con 0x7f20f40fbd40 2024-05-09T06:34:27.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20e400fd20 con 0x7f20f40fbd40 2024-05-09T06:34:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f410dde0 con 0x7f20f40fbd40 2024-05-09T06:34:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e40103a0 con 0x7f20f40fbd40 2024-05-09T06:34:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.747+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f410e370 con 0x7f20f40fbd40 2024-05-09T06:34:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.748+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f40fd430 con 0x7f20f40fbd40 2024-05-09T06:34:27.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.749+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f20e4011400 con 0x7f20f40fbd40 2024-05-09T06:34:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.749+0000 7f20f0ff9700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f20e0078290 0x7f20e007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.750+0000 7f20eaffd700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f20e0078290 0x7f20e007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.750+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f20e4099aa0 con 0x7f20f40fbd40 2024-05-09T06:34:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.750+0000 7f20eaffd700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f20e0078290 0x7f20e007a740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f20f410f4b0 tx=0x7f20dc009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:27.755+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f20e4062080 con 0x7f20f40fbd40 2024-05-09T06:34:27.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:27 smithi106 ceph-mon[34679]: pgmap v94: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:28.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.059+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20f404bed0 con 0x7f20f40fbd40 2024-05-09T06:34:28.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.060+0000 7f20f0ff9700 1 -- 172.21.15.46:0/2646559278 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f20e4061a20 con 0x7f20f40fbd40 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f20e0078290 msgr2=0x7f20e007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f20e0078290 0x7f20e007a740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f20f410f4b0 tx=0x7f20dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 msgr2=0x7f20f4113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f4113b80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f20e400b790 tx=0x7f20e4009250 comp rx=0 tx=0).stop 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 shutdown_connections 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f40fbd40 0x7f20f4113b80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f20e0078290 0x7f20e007a740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 --2- 172.21.15.46:0/2646559278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20f4101d90 0x7f20f41140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 >> 172.21.15.46:0/2646559278 conn(0x7f20f4071d00 msgr2=0x7f20f4065620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 shutdown_connections 2024-05-09T06:34:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:28.062+0000 7f20f9cc5700 1 -- 172.21.15.46:0/2646559278 wait complete. 2024-05-09T06:34:28.054 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)" 2024-05-09T06:34:28.718 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:28 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2646559278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:28.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-05-09T06:34:28.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:28 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2646559278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:29.022 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:29.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:29 smithi106 ceph-mon[34679]: pgmap v95: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:29.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:29 smithi046 ceph-mon[26924]: pgmap v95: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:30.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 -- 172.21.15.46:0/731178670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 msgr2=0x7fd4e40fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 --2- 172.21.15.46:0/731178670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e40fe230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4004940 tx=0x7fd4d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 -- 172.21.15.46:0/731178670 shutdown_connections 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 --2- 172.21.15.46:0/731178670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 0x7fd4e4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 --2- 172.21.15.46:0/731178670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e40fe230 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 -- 172.21.15.46:0/731178670 >> 172.21.15.46:0/731178670 conn(0x7fd4e40f7870 msgr2=0x7fd4e40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 -- 172.21.15.46:0/731178670 shutdown_connections 2024-05-09T06:34:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 -- 172.21.15.46:0/731178670 wait complete. 2024-05-09T06:34:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 Processor -- start 2024-05-09T06:34:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.718+0000 7fd4e9684700 1 -- start start 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e9684700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e4113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e9684700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 0x7fd4e4113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e9684700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41144d0 con 0x7fd4e40fde60 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e9684700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e410dad0 con 0x7fd4e40fe800 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e4113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e4113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35016/0 (socket says 172.21.15.46:35016) 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/4185470037 learned_addr learned my addr 172.21.15.46:0/4185470037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e27fc700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 0x7fd4e4113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/4185470037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 msgr2=0x7fd4e4113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 0x7fd4e4113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/4185470037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d4005040 con 0x7fd4e40fde60 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e27fc700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 0x7fd4e4113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4e2ffd700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e4113940 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009380 tx=0x7fd4d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.719+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d400e040 con 0x7fd4e40fde60 2024-05-09T06:34:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.720+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e410ddb0 con 0x7fd4e40fde60 2024-05-09T06:34:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.720+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4d4009af0 con 0x7fd4e40fde60 2024-05-09T06:34:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.720+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d401c630 con 0x7fd4e40fde60 2024-05-09T06:34:30.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.720+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e410e2f0 con 0x7fd4e40fde60 2024-05-09T06:34:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.720+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e4066ad0 con 0x7fd4e40fde60 2024-05-09T06:34:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.721+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fd4d400bbc0 con 0x7fd4e40fde60 2024-05-09T06:34:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.722+0000 7fd4db7fe700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd4d0078290 0x7fd4d007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.722+0000 7fd4e27fc700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd4d0078290 0x7fd4d007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.722+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd4d409b030 con 0x7fd4e40fde60 2024-05-09T06:34:30.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.722+0000 7fd4e27fc700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd4d0078290 0x7fd4d007a740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc007fd0 tx=0x7fd4cc009040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:30.727+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fd4d4063570 con 0x7fd4e40fde60 2024-05-09T06:34:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.031+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd4e4109e20 con 0x7fd4e40fde60 2024-05-09T06:34:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.031+0000 7fd4db7fe700 1 -- 172.21.15.46:0/4185470037 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fd4d4062f10 con 0x7fd4e40fde60 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd4d0078290 msgr2=0x7fd4d007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd4d0078290 0x7fd4d007a740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc007fd0 tx=0x7fd4cc009040 comp rx=0 tx=0).stop 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 msgr2=0x7fd4e4113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e4113940 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009380 tx=0x7fd4d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 shutdown_connections 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4e40fde60 0x7fd4e4113940 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd4d0078290 0x7fd4d007a740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 --2- 172.21.15.46:0/4185470037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40fe800 0x7fd4e4113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 >> 172.21.15.46:0/4185470037 conn(0x7fd4e40f7870 msgr2=0x7fd4e41016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 shutdown_connections 2024-05-09T06:34:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:31.034+0000 7fd4e9684700 1 -- 172.21.15.46:0/4185470037 wait complete. 2024-05-09T06:34:31.025 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:34:31.715 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:31 smithi046 ceph-mon[26924]: pgmap v96: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:31.715 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:31 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/4185470037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:31.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-05-09T06:34:31.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:31 smithi106 ceph-mon[34679]: pgmap v96: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:31.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:31 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/4185470037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:33.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 -- 172.21.15.46:0/2948896259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744102dc0 msgr2=0x7f6744103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 --2- 172.21.15.46:0/2948896259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744102dc0 0x7f6744103190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6734004940 tx=0x7f6734009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 -- 172.21.15.46:0/2948896259 shutdown_connections 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 --2- 172.21.15.46:0/2948896259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6744103760 0x7f67440fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 --2- 172.21.15.46:0/2948896259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744102dc0 0x7f6744103190 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 -- 172.21.15.46:0/2948896259 >> 172.21.15.46:0/2948896259 conn(0x7f67440f8930 msgr2=0x7f67440fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 -- 172.21.15.46:0/2948896259 shutdown_connections 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.611+0000 7f6748abc700 1 -- 172.21.15.46:0/2948896259 wait complete. 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6748abc700 1 Processor -- start 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6748abc700 1 -- start start 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6748abc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6744102dc0 0x7f6744113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6748abc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 0x7f6744113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6748abc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67441144f0 con 0x7f6744103760 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6748abc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674410daf0 con 0x7f6744102dc0 2024-05-09T06:34:33.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6741d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 0x7f6744113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6741d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 0x7f6744113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35038/0 (socket says 172.21.15.46:35038) 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f6741d9b700 1 -- 172.21.15.46:0/1266509857 learned_addr learned my addr 172.21.15.46:0/1266509857 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.612+0000 7f674259c700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6744102dc0 0x7f6744113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6741d9b700 1 -- 172.21.15.46:0/1266509857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6744102dc0 msgr2=0x7f6744113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6741d9b700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6744102dc0 0x7f6744113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6741d9b700 1 -- 172.21.15.46:0/1266509857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734005040 con 0x7f6744103760 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6741d9b700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 0x7f6744113ea0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6738002a50 tx=0x7f6738004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6738007cc0 con 0x7f6744103760 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674410ddd0 con 0x7f6744103760 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f673800f040 con 0x7f6744103760 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f673800d9c0 con 0x7f6744103760 2024-05-09T06:34:33.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.613+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674410e390 con 0x7f6744103760 2024-05-09T06:34:33.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.614+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67440fe510 con 0x7f6744103760 2024-05-09T06:34:33.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.615+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f6738009730 con 0x7f6744103760 2024-05-09T06:34:33.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.615+0000 7f6732ffd700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f672c078290 0x7f672c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:33.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:33 smithi046 ceph-mon[26924]: pgmap v97: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.616+0000 7f674259c700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f672c078290 0x7f672c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.616+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6738099af0 con 0x7f6744103760 2024-05-09T06:34:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.616+0000 7f674259c700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f672c078290 0x7f672c07a740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6734004f90 tx=0x7f6734009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.621+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f6738061fb0 con 0x7f6744103760 2024-05-09T06:34:33.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:33 smithi106 ceph-mon[34679]: pgmap v97: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:33.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:33.857+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}) v1 -- 0x7f6744109ec0 con 0x7f672c078290 2024-05-09T06:34:35.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:35 smithi106 ceph-mon[34679]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:35.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:35 smithi106 ceph-mon[34679]: pgmap v98: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:35.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:35 smithi046 ceph-mon[26924]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:35.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:35 smithi046 ceph-mon[26924]: pgmap v98: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:35.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.928+0000 7f6732ffd700 1 -- 172.21.15.46:0/1266509857 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f6744109ec0 con 0x7f672c078290 2024-05-09T06:34:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f672c078290 msgr2=0x7f672c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f672c078290 0x7f672c07a740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6734004f90 tx=0x7f6734009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 msgr2=0x7f6744113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 0x7f6744113ea0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6738002a50 tx=0x7f6738004600 comp rx=0 tx=0).stop 2024-05-09T06:34:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 shutdown_connections 2024-05-09T06:34:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f672c078290 0x7f672c07a740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6744102dc0 0x7f6744113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 --2- 172.21.15.46:0/1266509857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6744103760 0x7f6744113ea0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 >> 172.21.15.46:0/1266509857 conn(0x7f67440f8930 msgr2=0x7f67440f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.932+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 shutdown_connections 2024-05-09T06:34:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:35.933+0000 7f6748abc700 1 -- 172.21.15.46:0/1266509857 wait complete. 2024-05-09T06:34:35.926 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:34:36.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch ps' 2024-05-09T06:34:36.756 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:37.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:37 smithi046 ceph-mon[26924]: pgmap v99: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:37.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:37 smithi106 ceph-mon[34679]: pgmap v99: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 -- 172.21.15.46:0/1468787885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0102670 msgr2=0x7f9ed00fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 --2- 172.21.15.46:0/1468787885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0102670 0x7f9ed00fbce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4004940 tx=0x7f9ec4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 -- 172.21.15.46:0/1468787885 shutdown_connections 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 --2- 172.21.15.46:0/1468787885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0102670 0x7f9ed00fbce0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 --2- 172.21.15.46:0/1468787885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ed0101cd0 0x7f9ed01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 -- 172.21.15.46:0/1468787885 >> 172.21.15.46:0/1468787885 conn(0x7f9ed00f7860 msgr2=0x7f9ed00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 -- 172.21.15.46:0/1468787885 shutdown_connections 2024-05-09T06:34:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 -- 172.21.15.46:0/1468787885 wait complete. 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.312+0000 7f9ed6749700 1 Processor -- start 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ed6749700 1 -- start start 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ed6749700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 0x7f9ed0102b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ed6749700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ed0102670 0x7f9ed0103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ed6749700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01035b0 con 0x7f9ed0101cd0 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ed6749700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0103720 con 0x7f9ed0102670 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 0x7f9ed0102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 0x7f9ed0102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35060/0 (socket says 172.21.15.46:35060) 2024-05-09T06:34:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecffff700 1 -- 172.21.15.46:0/3897189863 learned_addr learned my addr 172.21.15.46:0/3897189863 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecf7fe700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ed0102670 0x7f9ed0103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecffff700 1 -- 172.21.15.46:0/3897189863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ed0102670 msgr2=0x7f9ed0103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecffff700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ed0102670 0x7f9ed0103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.313+0000 7f9ecffff700 1 -- 172.21.15.46:0/3897189863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4005040 con 0x7f9ed0101cd0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.314+0000 7f9ecffff700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 0x7f9ed0102b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000b790 tx=0x7f9ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.314+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec000f770 con 0x7f9ed0101cd0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.314+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ec000fda0 con 0x7f9ed0101cd0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.314+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed0119e60 con 0x7f9ed0101cd0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.314+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ec000d310 con 0x7f9ed0101cd0 2024-05-09T06:34:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.314+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed011a1b0 con 0x7f9ed0101cd0 2024-05-09T06:34:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.315+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed00fd420 con 0x7f9ed0101cd0 2024-05-09T06:34:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.315+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9ec000f8d0 con 0x7f9ed0101cd0 2024-05-09T06:34:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.316+0000 7f9eccff9700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9eb8078280 0x7f9eb807a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.316+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9ec0099e30 con 0x7f9ed0101cd0 2024-05-09T06:34:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.316+0000 7f9ecf7fe700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9eb8078280 0x7f9eb807a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.316+0000 7f9ecf7fe700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9eb8078280 0x7f9eb807a730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0104260 tx=0x7f9ec4009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.321+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9ec0062310 con 0x7f9ed0101cd0 2024-05-09T06:34:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.545+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ed0104080 con 0x7f9eb8078280 2024-05-09T06:34:38.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.556+0000 7f9eccff9700 1 -- 172.21.15.46:0/3897189863 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9ed0104080 con 0x7f9eb8078280 2024-05-09T06:34:38.536 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (80s) 51s ago 12m 16.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 51s ago 12m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (11m) 114s ago 11m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (56s) 51s ago 12m 54.9M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (7m) 51s ago 7m 12.8M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (6m) 51s ago 6m 156M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (7m) 114s ago 7m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (6m) 114s ago 6m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (3m) 51s ago 13m 525M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (2m) 114s ago 11m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 51s ago 14m 57.1M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (11m) 114s ago 11m 42.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 51s ago 12m 13.2M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:34:38.537 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (118s) 114s ago 11m 8070k - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 51s ago 10m 258M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 51s ago 10m 266M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 51s ago 9m 220M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (9m) 114s ago 9m 285M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (8m) 114s ago 8m 259M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (8m) 114s ago 8m 236M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:34:38.538 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (100s) 51s ago 11m 51.4M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9eb8078280 msgr2=0x7f9eb807a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9eb8078280 0x7f9eb807a730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0104260 tx=0x7f9ec4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 msgr2=0x7f9ed0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 0x7f9ed0102b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000b790 tx=0x7f9ec0009250 comp rx=0 tx=0).stop 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 shutdown_connections 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0101cd0 0x7f9ed0102b30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9eb8078280 0x7f9eb807a730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 --2- 172.21.15.46:0/3897189863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ed0102670 0x7f9ed0103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 >> 172.21.15.46:0/3897189863 conn(0x7f9ed00f7860 msgr2=0x7f9ed00662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:38.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 shutdown_connections 2024-05-09T06:34:38.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:38.558+0000 7f9ed6749700 1 -- 172.21.15.46:0/3897189863 wait complete. 2024-05-09T06:34:39.172 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:34:39.173 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:34:39.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-05-09T06:34:39.456 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:39.687 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:39 smithi046 ceph-mon[26924]: pgmap v100: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:39.687 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:39 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:39.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:39 smithi106 ceph-mon[34679]: pgmap v100: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:39.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:39 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:40.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:40 smithi046 ceph-mon[26924]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:40.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:40 smithi106 ceph-mon[34679]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:41.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 -- 172.21.15.46:0/1742578651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 msgr2=0x7fdad4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 --2- 172.21.15.46:0/1742578651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4065ab0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdabc004940 tx=0x7fdabc009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:41.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 -- 172.21.15.46:0/1742578651 shutdown_connections 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 --2- 172.21.15.46:0/1742578651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4065ab0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 --2- 172.21.15.46:0/1742578651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 0x7fdad4103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 -- 172.21.15.46:0/1742578651 >> 172.21.15.46:0/1742578651 conn(0x7fdad4071d00 msgr2=0x7fdad4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 -- 172.21.15.46:0/1742578651 shutdown_connections 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 -- 172.21.15.46:0/1742578651 wait complete. 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 Processor -- start 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.107+0000 7fdada901700 1 -- start start 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdada901700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdada901700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 0x7fdad41162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdada901700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4116910 con 0x7fdad4065640 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdada901700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad410fce0 con 0x7fdad4102e50 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60974/0 (socket says 172.21.15.46:60974) 2024-05-09T06:34:41.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 -- 172.21.15.46:0/3136543435 learned_addr learned my addr 172.21.15.46:0/3136543435 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 -- 172.21.15.46:0/3136543435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 msgr2=0x7fdad41162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdacbfff700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 0x7fdad41162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 0x7fdad41162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 -- 172.21.15.46:0/3136543435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc005040 con 0x7fdad4065640 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdacbfff700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 0x7fdad41162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad3fff700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4115d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c830 tx=0x7fdac4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac400a760 con 0x7fdad4065640 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad410ffc0 con 0x7fdad4065640 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdac400ad90 con 0x7fdad4065640 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac40113a0 con 0x7fdad4065640 2024-05-09T06:34:41.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.108+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad4110580 con 0x7fdad4065640 2024-05-09T06:34:41.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.109+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad4106960 con 0x7fdad4065640 2024-05-09T06:34:41.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.110+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fdac4012400 con 0x7fdad4065640 2024-05-09T06:34:41.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.111+0000 7fdad17fa700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fdac0078290 0x7fdac007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:41.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.111+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdac4099e00 con 0x7fdad4065640 2024-05-09T06:34:41.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.111+0000 7fdacbfff700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fdac0078290 0x7fdac007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:41.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.111+0000 7fdacbfff700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fdac0078290 0x7fdac007a740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdabc000c00 tx=0x7fdabc009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:41.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.115+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fdac4062340 con 0x7fdad4065640 2024-05-09T06:34:41.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.328+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fdad405f5f0 con 0x7fdad4065640 2024-05-09T06:34:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.333+0000 7fdad17fa700 1 -- 172.21.15.46:0/3136543435 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v46)=0 v46) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdac4061ce0 con 0x7fdad4065640 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fdac0078290 msgr2=0x7fdac007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fdac0078290 0x7fdac007a740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdabc000c00 tx=0x7fdabc009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 msgr2=0x7fdad4115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4115d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c830 tx=0x7fdac4004470 comp rx=0 tx=0).stop 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 shutdown_connections 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad4065640 0x7fdad4115d80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fdac0078290 0x7fdac007a740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 --2- 172.21.15.46:0/3136543435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdad4102e50 0x7fdad41162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:41.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 >> 172.21.15.46:0/3136543435 conn(0x7fdad4071d00 msgr2=0x7fdad40fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:41.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 shutdown_connections 2024-05-09T06:34:41.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:41.335+0000 7fdada901700 1 -- 172.21.15.46:0/3136543435 wait complete. 2024-05-09T06:34:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:41 smithi106 ceph-mon[34679]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:41 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/3136543435' entity='client.admin' 2024-05-09T06:34:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:41.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:41.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:41 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:41 smithi046 ceph-mon[26924]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:41 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/3136543435' entity='client.admin' 2024-05-09T06:34:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:41 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:41.895 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:34:41.896 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:34:41.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-09T06:34:42.169 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:43.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:43 smithi046 ceph-mon[26924]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:43.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:43 smithi106 ceph-mon[34679]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:43.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 -- 172.21.15.46:0/3337197644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43581037a0 msgr2=0x7f43580fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:43.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 --2- 172.21.15.46:0/3337197644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43581037a0 0x7f43580fce10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f434c004940 tx=0x7f434c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 -- 172.21.15.46:0/3337197644 shutdown_connections 2024-05-09T06:34:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 --2- 172.21.15.46:0/3337197644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43581037a0 0x7f43580fce10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 --2- 172.21.15.46:0/3337197644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4358102e00 0x7f43581031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 -- 172.21.15.46:0/3337197644 >> 172.21.15.46:0/3337197644 conn(0x7f43580f89d0 msgr2=0x7f43580fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 -- 172.21.15.46:0/3337197644 shutdown_connections 2024-05-09T06:34:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 -- 172.21.15.46:0/3337197644 wait complete. 2024-05-09T06:34:43.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.942+0000 7f435edda700 1 Processor -- start 2024-05-09T06:34:43.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435edda700 1 -- start start 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435edda700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 0x7f4358070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435edda700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43581037a0 0x7f43580707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435edda700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358072240 con 0x7f4358102e00 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435edda700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358070ce0 con 0x7f43581037a0 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435cb76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 0x7f4358070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435cb76700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 0x7f4358070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60992/0 (socket says 172.21.15.46:60992) 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435cb76700 1 -- 172.21.15.46:0/1624162994 learned_addr learned my addr 172.21.15.46:0/1624162994 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f4357fff700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43581037a0 0x7f43580707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435cb76700 1 -- 172.21.15.46:0/1624162994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43581037a0 msgr2=0x7f43580707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435cb76700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43581037a0 0x7f43580707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f435cb76700 1 -- 172.21.15.46:0/1624162994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c005040 con 0x7f4358102e00 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.943+0000 7f4357fff700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43581037a0 0x7f43580707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.944+0000 7f435cb76700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 0x7f4358070260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f434800b790 tx=0x7f4348009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.944+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434800f770 con 0x7f4358102e00 2024-05-09T06:34:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.944+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4358070fc0 con 0x7f4358102e00 2024-05-09T06:34:43.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.944+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f434800fda0 con 0x7f4358102e00 2024-05-09T06:34:43.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.944+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434800d310 con 0x7f4358102e00 2024-05-09T06:34:43.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.944+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435811a1d0 con 0x7f4358102e00 2024-05-09T06:34:43.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.945+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358100110 con 0x7f4358102e00 2024-05-09T06:34:43.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.945+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f4348010420 con 0x7f4358102e00 2024-05-09T06:34:43.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.946+0000 7f43557fa700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4340078290 0x7f434007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:43.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.946+0000 7f4357fff700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4340078290 0x7f434007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:43.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.946+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4348099dd0 con 0x7f4358102e00 2024-05-09T06:34:43.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.947+0000 7f4357fff700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4340078290 0x7f434007a740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4358071990 tx=0x7f434c009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:43.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:43.951+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f4348062310 con 0x7f4358102e00 2024-05-09T06:34:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.163+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f4358071740 con 0x7f4358102e00 2024-05-09T06:34:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.164+0000 7f43557fa700 1 -- 172.21.15.46:0/1624162994 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v46)=0 v46) v1 ==== 155+0+0 (secure 0 0 0) 0x7f4348061cb0 con 0x7f4358102e00 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4340078290 msgr2=0x7f434007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4340078290 0x7f434007a740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4358071990 tx=0x7f434c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 msgr2=0x7f4358070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 0x7f4358070260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f434800b790 tx=0x7f4348009250 comp rx=0 tx=0).stop 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 shutdown_connections 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4358102e00 0x7f4358070260 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4340078290 0x7f434007a740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 --2- 172.21.15.46:0/1624162994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43581037a0 0x7f43580707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.167+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 >> 172.21.15.46:0/1624162994 conn(0x7f43580f89d0 msgr2=0x7f43580fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.168+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 shutdown_connections 2024-05-09T06:34:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:44.168+0000 7f435edda700 1 -- 172.21.15.46:0/1624162994 wait complete. 2024-05-09T06:34:44.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-09T06:34:45.091 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:45.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:45 smithi046 ceph-mon[26924]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:45.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:45 smithi106 ceph-mon[34679]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 -- 172.21.15.46:0/2566469692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4103780 msgr2=0x7fd9b40fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2566469692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4103780 0x7fd9b40fcdf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8004940 tx=0x7fd9a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 -- 172.21.15.46:0/2566469692 shutdown_connections 2024-05-09T06:34:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2566469692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4103780 0x7fd9b40fcdf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2566469692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b4102de0 0x7fd9b41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 -- 172.21.15.46:0/2566469692 >> 172.21.15.46:0/2566469692 conn(0x7fd9b40f8950 msgr2=0x7fd9b40fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 -- 172.21.15.46:0/2566469692 shutdown_connections 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.720+0000 7fd9bc677700 1 -- 172.21.15.46:0/2566469692 wait complete. 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9bc677700 1 Processor -- start 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9bc677700 1 -- start start 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9bc677700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 0x7fd9b4113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9bc677700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b4103780 0x7fd9b4114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9bc677700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b41146d0 con 0x7fd9b4102de0 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9bc677700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b410db00 con 0x7fd9b4103780 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9ba413700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 0x7fd9b4113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9ba413700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 0x7fd9b4113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32770/0 (socket says 172.21.15.46:32770) 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9ba413700 1 -- 172.21.15.46:0/2182352440 learned_addr learned my addr 172.21.15.46:0/2182352440 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.721+0000 7fd9b9c12700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b4103780 0x7fd9b4114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9ba413700 1 -- 172.21.15.46:0/2182352440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b4103780 msgr2=0x7fd9b4114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9ba413700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b4103780 0x7fd9b4114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9ba413700 1 -- 172.21.15.46:0/2182352440 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8005040 con 0x7fd9b4102de0 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9ba413700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 0x7fd9b4113b40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0002a50 tx=0x7fd9b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b0007cc0 con 0x7fd9b4102de0 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9b000f040 con 0x7fd9b4102de0 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b410dde0 con 0x7fd9b4102de0 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b000da30 con 0x7fd9b4102de0 2024-05-09T06:34:46.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.722+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b410e370 con 0x7fd9b4102de0 2024-05-09T06:34:46.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.723+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b40fe530 con 0x7fd9b4102de0 2024-05-09T06:34:46.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.724+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fd9b000db90 con 0x7fd9b4102de0 2024-05-09T06:34:46.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.724+0000 7fd9a6ffd700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd9a0078280 0x7fd9a007a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:46.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.724+0000 7fd9b9c12700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd9a0078280 0x7fd9a007a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:46.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.724+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd9b0099b10 con 0x7fd9b4102de0 2024-05-09T06:34:46.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.725+0000 7fd9b9c12700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd9a0078280 0x7fd9a007a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9b410f420 tx=0x7fd9a8009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:46.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.729+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fd9b0061fd0 con 0x7fd9b4102de0 2024-05-09T06:34:46.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.942+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd9b404bed0 con 0x7fd9b4102de0 2024-05-09T06:34:46.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.943+0000 7fd9a6ffd700 1 -- 172.21.15.46:0/2182352440 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v46)=0 v46) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd9b0061970 con 0x7fd9b4102de0 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd9a0078280 msgr2=0x7fd9a007a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd9a0078280 0x7fd9a007a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9b410f420 tx=0x7fd9a8009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 msgr2=0x7fd9b4113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 0x7fd9b4113b40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0002a50 tx=0x7fd9b00046b0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 shutdown_connections 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9b4102de0 0x7fd9b4113b40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fd9a0078280 0x7fd9a007a730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 --2- 172.21.15.46:0/2182352440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b4103780 0x7fd9b4114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 >> 172.21.15.46:0/2182352440 conn(0x7fd9b40f8950 msgr2=0x7fd9b40f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 shutdown_connections 2024-05-09T06:34:46.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:46.945+0000 7fd9bc677700 1 -- 172.21.15.46:0/2182352440 wait complete. 2024-05-09T06:34:47.504 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:47 smithi046 ceph-mon[26924]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:47.532 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-09T06:34:47.806 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:47.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:47 smithi106 ceph-mon[34679]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 -- 172.21.15.46:0/2720488082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c101d90 msgr2=0x7f9f4c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 --2- 172.21.15.46:0/2720488082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c101d90 0x7f9f4c102160 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c004940 tx=0x7f9f3c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 -- 172.21.15.46:0/2720488082 shutdown_connections 2024-05-09T06:34:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 --2- 172.21.15.46:0/2720488082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 --2- 172.21.15.46:0/2720488082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c101d90 0x7f9f4c102160 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:49.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 -- 172.21.15.46:0/2720488082 >> 172.21.15.46:0/2720488082 conn(0x7f9f4c071d00 msgr2=0x7f9f4c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:49.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 -- 172.21.15.46:0/2720488082 shutdown_connections 2024-05-09T06:34:49.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.459+0000 7f9f517fb700 1 -- 172.21.15.46:0/2720488082 wait complete. 2024-05-09T06:34:49.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f517fb700 1 Processor -- start 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f517fb700 1 -- start start 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f517fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f517fb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f4c101d90 0x7f9f4c1140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f517fb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c114730 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f517fb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c10db20 con 0x7f9f4c101d90 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32794/0 (socket says 172.21.15.46:32794) 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4affd700 1 -- 172.21.15.46:0/989006433 learned_addr learned my addr 172.21.15.46:0/989006433 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:49.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4a7fc700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f4c101d90 0x7f9f4c1140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4affd700 1 -- 172.21.15.46:0/989006433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f4c101d90 msgr2=0x7f9f4c1140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4affd700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f4c101d90 0x7f9f4c1140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.460+0000 7f9f4affd700 1 -- 172.21.15.46:0/989006433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c005040 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.461+0000 7f9f4affd700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c113ba0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009180 tx=0x7f9f3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.461+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f3c00e040 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.461+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f3c00bbc0 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.461+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c10dda0 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.461+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f3c01c3f0 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.461+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c10e360 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.462+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c0fd430 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.463+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9f3c00bd30 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.463+0000 7f9f337fe700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9f34078280 0x7f9f3407a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.463+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9f3c09aef0 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.463+0000 7f9f4a7fc700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9f34078280 0x7f9f3407a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.464+0000 7f9f4a7fc700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9f34078280 0x7f9f3407a730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c10ece0 tx=0x7f9f4000b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.468+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9f3c0634d0 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.678+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f9f4c108df0 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.678+0000 7f9f337fe700 1 -- 172.21.15.46:0/989006433 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v46)=0 v46) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9f3c062e70 con 0x7f9f4c0fbd40 2024-05-09T06:34:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9f34078280 msgr2=0x7f9f3407a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9f34078280 0x7f9f3407a730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c10ece0 tx=0x7f9f4000b040 comp rx=0 tx=0).stop 2024-05-09T06:34:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 msgr2=0x7f9f4c113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c113ba0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009180 tx=0x7f9f3c009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 shutdown_connections 2024-05-09T06:34:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f4c0fbd40 0x7f9f4c113ba0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9f34078280 0x7f9f3407a730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 --2- 172.21.15.46:0/989006433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f4c101d90 0x7f9f4c1140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.680+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 >> 172.21.15.46:0/989006433 conn(0x7f9f4c071d00 msgr2=0x7f9f4c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.681+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 shutdown_connections 2024-05-09T06:34:49.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:49.681+0000 7f9f517fb700 1 -- 172.21.15.46:0/989006433 wait complete. 2024-05-09T06:34:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:49 smithi106 ceph-mon[34679]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:49 smithi046 ceph-mon[26924]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:50.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-09T06:34:50.525 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:50.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:50 smithi046 ceph-mon[26924]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:50.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:50 smithi106 ceph-mon[34679]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 -- 172.21.15.46:0/2122671544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fc470 msgr2=0x7ff0e01091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 --2- 172.21.15.46:0/2122671544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fc470 0x7ff0e01091d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0004940 tx=0x7ff0d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 -- 172.21.15.46:0/2122671544 shutdown_connections 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 --2- 172.21.15.46:0/2122671544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fc470 0x7ff0e01091d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 --2- 172.21.15.46:0/2122671544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fbb60 0x7ff0e00fbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 -- 172.21.15.46:0/2122671544 >> 172.21.15.46:0/2122671544 conn(0x7ff0e00f7870 msgr2=0x7ff0e00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 -- 172.21.15.46:0/2122671544 shutdown_connections 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.157+0000 7ff0e734a700 1 -- 172.21.15.46:0/2122671544 wait complete. 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e734a700 1 Processor -- start 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e734a700 1 -- start start 2024-05-09T06:34:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e734a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 0x7ff0e0115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e734a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fc470 0x7ff0e01160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e734a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0116700 con 0x7ff0e00fbb60 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e734a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e010fce0 con 0x7ff0e00fc470 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e50e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 0x7ff0e0115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e50e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 0x7ff0e0115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51848/0 (socket says 172.21.15.46:51848) 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.158+0000 7ff0e50e6700 1 -- 172.21.15.46:0/3934194544 learned_addr learned my addr 172.21.15.46:0/3934194544 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e48e5700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fc470 0x7ff0e01160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e50e6700 1 -- 172.21.15.46:0/3934194544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fc470 msgr2=0x7ff0e01160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e50e6700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fc470 0x7ff0e01160b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e50e6700 1 -- 172.21.15.46:0/3934194544 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0005040 con 0x7ff0e00fbb60 2024-05-09T06:34:52.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e48e5700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fc470 0x7ff0e01160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e50e6700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 0x7ff0e0115b70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc002a50 tx=0x7ff0dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc007cc0 con 0x7ff0e00fbb60 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e010ffc0 con 0x7ff0e00fbb60 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0dc00f040 con 0x7ff0e00fbb60 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc009640 con 0x7ff0e00fbb60 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.159+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0110580 con 0x7ff0e00fbb60 2024-05-09T06:34:52.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.160+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0066b30 con 0x7ff0e00fbb60 2024-05-09T06:34:52.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.161+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7ff0dc0097a0 con 0x7ff0e00fbb60 2024-05-09T06:34:52.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.161+0000 7ff0d5ffb700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ff0cc078290 0x7ff0cc07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:52.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.161+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff0dc099b90 con 0x7ff0e00fbb60 2024-05-09T06:34:52.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.161+0000 7ff0e48e5700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ff0cc078290 0x7ff0cc07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:52.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.162+0000 7ff0e48e5700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ff0cc078290 0x7ff0cc07a740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000c00 tx=0x7ff0d0009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.166+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7ff0dc062050 con 0x7ff0e00fbb60 2024-05-09T06:34:52.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.402+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0e01107a0 con 0x7ff0cc078290 2024-05-09T06:34:52.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.407+0000 7ff0d5ffb700 1 -- 172.21.15.46:0/3934194544 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff0e01107a0 con 0x7ff0cc078290 2024-05-09T06:34:52.387 INFO:teuthology.orchestra.run.smithi046.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ff0cc078290 msgr2=0x7ff0cc07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ff0cc078290 0x7ff0cc07a740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000c00 tx=0x7ff0d0009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 msgr2=0x7ff0e0115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 0x7ff0e0115b70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc002a50 tx=0x7ff0dc0046b0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 shutdown_connections 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0e00fbb60 0x7ff0e0115b70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7ff0cc078290 0x7ff0cc07a740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 --2- 172.21.15.46:0/3934194544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0e00fc470 0x7ff0e01160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:52.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 >> 172.21.15.46:0/3934194544 conn(0x7ff0e00f7870 msgr2=0x7ff0e00f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:52.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.409+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 shutdown_connections 2024-05-09T06:34:52.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:52.410+0000 7ff0e734a700 1 -- 172.21.15.46:0/3934194544 wait complete. 2024-05-09T06:34:53.009 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-05-09T06:34:53.009 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:34:53.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-05-09T06:34:53.287 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:53.670 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:53 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:34:53.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:53 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:54.702 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:54 smithi046 ceph-mon[26924]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:54.702 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:54 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:54.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:54 smithi106 ceph-mon[34679]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T06:34:54.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:54 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:34:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 -- 172.21.15.46:0/4259618924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fe7a0 msgr2=0x7f5240106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 --2- 172.21.15.46:0/4259618924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fe7a0 0x7f5240106e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5228004940 tx=0x7f5228009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 -- 172.21.15.46:0/4259618924 shutdown_connections 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 --2- 172.21.15.46:0/4259618924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fe7a0 0x7f5240106e70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 --2- 172.21.15.46:0/4259618924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52400fde00 0x7f52400fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 -- 172.21.15.46:0/4259618924 >> 172.21.15.46:0/4259618924 conn(0x7f52400f7860 msgr2=0x7f52400f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 -- 172.21.15.46:0/4259618924 shutdown_connections 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 -- 172.21.15.46:0/4259618924 wait complete. 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 Processor -- start 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.187+0000 7f524716d700 1 -- start start 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f524716d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 0x7f5240115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f524716d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52400fe7a0 0x7f5240116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f524716d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240116760 con 0x7f52400fde00 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f524716d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524010fd40 con 0x7f52400fe7a0 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 0x7f5240115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 0x7f5240115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51866/0 (socket says 172.21.15.46:51866) 2024-05-09T06:34:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 -- 172.21.15.46:0/1019323445 learned_addr learned my addr 172.21.15.46:0/1019323445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 -- 172.21.15.46:0/1019323445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52400fe7a0 msgr2=0x7f5240116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f523ffff700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52400fe7a0 0x7f5240116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52400fe7a0 0x7f5240116110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 -- 172.21.15.46:0/1019323445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228005040 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.188+0000 7f5244f09700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 0x7f5240115bd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f523000c830 tx=0x7f5230004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.189+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523000a760 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.189+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5240110020 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.189+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f523000ad90 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.189+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52300113a0 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.189+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5240110560 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.190+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5240066ad0 con 0x7f52400fde00 2024-05-09T06:34:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.190+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f5230012400 con 0x7f52400fde00 2024-05-09T06:34:55.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.191+0000 7f523d7fa700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f522c078280 0x7f522c07a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.191+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5230099dc0 con 0x7f52400fde00 2024-05-09T06:34:55.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.191+0000 7f523ffff700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f522c078280 0x7f522c07a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.192+0000 7f523ffff700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f522c078280 0x7f522c07a730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5240111470 tx=0x7f5228009e30 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.196+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f5230062300 con 0x7f52400fde00 2024-05-09T06:34:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.435+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5240111220 con 0x7f522c078280 2024-05-09T06:34:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.436+0000 7f523d7fa700 1 -- 172.21.15.46:0/1019323445 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f5240111220 con 0x7f522c078280 2024-05-09T06:34:55.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f522c078280 msgr2=0x7f522c07a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f522c078280 0x7f522c07a730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5240111470 tx=0x7f5228009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 msgr2=0x7f5240115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 0x7f5240115bd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f523000c830 tx=0x7f5230004470 comp rx=0 tx=0).stop 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 shutdown_connections 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52400fde00 0x7f5240115bd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f522c078280 0x7f522c07a730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 --2- 172.21.15.46:0/1019323445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52400fe7a0 0x7f5240116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 >> 172.21.15.46:0/1019323445 conn(0x7f52400f7860 msgr2=0x7f52400fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 shutdown_connections 2024-05-09T06:34:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.438+0000 7f524716d700 1 -- 172.21.15.46:0/1019323445 wait complete. 2024-05-09T06:34:55.429 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:34:55.530 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:55 smithi046 ceph-mon[26924]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/1081472652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fdde0 msgr2=0x7f5cd40fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/1081472652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fe1b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4004940 tx=0x7f5cc4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/1081472652 shutdown_connections 2024-05-09T06:34:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/1081472652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fe780 0x7f5cd4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/1081472652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fe1b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/1081472652 >> 172.21.15.46:0/1081472652 conn(0x7f5cd40f7850 msgr2=0x7f5cd40f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.549+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/1081472652 shutdown_connections 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.550+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/1081472652 wait complete. 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.550+0000 7f5cd9ed4700 1 Processor -- start 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.550+0000 7f5cd9ed4700 1 -- start start 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd9ed4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd9ed4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 0x7f5cd40fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd9ed4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40fc6e0 con 0x7f5cd40fe780 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd9ed4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40fc820 con 0x7f5cd40fdde0 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5ccaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 0x7f5cd40fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5ccaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 0x7f5cd40fc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51888/0 (socket says 172.21.15.46:51888) 2024-05-09T06:34:55.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5ccaffd700 1 -- 172.21.15.46:0/2990931644 learned_addr learned my addr 172.21.15.46:0/2990931644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:55.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd37fe700 1 -- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 msgr2=0x7f5cd40fc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd37fe700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 0x7f5cd40fc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd37fe700 1 -- 172.21.15.46:0/2990931644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4005040 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5ccaffd700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 0x7f5cd40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.551+0000 7f5cd37fe700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fbc10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400b3b0 tx=0x7f5cc4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.552+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc400e040 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.552+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cc4009b10 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.552+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd40fca70 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.552+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc4013420 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.552+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd411a200 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.553+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd4066750 con 0x7f5cd40fdde0 2024-05-09T06:34:55.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.554+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f5cc400baf0 con 0x7f5cd40fdde0 2024-05-09T06:34:55.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.555+0000 7f5cd0ff9700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5cc0078290 0x7f5cc007a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.555+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5cc409a9a0 con 0x7f5cd40fdde0 2024-05-09T06:34:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.555+0000 7f5ccaffd700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5cc0078290 0x7f5cc007a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.556+0000 7f5ccaffd700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5cc0078290 0x7f5cc007a740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40fd550 tx=0x7f5cbc00b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:55.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.560+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f5cc4062f00 con 0x7f5cd40fdde0 2024-05-09T06:34:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.803+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cd404bf40 con 0x7f5cc0078290 2024-05-09T06:34:55.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.804+0000 7f5cd0ff9700 1 -- 172.21.15.46:0/2990931644 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f5cd404bf40 con 0x7f5cc0078290 2024-05-09T06:34:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5cc0078290 msgr2=0x7f5cc007a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5cc0078290 0x7f5cc007a740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40fd550 tx=0x7f5cbc00b040 comp rx=0 tx=0).stop 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fdde0 msgr2=0x7f5cd40fbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fbc10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400b3b0 tx=0x7f5cc4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 shutdown_connections 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f5cc0078290 0x7f5cc007a740 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd40fdde0 0x7f5cd40fbc10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 --2- 172.21.15.46:0/2990931644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cd40fe780 0x7f5cd40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 >> 172.21.15.46:0/2990931644 conn(0x7f5cd40f7850 msgr2=0x7f5cd40f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 shutdown_connections 2024-05-09T06:34:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.807+0000 7f5cd9ed4700 1 -- 172.21.15.46:0/2990931644 wait complete. 2024-05-09T06:34:55.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:55 smithi106 ceph-mon[34679]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 -- 172.21.15.46:0/3346155078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 msgr2=0x7f71900fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 --2- 172.21.15.46:0/3346155078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71900fb600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7180004940 tx=0x7f7180009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 -- 172.21.15.46:0/3346155078 shutdown_connections 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 --2- 172.21.15.46:0/3346155078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71900fb600 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 --2- 172.21.15.46:0/3346155078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7190101cd0 0x7f71901020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 -- 172.21.15.46:0/3346155078 >> 172.21.15.46:0/3346155078 conn(0x7f7190071460 msgr2=0x7f7190071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 -- 172.21.15.46:0/3346155078 shutdown_connections 2024-05-09T06:34:55.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.919+0000 7f7197fa7700 1 -- 172.21.15.46:0/3346155078 wait complete. 2024-05-09T06:34:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7197fa7700 1 Processor -- start 2024-05-09T06:34:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7197fa7700 1 -- start start 2024-05-09T06:34:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7197fa7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7190101cd0 0x7f7190115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7197fa7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71901162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7197fa7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190116980 con 0x7f7190102670 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7197fa7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719010fcc0 con 0x7f7190101cd0 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7195542700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71901162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7195542700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71901162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51908/0 (socket says 172.21.15.46:51908) 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7195542700 1 -- 172.21.15.46:0/1202420283 learned_addr learned my addr 172.21.15.46:0/1202420283 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.920+0000 7f7195d43700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7190101cd0 0x7f7190115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f7195542700 1 -- 172.21.15.46:0/1202420283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7190101cd0 msgr2=0x7f7190115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f7195542700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7190101cd0 0x7f7190115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f7195542700 1 -- 172.21.15.46:0/1202420283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180005040 con 0x7f7190102670 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f7195542700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71901162a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7180000c00 tx=0x7f7180009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f718000e040 con 0x7f7190102670 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7180013420 con 0x7f7190102670 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f718001c630 con 0x7f7190102670 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719010fee0 con 0x7f7190102670 2024-05-09T06:34:55.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.921+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71901104a0 con 0x7f7190102670 2024-05-09T06:34:55.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.922+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190101130 con 0x7f7190102670 2024-05-09T06:34:55.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.924+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f7180013590 con 0x7f7190102670 2024-05-09T06:34:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.924+0000 7f71867fc700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f717c078290 0x7f717c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.925+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f718009aeb0 con 0x7f7190102670 2024-05-09T06:34:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.925+0000 7f7195d43700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f717c078290 0x7f717c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.925+0000 7f7195d43700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f717c078290 0x7f717c07a740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f718c009f50 tx=0x7f718c009590 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:55.930+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f7180063490 con 0x7f7190102670 2024-05-09T06:34:56.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.155+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7190111450 con 0x7f717c078290 2024-05-09T06:34:56.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.175+0000 7f71867fc700 1 -- 172.21.15.46:0/1202420283 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7190111450 con 0x7f717c078290 2024-05-09T06:34:56.155 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (98s) 68s ago 12m 16.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (13m) 68s ago 13m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (11m) 2m ago 11m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (74s) 68s ago 12m 54.9M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (7m) 68s ago 7m 12.8M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (7m) 68s ago 7m 156M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (7m) 2m ago 7m 16.7M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (7m) 2m ago 7m 14.3M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (3m) 68s ago 14m 525M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (2m) 2m ago 11m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (14m) 68s ago 14m 57.1M 2048M 17.2.7-933-g4ba5a836 b96134859c76 df41e0643791 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (11m) 2m ago 11m 42.5M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 68s ago 12m 13.2M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (2m) 2m ago 11m 8070k - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:34:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 68s ago 10m 258M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:34:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 68s ago 10m 266M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:34:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 68s ago 10m 220M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:34:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (9m) 2m ago 9m 285M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:34:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (9m) 2m ago 9m 259M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:34:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (8m) 2m ago 8m 236M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:34:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (118s) 68s ago 12m 51.4M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:34:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.177+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f717c078290 msgr2=0x7f717c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.177+0000 7f7197fa7700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f717c078290 0x7f717c07a740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f718c009f50 tx=0x7f718c009590 comp rx=0 tx=0).stop 2024-05-09T06:34:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.177+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 msgr2=0x7f71901162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.177+0000 7f7197fa7700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71901162a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7180000c00 tx=0x7f7180009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 shutdown_connections 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f717c078290 0x7f717c07a740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7190101cd0 0x7f7190115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 --2- 172.21.15.46:0/1202420283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7190102670 0x7f71901162a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 >> 172.21.15.46:0/1202420283 conn(0x7f7190071460 msgr2=0x7f71900f9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 shutdown_connections 2024-05-09T06:34:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.178+0000 7f7197fa7700 1 -- 172.21.15.46:0/1202420283 wait complete. 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 -- 172.21.15.46:0/253388489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b00fbd40 msgr2=0x7f41b00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 --2- 172.21.15.46:0/253388489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b00fbd40 0x7f41b00fc1b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f41a4004940 tx=0x7f41a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 -- 172.21.15.46:0/253388489 shutdown_connections 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 --2- 172.21.15.46:0/253388489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b00fbd40 0x7f41b00fc1b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 --2- 172.21.15.46:0/253388489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41b0101d90 0x7f41b0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 -- 172.21.15.46:0/253388489 >> 172.21.15.46:0/253388489 conn(0x7f41b0071d00 msgr2=0x7f41b0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:56.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 -- 172.21.15.46:0/253388489 shutdown_connections 2024-05-09T06:34:56.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.287+0000 7f41b595c700 1 -- 172.21.15.46:0/253388489 wait complete. 2024-05-09T06:34:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.288+0000 7f41b595c700 1 Processor -- start 2024-05-09T06:34:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.288+0000 7f41b595c700 1 -- start start 2024-05-09T06:34:56.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.288+0000 7f41b595c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41b00fbd40 0x7f41b0113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.288+0000 7f41b595c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 0x7f41b01140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.288+0000 7f41b595c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0114740 con 0x7f41b0101d90 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.288+0000 7f41b595c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b010db30 con 0x7f41b00fbd40 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 0x7f41b01140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 0x7f41b01140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51926/0 (socket says 172.21.15.46:51926) 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 -- 172.21.15.46:0/200426848 learned_addr learned my addr 172.21.15.46:0/200426848 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41aeffd700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41b00fbd40 0x7f41b0113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 -- 172.21.15.46:0/200426848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41b00fbd40 msgr2=0x7f41b0113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41b00fbd40 0x7f41b0113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 -- 172.21.15.46:0/200426848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4005040 con 0x7f41b0101d90 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41ae7fc700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 0x7f41b01140f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f41a400b3b0 tx=0x7f41a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.289+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a400e040 con 0x7f41b0101d90 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.290+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41a4013420 con 0x7f41b0101d90 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.290+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b010ddb0 con 0x7f41b0101d90 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.290+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a401c630 con 0x7f41b0101d90 2024-05-09T06:34:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.290+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b010e370 con 0x7f41b0101d90 2024-05-09T06:34:56.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.291+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b00fd430 con 0x7f41b0101d90 2024-05-09T06:34:56.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.291+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f41a4013590 con 0x7f41b0101d90 2024-05-09T06:34:56.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.292+0000 7f41977fe700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4198078290 0x7f419807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:56.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.292+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f41a409aee0 con 0x7f41b0101d90 2024-05-09T06:34:56.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.292+0000 7f41aeffd700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4198078290 0x7f419807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:56.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.293+0000 7f41aeffd700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4198078290 0x7f419807a740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41a0004f40 tx=0x7f41a000b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:56.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.297+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f41a4063570 con 0x7f41b0101d90 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.609+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41b005f5c0 con 0x7f41b0101d90 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.609+0000 7f41977fe700 1 -- 172.21.15.46:0/200426848 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f41a4062f10 con 0x7f41b0101d90 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:34:56.590 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 12, 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:34:56.591 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:34:56.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4198078290 msgr2=0x7f419807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4198078290 0x7f419807a740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41a0004f40 tx=0x7f41a000b040 comp rx=0 tx=0).stop 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 msgr2=0x7f41b01140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 0x7f41b01140f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f41a400b3b0 tx=0x7f41a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 shutdown_connections 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f4198078290 0x7f419807a740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41b00fbd40 0x7f41b0113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 --2- 172.21.15.46:0/200426848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41b0101d90 0x7f41b01140f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 >> 172.21.15.46:0/200426848 conn(0x7f41b0071d00 msgr2=0x7f41b00655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 shutdown_connections 2024-05-09T06:34:56.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.613+0000 7f41b595c700 1 -- 172.21.15.46:0/200426848 wait complete. 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 -- 172.21.15.46:0/3635316498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 msgr2=0x7fcc20106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 --2- 172.21.15.46:0/3635316498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc20106e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc14004940 tx=0x7fcc14009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 -- 172.21.15.46:0/3635316498 shutdown_connections 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 --2- 172.21.15.46:0/3635316498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc20106e40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 --2- 172.21.15.46:0/3635316498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200fde60 0x7fcc200fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 -- 172.21.15.46:0/3635316498 >> 172.21.15.46:0/3635316498 conn(0x7fcc200f78d0 msgr2=0x7fcc200f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:56.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 -- 172.21.15.46:0/3635316498 shutdown_connections 2024-05-09T06:34:56.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:56 smithi046 ceph-mon[26924]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:56.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:56 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:56.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:56 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:56.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:56 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:56.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:56 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:56.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:56 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:34:56.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.735+0000 7fcc25035700 1 -- 172.21.15.46:0/3635316498 wait complete. 2024-05-09T06:34:56.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc25035700 1 Processor -- start 2024-05-09T06:34:56.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc25035700 1 -- start start 2024-05-09T06:34:56.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc25035700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200fde60 0x7fcc200fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:56.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc25035700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc200fd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc25035700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2006e9e0 con 0x7fcc200fe800 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc25035700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2006eb20 con 0x7fcc200fde60 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc1e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc200fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc1e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc200fd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51940/0 (socket says 172.21.15.46:51940) 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.736+0000 7fcc1e59c700 1 -- 172.21.15.46:0/1470910340 learned_addr learned my addr 172.21.15.46:0/1470910340 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc1ed9d700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200fde60 0x7fcc200fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc1e59c700 1 -- 172.21.15.46:0/1470910340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200fde60 msgr2=0x7fcc200fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc1e59c700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200fde60 0x7fcc200fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc1e59c700 1 -- 172.21.15.46:0/1470910340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14005040 con 0x7fcc200fe800 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc1e59c700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc200fd880 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009380 tx=0x7fcc14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:56.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1400e040 con 0x7fcc200fe800 2024-05-09T06:34:56.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2006ee00 con 0x7fcc200fe800 2024-05-09T06:34:56.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.737+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2006f340 con 0x7fcc200fe800 2024-05-09T06:34:56.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.738+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc14009af0 con 0x7fcc200fe800 2024-05-09T06:34:56.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.738+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1401c3f0 con 0x7fcc200fe800 2024-05-09T06:34:56.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.739+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc200666f0 con 0x7fcc200fe800 2024-05-09T06:34:56.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.739+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fcc14013420 con 0x7fcc200fe800 2024-05-09T06:34:56.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.740+0000 7fcc077fe700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fcc08078290 0x7fcc0807a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:56.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.740+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcc1409aff0 con 0x7fcc200fe800 2024-05-09T06:34:56.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.740+0000 7fcc1ed9d700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fcc08078290 0x7fcc0807a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:56.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.741+0000 7fcc1ed9d700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fcc08078290 0x7fcc0807a740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc10004f40 tx=0x7fcc1000b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:56.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:56.746+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fcc14063530 con 0x7fcc200fe800 2024-05-09T06:34:56.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:56 smithi106 ceph-mon[34679]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:56.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:56 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:56.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:56 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:34:56.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:56 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:56.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:56 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:56.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:56 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:34:56.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.013+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc2005f5c0 con 0x7fcc200fe800 2024-05-09T06:34:56.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.013+0000 7fcc077fe700 1 -- 172.21.15.46:0/1470910340 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1811 (secure 0 0 0) 0x7fcc14062ed0 con 0x7fcc200fe800 2024-05-09T06:34:56.994 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:34:56.994 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:34:56.994 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:56.994 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:34:56.994 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:34:56.995 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:34:56.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:34:56.997 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:56.997 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:56.997 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:34:56.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fcc08078290 msgr2=0x7fcc0807a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fcc08078290 0x7fcc0807a740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc10004f40 tx=0x7fcc1000b040 comp rx=0 tx=0).stop 2024-05-09T06:34:56.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 msgr2=0x7fcc200fd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc200fd880 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009380 tx=0x7fcc14009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 shutdown_connections 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fcc08078290 0x7fcc0807a740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc200fde60 0x7fcc200fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 --2- 172.21.15.46:0/1470910340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc200fe800 0x7fcc200fd880 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 >> 172.21.15.46:0/1470910340 conn(0x7fcc200f78d0 msgr2=0x7fcc200f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 shutdown_connections 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.016+0000 7fcc25035700 1 -- 172.21.15.46:0/1470910340 wait complete. 2024-05-09T06:34:56.998 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 -- 172.21.15.46:0/177623489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 msgr2=0x7fa4940fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 --2- 172.21.15.46:0/177623489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa4940fbd80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa484004940 tx=0x7fa484009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 -- 172.21.15.46:0/177623489 shutdown_connections 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 --2- 172.21.15.46:0/177623489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa4940fbd80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 --2- 172.21.15.46:0/177623489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494101d70 0x7fa494102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 -- 172.21.15.46:0/177623489 >> 172.21.15.46:0/177623489 conn(0x7fa4940f78e0 msgr2=0x7fa4940f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 -- 172.21.15.46:0/177623489 shutdown_connections 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.128+0000 7fa49bff0700 1 -- 172.21.15.46:0/177623489 wait complete. 2024-05-09T06:34:57.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.129+0000 7fa49bff0700 1 Processor -- start 2024-05-09T06:34:57.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.129+0000 7fa49bff0700 1 -- start start 2024-05-09T06:34:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49bff0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494101d70 0x7fa4941127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49bff0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa494112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49bff0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa494113360 con 0x7fa494102710 2024-05-09T06:34:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49bff0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49410c960 con 0x7fa494101d70 2024-05-09T06:34:57.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa494112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa494112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51958/0 (socket says 172.21.15.46:51958) 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 -- 172.21.15.46:0/3453297042 learned_addr learned my addr 172.21.15.46:0/3453297042 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa499d8c700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494101d70 0x7fa4941127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 -- 172.21.15.46:0/3453297042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494101d70 msgr2=0x7fa4941127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494101d70 0x7fa4941127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 -- 172.21.15.46:0/3453297042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484005040 con 0x7fa494102710 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa49958b700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa494112d10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa484000c00 tx=0x7fa484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48400e070 con 0x7fa494102710 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.131+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49410cbe0 con 0x7fa494102710 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.130+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa484013c00 con 0x7fa494102710 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.131+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48400b700 con 0x7fa494102710 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.131+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49410d120 con 0x7fa494102710 2024-05-09T06:34:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.132+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4780052b0 con 0x7fa494102710 2024-05-09T06:34:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.133+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7fa48400b860 con 0x7fa494102710 2024-05-09T06:34:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.133+0000 7fa48a7fc700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa480078280 0x7fa48007a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.133+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa48409aed0 con 0x7fa494102710 2024-05-09T06:34:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.133+0000 7fa499d8c700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa480078280 0x7fa48007a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.134+0000 7fa499d8c700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa480078280 0x7fa48007a730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa490004600 tx=0x7fa49000b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:57.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.138+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7fa4840634e0 con 0x7fa494102710 2024-05-09T06:34:57.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.384+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 --> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa478000bc0 con 0x7fa480078280 2024-05-09T06:34:57.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.385+0000 7fa48a7fc700 1 -- 172.21.15.46:0/3453297042 <== mgr.14668 v2:172.21.15.46:6800/2477328679 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa478000bc0 con 0x7fa480078280 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/21 daemons upgraded", 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:34:57.366 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:34:57.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.387+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa480078280 msgr2=0x7fa48007a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.387+0000 7fa49bff0700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa480078280 0x7fa48007a730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa490004600 tx=0x7fa49000b040 comp rx=0 tx=0).stop 2024-05-09T06:34:57.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.387+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 msgr2=0x7fa494112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.387+0000 7fa49bff0700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa494112d10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa484000c00 tx=0x7fa484009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:57.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 shutdown_connections 2024-05-09T06:34:57.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7fa480078280 0x7fa48007a730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494101d70 0x7fa4941127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 --2- 172.21.15.46:0/3453297042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa494102710 0x7fa494112d10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 >> 172.21.15.46:0/3453297042 conn(0x7fa4940f78e0 msgr2=0x7fa4940f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:57.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 shutdown_connections 2024-05-09T06:34:57.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.388+0000 7fa49bff0700 1 -- 172.21.15.46:0/3453297042 wait complete. 2024-05-09T06:34:57.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 -- 172.21.15.46:0/305767943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 msgr2=0x7f9a940fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 --2- 172.21.15.46:0/305767943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fb3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9a88004940 tx=0x7f9a88009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:57.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 -- 172.21.15.46:0/305767943 shutdown_connections 2024-05-09T06:34:57.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 --2- 172.21.15.46:0/305767943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fb3c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 --2- 172.21.15.46:0/305767943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a94102e20 0x7f9a941031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 -- 172.21.15.46:0/305767943 >> 172.21.15.46:0/305767943 conn(0x7f9a94072380 msgr2=0x7f9a94072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 -- 172.21.15.46:0/305767943 shutdown_connections 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 -- 172.21.15.46:0/305767943 wait complete. 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 Processor -- start 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.495+0000 7f9a98e50700 1 -- start start 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a98e50700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a94102e20 0x7f9a940fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a98e50700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a98e50700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940fe4f0 con 0x7f9a941037c0 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a98e50700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940fd020 con 0x7f9a94102e20 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51988/0 (socket says 172.21.15.46:51988) 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 -- 172.21.15.46:0/2610861561 learned_addr learned my addr 172.21.15.46:0/2610861561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a9259c700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a94102e20 0x7f9a940fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:57.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 -- 172.21.15.46:0/2610861561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a94102e20 msgr2=0x7f9a940fc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a94102e20 0x7f9a940fc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 -- 172.21.15.46:0/2610861561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a88005040 con 0x7f9a941037c0 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a91d9b700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fcae0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9a88000c00 tx=0x7f9a88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a88021070 con 0x7f9a941037c0 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a88013c00 con 0x7f9a941037c0 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8800e070 con 0x7f9a941037c0 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.496+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a940fd2a0 con 0x7f9a941037c0 2024-05-09T06:34:57.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.497+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9411a010 con 0x7f9a941037c0 2024-05-09T06:34:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.498+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94100160 con 0x7f9a941037c0 2024-05-09T06:34:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.498+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) v1 ==== 99802+0+0 (secure 0 0 0) 0x7f9a8801ca60 con 0x7f9a941037c0 2024-05-09T06:34:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.499+0000 7f9a82ffd700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9a7c078290 0x7f9a7c07a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:34:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.499+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9a8809b090 con 0x7f9a941037c0 2024-05-09T06:34:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.499+0000 7f9a9259c700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9a7c078290 0x7f9a7c07a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:34:57.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.499+0000 7f9a9259c700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9a7c078290 0x7f9a7c07a740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009b80 tx=0x7f9a8400b040 comp rx=0 tx=0).ready entity=mgr.14668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:34:57.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.503+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+190121 (secure 0 0 0) 0x7f9a88063670 con 0x7f9a941037c0 2024-05-09T06:34:57.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: from='client.24595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (squid) 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: Upgrade: Setting container_image for all mgr 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/200426848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:57 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/1470910340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:34:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.820+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9a9404c710 con 0x7f9a941037c0 2024-05-09T06:34:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.820+0000 7f9a82ffd700 1 -- 172.21.15.46:0/2610861561 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9a88063010 con 0x7f9a941037c0 2024-05-09T06:34:57.801 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:57.801 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:34:57.801 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:34:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9a7c078290 msgr2=0x7f9a7c07a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9a7c078290 0x7f9a7c07a740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009b80 tx=0x7f9a8400b040 comp rx=0 tx=0).stop 2024-05-09T06:34:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 msgr2=0x7f9a940fcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:34:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fcae0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9a88000c00 tx=0x7f9a88009e30 comp rx=0 tx=0).stop 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 shutdown_connections 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:6800/2477328679,v1:172.21.15.46:6801/2477328679] conn(0x7f9a7c078290 0x7f9a7c07a740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a94102e20 0x7f9a940fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 --2- 172.21.15.46:0/2610861561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a941037c0 0x7f9a940fcae0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 >> 172.21.15.46:0/2610861561 conn(0x7f9a94072380 msgr2=0x7f9a940fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 shutdown_connections 2024-05-09T06:34:57.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:34:57.823+0000 7f9a98e50700 1 -- 172.21.15.46:0/2610861561 wait complete. 2024-05-09T06:34:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: from='client.24595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: Upgrade: Target is version 19.0.0-3575-g720f8e95 (squid) 2024-05-09T06:34:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc'] 2024-05-09T06:34:57.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: Upgrade: Setting container_image for all mgr 2024-05-09T06:34:57.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:57.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/200426848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:34:57.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:57 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/1470910340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:34:58.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:58 smithi046 ceph-mon[26924]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:58.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:58 smithi046 ceph-mon[26924]: from='client.? 172.21.15.46:0/2610861561' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:34:58.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:58 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:58.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:58 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:58.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:58 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:58.672 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:58 smithi046 ceph-mon[26924]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:58 smithi106 ceph-mon[34679]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:34:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:58 smithi106 ceph-mon[34679]: from='client.? 172.21.15.46:0/2610861561' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:34:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:58 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' 2024-05-09T06:34:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:58 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:34:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:58 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:34:58.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:58 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:34:59.678 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:59 smithi046 ceph-mon[26924]: Upgrade: Updating mon.smithi046 2024-05-09T06:34:59.678 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:59 smithi046 ceph-mon[26924]: Deploying daemon mon.smithi046 on smithi046 2024-05-09T06:34:59.678 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:59 smithi046 ceph-mon[26924]: pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:59 smithi106 ceph-mon[34679]: Upgrade: Updating mon.smithi046 2024-05-09T06:34:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:59 smithi106 ceph-mon[34679]: Deploying daemon mon.smithi046 on smithi046 2024-05-09T06:34:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:34:59 smithi106 ceph-mon[34679]: pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:34:59.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:34:59 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:35:00.300 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[26920]: 2024-05-09T06:35:00.009+0000 7f101d52a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:35:00.307 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[26920]: 2024-05-09T06:35:00.009+0000 7f101d52a700 -1 mon.smithi046@0(leader) e2 *** Got Signal Terminated *** 2024-05-09T06:35:00.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 podman[110534]: 2024-05-09 06:35:00.039720174 +0000 UTC m=+0.149363267 container died df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:35:00.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 podman[110534]: 2024-05-09 06:35:00.442624885 +0000 UTC m=+0.552267984 container cleanup df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-4ba5a83, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-09T06:35:00.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 bash[110534]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046 2024-05-09T06:35:01.011 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 podman[110550]: 2024-05-09 06:35:00.668804618 +0000 UTC m=+0.630223477 container remove df41e06437917c44bf7540437f423283368140a2860649bbca989412eda289d2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=quincy-4ba5a83, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-09T06:35:01.011 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service: Deactivated successfully. 2024-05-09T06:35:01.011 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:35:01.011 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:00 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service: Consumed 14.584s CPU time. 2024-05-09T06:35:01.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 systemd[1]: Starting Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:35:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 podman[110693]: 2024-05-09 06:35:01.154786315 +0000 UTC m=+0.019101104 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:35:01.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 podman[110693]: 2024-05-09 06:35:01.252917936 +0000 UTC m=+0.117232708 container create f5a8b8e67820edd9fc9c7f1834774ac51331e5db405d1f26e50fdb7195386fe8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-09T06:35:01.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 podman[110693]: 2024-05-09 06:35:01.497830778 +0000 UTC m=+0.362145593 container init f5a8b8e67820edd9fc9c7f1834774ac51331e5db405d1f26e50fdb7195386fe8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 podman[110693]: 2024-05-09 06:35:01.501396063 +0000 UTC m=+0.365710839 container start f5a8b8e67820edd9fc9c7f1834774ac51331e5db405d1f26e50fdb7195386fe8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev), process ceph-mon, pid 2 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: pidfile_write: ignore empty --pid-file 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: load: jerasure load: lrc 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: RocksDB version: 7.9.2 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Git sha 0 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Compile date 2024-05-08 16:28:29 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: DB SUMMARY 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: DB Session ID: SB395329I21NBS66TTDY 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: CURRENT file: CURRENT 2024-05-09T06:35:01.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1158 Bytes 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000033.sst 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000031.log size: 2013094 ; 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.error_if_exists: 0 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.create_if_missing: 0 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.paranoid_checks: 1 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.env: 0x564780de7cc0 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.info_log: 0x5647826e5ca0 2024-05-09T06:35:01.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T06:35:01.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.statistics: (nil) 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.use_fsync: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_log_file_size: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.allow_fallocate: 1 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.use_direct_reads: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.db_log_dir: 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.wal_dir: 2024-05-09T06:35:01.840 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.write_buffer_manager: 0x5647826b70e0 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T06:35:01.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.unordered_write: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.row_cache: None 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.wal_filter: None 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.two_write_queues: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T06:35:01.842 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.wal_compression: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.atomic_flush: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.log_readahead_size: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_background_jobs: 2 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_background_compactions: -1 2024-05-09T06:35:01.843 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_subcompactions: 1 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_open_files: -1 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_background_flushes: -1 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Compression algorithms supported: 2024-05-09T06:35:01.844 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kZSTD supported: 0 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kXpressCompression supported: 0 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kZlibCompression supported: 1 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kSnappyCompression supported: 1 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kLZ4Compression supported: 1 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: kBZip2Compression supported: 0 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000015 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.merge_operator: 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_filter: None 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T06:35:01.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5647826e5e60) 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 4 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-05-09T06:35:01.846 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x5647826e91f0 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: bloomfilter 2024-05-09T06:35:01.847 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 5 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_auto_readahead_size: 262144 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: prepopulate_block_cache: 0 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: initial_auto_readahead_size: 8192 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression: NoCompression 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T06:35:01.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.num_levels: 7 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T06:35:01.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T06:35:01.850 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T06:35:01.851 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T06:35:01.851 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T06:35:01.851 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T06:35:01.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.inplace_update_support: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.bloom_locality: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.max_successive_merges: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T06:35:01.853 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.ttl: 2592000 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.enable_blob_files: false 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.min_blob_size: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T06:35:01.854 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11970, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 19de92d5-aa05-4a67-adb5-588e7ed3b0ed 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236501542533, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236501549950, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1803075, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11971, "largest_seqno": 13629, "table_properties": {"data_size": 1795425, "index_size": 4752, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 17204, "raw_average_key_size": 23, "raw_value_size": 1779803, "raw_average_value_size": 2424, "num_data_blocks": 217, "num_entries": 734, "num_filter_entries": 734, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715236501, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "19de92d5-aa05-4a67-adb5-588e7ed3b0ed", "db_session_id": "SB395329I21NBS66TTDY", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236501550050, "job": 1, "event": "recovery_finished"} 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564782806000 2024-05-09T06:35:01.855 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: DB pointer 0x5647827f0000 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T06:35:01.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 1/0 1.72 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 441.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L6 1/0 6.94 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 8.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 441.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 441.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 441.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:35:01.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 86.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 86.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache BinnedLRUCache@0x5647826e91f0#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???) e2 preinit fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).mds e16 new map 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).mds e16 print_map 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e16 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:35:01.858 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: 1 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Filesystem 'cephfs' (1) 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: fs_name cephfs 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: epoch 16 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: tableserver 0 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: root 0 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: session_timeout 60 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: session_autoclose 300 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_file_size 1099511627776 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_xattr_size 65536 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: required_client_features {} 2024-05-09T06:35:01.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: last_failure 0 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: last_failure_osd_epoch 46 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_mds 1 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: in 0 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: up {0=14492} 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: failed 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: damaged 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: stopped 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_pools [3] 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_pool 2 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: inline_data enabled 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: balancer 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: bal_rank_mask -1 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: standby_count_wanted 1 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: qdb_cluster leader: 0 members: 2024-05-09T06:35:01.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Standby daemons: 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 ceph-mon[110713]: mon.smithi046@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 bash[110693]: f5a8b8e67820edd9fc9c7f1834774ac51331e5db405d1f26e50fdb7195386fe8 2024-05-09T06:35:01.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:01 smithi046 systemd[1]: Started Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:35:04.933 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: pgmap v111: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: pgmap v112: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: pgmap v113: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: mon.smithi046 calling monitor election 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: mon.smithi046 is new leader, mons smithi046,smithi106 in quorum (ranks 0,1) 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: monmap epoch 2 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: last_changed 2024-05-09T06:23:16.564747+0000 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: created 2024-05-09T06:20:34.219870+0000 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: min_mon_release 17 (quincy) 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: election_strategy: 1 2024-05-09T06:35:04.934 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.smithi106 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: mgrmap e33: smithi046.nvpcui(active, since 3m), standbys: smithi106.nlgnpx 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: from='mgr.14668 ' entity='' 2024-05-09T06:35:04.935 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:04 smithi106 ceph-mon[34679]: mgrmap e34: smithi046.nvpcui(active, since 3m), standbys: smithi106.nlgnpx 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: from='mgr.14668 172.21.15.46:0/219328061' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: pgmap v111: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: pgmap v112: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: pgmap v113: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: mon.smithi046 calling monitor election 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: mon.smithi046 is new leader, mons smithi046,smithi106 in quorum (ranks 0,1) 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: monmap epoch 2 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: last_changed 2024-05-09T06:23:16.564747+0000 2024-05-09T06:35:04.954 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: created 2024-05-09T06:20:34.219870+0000 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: min_mon_release 17 (quincy) 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: election_strategy: 1 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.smithi106 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: osdmap e48: 6 total, 6 up, 6 in 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: mgrmap e33: smithi046.nvpcui(active, since 3m), standbys: smithi106.nlgnpx 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: from='mgr.14668 ' entity='' 2024-05-09T06:35:04.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:04 smithi046 ceph-mon[110713]: mgrmap e34: smithi046.nvpcui(active, since 3m), standbys: smithi106.nlgnpx 2024-05-09T06:35:12.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:11 smithi046 ceph-mon[110713]: Standby manager daemon smithi106.nlgnpx restarted 2024-05-09T06:35:12.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:11 smithi046 ceph-mon[110713]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:35:12.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:11 smithi046 ceph-mon[110713]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:35:12.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:11 smithi046 ceph-mon[110713]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:35:12.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:11 smithi046 ceph-mon[110713]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:35:12.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:11 smithi046 ceph-mon[110713]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:35:12.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:11 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx restarted 2024-05-09T06:35:12.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:11 smithi106 ceph-mon[34679]: Standby manager daemon smithi106.nlgnpx started 2024-05-09T06:35:12.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:11 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/crt"}]: dispatch 2024-05-09T06:35:12.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:11 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T06:35:12.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:11 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi106.nlgnpx/key"}]: dispatch 2024-05-09T06:35:12.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:11 smithi106 ceph-mon[34679]: from='mgr.? 172.21.15.106:0/3167401300' entity='mgr.smithi106.nlgnpx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T06:35:13.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: mgrmap e35: smithi046.nvpcui(active, since 3m), standbys: smithi106.nlgnpx 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: Active manager daemon smithi046.nvpcui restarted 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: mgrmap e36: smithi046.nvpcui(active, starting, since 0.0064574s), standbys: smithi106.nlgnpx 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:35:13.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:35:13.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:12 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:35:13.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: mgrmap e35: smithi046.nvpcui(active, since 3m), standbys: smithi106.nlgnpx 2024-05-09T06:35:13.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: Active manager daemon smithi046.nvpcui restarted 2024-05-09T06:35:13.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: Activating manager daemon smithi046.nvpcui 2024-05-09T06:35:13.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:35:13.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: mgrmap e36: smithi046.nvpcui(active, starting, since 0.0064574s), standbys: smithi106.nlgnpx 2024-05-09T06:35:13.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi046.nvpcui", "id": "smithi046.nvpcui"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr metadata", "who": "smithi106.nlgnpx", "id": "smithi106.nlgnpx"}]: dispatch 2024-05-09T06:35:13.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T06:35:13.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: Manager daemon smithi046.nvpcui is now available 2024-05-09T06:35:13.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:13.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:13.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/mirror_snapshot_schedule"}]: dispatch 2024-05-09T06:35:13.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.nvpcui/trash_purge_schedule"}]: dispatch 2024-05-09T06:35:14.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:14 smithi046 ceph-mon[110713]: [09/May/2024:06:35:12] ENGINE Bus STARTING 2024-05-09T06:35:14.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:14 smithi046 ceph-mon[110713]: [09/May/2024:06:35:13] ENGINE Serving on http://172.21.15.46:8765 2024-05-09T06:35:14.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:14 smithi046 ceph-mon[110713]: mgrmap e37: smithi046.nvpcui(active, since 1.01029s), standbys: smithi106.nlgnpx 2024-05-09T06:35:14.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:14 smithi046 ceph-mon[110713]: pgmap v3: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:14.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:14 smithi046 ceph-mon[110713]: [09/May/2024:06:35:13] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:35:14.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:14 smithi046 ceph-mon[110713]: [09/May/2024:06:35:13] ENGINE Bus STARTED 2024-05-09T06:35:14.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:14 smithi106 ceph-mon[34679]: [09/May/2024:06:35:12] ENGINE Bus STARTING 2024-05-09T06:35:14.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:14 smithi106 ceph-mon[34679]: [09/May/2024:06:35:13] ENGINE Serving on http://172.21.15.46:8765 2024-05-09T06:35:14.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:14 smithi106 ceph-mon[34679]: mgrmap e37: smithi046.nvpcui(active, since 1.01029s), standbys: smithi106.nlgnpx 2024-05-09T06:35:14.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:14 smithi106 ceph-mon[34679]: pgmap v3: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:14.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:14 smithi106 ceph-mon[34679]: [09/May/2024:06:35:13] ENGINE Serving on https://172.21.15.46:7150 2024-05-09T06:35:14.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:14 smithi106 ceph-mon[34679]: [09/May/2024:06:35:13] ENGINE Bus STARTED 2024-05-09T06:35:15.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:15 smithi046 ceph-mon[110713]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:15.516 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:15 smithi046 ceph-mon[110713]: mgrmap e38: smithi046.nvpcui(active, since 2s), standbys: smithi106.nlgnpx 2024-05-09T06:35:15.563 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:15 smithi106 ceph-mon[34679]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:15.563 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:15 smithi106 ceph-mon[34679]: mgrmap e38: smithi046.nvpcui(active, since 2s), standbys: smithi106.nlgnpx 2024-05-09T06:35:16.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:16.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:16.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:16 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:16.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:16 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:17 smithi106 ceph-mon[34679]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:17 smithi106 ceph-mon[34679]: mgrmap e39: smithi046.nvpcui(active, since 4s), standbys: smithi106.nlgnpx 2024-05-09T06:35:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:17 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:17 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:17.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:17 smithi046 ceph-mon[110713]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:17.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:17 smithi046 ceph-mon[110713]: mgrmap e39: smithi046.nvpcui(active, since 4s), standbys: smithi106.nlgnpx 2024-05-09T06:35:17.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:17.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:19.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:18 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:19.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:18 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:19.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:18 smithi106 ceph-mon[34679]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:18 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:19.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:18 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:19.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:18 smithi046 ceph-mon[110713]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:20.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:19 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:19 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:21.126 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:20 smithi046 ceph-mon[110713]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-09T06:35:21.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:20 smithi106 ceph-mon[34679]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-09T06:35:23.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:23 smithi046 ceph-mon[110713]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-09T06:35:23.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:23.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:23.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:23.488 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:35:23.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:23 smithi106 ceph-mon[34679]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-09T06:35:23.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:23 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:23.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:23 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:23.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:23 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:23.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:23 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:35:24.513 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Detected new or changed devices on smithi046 2024-05-09T06:35:24.513 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:35:24.513 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:35:24.513 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:24.514 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:24 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Detected new or changed devices on smithi046 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi046:/etc/ceph/ceph.conf 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: Updating smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T06:35:24.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:35:24.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:24 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-09T06:35:25.526 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:25 smithi106 ceph-mon[34679]: pgmap v9: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-09T06:35:25.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:25 smithi046 ceph-mon[110713]: pgmap v9: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-09T06:35:26.849 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:26 smithi106 ceph-mon[34679]: Upgrade: Updating mon.smithi106 2024-05-09T06:35:26.849 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:26 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:26.849 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:26 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:26.849 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:26 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:26.849 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:26 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:26.850 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:26 smithi106 ceph-mon[34679]: Deploying daemon mon.smithi106 on smithi106 2024-05-09T06:35:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:26 smithi046 ceph-mon[110713]: Upgrade: Updating mon.smithi106 2024-05-09T06:35:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:26 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:26 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:26 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:26 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:27.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:26 smithi046 ceph-mon[110713]: Deploying daemon mon.smithi106 on smithi106 2024-05-09T06:35:27.672 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:27 smithi106 systemd[1]: Stopping Ceph mon.smithi106 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:35:27.672 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:27 smithi106 ceph-mon[34679]: pgmap v10: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:35:27.672 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:27 smithi106 ceph-mon[34679]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:27.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:27 smithi046 ceph-mon[110713]: pgmap v10: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:35:27.673 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 -- 172.21.15.46:0/1303294835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 msgr2=0x7f42701021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 --2- 172.21.15.46:0/1303294835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f42701021f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f426c004940 tx=0x7f426c009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 -- 172.21.15.46:0/1303294835 shutdown_connections 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 --2- 172.21.15.46:0/1303294835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 0x7f42700fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 --2- 172.21.15.46:0/1303294835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f42701021f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 -- 172.21.15.46:0/1303294835 >> 172.21.15.46:0/1303294835 conn(0x7f4270071460 msgr2=0x7f4270071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 -- 172.21.15.46:0/1303294835 shutdown_connections 2024-05-09T06:35:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 -- 172.21.15.46:0/1303294835 wait complete. 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 Processor -- start 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.932+0000 7f4278457700 1 -- start start 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4278457700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 0x7f4270112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4278457700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f4270112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4278457700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42701136b0 con 0x7f4270101e20 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4278457700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427010ca60 con 0x7f42700fc710 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f4270112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42761f3700 1 -- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 msgr2=0x7f4270112a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.106:3300/0 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42761f3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 0x7f4270112a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f4270112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38330/0 (socket says 172.21.15.46:38330) 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 -- 172.21.15.46:0/3111331299 learned_addr learned my addr 172.21.15.46:0/3111331299 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 -- 172.21.15.46:0/3111331299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 msgr2=0x7f4270112a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 0x7f4270112a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 -- 172.21.15.46:0/3111331299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c005040 con 0x7f4270101e20 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f42759f2700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f4270112fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f426000b760 tx=0x7f4260009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4260010790 con 0x7f4270101e20 2024-05-09T06:35:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4260010dc0 con 0x7f4270101e20 2024-05-09T06:35:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427010cd40 con 0x7f4270101e20 2024-05-09T06:35:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.933+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426000f300 con 0x7f4270101e20 2024-05-09T06:35:27.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.934+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427010d300 con 0x7f4270101e20 2024-05-09T06:35:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.935+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42700652f0 con 0x7f4270101e20 2024-05-09T06:35:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.935+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f42600108f0 con 0x7f4270101e20 2024-05-09T06:35:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.936+0000 7f4266ffd700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f425c0789f0 0x7f425c07aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.936+0000 7f42761f3700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f425c0789f0 0x7f425c07aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.936+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f426009a830 con 0x7f4270101e20 2024-05-09T06:35:27.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.936+0000 7f42761f3700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f425c0789f0 0x7f425c07aea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f426c004890 tx=0x7f426c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:27.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:27.941+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f4260062460 con 0x7f4270101e20 2024-05-09T06:35:28.038 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:27 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106[34662]: 2024-05-09T06:35:27.689+0000 7f369fea6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi106 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:35:28.038 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:27 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106[34662]: 2024-05-09T06:35:27.689+0000 7f369fea6700 -1 mon.smithi106@1(peon) e2 *** Got Signal Terminated *** 2024-05-09T06:35:28.038 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:27 smithi106 podman[81044]: 2024-05-09 06:35:27.761998823 +0000 UTC m=+0.191888743 container died 804da2f6372fe9254984364fb09cc682a3c631eb90309040b7dc4dc13952a758 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=quincy-4ba5a83, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-09T06:35:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.178+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4270108fc0 con 0x7f425c0789f0 2024-05-09T06:35:28.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.179+0000 7f4266ffd700 1 -- 172.21.15.46:0/3111331299 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4270108fc0 con 0x7f425c0789f0 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f425c0789f0 msgr2=0x7f425c07aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f425c0789f0 0x7f425c07aea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f426c004890 tx=0x7f426c009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 msgr2=0x7f4270112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f4270112fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f426000b760 tx=0x7f4260009220 comp rx=0 tx=0).stop 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 shutdown_connections 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f425c0789f0 0x7f425c07aea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42700fc710 0x7f4270112a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 --2- 172.21.15.46:0/3111331299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101e20 0x7f4270112fd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 >> 172.21.15.46:0/3111331299 conn(0x7f4270071460 msgr2=0x7f42700f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 shutdown_connections 2024-05-09T06:35:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.181+0000 7f4278457700 1 -- 172.21.15.46:0/3111331299 wait complete. 2024-05-09T06:35:28.173 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:35:28.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 -- 172.21.15.46:0/3246411049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 msgr2=0x7f92880fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 --2- 172.21.15.46:0/3246411049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f92880fbcf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f927c009ce0 tx=0x7f927c004d10 comp rx=0 tx=0).stop 2024-05-09T06:35:28.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 -- 172.21.15.46:0/3246411049 shutdown_connections 2024-05-09T06:35:28.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 --2- 172.21.15.46:0/3246411049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f92880fbcf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 --2- 172.21.15.46:0/3246411049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 0x7f92881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 -- 172.21.15.46:0/3246411049 >> 172.21.15.46:0/3246411049 conn(0x7f92880f7850 msgr2=0x7f92880f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 -- 172.21.15.46:0/3246411049 shutdown_connections 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.288+0000 7f928f593700 1 -- 172.21.15.46:0/3246411049 wait complete. 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928f593700 1 Processor -- start 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928f593700 1 -- start start 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928f593700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 0x7f9288115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928f593700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f9288116340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928f593700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288116a20 con 0x7f9288102680 2024-05-09T06:35:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928f593700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928810fd60 con 0x7f9288101ce0 2024-05-09T06:35:28.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928d32f700 1 -- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 msgr2=0x7f9288115e00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.106:3300/0 2024-05-09T06:35:28.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928d32f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 0x7f9288115e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:35:28.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f9288116340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f9288116340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38346/0 (socket says 172.21.15.46:38346) 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 -- 172.21.15.46:0/1218644674 learned_addr learned my addr 172.21.15.46:0/1218644674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 -- 172.21.15.46:0/1218644674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 msgr2=0x7f9288115e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 0x7f9288115e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 -- 172.21.15.46:0/1218644674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009940 con 0x7f9288102680 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.289+0000 7f928cb2e700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f9288116340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f927c009fd0 tx=0x7f927c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.290+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927c00e070 con 0x7f9288102680 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.290+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928810ff80 con 0x7f9288102680 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.290+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f927c012ac0 con 0x7f9288102680 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.290+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927c01b8a0 con 0x7f9288102680 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.290+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9288110540 con 0x7f9288102680 2024-05-09T06:35:28.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.291+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880fd430 con 0x7f9288102680 2024-05-09T06:35:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.292+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f927c019040 con 0x7f9288102680 2024-05-09T06:35:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.292+0000 7f9285ffb700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f92700789f0 0x7f927007aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.293+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f927c09c1e0 con 0x7f9288102680 2024-05-09T06:35:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.293+0000 7f928d32f700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f92700789f0 0x7f927007aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:28.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.293+0000 7f928d32f700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f92700789f0 0x7f927007aea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9280006fd0 tx=0x7f9280006df0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:28.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.297+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f927c063ca0 con 0x7f9288102680 2024-05-09T06:35:28.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 podman[81044]: 2024-05-09 06:35:28.148785965 +0000 UTC m=+0.578675927 container cleanup 804da2f6372fe9254984364fb09cc682a3c631eb90309040b7dc4dc13952a758 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=quincy-4ba5a83, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-09T06:35:28.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 bash[81044]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106 2024-05-09T06:35:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.537+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9288108ec0 con 0x7f92700789f0 2024-05-09T06:35:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.538+0000 7f9285ffb700 1 -- 172.21.15.46:0/1218644674 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9288108ec0 con 0x7f92700789f0 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.540+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f92700789f0 msgr2=0x7f927007aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.540+0000 7f928f593700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f92700789f0 0x7f927007aea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9280006fd0 tx=0x7f9280006df0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.540+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 msgr2=0x7f9288116340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.540+0000 7f928f593700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f9288116340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f927c009fd0 tx=0x7f927c004d10 comp rx=0 tx=0).stop 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 shutdown_connections 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f92700789f0 0x7f927007aea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9288101ce0 0x7f9288115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 --2- 172.21.15.46:0/1218644674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288102680 0x7f9288116340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 >> 172.21.15.46:0/1218644674 conn(0x7f92880f7850 msgr2=0x7f92880f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 shutdown_connections 2024-05-09T06:35:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.541+0000 7f928f593700 1 -- 172.21.15.46:0/1218644674 wait complete. 2024-05-09T06:35:28.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 -- 172.21.15.46:0/4211666935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 msgr2=0x7f31d4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/4211666935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4065ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31c8004940 tx=0x7f31c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 -- 172.21.15.46:0/4211666935 shutdown_connections 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/4211666935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4065ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/4211666935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 0x7f31d4103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 -- 172.21.15.46:0/4211666935 >> 172.21.15.46:0/4211666935 conn(0x7f31d4071d00 msgr2=0x7f31d4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 -- 172.21.15.46:0/4211666935 shutdown_connections 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 -- 172.21.15.46:0/4211666935 wait complete. 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 Processor -- start 2024-05-09T06:35:28.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.646+0000 7f31dc6d0700 1 -- start start 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31dc6d0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31dc6d0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 0x7f31d41140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31dc6d0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4114780 con 0x7f31d4065640 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31dc6d0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d410dae0 con 0x7f31d4102e50 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31d9c6b700 1 -- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 msgr2=0x7f31d41140a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.106:3300/0 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:28.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31d9c6b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 0x7f31d41140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38376/0 (socket says 172.21.15.46:38376) 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 -- 172.21.15.46:0/712060907 learned_addr learned my addr 172.21.15.46:0/712060907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 -- 172.21.15.46:0/712060907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 msgr2=0x7f31d41140a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 0x7f31d41140a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 -- 172.21.15.46:0/712060907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8005040 con 0x7f31d4065640 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31da46c700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4113b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31d000b760 tx=0x7f31d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d0010790 con 0x7f31d4065640 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31d0010dc0 con 0x7f31d4065640 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d410ddc0 con 0x7f31d4065640 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.647+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d000f300 con 0x7f31d4065640 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.648+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d410e380 con 0x7f31d4065640 2024-05-09T06:35:28.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.648+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d40fe540 con 0x7f31d4065640 2024-05-09T06:35:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.649+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f31d00117f0 con 0x7f31d4065640 2024-05-09T06:35:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.650+0000 7f31c6ffd700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f31c0078a50 0x7f31c007af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.650+0000 7f31d9c6b700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f31c0078a50 0x7f31c007af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.650+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f31d009a8c0 con 0x7f31d4065640 2024-05-09T06:35:28.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.650+0000 7f31d9c6b700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f31c0078a50 0x7f31c007af00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f31c8000c00 tx=0x7f31c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:28.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.655+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f31d0062470 con 0x7f31d4065640 2024-05-09T06:35:28.695 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 podman[81058]: 2024-05-09 06:35:28.391551723 +0000 UTC m=+0.626640938 container remove 804da2f6372fe9254984364fb09cc682a3c631eb90309040b7dc4dc13952a758 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=quincy-4ba5a83, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-09T06:35:28.695 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106.service: Deactivated successfully. 2024-05-09T06:35:28.695 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 systemd[1]: Stopped Ceph mon.smithi106 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:35:28.695 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106.service: Consumed 6.937s CPU time. 2024-05-09T06:35:28.696 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 systemd[1]: Starting Ceph mon.smithi106 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:35:28.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.879+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f31d410a000 con 0x7f31c0078a50 2024-05-09T06:35:28.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.890+0000 7f31c6ffd700 1 -- 172.21.15.46:0/712060907 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f31d410a000 con 0x7f31c0078a50 2024-05-09T06:35:28.871 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:35:28.871 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 11s ago 13m 17.8M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:35:28.871 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (13m) 11s ago 13m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:35:28.871 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (12m) 13s ago 12m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:35:28.871 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (107s) 11s ago 13m 76.1M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (7m) 11s ago 7m 13.5M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (7m) 11s ago 7m 156M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (7m) 13s ago 7m 17.6M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (7m) 13s ago 7m 15.2M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (4m) 11s ago 14m 487M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (3m) 13s ago 12m 462M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (27s) 11s ago 14m 31.0M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (12m) 13s ago 12m 46.8M 2048M 17.2.7-933-g4ba5a836 b96134859c76 804da2f6372f 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 11s ago 13m 15.0M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (2m) 13s ago 12m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (11m) 11s ago 11m 260M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (11m) 11s ago 11m 266M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 11s ago 10m 222M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (10m) 13s ago 10m 289M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:35:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (9m) 13s ago 9m 261M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:35:28.873 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (9m) 13s ago 9m 237M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:35:28.873 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (2m) 11s ago 12m 64.3M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:35:28.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f31c0078a50 msgr2=0x7f31c007af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f31c0078a50 0x7f31c007af00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f31c8000c00 tx=0x7f31c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:28.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 msgr2=0x7f31d4113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4113b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31d000b760 tx=0x7f31d0009220 comp rx=0 tx=0).stop 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 shutdown_connections 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f31c0078a50 0x7f31c007af00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4065640 0x7f31d4113b60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 --2- 172.21.15.46:0/712060907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31d4102e50 0x7f31d41140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 >> 172.21.15.46:0/712060907 conn(0x7f31d4071d00 msgr2=0x7f31d40fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 shutdown_connections 2024-05-09T06:35:28.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.892+0000 7f31dc6d0700 1 -- 172.21.15.46:0/712060907 wait complete. 2024-05-09T06:35:28.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 -- 172.21.15.46:0/265647372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 msgr2=0x7f7fdc0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:28.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 --2- 172.21.15.46:0/265647372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc0fc1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc004940 tx=0x7f7fcc009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 -- 172.21.15.46:0/265647372 shutdown_connections 2024-05-09T06:35:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 --2- 172.21.15.46:0/265647372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc0fc1b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 --2- 172.21.15.46:0/265647372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 0x7f7fdc102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 -- 172.21.15.46:0/265647372 >> 172.21.15.46:0/265647372 conn(0x7f7fdc071d00 msgr2=0x7f7fdc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 -- 172.21.15.46:0/265647372 shutdown_connections 2024-05-09T06:35:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 -- 172.21.15.46:0/265647372 wait complete. 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.996+0000 7f7fe455b700 1 Processor -- start 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe455b700 1 -- start start 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe455b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe455b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 0x7f7fdc114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe455b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc114830 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe455b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc10db90 con 0x7f7fdc101d90 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe1af6700 1 -- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 msgr2=0x7f7fdc114150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.106:3300/0 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38392/0 (socket says 172.21.15.46:38392) 2024-05-09T06:35:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 -- 172.21.15.46:0/713602889 learned_addr learned my addr 172.21.15.46:0/713602889 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe1af6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 0x7f7fdc114150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 -- 172.21.15.46:0/713602889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 msgr2=0x7f7fdc114150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 0x7f7fdc114150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 -- 172.21.15.46:0/713602889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc005040 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.997+0000 7f7fe22f7700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc113c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800b760 tx=0x7f7fd8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.998+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd8010790 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.998+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fd8010dc0 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.998+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc10de70 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.998+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd800f300 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.998+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc10e430 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.999+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc0fd430 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:28.999+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f7fd80117f0 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.000+0000 7f7fd2ffd700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7fc80789f0 0x7f7fc807aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.000+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7fd809a800 con 0x7f7fdc0fbd40 2024-05-09T06:35:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.000+0000 7f7fe1af6700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7fc80789f0 0x7f7fc807aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.000+0000 7f7fe1af6700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7fc80789f0 0x7f7fc807aea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc004890 tx=0x7f7fcc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:28.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.005+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f7fd8062430 con 0x7f7fdc0fbd40 2024-05-09T06:35:29.019 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 podman[81189]: 2024-05-09 06:35:28.835114988 +0000 UTC m=+0.018316829 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:35:29.019 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:28 smithi106 podman[81189]: 2024-05-09 06:35:28.942921802 +0000 UTC m=+0.126123630 container create 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-09T06:35:29.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.316+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7fdc05f5c0 con 0x7f7fdc0fbd40 2024-05-09T06:35:29.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.316+0000 7f7fd2ffd700 1 -- 172.21.15.46:0/713602889 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f7fd8061dd0 con 0x7f7fdc0fbd40 2024-05-09T06:35:29.298 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:35:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:35:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:35:29.298 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 11, 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 3 2024-05-09T06:35:29.299 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:35:29.300 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:35:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7fc80789f0 msgr2=0x7f7fc807aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7fc80789f0 0x7f7fc807aea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc004890 tx=0x7f7fcc009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 msgr2=0x7f7fdc113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc113c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800b760 tx=0x7f7fd8009220 comp rx=0 tx=0).stop 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 shutdown_connections 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7fc80789f0 0x7f7fc807aea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fdc0fbd40 0x7f7fdc113c10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 --2- 172.21.15.46:0/713602889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fdc101d90 0x7f7fdc114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 >> 172.21.15.46:0/713602889 conn(0x7f7fdc071d00 msgr2=0x7f7fdc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 shutdown_connections 2024-05-09T06:35:29.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.319+0000 7f7fe455b700 1 -- 172.21.15.46:0/713602889 wait complete. 2024-05-09T06:35:29.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 podman[81189]: 2024-05-09 06:35:29.161829578 +0000 UTC m=+0.345031410 container init 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-720f8e9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 podman[81189]: 2024-05-09 06:35:29.16522589 +0000 UTC m=+0.348427718 container start 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev), process ceph-mon, pid 2 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: pidfile_write: ignore empty --pid-file 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: load: jerasure load: lrc 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: RocksDB version: 7.9.2 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Git sha 0 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Compile date 2024-05-08 16:28:29 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: DB SUMMARY 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: DB Session ID: JSDDX74C45IKM6GASEDR 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: CURRENT file: CURRENT 2024-05-09T06:35:29.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1083 Bytes 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi106/store.db dir, Total Num: 1, files: 000027.sst 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi106/store.db: 000025.log size: 6040258 ; 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.error_if_exists: 0 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.create_if_missing: 0 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.paranoid_checks: 1 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.env: 0x55df78f81cc0 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.info_log: 0x55df7a6a1ca0 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.statistics: (nil) 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.use_fsync: 0 2024-05-09T06:35:29.325 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_log_file_size: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.allow_fallocate: 1 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.use_direct_reads: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.db_log_dir: 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.wal_dir: 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T06:35:29.326 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.write_buffer_manager: 0x55df7a6730e0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T06:35:29.327 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.unordered_write: 0 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.row_cache: None 2024-05-09T06:35:29.328 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.wal_filter: None 2024-05-09T06:35:29.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T06:35:29.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T06:35:29.329 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.two_write_queues: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.wal_compression: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.atomic_flush: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.log_readahead_size: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T06:35:29.330 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_background_jobs: 2 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_background_compactions: -1 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_subcompactions: 1 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T06:35:29.331 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_open_files: -1 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_background_flushes: -1 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Compression algorithms supported: 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kZSTD supported: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kXpressCompression supported: 0 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kZlibCompression supported: 1 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kSnappyCompression supported: 1 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kLZ4Compression supported: 1 2024-05-09T06:35:29.332 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: kBZip2Compression supported: 0 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi106/store.db/MANIFEST-000009 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.merge_operator: 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_filter: None 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55df7a6a1e60) 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: cache_index_and_filter_blocks: 1 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T06:35:29.333 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: pin_top_level_index_and_filter: 1 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: index_type: 0 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: data_block_index_type: 0 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: index_shortening: 1 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: checksum: 4 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: no_block_cache: 0 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_cache: 0x55df7a6a51f0 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_cache_name: BinnedLRUCache 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_cache_options: 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: capacity : 536870912 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: num_shard_bits : 4 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: strict_capacity_limit : 0 2024-05-09T06:35:29.334 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: high_pri_pool_ratio: 0.000 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_cache_compressed: (nil) 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: persistent_cache: (nil) 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_size: 4096 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_size_deviation: 10 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_restart_interval: 16 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: index_block_restart_interval: 1 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: metadata_block_size: 4096 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: partition_filters: 0 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: use_delta_encoding: 1 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: filter_policy: bloomfilter 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: whole_key_filtering: 1 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: verify_compression: 0 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: read_amp_bytes_per_bit: 0 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: format_version: 5 2024-05-09T06:35:29.335 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: enable_index_compression: 1 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: block_align: 0 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: max_auto_readahead_size: 262144 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: prepopulate_block_cache: 0 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: initial_auto_readahead_size: 8192 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression: NoCompression 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.num_levels: 7 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T06:35:29.336 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T06:35:29.337 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T06:35:29.338 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T06:35:29.339 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.inplace_update_support: 0 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.bloom_locality: 0 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.max_successive_merges: 0 2024-05-09T06:35:29.340 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.ttl: 2592000 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.enable_blob_files: false 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.min_blob_size: 0 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T06:35:29.341 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi106/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12184, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fea7a549-6f25-46d5-963b-de90cad2d11e 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236529196656, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236529210475, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3717760, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12189, "largest_seqno": 14541, "table_properties": {"data_size": 3707998, "index_size": 6284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2437, "raw_key_size": 22402, "raw_average_key_size": 23, "raw_value_size": 3687687, "raw_average_value_size": 3861, "num_data_blocks": 284, "num_entries": 955, "num_filter_entries": 955, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715236529, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fea7a549-6f25-46d5-963b-de90cad2d11e", "db_session_id": "JSDDX74C45IKM6GASEDR", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715236529210577, "job": 1, "event": "recovery_finished"} 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi106/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T06:35:29.342 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55df7a7c2000 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: DB pointer 0x55df7a7ac000 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: ** DB Stats ** 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.343 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: ** Compaction Stats [default] ** 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: L0 1/0 3.55 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 656.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: L6 1/0 6.94 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Sum 2/0 10.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 656.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 656.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: ** Compaction Stats [default] ** 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 656.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T06:35:29.344 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Cumulative compaction: 0.00 GB write, 188.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Interval compaction: 0.00 GB write, 188.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Block cache BinnedLRUCache@0x55df7a6a51f0#2 capacity: 512.00 MB usage: 9.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: starting mon.smithi106 rank 1 at public addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] at bind addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi106 fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:29.345 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???) e2 preinit fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).mds e16 new map 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).mds e16 print_map 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: e16 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: legacy client fscid: 1 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Filesystem 'cephfs' (1) 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: fs_name cephfs 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: epoch 16 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:35:29.346 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: tableserver 0 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: root 0 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: session_timeout 60 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: session_autoclose 300 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: max_file_size 1099511627776 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: max_xattr_size 65536 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: required_client_features {} 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: last_failure 0 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: last_failure_osd_epoch 46 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: max_mds 1 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: in 0 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: up {0=14492} 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: failed 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: damaged 2024-05-09T06:35:29.347 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: stopped 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: data_pools [3] 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: metadata_pool 2 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: inline_data enabled 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: balancer 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: bal_rank_mask -1 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: standby_count_wanted 1 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: qdb_cluster leader: 0 members: 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: [mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: Standby daemons: 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: [mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: [mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout: [mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 ceph-mon[81208]: mon.smithi106@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 bash[81189]: 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 2024-05-09T06:35:29.349 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:29 smithi106 systemd[1]: Started Ceph mon.smithi106 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:35:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 -- 172.21.15.46:0/912984264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101d90 msgr2=0x7f8d54102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/912984264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101d90 0x7f8d54102160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d44004940 tx=0x7f8d44009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 -- 172.21.15.46:0/912984264 shutdown_connections 2024-05-09T06:35:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/912984264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d540fbd40 0x7f8d540fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/912984264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101d90 0x7f8d54102160 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 -- 172.21.15.46:0/912984264 >> 172.21.15.46:0/912984264 conn(0x7f8d54071d00 msgr2=0x7f8d54072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:29.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 -- 172.21.15.46:0/912984264 shutdown_connections 2024-05-09T06:35:29.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.423+0000 7f8d59c3c700 1 -- 172.21.15.46:0/912984264 wait complete. 2024-05-09T06:35:29.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d59c3c700 1 Processor -- start 2024-05-09T06:35:29.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d59c3c700 1 -- start start 2024-05-09T06:35:29.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d59c3c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 0x7f8d5410ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:29.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d59c3c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 0x7f8d5410f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d59c3c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5410f760 con 0x7f8d540fbd40 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d59c3c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5410f8a0 con 0x7f8d54101d90 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 0x7f8d5410ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 0x7f8d5410ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38410/0 (socket says 172.21.15.46:38410) 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d537fe700 1 -- 172.21.15.46:0/961008879 learned_addr learned my addr 172.21.15.46:0/961008879 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.424+0000 7f8d52ffd700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 0x7f8d5410f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d52ffd700 1 -- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 msgr2=0x7f8d5410f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d52ffd700 1 -- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 msgr2=0x7f8d5410f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d52ffd700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 0x7f8d5410f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d52ffd700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 0x7f8d5410f220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d537fe700 1 -- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 msgr2=0x7f8d5410f220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:35:29.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d537fe700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 0x7f8d5410f220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d537fe700 1 -- 172.21.15.46:0/961008879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44005040 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d537fe700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 0x7f8d5410ece0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400b8b0 tx=0x7f8d44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4400e040 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d54117b90 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d44013420 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4401c630 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.425+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d54118120 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.426+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d540fd430 con 0x7f8d540fbd40 2024-05-09T06:35:29.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.427+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f8d4401c8f0 con 0x7f8d540fbd40 2024-05-09T06:35:29.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.427+0000 7f8d3bfff700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8d3c078aa0 0x7f8d3c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:29.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.428+0000 7f8d52ffd700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8d3c078aa0 0x7f8d3c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:29.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.428+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8d4409bc20 con 0x7f8d540fbd40 2024-05-09T06:35:29.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.428+0000 7f8d52ffd700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8d3c078aa0 0x7f8d3c07af50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8d54066000 tx=0x7f8d48009f10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.432+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8d440637b0 con 0x7f8d540fbd40 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.693+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8d54108e50 con 0x7f8d540fbd40 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.693+0000 7f8d3bfff700 1 -- 172.21.15.46:0/961008879 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f8d44063150 con 0x7f8d540fbd40 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:35:29.675 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:35:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:35:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:35:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:35:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:35:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.695+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8d3c078aa0 msgr2=0x7f8d3c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.695+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8d3c078aa0 0x7f8d3c07af50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8d54066000 tx=0x7f8d48009f10 comp rx=0 tx=0).stop 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.695+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 msgr2=0x7f8d5410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.695+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 0x7f8d5410ece0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400b8b0 tx=0x7f8d44009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 shutdown_connections 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8d3c078aa0 0x7f8d3c07af50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d540fbd40 0x7f8d5410ece0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 --2- 172.21.15.46:0/961008879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d54101d90 0x7f8d5410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 >> 172.21.15.46:0/961008879 conn(0x7f8d54071d00 msgr2=0x7f8d540fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 shutdown_connections 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.696+0000 7f8d59c3c700 1 -- 172.21.15.46:0/961008879 wait complete. 2024-05-09T06:35:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:35:29.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 -- 172.21.15.46:0/3761280402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494102de0 msgr2=0x7fb4941031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 --2- 172.21.15.46:0/3761280402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494102de0 0x7fb4941031b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb484009ce0 tx=0x7fb484004d10 comp rx=0 tx=0).stop 2024-05-09T06:35:29.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 -- 172.21.15.46:0/3761280402 shutdown_connections 2024-05-09T06:35:29.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 --2- 172.21.15.46:0/3761280402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb494103780 0x7fb4940fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 --2- 172.21.15.46:0/3761280402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494102de0 0x7fb4941031b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 -- 172.21.15.46:0/3761280402 >> 172.21.15.46:0/3761280402 conn(0x7fb4940f8990 msgr2=0x7fb4940fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 -- 172.21.15.46:0/3761280402 shutdown_connections 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.802+0000 7fb498f36700 1 -- 172.21.15.46:0/3761280402 wait complete. 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb498f36700 1 Processor -- start 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb498f36700 1 -- start start 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb498f36700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb494102de0 0x7fb494113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb498f36700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 0x7fb494113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb498f36700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494114640 con 0x7fb494103780 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb498f36700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49410dc20 con 0x7fb494102de0 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 0x7fb494113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 0x7fb494113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38420/0 (socket says 172.21.15.46:38420) 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 -- 172.21.15.46:0/3762945701 learned_addr learned my addr 172.21.15.46:0/3762945701 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb49259c700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb494102de0 0x7fb494113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 -- 172.21.15.46:0/3762945701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb494102de0 msgr2=0x7fb494113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb494102de0 0x7fb494113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 -- 172.21.15.46:0/3762945701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009940 con 0x7fb494103780 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.803+0000 7fb491d9b700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 0x7fb494113ff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb488002a80 tx=0x7fb488004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.804+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb488007cc0 con 0x7fb494103780 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.804+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb48800f040 con 0x7fb494103780 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.804+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49410df00 con 0x7fb494103780 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.804+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48800db30 con 0x7fb494103780 2024-05-09T06:35:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.804+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49410e4c0 con 0x7fb494103780 2024-05-09T06:35:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.805+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4941000f0 con 0x7fb494103780 2024-05-09T06:35:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.805+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fb48800dcd0 con 0x7fb494103780 2024-05-09T06:35:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.806+0000 7fb482ffd700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb47c078aa0 0x7fb47c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.806+0000 7fb49259c700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb47c078aa0 0x7fb47c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.806+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb488099f80 con 0x7fb494103780 2024-05-09T06:35:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.806+0000 7fb49259c700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb47c078aa0 0x7fb47c07af50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb484015040 tx=0x7fb484004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.811+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb488061aa0 con 0x7fb494103780 2024-05-09T06:35:29.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:29.988+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb488061aa0 con 0x7fb494103780 2024-05-09T06:35:30.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.047+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb49410f100 con 0x7fb47c078aa0 2024-05-09T06:35:30.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.048+0000 7fb482ffd700 1 -- 172.21.15.46:0/3762945701 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb49410f100 con 0x7fb47c078aa0 2024-05-09T06:35:30.029 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:35:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:35:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:35:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "3/21 daemons upgraded", 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:35:30.030 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:35:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb47c078aa0 msgr2=0x7fb47c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb47c078aa0 0x7fb47c07af50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb484015040 tx=0x7fb484004d10 comp rx=0 tx=0).stop 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 msgr2=0x7fb494113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 0x7fb494113ff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb488002a80 tx=0x7fb488004630 comp rx=0 tx=0).stop 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 shutdown_connections 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb47c078aa0 0x7fb47c07af50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb494102de0 0x7fb494113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 --2- 172.21.15.46:0/3762945701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb494103780 0x7fb494113ff0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 >> 172.21.15.46:0/3762945701 conn(0x7fb4940f8990 msgr2=0x7fb4941073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 shutdown_connections 2024-05-09T06:35:30.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.050+0000 7fb498f36700 1 -- 172.21.15.46:0/3762945701 wait complete. 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 -- 172.21.15.46:0/1202870475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708102e50 msgr2=0x7f4708103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 --2- 172.21.15.46:0/1202870475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708102e50 0x7f4708103220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f46f8004940 tx=0x7f46f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 -- 172.21.15.46:0/1202870475 shutdown_connections 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 --2- 172.21.15.46:0/1202870475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708065640 0x7f4708065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 --2- 172.21.15.46:0/1202870475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708102e50 0x7f4708103220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 -- 172.21.15.46:0/1202870475 >> 172.21.15.46:0/1202870475 conn(0x7f4708071d00 msgr2=0x7f4708072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 -- 172.21.15.46:0/1202870475 shutdown_connections 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.156+0000 7f470ced5700 1 -- 172.21.15.46:0/1202870475 wait complete. 2024-05-09T06:35:30.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470ced5700 1 Processor -- start 2024-05-09T06:35:30.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470ced5700 1 -- start start 2024-05-09T06:35:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470ced5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 0x7f4708113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470ced5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 0x7f4708114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470ced5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47081146e0 con 0x7f4708065640 2024-05-09T06:35:30.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470ced5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470810dad0 con 0x7f4708102e50 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 0x7f4708113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 0x7f4708113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38434/0 (socket says 172.21.15.46:38434) 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470659c700 1 -- 172.21.15.46:0/853939417 learned_addr learned my addr 172.21.15.46:0/853939417 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f4705d9b700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 0x7f4708114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f4705d9b700 1 -- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 msgr2=0x7f4708114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f4705d9b700 1 -- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 msgr2=0x7f4708114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f4705d9b700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 0x7f4708114090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f4705d9b700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 0x7f4708114090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470659c700 1 -- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 msgr2=0x7f4708114090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470659c700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 0x7f4708114090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.157+0000 7f470659c700 1 -- 172.21.15.46:0/853939417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8005040 con 0x7f4708065640 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.158+0000 7f470659c700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 0x7f4708113b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46f800b3b0 tx=0x7f46f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.158+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f800e040 con 0x7f4708065640 2024-05-09T06:35:30.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.158+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46f800bbc0 con 0x7f4708065640 2024-05-09T06:35:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.158+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470810dd50 con 0x7f4708065640 2024-05-09T06:35:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.158+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f801c3f0 con 0x7f4708065640 2024-05-09T06:35:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.158+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470810e310 con 0x7f4708065640 2024-05-09T06:35:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.159+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708100100 con 0x7f4708065640 2024-05-09T06:35:30.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.160+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f46f800bd30 con 0x7f4708065640 2024-05-09T06:35:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.160+0000 7f46f6ffd700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f46f0078aa0 0x7f46f007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:35:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.161+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f46f809c690 con 0x7f4708065640 2024-05-09T06:35:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.161+0000 7f4705d9b700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f46f0078aa0 0x7f46f007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:35:30.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.161+0000 7f4705d9b700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f46f0078aa0 0x7f46f007af50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f470810ec90 tx=0x7f46fc009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:35:30.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.165+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f46f80641b0 con 0x7f4708065640 2024-05-09T06:35:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.474+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f470810f1a0 con 0x7f4708065640 2024-05-09T06:35:30.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.474+0000 7f46f6ffd700 1 -- 172.21.15.46:0/853939417 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f46f8063b50 con 0x7f4708065640 2024-05-09T06:35:30.456 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:30.456 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.476+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f46f0078aa0 msgr2=0x7f46f007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:30.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.476+0000 7f470ced5700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f46f0078aa0 0x7f46f007af50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f470810ec90 tx=0x7f46fc009f70 comp rx=0 tx=0).stop 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.476+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 msgr2=0x7f4708113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.476+0000 7f470ced5700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 0x7f4708113b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46f800b3b0 tx=0x7f46f8009e30 comp rx=0 tx=0).stop 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.476+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 shutdown_connections 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.477+0000 7f470ced5700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f46f0078aa0 0x7f46f007af50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.477+0000 7f470ced5700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4708065640 0x7f4708113b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.477+0000 7f470ced5700 1 --2- 172.21.15.46:0/853939417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708102e50 0x7f4708114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.477+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 >> 172.21.15.46:0/853939417 conn(0x7f4708071d00 msgr2=0x7f47080fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.477+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 shutdown_connections 2024-05-09T06:35:30.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:35:30.477+0000 7f470ced5700 1 -- 172.21.15.46:0/853939417 wait complete. 2024-05-09T06:35:31.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:35:31.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: mgrmap e39: smithi046.nvpcui(active, since 17s), standbys: smithi106.nlgnpx 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: mon.smithi106 calling monitor election 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: mon.smithi046 calling monitor election 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: mon.smithi046 is new leader, mons smithi046,smithi106 in quorum (ranks 0,1) 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: monmap epoch 3 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: last_changed 2024-05-09T06:35:29.986781+0000 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: created 2024-05-09T06:20:34.219870+0000 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: min_mon_release 19 (squid) 2024-05-09T06:35:31.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: election_strategy: 1 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.smithi106 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: mgrmap e39: smithi046.nvpcui(active, since 17s), standbys: smithi106.nlgnpx 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:35:31.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:30 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/853939417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:35:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:35:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: mgrmap e39: smithi046.nvpcui(active, since 17s), standbys: smithi106.nlgnpx 2024-05-09T06:35:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:31.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: mon.smithi106 calling monitor election 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: mon.smithi046 calling monitor election 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: mon.smithi046 is new leader, mons smithi046,smithi106 in quorum (ranks 0,1) 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: monmap epoch 3 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: last_changed 2024-05-09T06:35:29.986781+0000 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: created 2024-05-09T06:20:34.219870+0000 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: min_mon_release 19 (squid) 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: election_strategy: 1 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.smithi106 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: osdmap e49: 6 total, 6 up, 6 in 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: mgrmap e39: smithi046.nvpcui(active, since 17s), standbys: smithi106.nlgnpx 2024-05-09T06:35:31.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mon metadata", "id": "smithi106"}]: dispatch 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-09T06:35:31.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:30 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/853939417' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:35:33.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:33 smithi046 ceph-mon[110713]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:33.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:33 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:33.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:33 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:33 smithi106 ceph-mon[81208]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:33 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:33 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:35.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:34 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:35.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:34 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:35.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:34 smithi106 ceph-mon[81208]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:35.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:34 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:35.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:34 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:35.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:34 smithi046 ceph-mon[110713]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:37.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:37 smithi106 ceph-mon[81208]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:37.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:37 smithi046 ceph-mon[110713]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: Detected new or changed devices on smithi106 2024-05-09T06:35:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: Reconfiguring mon.smithi046 (monmap changed)... 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:38.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:38 smithi106 ceph-mon[81208]: Reconfiguring daemon mon.smithi046 on smithi046 2024-05-09T06:35:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: Detected new or changed devices on smithi106 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: Reconfiguring mon.smithi046 (monmap changed)... 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:38.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:38 smithi046 ceph-mon[110713]: Reconfiguring daemon mon.smithi046 on smithi046 2024-05-09T06:35:39.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:39 smithi046 ceph-mon[110713]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:39.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:39.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:39.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:35:39.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:35:39.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:39 smithi106 ceph-mon[81208]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.nvpcui", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:35:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:35:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:40.484 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:40 smithi046 ceph-mon[110713]: Reconfiguring mgr.smithi046.nvpcui (monmap changed)... 2024-05-09T06:35:40.484 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:40 smithi046 ceph-mon[110713]: Reconfiguring daemon mgr.smithi046.nvpcui on smithi046 2024-05-09T06:35:40.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:40 smithi106 ceph-mon[81208]: Reconfiguring mgr.smithi046.nvpcui (monmap changed)... 2024-05-09T06:35:40.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:40 smithi106 ceph-mon[81208]: Reconfiguring daemon mgr.smithi046.nvpcui on smithi046 2024-05-09T06:35:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:41.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: Reconfiguring crash.smithi046 (monmap changed)... 2024-05-09T06:35:41.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:41.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:41.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:41 smithi106 ceph-mon[81208]: Reconfiguring daemon crash.smithi046 on smithi046 2024-05-09T06:35:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: Reconfiguring crash.smithi046 (monmap changed)... 2024-05-09T06:35:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:41.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:41 smithi046 ceph-mon[110713]: Reconfiguring daemon crash.smithi046 on smithi046 2024-05-09T06:35:43.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: Reconfiguring osd.0 (monmap changed)... 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:43.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:43 smithi046 ceph-mon[110713]: Reconfiguring daemon osd.0 on smithi046 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: Reconfiguring osd.0 (monmap changed)... 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:43 smithi106 ceph-mon[81208]: Reconfiguring daemon osd.0 on smithi046 2024-05-09T06:35:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: Reconfiguring osd.1 (monmap changed)... 2024-05-09T06:35:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:35:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: Reconfiguring daemon osd.1 on smithi046 2024-05-09T06:35:45.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:44 smithi046 ceph-mon[110713]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: Reconfiguring osd.1 (monmap changed)... 2024-05-09T06:35:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:35:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:45.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: Reconfiguring daemon osd.1 on smithi046 2024-05-09T06:35:45.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:44 smithi106 ceph-mon[81208]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: Reconfiguring osd.2 (monmap changed)... 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: Reconfiguring daemon osd.2 on smithi046 2024-05-09T06:35:46.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:46 smithi046 ceph-mon[110713]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: Reconfiguring osd.2 (monmap changed)... 2024-05-09T06:35:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:35:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:47.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: Reconfiguring daemon osd.2 on smithi046 2024-05-09T06:35:47.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:46 smithi106 ceph-mon[81208]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:48 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:48 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:48 smithi046 ceph-mon[110713]: Reconfiguring mds.cephfs.smithi046.easboa (monmap changed)... 2024-05-09T06:35:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:48 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:48 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:48.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:48 smithi046 ceph-mon[110713]: Reconfiguring daemon mds.cephfs.smithi046.easboa on smithi046 2024-05-09T06:35:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:48 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:48 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:48 smithi106 ceph-mon[81208]: Reconfiguring mds.cephfs.smithi046.easboa (monmap changed)... 2024-05-09T06:35:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:48 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:48 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:48.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:48 smithi106 ceph-mon[81208]: Reconfiguring daemon mds.cephfs.smithi046.easboa on smithi046 2024-05-09T06:35:49.681 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:49 smithi046 ceph-mon[110713]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:49.681 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:49.681 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:49.682 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:49.682 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:49 smithi106 ceph-mon[81208]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:35:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:50.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:50 smithi046 ceph-mon[110713]: Reconfiguring mds.cephfs.smithi046.pkuwsr (monmap changed)... 2024-05-09T06:35:50.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:50 smithi046 ceph-mon[110713]: Reconfiguring daemon mds.cephfs.smithi046.pkuwsr on smithi046 2024-05-09T06:35:50.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:50 smithi106 ceph-mon[81208]: Reconfiguring mds.cephfs.smithi046.pkuwsr (monmap changed)... 2024-05-09T06:35:50.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:50 smithi106 ceph-mon[81208]: Reconfiguring daemon mds.cephfs.smithi046.pkuwsr on smithi046 2024-05-09T06:35:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:51 smithi106 ceph-mon[81208]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:51 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:51 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:51 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:51 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:51.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:51 smithi046 ceph-mon[110713]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:51.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:51 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:51.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:51 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:51.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:51 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:35:51.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:51 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:52.744 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: Reconfiguring crash.smithi106 (monmap changed)... 2024-05-09T06:35:52.744 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: Reconfiguring daemon crash.smithi106 on smithi106 2024-05-09T06:35:52.744 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:52.744 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:52.744 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:35:52.744 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:35:52.745 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:52 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:52.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: Reconfiguring crash.smithi106 (monmap changed)... 2024-05-09T06:35:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: Reconfiguring daemon crash.smithi106 on smithi106 2024-05-09T06:35:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi106.nlgnpx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T06:35:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T06:35:52.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:52 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:53.738 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:53 smithi106 ceph-mon[81208]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:53.738 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:53 smithi106 ceph-mon[81208]: Reconfiguring mgr.smithi106.nlgnpx (monmap changed)... 2024-05-09T06:35:53.738 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:53 smithi106 ceph-mon[81208]: Reconfiguring daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:35:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:53 smithi046 ceph-mon[110713]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:53 smithi046 ceph-mon[110713]: Reconfiguring mgr.smithi106.nlgnpx (monmap changed)... 2024-05-09T06:35:53.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:53 smithi046 ceph-mon[110713]: Reconfiguring daemon mgr.smithi106.nlgnpx on smithi106 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: Reconfiguring mon.smithi106 (monmap changed)... 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: Reconfiguring daemon mon.smithi106 on smithi106 2024-05-09T06:35:55.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:54 smithi106 ceph-mon[81208]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: Reconfiguring mon.smithi106 (monmap changed)... 2024-05-09T06:35:55.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T06:35:55.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T06:35:55.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:55.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: Reconfiguring daemon mon.smithi106 on smithi106 2024-05-09T06:35:55.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:54 smithi046 ceph-mon[110713]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:56.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:56 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:56.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:56 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:56.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:56 smithi106 ceph-mon[81208]: Reconfiguring osd.3 (monmap changed)... 2024-05-09T06:35:56.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:56 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:35:56.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:56 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:56.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:56 smithi106 ceph-mon[81208]: Reconfiguring daemon osd.3 on smithi106 2024-05-09T06:35:56.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:56 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:56.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:56 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:56.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:56 smithi046 ceph-mon[110713]: Reconfiguring osd.3 (monmap changed)... 2024-05-09T06:35:56.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:56 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:35:56.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:56 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:56.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:56 smithi046 ceph-mon[110713]: Reconfiguring daemon osd.3 on smithi106 2024-05-09T06:35:57.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:57 smithi046 ceph-mon[110713]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:35:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:57.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:57.691 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:57 smithi106 ceph-mon[81208]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:57.691 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:57.691 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:57.691 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:35:57.691 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:57.691 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:35:58.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:58 smithi046 ceph-mon[110713]: Reconfiguring osd.4 (monmap changed)... 2024-05-09T06:35:58.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:58 smithi046 ceph-mon[110713]: Reconfiguring daemon osd.4 on smithi106 2024-05-09T06:35:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:58 smithi106 ceph-mon[81208]: Reconfiguring osd.4 (monmap changed)... 2024-05-09T06:35:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:58 smithi106 ceph-mon[81208]: Reconfiguring daemon osd.4 on smithi106 2024-05-09T06:35:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:35:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:35:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: Reconfiguring osd.5 (monmap changed)... 2024-05-09T06:35:59.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:35:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:35:59.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:35:59 smithi106 ceph-mon[81208]: Reconfiguring daemon osd.5 on smithi106 2024-05-09T06:36:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: Reconfiguring osd.5 (monmap changed)... 2024-05-09T06:36:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:36:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:35:59 smithi046 ceph-mon[110713]: Reconfiguring daemon osd.5 on smithi106 2024-05-09T06:36:00.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 -- 172.21.15.46:0/1512656270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4071f30 msgr2=0x7efda4070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 --2- 172.21.15.46:0/1512656270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4071f30 0x7efda4070300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efda0004970 tx=0x7efda0009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 -- 172.21.15.46:0/1512656270 shutdown_connections 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 --2- 172.21.15.46:0/1512656270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4070840 0x7efda4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 --2- 172.21.15.46:0/1512656270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4071f30 0x7efda4070300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 -- 172.21.15.46:0/1512656270 >> 172.21.15.46:0/1512656270 conn(0x7efda40f8930 msgr2=0x7efda40fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 -- 172.21.15.46:0/1512656270 shutdown_connections 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.598+0000 7efdab933700 1 -- 172.21.15.46:0/1512656270 wait complete. 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efdab933700 1 Processor -- start 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efdab933700 1 -- start start 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efdab933700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 0x7efda4119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efdab933700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4071f30 0x7efda411a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efdab933700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda411aac0 con 0x7efda4070840 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efdab933700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda41140a0 con 0x7efda4071f30 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 0x7efda4119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 0x7efda4119f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46460/0 (socket says 172.21.15.46:46460) 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 -- 172.21.15.46:0/4191949573 learned_addr learned my addr 172.21.15.46:0/4191949573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda8ece700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4071f30 0x7efda411a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 -- 172.21.15.46:0/4191949573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4071f30 msgr2=0x7efda411a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4071f30 0x7efda411a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 -- 172.21.15.46:0/4191949573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0005040 con 0x7efda4070840 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda8ece700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4071f30 0x7efda411a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.599+0000 7efda96cf700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 0x7efda4119f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efda0004f50 tx=0x7efda0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.600+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda000e040 con 0x7efda4070840 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.600+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efda0004290 con 0x7efda4070840 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.600+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda4114320 con 0x7efda4070840 2024-05-09T06:36:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.600+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda001c630 con 0x7efda4070840 2024-05-09T06:36:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.600+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda4114860 con 0x7efda4070840 2024-05-09T06:36:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.601+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda4071a40 con 0x7efda4070840 2024-05-09T06:36:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.602+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7efda000bc10 con 0x7efda4070840 2024-05-09T06:36:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.602+0000 7efd99ffb700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efd90078aa0 0x7efd9007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.602+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efda009bc20 con 0x7efda4070840 2024-05-09T06:36:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.602+0000 7efda8ece700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efd90078aa0 0x7efd9007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.603+0000 7efda8ece700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efd90078aa0 0x7efd9007af50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd94009fd0 tx=0x7efd94009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:00.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.608+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7efda0063740 con 0x7efda4070840 2024-05-09T06:36:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.845+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efda4115580 con 0x7efd90078aa0 2024-05-09T06:36:00.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.847+0000 7efd99ffb700 1 -- 172.21.15.46:0/4191949573 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7efda4115580 con 0x7efd90078aa0 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efd90078aa0 msgr2=0x7efd9007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efd90078aa0 0x7efd9007af50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd94009fd0 tx=0x7efd94009ee0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 msgr2=0x7efda4119f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 0x7efda4119f30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efda0004f50 tx=0x7efda0009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 shutdown_connections 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efd90078aa0 0x7efd9007af50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efda4070840 0x7efda4119f30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 --2- 172.21.15.46:0/4191949573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efda4071f30 0x7efda411a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 >> 172.21.15.46:0/4191949573 conn(0x7efda40f8930 msgr2=0x7efda40f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 shutdown_connections 2024-05-09T06:36:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.850+0000 7efdab933700 1 -- 172.21.15.46:0/4191949573 wait complete. 2024-05-09T06:36:00.841 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:36:00.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1730369656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 msgr2=0x7fcb880fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:00.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1730369656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fe1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb78004940 tx=0x7fcb78009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:00.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1730369656 shutdown_connections 2024-05-09T06:36:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1730369656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880fe7b0 0x7fcb88106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1730369656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fe1e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1730369656 >> 172.21.15.46:0/1730369656 conn(0x7fcb880f7860 msgr2=0x7fcb880f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1730369656 shutdown_connections 2024-05-09T06:36:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1730369656 wait complete. 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 Processor -- start 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.955+0000 7fcb8d41c700 1 -- start start 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb8d41c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb8d41c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880fe7b0 0x7fcb880fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb8d41c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880fdb90 con 0x7fcb880fde10 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb8d41c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880fc6c0 con 0x7fcb880fe7b0 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51198/0 (socket says 172.21.15.46:51198) 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 -- 172.21.15.46:0/1466266384 learned_addr learned my addr 172.21.15.46:0/1466266384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb867fc700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880fe7b0 0x7fcb880fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 -- 172.21.15.46:0/1466266384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880fe7b0 msgr2=0x7fcb880fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880fe7b0 0x7fcb880fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 -- 172.21.15.46:0/1466266384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78005040 con 0x7fcb880fde10 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.956+0000 7fcb86ffd700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fbc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb78004890 tx=0x7fcb78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.957+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7800e040 con 0x7fcb880fde10 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.957+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb78009af0 con 0x7fcb880fde10 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.957+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb880fc940 con 0x7fcb880fde10 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.957+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7801c3f0 con 0x7fcb880fde10 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.957+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb88119ff0 con 0x7fcb880fde10 2024-05-09T06:36:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.958+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb88066b50 con 0x7fcb880fde10 2024-05-09T06:36:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.958+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fcb7800baf0 con 0x7fcb880fde10 2024-05-09T06:36:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.959+0000 7fcb6f7fe700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb70078aa0 0x7fcb7007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.959+0000 7fcb867fc700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb70078aa0 0x7fcb7007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.959+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcb7809bc80 con 0x7fcb880fde10 2024-05-09T06:36:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.960+0000 7fcb867fc700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb70078aa0 0x7fcb7007af50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb880fd370 tx=0x7fcb7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:00.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:00.967+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fcb78063680 con 0x7fcb880fde10 2024-05-09T06:36:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.205+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb880f9410 con 0x7fcb70078aa0 2024-05-09T06:36:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.207+0000 7fcb6f7fe700 1 -- 172.21.15.46:0/1466266384 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fcb880f9410 con 0x7fcb70078aa0 2024-05-09T06:36:01.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb70078aa0 msgr2=0x7fcb7007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb70078aa0 0x7fcb7007af50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb880fd370 tx=0x7fcb7c00b040 comp rx=0 tx=0).stop 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 msgr2=0x7fcb880fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fbc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb78004890 tx=0x7fcb78009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 shutdown_connections 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb70078aa0 0x7fcb7007af50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb880fde10 0x7fcb880fbc40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 --2- 172.21.15.46:0/1466266384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880fe7b0 0x7fcb880fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 >> 172.21.15.46:0/1466266384 conn(0x7fcb880f7860 msgr2=0x7fcb880f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 shutdown_connections 2024-05-09T06:36:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.209+0000 7fcb8d41c700 1 -- 172.21.15.46:0/1466266384 wait complete. 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 -- 172.21.15.46:0/1512509744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 msgr2=0x7f52380fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 --2- 172.21.15.46:0/1512509744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f52380fb970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5228004940 tx=0x7f5228009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 -- 172.21.15.46:0/1512509744 shutdown_connections 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 --2- 172.21.15.46:0/1512509744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52380fbf40 0x7f5238101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 --2- 172.21.15.46:0/1512509744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f52380fb970 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 -- 172.21.15.46:0/1512509744 >> 172.21.15.46:0/1512509744 conn(0x7f5238073350 msgr2=0x7f5238073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:01.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 -- 172.21.15.46:0/1512509744 shutdown_connections 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 -- 172.21.15.46:0/1512509744 wait complete. 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 Processor -- start 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.315+0000 7f523ccf2700 1 -- start start 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523ccf2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f5238113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523ccf2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52380fbf40 0x7f5238113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523ccf2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238114500 con 0x7f52380fb5a0 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523ccf2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523810db20 con 0x7f52380fbf40 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f5238113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f5238113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51222/0 (socket says 172.21.15.46:51222) 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 -- 172.21.15.46:0/3993831497 learned_addr learned my addr 172.21.15.46:0/3993831497 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f5235d9b700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52380fbf40 0x7f5238113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 -- 172.21.15.46:0/3993831497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52380fbf40 msgr2=0x7f5238113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52380fbf40 0x7f5238113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 -- 172.21.15.46:0/3993831497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228005040 con 0x7f52380fb5a0 2024-05-09T06:36:01.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523659c700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f5238113970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5228009b30 tx=0x7f5228009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5228021070 con 0x7f52380fb5a0 2024-05-09T06:36:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5228013c00 con 0x7f52380fb5a0 2024-05-09T06:36:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523810dda0 con 0x7f52380fb5a0 2024-05-09T06:36:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522800e070 con 0x7f52380fb5a0 2024-05-09T06:36:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.316+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523810e280 con 0x7f52380fb5a0 2024-05-09T06:36:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.317+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380fe670 con 0x7f52380fb5a0 2024-05-09T06:36:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.318+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f522801cad0 con 0x7f52380fb5a0 2024-05-09T06:36:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.319+0000 7f5226ffd700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5220078aa0 0x7f522007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.319+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f522809bcd0 con 0x7f52380fb5a0 2024-05-09T06:36:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.319+0000 7f5235d9b700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5220078aa0 0x7f522007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:01.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.319+0000 7f5235d9b700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5220078aa0 0x7f522007af50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f523810f210 tx=0x7f522c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:01.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.323+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f52280637f0 con 0x7f52380fb5a0 2024-05-09T06:36:01.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.547+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f523810f030 con 0x7f5220078aa0 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: Reconfiguring mds.cephfs.smithi106.fqgqkm (monmap changed)... 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:01 smithi046 ceph-mon[110713]: Reconfiguring daemon mds.cephfs.smithi106.fqgqkm on smithi106 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.558+0000 7f5226ffd700 1 -- 172.21.15.46:0/3993831497 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f523810f030 con 0x7f5220078aa0 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 43s ago 13m 17.8M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (14m) 43s ago 14m 6656k - 17.2.7-933-g4ba5a836 b96134859c76 abde8e56209f 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (12m) 28s ago 12m 6660k - 17.2.7-933-g4ba5a836 b96134859c76 6a74b0b8a216 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 43s ago 13m 76.1M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (8m) 43s ago 8m 13.5M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (8m) 43s ago 8m 156M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (8m) 28s ago 8m 17.7M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:36:01.539 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (8m) 28s ago 8m 15.4M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (4m) 43s ago 15m 487M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (3m) 28s ago 12m 463M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (60s) 43s ago 15m 31.0M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (32s) 28s ago 12m 23.0M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (3m) 43s ago 14m 15.0M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (3m) 28s ago 12m 15.5M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (12m) 43s ago 12m 260M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (11m) 43s ago 11m 266M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (11m) 43s ago 11m 222M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (10m) 28s ago 10m 289M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (10m) 28s ago 10m 261M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (9m) 28s ago 9m 238M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:36:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 43s ago 13m 64.3M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:36:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5220078aa0 msgr2=0x7f522007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5220078aa0 0x7f522007af50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f523810f210 tx=0x7f522c00b040 comp rx=0 tx=0).stop 2024-05-09T06:36:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 msgr2=0x7f5238113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f5238113970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5228009b30 tx=0x7f5228009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 shutdown_connections 2024-05-09T06:36:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5220078aa0 0x7f522007af50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52380fb5a0 0x7f5238113970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 --2- 172.21.15.46:0/3993831497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52380fbf40 0x7f5238113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 >> 172.21.15.46:0/3993831497 conn(0x7f5238073350 msgr2=0x7f52380f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 shutdown_connections 2024-05-09T06:36:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.560+0000 7f523ccf2700 1 -- 172.21.15.46:0/3993831497 wait complete. 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: Reconfiguring mds.cephfs.smithi106.fqgqkm (monmap changed)... 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:01 smithi106 ceph-mon[81208]: Reconfiguring daemon mds.cephfs.smithi106.fqgqkm on smithi106 2024-05-09T06:36:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 -- 172.21.15.46:0/3118581900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 msgr2=0x7fa3e81020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/3118581900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e81020e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8004940 tx=0x7fa3d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 -- 172.21.15.46:0/3118581900 shutdown_connections 2024-05-09T06:36:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/3118581900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 0x7fa3e80fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/3118581900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e81020e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 -- 172.21.15.46:0/3118581900 >> 172.21.15.46:0/3118581900 conn(0x7fa3e80f7820 msgr2=0x7fa3e80f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 -- 172.21.15.46:0/3118581900 shutdown_connections 2024-05-09T06:36:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.663+0000 7fa3ee29d700 1 -- 172.21.15.46:0/3118581900 wait complete. 2024-05-09T06:36:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.664+0000 7fa3ee29d700 1 Processor -- start 2024-05-09T06:36:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.664+0000 7fa3ee29d700 1 -- start start 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.664+0000 7fa3ee29d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e810ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.664+0000 7fa3ee29d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 0x7fa3e810f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.664+0000 7fa3ee29d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e810f8c0 con 0x7fa3e8101d10 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.664+0000 7fa3ee29d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e810fa00 con 0x7fa3e81026b0 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e810ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e810ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51232/0 (socket says 172.21.15.46:51232) 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 -- 172.21.15.46:0/1782171451 learned_addr learned my addr 172.21.15.46:0/1782171451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e77fe700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 0x7fa3e810f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 -- 172.21.15.46:0/1782171451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 msgr2=0x7fa3e810f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 0x7fa3e810f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 -- 172.21.15.46:0/1782171451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8005040 con 0x7fa3e8101d10 2024-05-09T06:36:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e77fe700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 0x7fa3e810f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e7fff700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e810ee40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800b3b0 tx=0x7fa3d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d800e040 con 0x7fa3e8101d10 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3d800bbc0 con 0x7fa3e8101d10 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e810fc80 con 0x7fa3e8101d10 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d801c3f0 con 0x7fa3e8101d10 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.665+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e81181b0 con 0x7fa3e8101d10 2024-05-09T06:36:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.666+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e80fd460 con 0x7fa3e8101d10 2024-05-09T06:36:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.667+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fa3d800bd30 con 0x7fa3e8101d10 2024-05-09T06:36:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.668+0000 7fa3e4ff9700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa3d0078aa0 0x7fa3d007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.668+0000 7fa3e77fe700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa3d0078aa0 0x7fa3d007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.668+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa3d809c620 con 0x7fa3e8101d10 2024-05-09T06:36:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.668+0000 7fa3e77fe700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa3d0078aa0 0x7fa3d007af50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009fd0 tx=0x7fa3dc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.672+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa3d8064140 con 0x7fa3e8101d10 2024-05-09T06:36:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.977+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3e804c710 con 0x7fa3e8101d10 2024-05-09T06:36:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.977+0000 7fa3e4ff9700 1 -- 172.21.15.46:0/1782171451 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fa3d8063ae0 con 0x7fa3e8101d10 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:36:01.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:36:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 10, 2024-05-09T06:36:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:36:01.960 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:36:01.960 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:36:01.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa3d0078aa0 msgr2=0x7fa3d007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa3d0078aa0 0x7fa3d007af50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009fd0 tx=0x7fa3dc00b040 comp rx=0 tx=0).stop 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 msgr2=0x7fa3e810ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e810ee40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800b3b0 tx=0x7fa3d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 shutdown_connections 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa3d0078aa0 0x7fa3d007af50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3e8101d10 0x7fa3e810ee40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 --2- 172.21.15.46:0/1782171451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e81026b0 0x7fa3e810f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 >> 172.21.15.46:0/1782171451 conn(0x7fa3e80f7820 msgr2=0x7fa3e80f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 shutdown_connections 2024-05-09T06:36:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:01.980+0000 7fa3ee29d700 1 -- 172.21.15.46:0/1782171451 wait complete. 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 -- 172.21.15.46:0/1133756589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 msgr2=0x7ff2080fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 --2- 172.21.15.46:0/1133756589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fe230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff204004940 tx=0x7ff204009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 -- 172.21.15.46:0/1133756589 shutdown_connections 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 --2- 172.21.15.46:0/1133756589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2080fe800 0x7ff208106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 --2- 172.21.15.46:0/1133756589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fe230 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 -- 172.21.15.46:0/1133756589 >> 172.21.15.46:0/1133756589 conn(0x7ff2080f7870 msgr2=0x7ff2080f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 -- 172.21.15.46:0/1133756589 shutdown_connections 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 -- 172.21.15.46:0/1133756589 wait complete. 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 Processor -- start 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.085+0000 7ff20f774700 1 -- start start 2024-05-09T06:36:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20f774700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20f774700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2080fe800 0x7ff2080fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20f774700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080fdbe0 con 0x7ff2080fde60 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20f774700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080fc710 con 0x7ff2080fe800 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51256/0 (socket says 172.21.15.46:51256) 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 -- 172.21.15.46:0/404703885 learned_addr learned my addr 172.21.15.46:0/404703885 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20cd0f700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2080fe800 0x7ff2080fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 -- 172.21.15.46:0/404703885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2080fe800 msgr2=0x7ff2080fc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2080fe800 0x7ff2080fc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 -- 172.21.15.46:0/404703885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204005040 con 0x7ff2080fde60 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20d510700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fbc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff204004890 tx=0x7ff204009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20400e040 con 0x7ff2080fde60 2024-05-09T06:36:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff204009af0 con 0x7ff2080fde60 2024-05-09T06:36:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2080fc9f0 con 0x7ff2080fde60 2024-05-09T06:36:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.086+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20401c3f0 con 0x7ff2080fde60 2024-05-09T06:36:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.087+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20811a070 con 0x7ff2080fde60 2024-05-09T06:36:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.089+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff208066ad0 con 0x7ff2080fde60 2024-05-09T06:36:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.089+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7ff20400baf0 con 0x7ff2080fde60 2024-05-09T06:36:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.089+0000 7ff1fdffb700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff1f4078aa0 0x7ff1f407af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.089+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff20409bb30 con 0x7ff2080fde60 2024-05-09T06:36:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.089+0000 7ff20cd0f700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff1f4078aa0 0x7ff1f407af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.089+0000 7ff20cd0f700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff1f4078aa0 0x7ff1f407af50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff2080fd3c0 tx=0x7ff1f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.095+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff204063650 con 0x7ff2080fde60 2024-05-09T06:36:02.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:02.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:02 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1782171451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.363+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff20811a2b0 con 0x7ff2080fde60 2024-05-09T06:36:02.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.364+0000 7ff1fdffb700 1 -- 172.21.15.46:0/404703885 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7ff204062ff0 con 0x7ff2080fde60 2024-05-09T06:36:02.345 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:36:02.345 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:36:02.345 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:02.345 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:36:02.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:02.345 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:36:02.346 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:36:02.346 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:36:02.346 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:36:02.346 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:36:02.346 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:36:02.346 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:36:02.347 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:36:02.348 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:36:02.349 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:02.350 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff1f4078aa0 msgr2=0x7ff1f407af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff1f4078aa0 0x7ff1f407af50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff2080fd3c0 tx=0x7ff1f800b040 comp rx=0 tx=0).stop 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 msgr2=0x7ff2080fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fbc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff204004890 tx=0x7ff204009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 shutdown_connections 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff1f4078aa0 0x7ff1f407af50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2080fde60 0x7ff2080fbc90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 --2- 172.21.15.46:0/404703885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2080fe800 0x7ff2080fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 >> 172.21.15.46:0/404703885 conn(0x7ff2080f7870 msgr2=0x7ff2081016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 shutdown_connections 2024-05-09T06:36:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.367+0000 7ff20f774700 1 -- 172.21.15.46:0/404703885 wait complete. 2024-05-09T06:36:02.352 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:36:02.419 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:02.420 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:02 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1782171451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.478+0000 7f13557dc700 1 -- 172.21.15.46:0/4282590830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350102de0 msgr2=0x7f13501031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.478+0000 7f13557dc700 1 --2- 172.21.15.46:0/4282590830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350102de0 0x7f13501031b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1340004940 tx=0x7f1340009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 -- 172.21.15.46:0/4282590830 shutdown_connections 2024-05-09T06:36:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 --2- 172.21.15.46:0/4282590830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1350103780 0x7f13500fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 --2- 172.21.15.46:0/4282590830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350102de0 0x7f13501031b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 -- 172.21.15.46:0/4282590830 >> 172.21.15.46:0/4282590830 conn(0x7f13500f8950 msgr2=0x7f13500fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 -- 172.21.15.46:0/4282590830 shutdown_connections 2024-05-09T06:36:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 -- 172.21.15.46:0/4282590830 wait complete. 2024-05-09T06:36:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 Processor -- start 2024-05-09T06:36:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.479+0000 7f13557dc700 1 -- start start 2024-05-09T06:36:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f13557dc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1350102de0 0x7f1350070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f13557dc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 0x7f13500707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f13557dc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350070ce0 con 0x7f1350103780 2024-05-09T06:36:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f13557dc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350070e20 con 0x7f1350102de0 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 0x7f13500707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 0x7f13500707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51268/0 (socket says 172.21.15.46:51268) 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 -- 172.21.15.46:0/4051876862 learned_addr learned my addr 172.21.15.46:0/4051876862 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f134effd700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1350102de0 0x7f1350070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 -- 172.21.15.46:0/4051876862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1350102de0 msgr2=0x7f1350070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1350102de0 0x7f1350070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 -- 172.21.15.46:0/4051876862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340005040 con 0x7f1350103780 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.480+0000 7f1347fff700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 0x7f13500707a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f133800eb40 tx=0x7f133800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.481+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1338007cc0 con 0x7f1350103780 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.481+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350071070 con 0x7f1350103780 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.481+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f133800f040 con 0x7f1350103780 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.481+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13380095e0 con 0x7f1350103780 2024-05-09T06:36:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.481+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135011a1e0 con 0x7f1350103780 2024-05-09T06:36:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.482+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13501000f0 con 0x7f1350103780 2024-05-09T06:36:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.483+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f1338009740 con 0x7f1350103780 2024-05-09T06:36:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.483+0000 7f13477fe700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f133c078aa0 0x7f133c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.483+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f133809a4a0 con 0x7f1350103780 2024-05-09T06:36:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.483+0000 7f134effd700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f133c078aa0 0x7f133c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.484+0000 7f134effd700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f133c078aa0 0x7f133c07af50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f134000b0d0 tx=0x7f1340009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.488+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f1338062110 con 0x7f1350103780 2024-05-09T06:36:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.725+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1350109ee0 con 0x7f133c078aa0 2024-05-09T06:36:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.726+0000 7f13477fe700 1 -- 172.21.15.46:0/4051876862 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1350109ee0 con 0x7f133c078aa0 2024-05-09T06:36:02.707 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:36:02.707 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:36:02.707 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "4/21 daemons upgraded", 2024-05-09T06:36:02.708 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-05-09T06:36:02.709 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:36:02.709 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:36:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.728+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f133c078aa0 msgr2=0x7f133c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.728+0000 7f13557dc700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f133c078aa0 0x7f133c07af50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f134000b0d0 tx=0x7f1340009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.728+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 msgr2=0x7f13500707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.728+0000 7f13557dc700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 0x7f13500707a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f133800eb40 tx=0x7f133800b040 comp rx=0 tx=0).stop 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 shutdown_connections 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f133c078aa0 0x7f133c07af50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1350102de0 0x7f1350070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 --2- 172.21.15.46:0/4051876862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1350103780 0x7f13500707a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 >> 172.21.15.46:0/4051876862 conn(0x7f13500f8950 msgr2=0x7f13501073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 shutdown_connections 2024-05-09T06:36:02.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.729+0000 7f13557dc700 1 -- 172.21.15.46:0/4051876862 wait complete. 2024-05-09T06:36:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.833+0000 7f371641b700 1 -- 172.21.15.46:0/772076954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3710102e20 msgr2=0x7f37101031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.833+0000 7f371641b700 1 --2- 172.21.15.46:0/772076954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3710102e20 0x7f37101031f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3700004940 tx=0x7f3700009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 -- 172.21.15.46:0/772076954 shutdown_connections 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 --2- 172.21.15.46:0/772076954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37101037c0 0x7f37100fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 --2- 172.21.15.46:0/772076954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3710102e20 0x7f37101031f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 -- 172.21.15.46:0/772076954 >> 172.21.15.46:0/772076954 conn(0x7f3710072380 msgr2=0x7f3710072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 -- 172.21.15.46:0/772076954 shutdown_connections 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 -- 172.21.15.46:0/772076954 wait complete. 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 Processor -- start 2024-05-09T06:36:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 -- start start 2024-05-09T06:36:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.834+0000 7f371641b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710102e20 0x7f3710115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f371641b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 0x7f3710116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f371641b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710116760 con 0x7f37101037c0 2024-05-09T06:36:02.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f371641b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371010fd90 con 0x7f3710102e20 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 0x7f3710116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 0x7f3710116110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51292/0 (socket says 172.21.15.46:51292) 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 -- 172.21.15.46:0/3836797327 learned_addr learned my addr 172.21.15.46:0/3836797327 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370ffff700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710102e20 0x7f3710115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 -- 172.21.15.46:0/3836797327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710102e20 msgr2=0x7f3710115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710102e20 0x7f3710115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 -- 172.21.15.46:0/3836797327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700005040 con 0x7f37101037c0 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370ffff700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710102e20 0x7f3710115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370f7fe700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 0x7f3710116110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3704002a50 tx=0x7f3704004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3704007cc0 con 0x7f37101037c0 2024-05-09T06:36:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f370400f040 con 0x7f37101037c0 2024-05-09T06:36:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.835+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3710110070 con 0x7f37101037c0 2024-05-09T06:36:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.836+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f370400d9c0 con 0x7f37101037c0 2024-05-09T06:36:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.836+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37101105b0 con 0x7f37101037c0 2024-05-09T06:36:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.837+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3710106a10 con 0x7f37101037c0 2024-05-09T06:36:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.837+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f3704009730 con 0x7f37101037c0 2024-05-09T06:36:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.838+0000 7f370cff9700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f36f8078aa0 0x7f36f807af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.838+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f370409a610 con 0x7f37101037c0 2024-05-09T06:36:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.838+0000 7f370ffff700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f36f8078aa0 0x7f36f807af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.838+0000 7f370ffff700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f36f8078aa0 0x7f36f807af50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3700004890 tx=0x7f3700009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:02.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:02.843+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f3704062090 con 0x7f37101037c0 2024-05-09T06:36:03.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.152+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f37100fe6e0 con 0x7f37101037c0 2024-05-09T06:36:03.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.152+0000 7f370cff9700 1 -- 172.21.15.46:0/3836797327 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f3704061a30 con 0x7f37101037c0 2024-05-09T06:36:03.133 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:36:03.133 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:36:03.133 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f36f8078aa0 msgr2=0x7f36f807af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f36f8078aa0 0x7f36f807af50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3700004890 tx=0x7f3700009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 msgr2=0x7f3710116110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 0x7f3710116110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3704002a50 tx=0x7f3704004600 comp rx=0 tx=0).stop 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 shutdown_connections 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f36f8078aa0 0x7f36f807af50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710102e20 0x7f3710115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 --2- 172.21.15.46:0/3836797327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37101037c0 0x7f3710116110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 >> 172.21.15.46:0/3836797327 conn(0x7f3710072380 msgr2=0x7f37100fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 shutdown_connections 2024-05-09T06:36:03.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:03.154+0000 7f371641b700 1 -- 172.21.15.46:0/3836797327 wait complete. 2024-05-09T06:36:03.361 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:03 smithi106 ceph-mon[81208]: Reconfiguring mds.cephfs.smithi106.ugnujp (monmap changed)... 2024-05-09T06:36:03.362 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:03 smithi106 ceph-mon[81208]: Reconfiguring daemon mds.cephfs.smithi106.ugnujp on smithi106 2024-05-09T06:36:03.362 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:03 smithi106 ceph-mon[81208]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:03.362 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:03 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/404703885' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:03.362 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:03 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3836797327' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:03.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:03 smithi046 ceph-mon[110713]: Reconfiguring mds.cephfs.smithi106.ugnujp (monmap changed)... 2024-05-09T06:36:03.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:03 smithi046 ceph-mon[110713]: Reconfiguring daemon mds.cephfs.smithi106.ugnujp on smithi106 2024-05-09T06:36:03.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:03 smithi046 ceph-mon[110713]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:03.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:03 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/404703885' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:03.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:03 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3836797327' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all mon 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]: dispatch 2024-05-09T06:36:04.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]': finished 2024-05-09T06:36:04.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi106"}]: dispatch 2024-05-09T06:36:04.824 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi106"}]': finished 2024-05-09T06:36:04.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:04.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:04.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:04.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all mon 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]: dispatch 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]': finished 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi106"}]: dispatch 2024-05-09T06:36:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi106"}]': finished 2024-05-09T06:36:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:05 smithi046 ceph-mon[110713]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:36:05.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:05 smithi106 ceph-mon[81208]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:36:05.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:06.772 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:06 smithi046 ceph-mon[110713]: Upgrade: Updating crash.smithi046 (1/2) 2024-05-09T06:36:06.773 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:06 smithi046 ceph-mon[110713]: Deploying daemon crash.smithi046 on smithi046 2024-05-09T06:36:06.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:06 smithi106 ceph-mon[81208]: Upgrade: Updating crash.smithi046 (1/2) 2024-05-09T06:36:06.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:06 smithi106 ceph-mon[81208]: Deploying daemon crash.smithi046 on smithi046 2024-05-09T06:36:07.644 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:07 smithi046 ceph-mon[110713]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:07 smithi106 ceph-mon[81208]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:09.729 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:09 smithi106 ceph-mon[81208]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:09.729 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:09 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:09.730 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:09 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:09.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:09 smithi046 ceph-mon[110713]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:09.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:09 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:09.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:09 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:11.522 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:11 smithi106 ceph-mon[81208]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:11.522 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:11 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:11.522 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:11 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:36:11.522 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:11 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:11.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:11 smithi046 ceph-mon[110713]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:11.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:11 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:11.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:11 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi106", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-05-09T06:36:11.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:11 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:12.649 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:12 smithi106 ceph-mon[81208]: Upgrade: Updating crash.smithi106 (2/2) 2024-05-09T06:36:12.649 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:12 smithi106 ceph-mon[81208]: Deploying daemon crash.smithi106 on smithi106 2024-05-09T06:36:12.649 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:12.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:12 smithi046 ceph-mon[110713]: Upgrade: Updating crash.smithi106 (2/2) 2024-05-09T06:36:12.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:12 smithi046 ceph-mon[110713]: Deploying daemon crash.smithi106 on smithi106 2024-05-09T06:36:12.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:13.787 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:13 smithi106 ceph-mon[81208]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:13.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:13 smithi046 ceph-mon[110713]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:15.226 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:15 smithi106 ceph-mon[81208]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:15.227 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:15 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:15.227 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:15 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:15.227 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:15 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:15.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:15 smithi046 ceph-mon[110713]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:15.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:15 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:15.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:15 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:15.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:15 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:17.497 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:17 smithi046 ceph-mon[110713]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:17.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:17.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:17.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:17 smithi106 ceph-mon[81208]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:17.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:17 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:17.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:17 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:19 smithi046 ceph-mon[110713]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:19 smithi106 ceph-mon[81208]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:20.703 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:20 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:20.704 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:20 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:20.791 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:20 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:20.791 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:20 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:21 smithi106 ceph-mon[81208]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:21 smithi046 ceph-mon[110713]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:21.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:21.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:23.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:23 smithi046 ceph-mon[110713]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:23.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:23 smithi106 ceph-mon[81208]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:25.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all crash 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]: dispatch 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]': finished 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi106"}]: dispatch 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi106"}]': finished 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:36:25.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:25 smithi046 ceph-mon[110713]: Upgrade: osd.0 is safe to restart 2024-05-09T06:36:25.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:25.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all crash 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]: dispatch 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]': finished 2024-05-09T06:36:25.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi106"}]: dispatch 2024-05-09T06:36:25.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi106"}]': finished 2024-05-09T06:36:25.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:36:25.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-09T06:36:25.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:25 smithi106 ceph-mon[81208]: Upgrade: osd.0 is safe to restart 2024-05-09T06:36:27.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:27 smithi046 ceph-mon[110713]: Upgrade: Updating osd.0 2024-05-09T06:36:27.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:27.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:36:27.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:27.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:27 smithi046 ceph-mon[110713]: Deploying daemon osd.0 on smithi046 2024-05-09T06:36:27.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:27 smithi046 ceph-mon[110713]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:27 smithi106 ceph-mon[81208]: Upgrade: Updating osd.0 2024-05-09T06:36:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T06:36:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:27 smithi106 ceph-mon[81208]: Deploying daemon osd.0 on smithi046 2024-05-09T06:36:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:27 smithi106 ceph-mon[81208]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:28.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:28 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:28.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:28 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:29.245 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:29 smithi046 ceph-mon[110713]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:29.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:29 smithi106 ceph-mon[81208]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:29.585 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:29 smithi046 systemd[1]: Stopping Ceph osd.0 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:36:29.995 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:29 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[45100]: 2024-05-09T06:36:29.707+0000 7f746623d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:36:29.995 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:29 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[45100]: 2024-05-09T06:36:29.707+0000 7f746623d700 -1 osd.0 49 *** Got signal Terminated *** 2024-05-09T06:36:29.995 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:29 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[45100]: 2024-05-09T06:36:29.707+0000 7f746623d700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:36:30.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:30 smithi106 ceph-mon[81208]: osd.0 marked itself down and dead 2024-05-09T06:36:30.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:30 smithi046 ceph-mon[110713]: osd.0 marked itself down and dead 2024-05-09T06:36:30.731 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:30 smithi046 podman[121436]: 2024-05-09 06:36:30.486834926 +0000 UTC m=+0.885380926 container died 88dfa35cf3cc1ab960e74ba54a18eed2834f3524b5c12a865224ae1d6b8a2887 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:36:30.996 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:30 smithi046 podman[121436]: 2024-05-09 06:36:30.857398857 +0000 UTC m=+1.255944865 container cleanup 88dfa35cf3cc1ab960e74ba54a18eed2834f3524b5c12a865224ae1d6b8a2887 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-4ba5a83, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-05-09T06:36:30.996 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:30 smithi046 bash[121436]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0 2024-05-09T06:36:31.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:31 smithi106 ceph-mon[81208]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:36:31.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:31 smithi106 ceph-mon[81208]: osdmap e50: 6 total, 5 up, 6 in 2024-05-09T06:36:31.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:31 smithi106 ceph-mon[81208]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:31.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:31 smithi046 ceph-mon[110713]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:36:31.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:31 smithi046 ceph-mon[110713]: osdmap e50: 6 total, 5 up, 6 in 2024-05-09T06:36:31.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:31 smithi046 ceph-mon[110713]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:31.335 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:31 smithi046 podman[121454]: 2024-05-09 06:36:31.150710036 +0000 UTC m=+0.657496972 container remove 88dfa35cf3cc1ab960e74ba54a18eed2834f3524b5c12a865224ae1d6b8a2887 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=quincy-4ba5a83, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-09T06:36:31.735 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:31 smithi046 podman[121549]: 2024-05-09 06:36:31.370664423 +0000 UTC m=+0.019050165 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:36:31.735 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:31 smithi046 podman[121549]: 2024-05-09 06:36:31.501787572 +0000 UTC m=+0.150173343 container create 6274b72410cdd18713b3b7f56270eca92ae191aa87d8b5219415d508cee41767 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-09T06:36:31.735 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:31 smithi046 podman[121549]: 2024-05-09 06:36:31.754628212 +0000 UTC m=+0.403013941 container init 6274b72410cdd18713b3b7f56270eca92ae191aa87d8b5219415d508cee41767 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-09T06:36:32.004 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:31 smithi046 podman[121549]: 2024-05-09 06:36:31.758370741 +0000 UTC m=+0.406756467 container start 6274b72410cdd18713b3b7f56270eca92ae191aa87d8b5219415d508cee41767 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-09T06:36:32.004 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:31 smithi046 podman[121549]: 2024-05-09 06:36:31.845857067 +0000 UTC m=+0.494242792 container attach 6274b72410cdd18713b3b7f56270eca92ae191aa87d8b5219415d508cee41767 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-05-09T06:36:32.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:32 smithi106 ceph-mon[81208]: osdmap e51: 6 total, 5 up, 6 in 2024-05-09T06:36:32.329 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:32 smithi046 podman[121549]: 2024-05-09 06:36:32.067090734 +0000 UTC m=+0.715476454 container died 6274b72410cdd18713b3b7f56270eca92ae191aa87d8b5219415d508cee41767 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True) 2024-05-09T06:36:32.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:32 smithi046 ceph-mon[110713]: osdmap e51: 6 total, 5 up, 6 in 2024-05-09T06:36:32.891 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:32 smithi046 podman[121575]: 2024-05-09 06:36:32.657869881 +0000 UTC m=+0.584760300 container remove 6274b72410cdd18713b3b7f56270eca92ae191aa87d8b5219415d508cee41767 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:36:32.891 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:32 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-09T06:36:32.892 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:32 smithi046 systemd[1]: Stopped Ceph osd.0 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:36:32.892 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:32 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.0.service: Consumed 1min 8.837s CPU time. 2024-05-09T06:36:33.148 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:32 smithi046 systemd[1]: Starting Ceph osd.0 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:36:33.148 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 podman[121678]: 2024-05-09 06:36:33.038407623 +0000 UTC m=+0.020060865 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:36:33.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:33 smithi046 ceph-mon[110713]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:33.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 -- 172.21.15.46:0/270842985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 msgr2=0x7fb37c1020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 --2- 172.21.15.46:0/270842985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c1020d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb36c004940 tx=0x7fb36c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 -- 172.21.15.46:0/270842985 shutdown_connections 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 --2- 172.21.15.46:0/270842985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb37c1026a0 0x7fb37c0fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 --2- 172.21.15.46:0/270842985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c1020d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 -- 172.21.15.46:0/270842985 >> 172.21.15.46:0/270842985 conn(0x7fb37c0f7870 msgr2=0x7fb37c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 -- 172.21.15.46:0/270842985 shutdown_connections 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.267+0000 7fb3825ce700 1 -- 172.21.15.46:0/270842985 wait complete. 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb3825ce700 1 Processor -- start 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb3825ce700 1 -- start start 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb3825ce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb3825ce700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb37c1026a0 0x7fb37c116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb3825ce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c116790 con 0x7fb37c101d00 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb3825ce700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c10fd70 con 0x7fb37c1026a0 2024-05-09T06:36:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c115c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47708/0 (socket says 172.21.15.46:47708) 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb37bfff700 1 -- 172.21.15.46:0/1076930037 learned_addr learned my addr 172.21.15.46:0/1076930037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb373fff700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb37c1026a0 0x7fb37c116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.268+0000 7fb37bfff700 1 -- 172.21.15.46:0/1076930037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb37c1026a0 msgr2=0x7fb37c116140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb37bfff700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb37c1026a0 0x7fb37c116140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb37bfff700 1 -- 172.21.15.46:0/1076930037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c005040 con 0x7fb37c101d00 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb37bfff700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c115c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00b3b0 tx=0x7fb36c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb36c00e040 con 0x7fb37c101d00 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c10fff0 con 0x7fb37c101d00 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb36c00bbc0 con 0x7fb37c101d00 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb36c01c3f0 con 0x7fb37c101d00 2024-05-09T06:36:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.269+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c1105b0 con 0x7fb37c101d00 2024-05-09T06:36:33.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.270+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c0fd450 con 0x7fb37c101d00 2024-05-09T06:36:33.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.272+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fb36c013420 con 0x7fb37c101d00 2024-05-09T06:36:33.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.272+0000 7fb3797fa700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb368078aa0 0x7fb36807af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.272+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb36c09bbe0 con 0x7fb37c101d00 2024-05-09T06:36:33.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.272+0000 7fb373fff700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb368078aa0 0x7fb36807af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.273+0000 7fb373fff700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb368078aa0 0x7fb36807af50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb364009fd0 tx=0x7fb364009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:33.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.277+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb36c063680 con 0x7fb37c101d00 2024-05-09T06:36:33.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:33 smithi106 ceph-mon[81208]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:33.459 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 podman[121678]: 2024-05-09 06:36:33.167771405 +0000 UTC m=+0.149424635 container create 683b8273e6e152af411492c4c125ede74e7f6df7e5e4c75063b521c896342821 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:36:33.459 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 podman[121678]: 2024-05-09 06:36:33.378744129 +0000 UTC m=+0.360397356 container init 683b8273e6e152af411492c4c125ede74e7f6df7e5e4c75063b521c896342821 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T06:36:33.459 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 podman[121678]: 2024-05-09 06:36:33.382499528 +0000 UTC m=+0.364152762 container start 683b8273e6e152af411492c4c125ede74e7f6df7e5e4c75063b521c896342821 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-09T06:36:33.459 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 podman[121678]: 2024-05-09 06:36:33.47864676 +0000 UTC m=+0.460300002 container attach 683b8273e6e152af411492c4c125ede74e7f6df7e5e4c75063b521c896342821 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:36:33.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.518+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb37c1112c0 con 0x7fb368078aa0 2024-05-09T06:36:33.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.519+0000 7fb3797fa700 1 -- 172.21.15.46:0/1076930037 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb37c1112c0 con 0x7fb368078aa0 2024-05-09T06:36:33.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb368078aa0 msgr2=0x7fb36807af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb368078aa0 0x7fb36807af50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb364009fd0 tx=0x7fb364009f20 comp rx=0 tx=0).stop 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 msgr2=0x7fb37c115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c115c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00b3b0 tx=0x7fb36c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 shutdown_connections 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb368078aa0 0x7fb36807af50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb37c101d00 0x7fb37c115c00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 --2- 172.21.15.46:0/1076930037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb37c1026a0 0x7fb37c116140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 >> 172.21.15.46:0/1076930037 conn(0x7fb37c0f7870 msgr2=0x7fb37c0f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 shutdown_connections 2024-05-09T06:36:33.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.521+0000 7fb3825ce700 1 -- 172.21.15.46:0/1076930037 wait complete. 2024-05-09T06:36:33.513 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:36:33.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 -- 172.21.15.46:0/4056688369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c101ce0 msgr2=0x7fea6c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 --2- 172.21.15.46:0/4056688369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c101ce0 0x7fea6c1020b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea5c004940 tx=0x7fea5c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 -- 172.21.15.46:0/4056688369 shutdown_connections 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 --2- 172.21.15.46:0/4056688369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6c102680 0x7fea6c0fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 --2- 172.21.15.46:0/4056688369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c101ce0 0x7fea6c1020b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 -- 172.21.15.46:0/4056688369 >> 172.21.15.46:0/4056688369 conn(0x7fea6c0f7850 msgr2=0x7fea6c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 -- 172.21.15.46:0/4056688369 shutdown_connections 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 -- 172.21.15.46:0/4056688369 wait complete. 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 Processor -- start 2024-05-09T06:36:33.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.631+0000 7fea70a34700 1 -- start start 2024-05-09T06:36:33.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea70a34700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6c101ce0 0x7fea6c10eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea70a34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 0x7fea6c10f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea70a34700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c10f6a0 con 0x7fea6c102680 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea70a34700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c10f7e0 con 0x7fea6c101ce0 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 0x7fea6c10f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 0x7fea6c10f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47730/0 (socket says 172.21.15.46:47730) 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 -- 172.21.15.46:0/3293743698 learned_addr learned my addr 172.21.15.46:0/3293743698 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea6a59c700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6c101ce0 0x7fea6c10eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 -- 172.21.15.46:0/3293743698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6c101ce0 msgr2=0x7fea6c10eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6c101ce0 0x7fea6c10eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 -- 172.21.15.46:0/3293743698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c005040 con 0x7fea6c102680 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.632+0000 7fea69d9b700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 0x7fea6c10f050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea60002a50 tx=0x7fea60004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.633+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea60007cc0 con 0x7fea6c102680 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.633+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea6000f040 con 0x7fea6c102680 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.633+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6000daf0 con 0x7fea6c102680 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.633+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c117b80 con 0x7fea6c102680 2024-05-09T06:36:33.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.633+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c1180e0 con 0x7fea6c102680 2024-05-09T06:36:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.634+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c0fd430 con 0x7fea6c102680 2024-05-09T06:36:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.634+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7fea60009810 con 0x7fea6c102680 2024-05-09T06:36:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.635+0000 7fea5affd700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fea54078aa0 0x7fea5407af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.635+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fea6009a5e0 con 0x7fea6c102680 2024-05-09T06:36:33.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.635+0000 7fea6a59c700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fea54078aa0 0x7fea5407af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.635+0000 7fea6a59c700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fea54078aa0 0x7fea5407af50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b3b0 tx=0x7fea5c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:33.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.640+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fea60062100 con 0x7fea6c102680 2024-05-09T06:36:33.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.880+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea6c108e50 con 0x7fea54078aa0 2024-05-09T06:36:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.882+0000 7fea5affd700 1 -- 172.21.15.46:0/3293743698 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fea6c108e50 con 0x7fea54078aa0 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fea54078aa0 msgr2=0x7fea5407af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fea54078aa0 0x7fea5407af50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b3b0 tx=0x7fea5c009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 msgr2=0x7fea6c10f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 0x7fea6c10f050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea60002a50 tx=0x7fea60004600 comp rx=0 tx=0).stop 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 shutdown_connections 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fea54078aa0 0x7fea5407af50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea6c101ce0 0x7fea6c10eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 --2- 172.21.15.46:0/3293743698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102680 0x7fea6c10f050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 >> 172.21.15.46:0/3293743698 conn(0x7fea6c0f7850 msgr2=0x7fea6c0f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 shutdown_connections 2024-05-09T06:36:33.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.884+0000 7fea70a34700 1 -- 172.21.15.46:0/3293743698 wait complete. 2024-05-09T06:36:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 -- 172.21.15.46:0/335097765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fd1b0 msgr2=0x7f06d00fd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 --2- 172.21.15.46:0/335097765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fd1b0 0x7f06d00fd580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06cc004940 tx=0x7f06cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 -- 172.21.15.46:0/335097765 shutdown_connections 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 --2- 172.21.15.46:0/335097765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06d00fe9b0 0x7f06d00fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 --2- 172.21.15.46:0/335097765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fd1b0 0x7f06d00fd580 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 -- 172.21.15.46:0/335097765 >> 172.21.15.46:0/335097765 conn(0x7f06d00f89b0 msgr2=0x7f06d00fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 -- 172.21.15.46:0/335097765 shutdown_connections 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.996+0000 7f06d7355700 1 -- 172.21.15.46:0/335097765 wait complete. 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d7355700 1 Processor -- start 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d7355700 1 -- start start 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d7355700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06d00fd1b0 0x7f06d0070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d7355700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 0x7f06d00707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d7355700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d00721b0 con 0x7f06d00fe9b0 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d7355700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0070ce0 con 0x7f06d00fd1b0 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d48f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 0x7f06d00707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d48f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 0x7f06d00707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47744/0 (socket says 172.21.15.46:47744) 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d48f0700 1 -- 172.21.15.46:0/2482552515 learned_addr learned my addr 172.21.15.46:0/2482552515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d50f1700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06d00fd1b0 0x7f06d0070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d48f0700 1 -- 172.21.15.46:0/2482552515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06d00fd1b0 msgr2=0x7f06d0070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d48f0700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06d00fd1b0 0x7f06d0070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.997+0000 7f06d48f0700 1 -- 172.21.15.46:0/2482552515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc005040 con 0x7f06d00fe9b0 2024-05-09T06:36:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.998+0000 7f06d48f0700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 0x7f06d00707a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c830 tx=0x7f06c0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.998+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c00106f0 con 0x7f06d00fe9b0 2024-05-09T06:36:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.998+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06c0010d20 con 0x7f06d00fe9b0 2024-05-09T06:36:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.998+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d0070fc0 con 0x7f06d00fe9b0 2024-05-09T06:36:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.998+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c00113a0 con 0x7f06d00fe9b0 2024-05-09T06:36:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.998+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d011a0e0 con 0x7f06d00fe9b0 2024-05-09T06:36:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.999+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d00fe550 con 0x7f06d00fe9b0 2024-05-09T06:36:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:33.999+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f06c0012400 con 0x7f06d00fe9b0 2024-05-09T06:36:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.000+0000 7f06c5ffb700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f06bc078aa0 0x7f06bc07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.000+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f06c009a790 con 0x7f06d00fe9b0 2024-05-09T06:36:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.000+0000 7f06d50f1700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f06bc078aa0 0x7f06bc07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.001+0000 7f06d50f1700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f06bc078aa0 0x7f06bc07af50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06cc004f90 tx=0x7f06cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.005+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f06c00623c0 con 0x7f06d00fe9b0 2024-05-09T06:36:34.195 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:34 smithi046 ceph-mon[110713]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:34.196 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:34.196 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:34.196 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:34.196 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:36:34.196 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:36:34.196 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 bash[121678]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate[121717]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-09T06:36:34.197 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:33 smithi046 podman[121678]: 2024-05-09 06:36:33.925316468 +0000 UTC m=+0.906969698 container died 683b8273e6e152af411492c4c125ede74e7f6df7e5e4c75063b521c896342821 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-09T06:36:34.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.235+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f06d00fa880 con 0x7f06bc078aa0 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.245+0000 7f06c5ffb700 1 -- 172.21.15.46:0/2482552515 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f06d00fa880 con 0x7f06bc078aa0 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 14s ago 14m 24.1M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (25s) 14s ago 14m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (20s) 17s ago 13m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 14s ago 14m 75.0M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (9m) 14s ago 9m 14.0M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (8m) 14s ago 8m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (8m) 17s ago 8m 17.9M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:36:34.226 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (8m) 17s ago 8m 15.6M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (5m) 14s ago 15m 513M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (4m) 17s ago 13m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (93s) 14s ago 15m 43.8M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (65s) 17s ago 13m 32.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (3m) 14s ago 14m 15.1M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (3m) 17s ago 13m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (12m) 14s ago 12m 260M 1559M 17.2.7-933-g4ba5a836 b96134859c76 88dfa35cf3cc 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (12m) 14s ago 12m 267M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (11m) 14s ago 11m 221M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (11m) 17s ago 11m 289M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (10m) 17s ago 10m 262M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (10m) 17s ago 10m 238M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:36:34.227 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 14s ago 13m 64.4M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:36:34.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f06bc078aa0 msgr2=0x7f06bc07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f06bc078aa0 0x7f06bc07af50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06cc004f90 tx=0x7f06cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:34.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 msgr2=0x7f06d00707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 0x7f06d00707a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c830 tx=0x7f06c0004470 comp rx=0 tx=0).stop 2024-05-09T06:36:34.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 shutdown_connections 2024-05-09T06:36:34.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f06bc078aa0 0x7f06bc07af50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06d00fd1b0 0x7f06d0070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 --2- 172.21.15.46:0/2482552515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06d00fe9b0 0x7f06d00707a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 >> 172.21.15.46:0/2482552515 conn(0x7f06d00f89b0 msgr2=0x7f06d00fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:34.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 shutdown_connections 2024-05-09T06:36:34.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.248+0000 7f06d7355700 1 -- 172.21.15.46:0/2482552515 wait complete. 2024-05-09T06:36:34.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:34 smithi106 ceph-mon[81208]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:34.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 -- 172.21.15.46:0/1041454937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fc4f0 msgr2=0x7f7da0109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 --2- 172.21.15.46:0/1041454937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fc4f0 0x7f7da0109250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d88004940 tx=0x7f7d88009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:34.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 -- 172.21.15.46:0/1041454937 shutdown_connections 2024-05-09T06:36:34.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 --2- 172.21.15.46:0/1041454937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fc4f0 0x7f7da0109250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 --2- 172.21.15.46:0/1041454937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fbbe0 0x7f7da00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 -- 172.21.15.46:0/1041454937 >> 172.21.15.46:0/1041454937 conn(0x7f7da00f7870 msgr2=0x7f7da00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 -- 172.21.15.46:0/1041454937 shutdown_connections 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.354+0000 7f7da659e700 1 -- 172.21.15.46:0/1041454937 wait complete. 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7da659e700 1 Processor -- start 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7da659e700 1 -- start start 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7da659e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 0x7f7da0115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7da659e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fc4f0 0x7f7da0116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7da659e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0116760 con 0x7f7da00fbbe0 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7da659e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da010fd90 con 0x7f7da00fc4f0 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d9ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 0x7f7da0115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d9ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 0x7f7da0115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47776/0 (socket says 172.21.15.46:47776) 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d9ffff700 1 -- 172.21.15.46:0/3628949084 learned_addr learned my addr 172.21.15.46:0/3628949084 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d97fff700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fc4f0 0x7f7da0116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:34.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d9ffff700 1 -- 172.21.15.46:0/3628949084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fc4f0 msgr2=0x7f7da0116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d9ffff700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fc4f0 0x7f7da0116110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d9ffff700 1 -- 172.21.15.46:0/3628949084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88005040 con 0x7f7da00fbbe0 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.355+0000 7f7d97fff700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fc4f0 0x7f7da0116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.356+0000 7f7d9ffff700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 0x7f7da0115bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c830 tx=0x7f7d90004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.356+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9000a760 con 0x7f7da00fbbe0 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.356+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d9000ad90 con 0x7f7da00fbbe0 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.356+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da0110070 con 0x7f7da00fbbe0 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.356+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d900113a0 con 0x7f7da00fbbe0 2024-05-09T06:36:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.356+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da0110630 con 0x7f7da00fbbe0 2024-05-09T06:36:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.357+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0066ab0 con 0x7f7da00fbbe0 2024-05-09T06:36:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.358+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f7d90012400 con 0x7f7da00fbbe0 2024-05-09T06:36:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.358+0000 7f7d9d7fa700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7d8c078aa0 0x7f7d8c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.358+0000 7f7d97fff700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7d8c078aa0 0x7f7d8c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.358+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7d9009a850 con 0x7f7da00fbbe0 2024-05-09T06:36:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.359+0000 7f7d97fff700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7d8c078aa0 0x7f7d8c07af50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000c00 tx=0x7f7d88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:34.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.363+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f7d90062480 con 0x7f7da00fbbe0 2024-05-09T06:36:34.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.686+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7da004c710 con 0x7f7da00fbbe0 2024-05-09T06:36:34.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.686+0000 7f7d9d7fa700 1 -- 172.21.15.46:0/3628949084 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f7d90061e20 con 0x7f7da00fbbe0 2024-05-09T06:36:34.667 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:36:34.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:36:34.668 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:34.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:34.668 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:36:34.668 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:36:34.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:34.669 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:36:34.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 5 2024-05-09T06:36:34.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:34.669 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:36:34.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:36:34.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:36:34.670 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:36:34.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 9, 2024-05-09T06:36:34.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:36:34.670 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:36:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:36:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7d8c078aa0 msgr2=0x7f7d8c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7d8c078aa0 0x7f7d8c07af50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000c00 tx=0x7f7d88009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 msgr2=0x7f7da0115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 0x7f7da0115bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000c830 tx=0x7f7d90004470 comp rx=0 tx=0).stop 2024-05-09T06:36:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 shutdown_connections 2024-05-09T06:36:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7d8c078aa0 0x7f7d8c07af50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7da00fbbe0 0x7f7da0115bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 --2- 172.21.15.46:0/3628949084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7da00fc4f0 0x7f7da0116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.689+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 >> 172.21.15.46:0/3628949084 conn(0x7f7da00f7870 msgr2=0x7f7da00f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.690+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 shutdown_connections 2024-05-09T06:36:34.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.690+0000 7f7da659e700 1 -- 172.21.15.46:0/3628949084 wait complete. 2024-05-09T06:36:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 -- 172.21.15.46:0/1640437775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80102df0 msgr2=0x7f6c801031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1640437775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80102df0 0x7f6c801031c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c74004940 tx=0x7f6c74009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 -- 172.21.15.46:0/1640437775 shutdown_connections 2024-05-09T06:36:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1640437775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80103790 0x7f6c800fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1640437775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80102df0 0x7f6c801031c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 -- 172.21.15.46:0/1640437775 >> 172.21.15.46:0/1640437775 conn(0x7f6c800f8980 msgr2=0x7f6c800fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 -- 172.21.15.46:0/1640437775 shutdown_connections 2024-05-09T06:36:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.803+0000 7f6c870ea700 1 -- 172.21.15.46:0/1640437775 wait complete. 2024-05-09T06:36:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.804+0000 7f6c870ea700 1 Processor -- start 2024-05-09T06:36:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.804+0000 7f6c870ea700 1 -- start start 2024-05-09T06:36:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.804+0000 7f6c870ea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80102df0 0x7f6c80113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.804+0000 7f6c870ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 0x7f6c801140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.804+0000 7f6c870ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80114710 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.804+0000 7f6c870ea700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8010db20 con 0x7f6c80102df0 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 0x7f6c801140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 0x7f6c801140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47790/0 (socket says 172.21.15.46:47790) 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 -- 172.21.15.46:0/1544750543 learned_addr learned my addr 172.21.15.46:0/1544750543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c84e86700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80102df0 0x7f6c80113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 -- 172.21.15.46:0/1544750543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80102df0 msgr2=0x7f6c80113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80102df0 0x7f6c80113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 -- 172.21.15.46:0/1544750543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74005040 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7ffff700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 0x7f6c801140c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c002a50 tx=0x7f6c6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6c007cc0 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c6c00f040 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8010de00 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6c00d9c0 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.805+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8010e3c0 con 0x7f6c80103790 2024-05-09T06:36:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.806+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c80100100 con 0x7f6c80103790 2024-05-09T06:36:34.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.807+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f6c6c009730 con 0x7f6c80103790 2024-05-09T06:36:34.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.807+0000 7f6c7d7fa700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6c70078aa0 0x7f6c7007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:34.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.808+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6c6c09a6b0 con 0x7f6c80103790 2024-05-09T06:36:34.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.808+0000 7f6c84e86700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6c70078aa0 0x7f6c7007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:34.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.808+0000 7f6c84e86700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6c70078aa0 0x7f6c7007af50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c74004f90 tx=0x7f6c74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:34.812+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6c6c062150 con 0x7f6c80103790 2024-05-09T06:36:34.931 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:34 smithi046 podman[121889]: 2024-05-09 06:36:34.607939251 +0000 UTC m=+0.676747174 container remove 683b8273e6e152af411492c4c125ede74e7f6df7e5e4c75063b521c896342821 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:36:34.931 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:34 smithi046 podman[121999]: 2024-05-09 06:36:34.744589954 +0000 UTC m=+0.019303565 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:36:34.931 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:34 smithi046 podman[121999]: 2024-05-09 06:36:34.842654308 +0000 UTC m=+0.117367902 container create 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:36:35.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.082+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c8010f1d0 con 0x7f6c80103790 2024-05-09T06:36:35.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.083+0000 7f6c7d7fa700 1 -- 172.21.15.46:0/1544750543 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f6c6c061af0 con 0x7f6c80103790 2024-05-09T06:36:35.063 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:36:35.063 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:36:35.063 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:35.063 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:36:35.064 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:36:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:36:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:36:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:36:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:36:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:36:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:36:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:36:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:36:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:36:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:36:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:36:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:36:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:35.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:35.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:35.068 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:36:35.068 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:36:35.068 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:35.068 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:35.069 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:36:35.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6c70078aa0 msgr2=0x7f6c7007af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6c70078aa0 0x7f6c7007af50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c74004f90 tx=0x7f6c74009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:35.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 msgr2=0x7f6c801140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 0x7f6c801140c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c002a50 tx=0x7f6c6c004600 comp rx=0 tx=0).stop 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 shutdown_connections 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6c70078aa0 0x7f6c7007af50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80102df0 0x7f6c80113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 --2- 172.21.15.46:0/1544750543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c80103790 0x7f6c801140c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 >> 172.21.15.46:0/1544750543 conn(0x7f6c800f8980 msgr2=0x7f6c801073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:35.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 shutdown_connections 2024-05-09T06:36:35.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.086+0000 7f6c870ea700 1 -- 172.21.15.46:0/1544750543 wait complete. 2024-05-09T06:36:35.072 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:36:35.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 -- 172.21.15.46:0/952488650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534103780 msgr2=0x7f55340fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 --2- 172.21.15.46:0/952488650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534103780 0x7f55340fcdf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5524004940 tx=0x7f5524009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 -- 172.21.15.46:0/952488650 shutdown_connections 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 --2- 172.21.15.46:0/952488650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534103780 0x7f55340fcdf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 --2- 172.21.15.46:0/952488650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5534102de0 0x7f55341031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 -- 172.21.15.46:0/952488650 >> 172.21.15.46:0/952488650 conn(0x7f55340f8990 msgr2=0x7f55340fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 -- 172.21.15.46:0/952488650 shutdown_connections 2024-05-09T06:36:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.197+0000 7f553ac67700 1 -- 172.21.15.46:0/952488650 wait complete. 2024-05-09T06:36:35.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f553ac67700 1 Processor -- start 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f553ac67700 1 -- start start 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f553ac67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 0x7f5534113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f553ac67700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5534103780 0x7f5534113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f553ac67700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534114520 con 0x7f5534102de0 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f553ac67700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553410db20 con 0x7f5534103780 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f5538a03700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 0x7f5534113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f5538a03700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 0x7f5534113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47820/0 (socket says 172.21.15.46:47820) 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f5538a03700 1 -- 172.21.15.46:0/4254433508 learned_addr learned my addr 172.21.15.46:0/4254433508 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.198+0000 7f552bfff700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5534103780 0x7f5534113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f5538a03700 1 -- 172.21.15.46:0/4254433508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5534103780 msgr2=0x7f5534113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f5538a03700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5534103780 0x7f5534113ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f5538a03700 1 -- 172.21.15.46:0/4254433508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524005040 con 0x7f5534102de0 2024-05-09T06:36:35.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f5538a03700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 0x7f5534113990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f553000cb10 tx=0x7f5530007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:35.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5530004200 con 0x7f5534102de0 2024-05-09T06:36:35.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f553000ac70 con 0x7f5534102de0 2024-05-09T06:36:35.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5530003d30 con 0x7f5534102de0 2024-05-09T06:36:35.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553410de00 con 0x7f5534102de0 2024-05-09T06:36:35.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.199+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553410e390 con 0x7f5534102de0 2024-05-09T06:36:35.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.200+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55340fe530 con 0x7f5534102de0 2024-05-09T06:36:35.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.202+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f553000a7a0 con 0x7f5534102de0 2024-05-09T06:36:35.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:35 smithi046 ceph-mon[110713]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:35.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:35 smithi046 ceph-mon[110713]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:35.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:35 smithi046 ceph-mon[110713]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:35.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:35 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3628949084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:35.183 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:35 smithi046 podman[121999]: 2024-05-09 06:36:35.06166551 +0000 UTC m=+0.336379105 container init 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-09T06:36:35.183 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:35 smithi046 podman[121999]: 2024-05-09 06:36:35.065166576 +0000 UTC m=+0.339880173 container start 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T06:36:35.183 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:35 smithi046 ceph-osd[122038]: -- 172.21.15.46:0/838421566 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a89d63680 con 0x563a89d2d000 2024-05-09T06:36:35.183 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:35 smithi046 bash[121999]: 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 2024-05-09T06:36:35.183 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:35 smithi046 systemd[1]: Started Ceph osd.0 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:36:35.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.202+0000 7f55297fa700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f551c078aa0 0x7f551c07af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.202+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f553009abf0 con 0x7f5534102de0 2024-05-09T06:36:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.203+0000 7f552bfff700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f551c078aa0 0x7f551c07af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.203+0000 7f552bfff700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f551c078aa0 0x7f551c07af50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f553410ee00 tx=0x7f5524009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:35.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.209+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f5530062820 con 0x7f5534102de0 2024-05-09T06:36:35.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:35 smithi106 ceph-mon[81208]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:35.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:35 smithi106 ceph-mon[81208]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:35.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:35 smithi106 ceph-mon[81208]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:35.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:35 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3628949084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:35.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.447+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5534109f60 con 0x7f551c078aa0 2024-05-09T06:36:35.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.448+0000 7f55297fa700 1 -- 172.21.15.46:0/4254433508 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5524008ee0 con 0x7f551c078aa0 2024-05-09T06:36:35.428 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:36:35.428 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:36:35.428 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "6/21 daemons upgraded", 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:36:35.429 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.450+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f551c078aa0 msgr2=0x7f551c07af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.450+0000 7f553ac67700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f551c078aa0 0x7f551c07af50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f553410ee00 tx=0x7f5524009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.450+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 msgr2=0x7f5534113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.450+0000 7f553ac67700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 0x7f5534113990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f553000cb10 tx=0x7f5530007f90 comp rx=0 tx=0).stop 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 shutdown_connections 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f551c078aa0 0x7f551c07af50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5534102de0 0x7f5534113990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 --2- 172.21.15.46:0/4254433508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5534103780 0x7f5534113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 >> 172.21.15.46:0/4254433508 conn(0x7f55340f8990 msgr2=0x7f55340f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 shutdown_connections 2024-05-09T06:36:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.451+0000 7f553ac67700 1 -- 172.21.15.46:0/4254433508 wait complete. 2024-05-09T06:36:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.559+0000 7f6bb53be700 1 -- 172.21.15.46:0/3635956924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fdde0 msgr2=0x7f6bb00fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.559+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3635956924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fdde0 0x7f6bb00fe1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0004940 tx=0x7f6ba0009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.559+0000 7f6bb53be700 1 -- 172.21.15.46:0/3635956924 shutdown_connections 2024-05-09T06:36:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.559+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3635956924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bb00fe780 0x7f6bb0106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.559+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3635956924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fdde0 0x7f6bb00fe1b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.559+0000 7f6bb53be700 1 -- 172.21.15.46:0/3635956924 >> 172.21.15.46:0/3635956924 conn(0x7f6bb00f7890 msgr2=0x7f6bb00f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.560+0000 7f6bb53be700 1 -- 172.21.15.46:0/3635956924 shutdown_connections 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.560+0000 7f6bb53be700 1 -- 172.21.15.46:0/3635956924 wait complete. 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bb53be700 1 Processor -- start 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bb53be700 1 -- start start 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bb53be700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bb00fdde0 0x7f6bb00fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bb53be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 0x7f6bb00fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bb53be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00fc6e0 con 0x7f6bb00fe780 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bb53be700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00fc820 con 0x7f6bb00fdde0 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bae7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 0x7f6bb00fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bae7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 0x7f6bb00fc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47838/0 (socket says 172.21.15.46:47838) 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bae7fc700 1 -- 172.21.15.46:0/3676926038 learned_addr learned my addr 172.21.15.46:0/3676926038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6baeffd700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bb00fdde0 0x7f6bb00fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:35.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bae7fc700 1 -- 172.21.15.46:0/3676926038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bb00fdde0 msgr2=0x7f6bb00fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.561+0000 7f6bae7fc700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bb00fdde0 0x7f6bb00fbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.562+0000 7f6bae7fc700 1 -- 172.21.15.46:0/3676926038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0005040 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.562+0000 7f6bae7fc700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 0x7f6bb00fc150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4002a50 tx=0x7f6ba40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.562+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba4007cc0 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.562+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb0119e50 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.562+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ba400f040 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.562+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba400da30 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.563+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb011a250 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.564+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 100182+0+0 (secure 0 0 0) 0x7f6ba400db90 con 0x7f6bb00fe780 2024-05-09T06:36:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.564+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb0066750 con 0x7f6bb00fe780 2024-05-09T06:36:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.564+0000 7f6b977fe700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6b98078aa0 0x7f6b9807af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:36:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.564+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6ba409a6b0 con 0x7f6bb00fe780 2024-05-09T06:36:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.565+0000 7f6baeffd700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6b98078aa0 0x7f6b9807af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:36:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.565+0000 7f6baeffd700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6b98078aa0 0x7f6b9807af50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0004f90 tx=0x7f6ba0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:36:35.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.574+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6ba4062150 con 0x7f6bb00fe780 2024-05-09T06:36:35.835 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:35 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[122034]: 2024-05-09T06:36:35.613+0000 7f11d1ff77c0 -1 Falling back to public interface 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.897+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6bb004bed0 con 0x7f6bb00fe780 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.898+0000 7f6b977fe700 1 -- 172.21.15.46:0/3676926038 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1406 (secure 0 0 0) 0x7f6ba4061af0 con 0x7f6bb00fe780 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 45/219 objects degraded (20.548%), 17 pgs degraded 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: osd.0 (root=default,host=smithi046) is down 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/219 objects degraded (20.548%), 17 pgs degraded 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-05-09T06:36:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-05-09T06:36:35.880 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-05-09T06:36:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6b98078aa0 msgr2=0x7f6b9807af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6b98078aa0 0x7f6b9807af50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0004f90 tx=0x7f6ba0009e30 comp rx=0 tx=0).stop 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 msgr2=0x7f6bb00fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 0x7f6bb00fc150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4002a50 tx=0x7f6ba40046b0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 shutdown_connections 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6b98078aa0 0x7f6b9807af50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bb00fdde0 0x7f6bb00fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 --2- 172.21.15.46:0/3676926038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bb00fe780 0x7f6bb00fc150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 >> 172.21.15.46:0/3676926038 conn(0x7f6bb00f7890 msgr2=0x7f6bb00f8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 shutdown_connections 2024-05-09T06:36:35.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:36:35.901+0000 7f6bb53be700 1 -- 172.21.15.46:0/3676926038 wait complete. 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: Health check failed: Degraded data redundancy: 45/219 objects degraded (20.548%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1544750543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:36.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:36 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3676926038' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: Health check failed: Degraded data redundancy: 45/219 objects degraded (20.548%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1544750543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:36:36.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:36 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3676926038' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:36:37.190 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:37 smithi046 ceph-mon[110713]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:37 smithi106 ceph-mon[81208]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:39 smithi106 ceph-mon[81208]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:39.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:39 smithi046 ceph-mon[110713]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:41.085 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:40 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[122034]: 2024-05-09T06:36:40.735+0000 7f11d1ff77c0 -1 osd.0 49 log_to_monitors true 2024-05-09T06:36:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:41 smithi106 ceph-mon[81208]: pgmap v49: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:41.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:41 smithi106 ceph-mon[81208]: from='osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:36:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:41 smithi046 ceph-mon[110713]: pgmap v49: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:41.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:41 smithi046 ceph-mon[110713]: from='osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T06:36:41.836 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:36:41 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[122034]: 2024-05-09T06:36:41.601+0000 7f11c344e700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: from='osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: osdmap e52: 6 total, 5 up, 6 in 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: from='osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:42.692 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: from='osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: osdmap e52: 6 total, 5 up, 6 in 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: from='osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:42.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:43.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:43 smithi046 ceph-mon[110713]: pgmap v51: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:43.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:43 smithi046 ceph-mon[110713]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:36:43.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:43 smithi046 ceph-mon[110713]: osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115] boot 2024-05-09T06:36:43.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:43 smithi046 ceph-mon[110713]: osdmap e53: 6 total, 6 up, 6 in 2024-05-09T06:36:43.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:36:43.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:43 smithi046 ceph-mon[110713]: osdmap e54: 6 total, 6 up, 6 in 2024-05-09T06:36:44.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:43 smithi106 ceph-mon[81208]: pgmap v51: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 45/219 objects degraded (20.548%) 2024-05-09T06:36:44.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:43 smithi106 ceph-mon[81208]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:36:44.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:43 smithi106 ceph-mon[81208]: osd.0 [v2:172.21.15.46:6802/2054371115,v1:172.21.15.46:6803/2054371115] boot 2024-05-09T06:36:44.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:43 smithi106 ceph-mon[81208]: osdmap e53: 6 total, 6 up, 6 in 2024-05-09T06:36:44.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T06:36:44.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:43 smithi106 ceph-mon[81208]: osdmap e54: 6 total, 6 up, 6 in 2024-05-09T06:36:44.626 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:44 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:44.626 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:44 smithi046 ceph-mon[110713]: mgrmap e40: smithi046.nvpcui(active, since 92s), standbys: smithi106.nlgnpx 2024-05-09T06:36:45.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:44 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:36:45.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:44 smithi106 ceph-mon[81208]: mgrmap e40: smithi046.nvpcui(active, since 92s), standbys: smithi106.nlgnpx 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: pgmap v54: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/219 objects degraded (2.740%) 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:45.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:45.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:45.837 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:45.974 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: pgmap v54: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/219 objects degraded (2.740%) 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:36:45.975 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:46 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:47.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:46 smithi106 ceph-mon[81208]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-05-09T06:36:47.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:46 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:36:47.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:46 smithi046 ceph-mon[110713]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-05-09T06:36:48.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:47 smithi106 ceph-mon[81208]: pgmap v55: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/219 objects degraded (2.740%) 2024-05-09T06:36:48.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:47 smithi046 ceph-mon[110713]: pgmap v55: 65 pgs: 25 peering, 2 active+undersized+degraded, 7 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 6/219 objects degraded (2.740%) 2024-05-09T06:36:49.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:48 smithi106 ceph-mon[81208]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 469 B/s wr, 0 op/s 2024-05-09T06:36:49.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:48 smithi106 ceph-mon[81208]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded) 2024-05-09T06:36:49.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:48 smithi046 ceph-mon[110713]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 469 B/s wr, 0 op/s 2024-05-09T06:36:49.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:48 smithi046 ceph-mon[110713]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded) 2024-05-09T06:36:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:51 smithi106 ceph-mon[81208]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-05-09T06:36:51.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:51 smithi046 ceph-mon[110713]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-05-09T06:36:53.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:53 smithi106 ceph-mon[81208]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 322 B/s wr, 0 op/s 2024-05-09T06:36:53.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:53 smithi046 ceph-mon[110713]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 322 B/s wr, 0 op/s 2024-05-09T06:36:55.494 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:55 smithi046 ceph-mon[110713]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:55.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:55 smithi106 ceph-mon[81208]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:57.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:57 smithi106 ceph-mon[81208]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:57.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:57.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:57.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:57.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:57 smithi046 ceph-mon[110713]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:57.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:57.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:36:57.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:36:59.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:36:59 smithi106 ceph-mon[81208]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:36:59.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:36:59 smithi046 ceph-mon[110713]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:01.448 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:01 smithi046 ceph-mon[110713]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:01.448 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:37:01.448 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:01 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:37:01.448 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:01 smithi046 ceph-mon[110713]: Upgrade: osd.1 is safe to restart 2024-05-09T06:37:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:01 smithi106 ceph-mon[81208]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:37:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:01 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-05-09T06:37:01.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:01 smithi106 ceph-mon[81208]: Upgrade: osd.1 is safe to restart 2024-05-09T06:37:03.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:03 smithi106 ceph-mon[81208]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:03.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:03 smithi106 ceph-mon[81208]: Upgrade: Updating osd.1 2024-05-09T06:37:03.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:03 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:03.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:03 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:37:03.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:03 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:03.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:03 smithi106 ceph-mon[81208]: Deploying daemon osd.1 on smithi046 2024-05-09T06:37:03.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:03 smithi046 ceph-mon[110713]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:03.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:03 smithi046 ceph-mon[110713]: Upgrade: Updating osd.1 2024-05-09T06:37:03.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:03 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:03.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:03 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T06:37:03.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:03 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:03.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:03 smithi046 ceph-mon[110713]: Deploying daemon osd.1 on smithi046 2024-05-09T06:37:05.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:05 smithi106 ceph-mon[81208]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:05.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:05 smithi046 ceph-mon[110713]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:05.988 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:05 smithi046 systemd[1]: Stopping Ceph osd.1 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:37:05.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.012+0000 7fee0126b700 1 -- 172.21.15.46:0/1061328390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc0fb520 msgr2=0x7fedfc0fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:05.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.012+0000 7fee0126b700 1 --2- 172.21.15.46:0/1061328390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc0fb520 0x7fedfc0fb990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fede4004940 tx=0x7fede4009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:05.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.012+0000 7fee0126b700 1 -- 172.21.15.46:0/1061328390 shutdown_connections 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.012+0000 7fee0126b700 1 --2- 172.21.15.46:0/1061328390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc0fb520 0x7fedfc0fb990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.012+0000 7fee0126b700 1 --2- 172.21.15.46:0/1061328390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedfc102f60 0x7fedfc103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.012+0000 7fee0126b700 1 -- 172.21.15.46:0/1061328390 >> 172.21.15.46:0/1061328390 conn(0x7fedfc0714d0 msgr2=0x7fedfc0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.013+0000 7fee0126b700 1 -- 172.21.15.46:0/1061328390 shutdown_connections 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.013+0000 7fee0126b700 1 -- 172.21.15.46:0/1061328390 wait complete. 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.013+0000 7fee0126b700 1 Processor -- start 2024-05-09T06:37:05.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.013+0000 7fee0126b700 1 -- start start 2024-05-09T06:37:05.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fee0126b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedfc0fb520 0x7fedfc113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:05.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fee0126b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 0x7fedfc113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:05.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fee0126b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc114590 con 0x7fedfc102f60 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fee0126b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc10dbb0 con 0x7fedfc0fb520 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 0x7fedfc113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 0x7fedfc113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33608/0 (socket says 172.21.15.46:33608) 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 -- 172.21.15.46:0/1699622992 learned_addr learned my addr 172.21.15.46:0/1699622992 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfaffd700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedfc0fb520 0x7fedfc113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 -- 172.21.15.46:0/1699622992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedfc0fb520 msgr2=0x7fedfc113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedfc0fb520 0x7fedfc113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 -- 172.21.15.46:0/1699622992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4005040 con 0x7fedfc102f60 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedfa7fc700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 0x7fedfc113f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fede400b3b0 tx=0x7fede4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.014+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede400e040 con 0x7fedfc102f60 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.015+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc10de30 con 0x7fedfc102f60 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.015+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fede400bbc0 con 0x7fedfc102f60 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.015+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede401c3f0 con 0x7fedfc102f60 2024-05-09T06:37:05.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.015+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc10e370 con 0x7fedfc102f60 2024-05-09T06:37:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.016+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc100250 con 0x7fedfc102f60 2024-05-09T06:37:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.016+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fede400bd30 con 0x7fedfc102f60 2024-05-09T06:37:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.017+0000 7fedf37fe700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fede8078990 0x7fede807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.017+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fede409b900 con 0x7fedfc102f60 2024-05-09T06:37:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.017+0000 7fedfaffd700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fede8078990 0x7fede807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:05.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.017+0000 7fedfaffd700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fede8078990 0x7fede807ae40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedec004f30 tx=0x7fedec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:06.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.022+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fede40635c0 con 0x7fedfc102f60 2024-05-09T06:37:06.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.257+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedfc04c780 con 0x7fede8078990 2024-05-09T06:37:06.239 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:06 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[52304]: 2024-05-09T06:37:06.006+0000 7f9d41648700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:37:06.239 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:06 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[52304]: 2024-05-09T06:37:06.007+0000 7f9d41648700 -1 osd.1 54 *** Got signal Terminated *** 2024-05-09T06:37:06.239 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:06 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[52304]: 2024-05-09T06:37:06.007+0000 7f9d41648700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:37:06.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.259+0000 7fedf37fe700 1 -- 172.21.15.46:0/1699622992 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fedfc04c780 con 0x7fede8078990 2024-05-09T06:37:06.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fede8078990 msgr2=0x7fede807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fede8078990 0x7fede807ae40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fedec004f30 tx=0x7fedec00b040 comp rx=0 tx=0).stop 2024-05-09T06:37:06.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 msgr2=0x7fedfc113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 0x7fedfc113f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fede400b3b0 tx=0x7fede4009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 shutdown_connections 2024-05-09T06:37:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fede8078990 0x7fede807ae40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedfc0fb520 0x7fedfc113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 --2- 172.21.15.46:0/1699622992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedfc102f60 0x7fedfc113f40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 >> 172.21.15.46:0/1699622992 conn(0x7fedfc0714d0 msgr2=0x7fedfc0fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:06.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 shutdown_connections 2024-05-09T06:37:06.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.262+0000 7fee0126b700 1 -- 172.21.15.46:0/1699622992 wait complete. 2024-05-09T06:37:06.254 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:37:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 -- 172.21.15.46:0/1932929415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 msgr2=0x7fc2000fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 --2- 172.21.15.46:0/1932929415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc2000fbd10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0004940 tx=0x7fc1f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 -- 172.21.15.46:0/1932929415 shutdown_connections 2024-05-09T06:37:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 --2- 172.21.15.46:0/1932929415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc2000fbd10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 --2- 172.21.15.46:0/1932929415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc200101d00 0x7fc2001020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 -- 172.21.15.46:0/1932929415 >> 172.21.15.46:0/1932929415 conn(0x7fc2000f7870 msgr2=0x7fc2000f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 -- 172.21.15.46:0/1932929415 shutdown_connections 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.378+0000 7fc2074e5700 1 -- 172.21.15.46:0/1932929415 wait complete. 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc2074e5700 1 Processor -- start 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc2074e5700 1 -- start start 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc2074e5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc200101d00 0x7fc20010ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc2074e5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc20010f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc2074e5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20010f550 con 0x7fc2001026a0 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc2074e5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20010f690 con 0x7fc200101d00 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc204a80700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc20010f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc204a80700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc20010f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33628/0 (socket says 172.21.15.46:33628) 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc204a80700 1 -- 172.21.15.46:0/2291906775 learned_addr learned my addr 172.21.15.46:0/2291906775 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc205281700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc200101d00 0x7fc20010ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc204a80700 1 -- 172.21.15.46:0/2291906775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc200101d00 msgr2=0x7fc20010ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc204a80700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc200101d00 0x7fc20010ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.379+0000 7fc204a80700 1 -- 172.21.15.46:0/2291906775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0005040 con 0x7fc2001026a0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.380+0000 7fc204a80700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc20010f010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009100 tx=0x7fc1f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.380+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1f000e040 con 0x7fc2001026a0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.380+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1f0004290 con 0x7fc2001026a0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.380+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1f001c3f0 con 0x7fc2001026a0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.380+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20010f910 con 0x7fc2001026a0 2024-05-09T06:37:06.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.380+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc200117ee0 con 0x7fc2001026a0 2024-05-09T06:37:06.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.381+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2000fd450 con 0x7fc2001026a0 2024-05-09T06:37:06.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.382+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc1f0013690 con 0x7fc2001026a0 2024-05-09T06:37:06.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.382+0000 7fc1f5ffb700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc1ec078980 0x7fc1ec07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:06.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.382+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc1f009b6f0 con 0x7fc2001026a0 2024-05-09T06:37:06.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.382+0000 7fc205281700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc1ec078980 0x7fc1ec07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:06.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.383+0000 7fc205281700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc1ec078980 0x7fc1ec07ae30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc004f40 tx=0x7fc1fc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.387+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc1f00634d0 con 0x7fc2001026a0 2024-05-09T06:37:06.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:06 smithi046 ceph-mon[110713]: osd.1 marked itself down and dead 2024-05-09T06:37:06.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.622+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2000f8f20 con 0x7fc1ec078980 2024-05-09T06:37:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.624+0000 7fc1f5ffb700 1 -- 172.21.15.46:0/2291906775 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc2000f8f20 con 0x7fc1ec078980 2024-05-09T06:37:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc1ec078980 msgr2=0x7fc1ec07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc1ec078980 0x7fc1ec07ae30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc004f40 tx=0x7fc1fc00b040 comp rx=0 tx=0).stop 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 msgr2=0x7fc20010f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc20010f010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009100 tx=0x7fc1f0009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 shutdown_connections 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc1ec078980 0x7fc1ec07ae30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc200101d00 0x7fc20010ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 --2- 172.21.15.46:0/2291906775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2001026a0 0x7fc20010f010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 >> 172.21.15.46:0/2291906775 conn(0x7fc2000f7870 msgr2=0x7fc2000f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 shutdown_connections 2024-05-09T06:37:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.626+0000 7fc2074e5700 1 -- 172.21.15.46:0/2291906775 wait complete. 2024-05-09T06:37:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 -- 172.21.15.46:0/2760804791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 msgr2=0x7f8b340fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2760804791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b340fc1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b28004940 tx=0x7f8b28009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 -- 172.21.15.46:0/2760804791 shutdown_connections 2024-05-09T06:37:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2760804791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b340fc1b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2760804791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b34101d90 0x7f8b34102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 -- 172.21.15.46:0/2760804791 >> 172.21.15.46:0/2760804791 conn(0x7f8b34071d00 msgr2=0x7f8b34072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 -- 172.21.15.46:0/2760804791 shutdown_connections 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.734+0000 7f8b3a198700 1 -- 172.21.15.46:0/2760804791 wait complete. 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b3a198700 1 Processor -- start 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b3a198700 1 -- start start 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b3a198700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b34112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b3a198700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b34101d90 0x7f8b34112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b3a198700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34113620 con 0x7f8b340fbd40 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b3a198700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3410ca10 con 0x7f8b34101d90 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b34112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b34112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33646/0 (socket says 172.21.15.46:33646) 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.735+0000 7f8b337fe700 1 -- 172.21.15.46:0/2335419471 learned_addr learned my addr 172.21.15.46:0/2335419471 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b32ffd700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b34101d90 0x7f8b34112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b337fe700 1 -- 172.21.15.46:0/2335419471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b34101d90 msgr2=0x7f8b34112fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b337fe700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b34101d90 0x7f8b34112fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b337fe700 1 -- 172.21.15.46:0/2335419471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28005040 con 0x7f8b340fbd40 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b337fe700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b34112a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001d80 tx=0x7f8b24009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b24007d10 con 0x7f8b340fbd40 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b24001e80 con 0x7f8b340fbd40 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3410ccf0 con 0x7f8b340fbd40 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b24014640 con 0x7f8b340fbd40 2024-05-09T06:37:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.736+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3410d280 con 0x7f8b340fbd40 2024-05-09T06:37:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.737+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b340fd430 con 0x7f8b340fbd40 2024-05-09T06:37:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.738+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8b2400e960 con 0x7f8b340fbd40 2024-05-09T06:37:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.738+0000 7f8b1bfff700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8b1c078990 0x7f8b1c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.739+0000 7f8b32ffd700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8b1c078990 0x7f8b1c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.739+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8b2409a2c0 con 0x7f8b340fbd40 2024-05-09T06:37:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.739+0000 7f8b32ffd700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8b1c078990 0x7f8b1c07ae40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b3410dcf0 tx=0x7f8b28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:06.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.743+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8b240620b0 con 0x7f8b340fbd40 2024-05-09T06:37:06.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:06 smithi106 ceph-mon[81208]: osd.1 marked itself down and dead 2024-05-09T06:37:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:06.995+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b34108df0 con 0x7f8b1c078990 2024-05-09T06:37:06.977 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:06 smithi046 podman[126795]: 2024-05-09 06:37:06.872569565 +0000 UTC m=+0.975766291 container died e6368b5e850aa3327053737a5595d52936c6d54a21a90de9e7079efd40570706 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=quincy-4ba5a83, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.005+0000 7f8b1bfff700 1 -- 172.21.15.46:0/2335419471 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8b34108df0 con 0x7f8b1c078990 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 26s ago 14m 24.1M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (58s) 26s ago 15m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (53s) 50s ago 14m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 26s ago 14m 79.4M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (9m) 26s ago 9m 14.1M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (9m) 26s ago 9m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (9m) 50s ago 9m 17.9M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (9m) 50s ago 9m 15.6M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (5m) 26s ago 16m 515M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (4m) 50s ago 13m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (2m) 26s ago 16m 46.8M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:37:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (98s) 50s ago 13m 32.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (4m) 26s ago 15m 15.3M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (4m) 50s ago 13m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (32s) 26s ago 13m 12.7M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (12m) 26s ago 12m 266M 1559M 17.2.7-933-g4ba5a836 b96134859c76 e6368b5e850a 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (12m) 26s ago 12m 219M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (11m) 50s ago 11m 289M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (11m) 50s ago 11m 262M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (11m) 50s ago 11m 238M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:37:06.988 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 26s ago 14m 64.4M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:37:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8b1c078990 msgr2=0x7f8b1c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8b1c078990 0x7f8b1c07ae40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b3410dcf0 tx=0x7f8b28009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 msgr2=0x7f8b34112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b34112a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001d80 tx=0x7f8b24009ec0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 shutdown_connections 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8b1c078990 0x7f8b1c07ae40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fbd40 0x7f8b34112a90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 --2- 172.21.15.46:0/2335419471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b34101d90 0x7f8b34112fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 >> 172.21.15.46:0/2335419471 conn(0x7f8b34071d00 msgr2=0x7f8b34104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 shutdown_connections 2024-05-09T06:37:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.008+0000 7f8b3a198700 1 -- 172.21.15.46:0/2335419471 wait complete. 2024-05-09T06:37:07.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 -- 172.21.15.46:0/2735058953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c103790 msgr2=0x7f0c8c0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 --2- 172.21.15.46:0/2735058953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c103790 0x7f0c8c0fce00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0c80004940 tx=0x7f0c80009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:07.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 -- 172.21.15.46:0/2735058953 shutdown_connections 2024-05-09T06:37:07.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 --2- 172.21.15.46:0/2735058953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c103790 0x7f0c8c0fce00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 --2- 172.21.15.46:0/2735058953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c8c102df0 0x7f0c8c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 -- 172.21.15.46:0/2735058953 >> 172.21.15.46:0/2735058953 conn(0x7f0c8c0f8980 msgr2=0x7f0c8c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 -- 172.21.15.46:0/2735058953 shutdown_connections 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.114+0000 7f0c90b01700 1 -- 172.21.15.46:0/2735058953 wait complete. 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c90b01700 1 Processor -- start 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c90b01700 1 -- start start 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c90b01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 0x7f0c8c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c90b01700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c8c103790 0x7f0c8c1140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c90b01700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c114730 con 0x7f0c8c102df0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c90b01700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c10db40 con 0x7f0c8c103790 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c8a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 0x7f0c8c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c8a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 0x7f0c8c113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33666/0 (socket says 172.21.15.46:33666) 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c8a59c700 1 -- 172.21.15.46:0/4064681032 learned_addr learned my addr 172.21.15.46:0/4064681032 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c89d9b700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c8c103790 0x7f0c8c1140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c8a59c700 1 -- 172.21.15.46:0/4064681032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c8c103790 msgr2=0x7f0c8c1140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c8a59c700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c8c103790 0x7f0c8c1140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.115+0000 7f0c8a59c700 1 -- 172.21.15.46:0/4064681032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80005040 con 0x7f0c8c102df0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.116+0000 7f0c8a59c700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 0x7f0c8c113ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00cb10 tx=0x7f0c7c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.116+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c7c004200 con 0x7f0c8c102df0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.116+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c7c00acc0 con 0x7f0c8c102df0 2024-05-09T06:37:07.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.116+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c10de20 con 0x7f0c8c102df0 2024-05-09T06:37:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.116+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c7c003d90 con 0x7f0c8c102df0 2024-05-09T06:37:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.116+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c10e3e0 con 0x7f0c8c102df0 2024-05-09T06:37:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.117+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c1052c0 con 0x7f0c8c102df0 2024-05-09T06:37:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.117+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f0c7c003430 con 0x7f0c8c102df0 2024-05-09T06:37:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.118+0000 7f0c7affd700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0c74078980 0x7f0c7407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.118+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0c7c09ac30 con 0x7f0c8c102df0 2024-05-09T06:37:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.118+0000 7f0c89d9b700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0c74078980 0x7f0c7407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.119+0000 7f0c89d9b700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0c74078980 0x7f0c7407ae30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000b3b0 tx=0x7f0c80009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:07.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.123+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0c7c0628f0 con 0x7f0c8c102df0 2024-05-09T06:37:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.458+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c8c109ef0 con 0x7f0c8c102df0 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.458+0000 7f0c7affd700 1 -- 172.21.15.46:0/4064681032 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f0c7c062290 con 0x7f0c8c102df0 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4, 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:37:07.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 8, 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 5 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:37:07.441 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:37:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0c74078980 msgr2=0x7f0c7407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0c74078980 0x7f0c7407ae30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000b3b0 tx=0x7f0c80009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 msgr2=0x7f0c8c113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 0x7f0c8c113ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00cb10 tx=0x7f0c7c007f70 comp rx=0 tx=0).stop 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 shutdown_connections 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0c74078980 0x7f0c7407ae30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c8c102df0 0x7f0c8c113ba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 --2- 172.21.15.46:0/4064681032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c8c103790 0x7f0c8c1140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 >> 172.21.15.46:0/4064681032 conn(0x7f0c8c0f8980 msgr2=0x7f0c8c102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 shutdown_connections 2024-05-09T06:37:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.461+0000 7f0c90b01700 1 -- 172.21.15.46:0/4064681032 wait complete. 2024-05-09T06:37:07.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2929958363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4102670 msgr2=0x7f8af40fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2929958363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4102670 0x7f8af40fb600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8004940 tx=0x7f8ae8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2929958363 shutdown_connections 2024-05-09T06:37:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2929958363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4102670 0x7f8af40fb600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2929958363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af4101cd0 0x7f8af41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2929958363 >> 172.21.15.46:0/2929958363 conn(0x7f8af4071460 msgr2=0x7f8af4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2929958363 shutdown_connections 2024-05-09T06:37:07.552 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:07 smithi046 ceph-mon[110713]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:07.552 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:07 smithi046 ceph-mon[110713]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:07.552 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:07 smithi046 ceph-mon[110713]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:37:07.552 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:07 smithi046 ceph-mon[110713]: osdmap e55: 6 total, 5 up, 6 in 2024-05-09T06:37:07.553 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:07 smithi046 ceph-mon[110713]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:07.553 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:07 smithi046 podman[126795]: 2024-05-09 06:37:07.274585998 +0000 UTC m=+1.377782724 container cleanup e6368b5e850aa3327053737a5595d52936c6d54a21a90de9e7079efd40570706 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=quincy-4ba5a83, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:37:07.553 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:07 smithi046 bash[126795]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1 2024-05-09T06:37:07.553 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:07 smithi046 podman[126887]: 2024-05-09 06:37:07.501223648 +0000 UTC m=+0.624560231 container remove e6368b5e850aa3327053737a5595d52936c6d54a21a90de9e7079efd40570706 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-4ba5a83, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2929958363 wait complete. 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.570+0000 7f8af9e2d700 1 Processor -- start 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af9e2d700 1 -- start start 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af9e2d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 0x7f8af4113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af9e2d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af4102670 0x7f8af4114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af9e2d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4114750 con 0x7f8af4101cd0 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af9e2d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af410dab0 con 0x7f8af4102670 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 0x7f8af4113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 0x7f8af4113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33682/0 (socket says 172.21.15.46:33682) 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.571+0000 7f8af37fe700 1 -- 172.21.15.46:0/2665699088 learned_addr learned my addr 172.21.15.46:0/2665699088 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af2ffd700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af4102670 0x7f8af4114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af37fe700 1 -- 172.21.15.46:0/2665699088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af4102670 msgr2=0x7f8af4114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af37fe700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af4102670 0x7f8af4114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af37fe700 1 -- 172.21.15.46:0/2665699088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8005040 con 0x7f8af4101cd0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af37fe700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 0x7f8af4113b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400b790 tx=0x7f8ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae400f6f0 con 0x7f8af4101cd0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ae400fd20 con 0x7f8af4101cd0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae40103a0 con 0x7f8af4101cd0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af410dd90 con 0x7f8af4101cd0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.572+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af410e320 con 0x7f8af4101cd0 2024-05-09T06:37:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.573+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4065200 con 0x7f8af4101cd0 2024-05-09T06:37:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.574+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8ae4011400 con 0x7f8af4101cd0 2024-05-09T06:37:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.575+0000 7f8adbfff700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8adc078990 0x7f8adc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.575+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8ae409a380 con 0x7f8af4101cd0 2024-05-09T06:37:07.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.575+0000 7f8af2ffd700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8adc078990 0x7f8adc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.575+0000 7f8af2ffd700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8adc078990 0x7f8adc07ae40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8004890 tx=0x7f8ae8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.580+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8ae4062160 con 0x7f8af4101cd0 2024-05-09T06:37:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:07 smithi106 ceph-mon[81208]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-05-09T06:37:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:07 smithi106 ceph-mon[81208]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:07 smithi106 ceph-mon[81208]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:37:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:07 smithi106 ceph-mon[81208]: osdmap e55: 6 total, 5 up, 6 in 2024-05-09T06:37:07.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:07 smithi106 ceph-mon[81208]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.861+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8af4109f40 con 0x7f8af4101cd0 2024-05-09T06:37:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.861+0000 7f8adbfff700 1 -- 172.21.15.46:0/2665699088 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f8ae4061b00 con 0x7f8af4101cd0 2024-05-09T06:37:07.842 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:37:07.843 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:37:07.844 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8adc078990 msgr2=0x7f8adc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8adc078990 0x7f8adc07ae40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8004890 tx=0x7f8ae8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 msgr2=0x7f8af4113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 0x7f8af4113b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400b790 tx=0x7f8ae4009250 comp rx=0 tx=0).stop 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 shutdown_connections 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8adc078990 0x7f8adc07ae40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8af4101cd0 0x7f8af4113b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 --2- 172.21.15.46:0/2665699088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af4102670 0x7f8af4114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 >> 172.21.15.46:0/2665699088 conn(0x7f8af4071460 msgr2=0x7f8af40f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.863+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 shutdown_connections 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.864+0000 7f8af9e2d700 1 -- 172.21.15.46:0/2665699088 wait complete. 2024-05-09T06:37:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:37:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.973+0000 7f6edf515700 1 -- 172.21.15.46:0/4009710416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8065640 msgr2=0x7f6ed8065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.973+0000 7f6edf515700 1 --2- 172.21.15.46:0/4009710416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8065640 0x7f6ed8065ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8004940 tx=0x7f6ec8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.973+0000 7f6edf515700 1 -- 172.21.15.46:0/4009710416 shutdown_connections 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.973+0000 7f6edf515700 1 --2- 172.21.15.46:0/4009710416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8065640 0x7f6ed8065ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.973+0000 7f6edf515700 1 --2- 172.21.15.46:0/4009710416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed8102e50 0x7f6ed8103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.973+0000 7f6edf515700 1 -- 172.21.15.46:0/4009710416 >> 172.21.15.46:0/4009710416 conn(0x7f6ed8071d00 msgr2=0x7f6ed8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.974+0000 7f6edf515700 1 -- 172.21.15.46:0/4009710416 shutdown_connections 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.974+0000 7f6edf515700 1 -- 172.21.15.46:0/4009710416 wait complete. 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.974+0000 7f6edf515700 1 Processor -- start 2024-05-09T06:37:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.974+0000 7f6edf515700 1 -- start start 2024-05-09T06:37:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edf515700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed8065640 0x7f6ed8113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edf515700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 0x7f6ed81140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edf515700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8114700 con 0x7f6ed8102e50 2024-05-09T06:37:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edf515700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed810daf0 con 0x7f6ed8065640 2024-05-09T06:37:07.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 0x7f6ed81140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 0x7f6ed81140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33700/0 (socket says 172.21.15.46:33700) 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 -- 172.21.15.46:0/1124518542 learned_addr learned my addr 172.21.15.46:0/1124518542 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edd2b1700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed8065640 0x7f6ed8113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 -- 172.21.15.46:0/1124518542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed8065640 msgr2=0x7f6ed8113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed8065640 0x7f6ed8113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 -- 172.21.15.46:0/1124518542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8005040 con 0x7f6ed8102e50 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edcab0700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 0x7f6ed81140b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800b3b0 tx=0x7f6ec8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec800e040 con 0x7f6ed8102e50 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ec8013420 con 0x7f6ed8102e50 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed810dd70 con 0x7f6ed8102e50 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.975+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec801c630 con 0x7f6ed8102e50 2024-05-09T06:37:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.976+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed810e330 con 0x7f6ed8102e50 2024-05-09T06:37:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.977+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed8100100 con 0x7f6ed8102e50 2024-05-09T06:37:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.977+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6ec801c860 con 0x7f6ed8102e50 2024-05-09T06:37:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.978+0000 7f6ecdffb700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6ec4078990 0x7f6ec407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.978+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6ec809b760 con 0x7f6ed8102e50 2024-05-09T06:37:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.978+0000 7f6edd2b1700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6ec4078990 0x7f6ec407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:07.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.980+0000 7f6edd2b1700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6ec4078990 0x7f6ec407ae40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4004f40 tx=0x7f6ed400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:07.984+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6ec8063540 con 0x7f6ed8102e50 2024-05-09T06:37:08.085 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:07 smithi046 podman[127023]: 2024-05-09 06:37:07.740705738 +0000 UTC m=+0.018941778 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:08.085 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:07 smithi046 podman[127023]: 2024-05-09 06:37:07.868919755 +0000 UTC m=+0.147155793 container create 406cbdefd340f15a7cd2bdd3c1ebf119efc58ca34b22fdd26478db16b15db21d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:37:08.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.225+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ed8113840 con 0x7f6ec4078990 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.227+0000 7f6ecdffb700 1 -- 172.21.15.46:0/1124518542 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ed8113840 con 0x7f6ec4078990 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "7/21 daemons upgraded", 2024-05-09T06:37:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:37:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:37:08.209 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6ec4078990 msgr2=0x7f6ec407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6ec4078990 0x7f6ec407ae40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4004f40 tx=0x7f6ed400b040 comp rx=0 tx=0).stop 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 msgr2=0x7f6ed81140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 0x7f6ed81140b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800b3b0 tx=0x7f6ec8009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 shutdown_connections 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6ec4078990 0x7f6ec407ae40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ed8065640 0x7f6ed8113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 --2- 172.21.15.46:0/1124518542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ed8102e50 0x7f6ed81140b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 >> 172.21.15.46:0/1124518542 conn(0x7f6ed8071d00 msgr2=0x7f6ed80fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 shutdown_connections 2024-05-09T06:37:08.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.229+0000 7f6edf515700 1 -- 172.21.15.46:0/1124518542 wait complete. 2024-05-09T06:37:08.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.337+0000 7f89972f4700 1 -- 172.21.15.46:0/4133342378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fdad0 msgr2=0x7f89900fdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.337+0000 7f89972f4700 1 --2- 172.21.15.46:0/4133342378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fdad0 0x7f89900fdea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f898c004940 tx=0x7f898c009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.337+0000 7f89972f4700 1 -- 172.21.15.46:0/4133342378 shutdown_connections 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.337+0000 7f89972f4700 1 --2- 172.21.15.46:0/4133342378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89900fe3e0 0x7f89900fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.337+0000 7f89972f4700 1 --2- 172.21.15.46:0/4133342378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fdad0 0x7f89900fdea0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 -- 172.21.15.46:0/4133342378 >> 172.21.15.46:0/4133342378 conn(0x7f8990071460 msgr2=0x7f8990071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 -- 172.21.15.46:0/4133342378 shutdown_connections 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 -- 172.21.15.46:0/4133342378 wait complete. 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 Processor -- start 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 -- start start 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89900fdad0 0x7f8990115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 0x7f89901162e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990116930 con 0x7f89900fe3e0 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.338+0000 7f89972f4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899010fd00 con 0x7f89900fdad0 2024-05-09T06:37:08.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 0x7f89901162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 0x7f89901162e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33728/0 (socket says 172.21.15.46:33728) 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 -- 172.21.15.46:0/2156629474 learned_addr learned my addr 172.21.15.46:0/2156629474 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f8995090700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89900fdad0 0x7f8990115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 -- 172.21.15.46:0/2156629474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89900fdad0 msgr2=0x7f8990115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89900fdad0 0x7f8990115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 -- 172.21.15.46:0/2156629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c005040 con 0x7f89900fe3e0 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f899488f700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 0x7f89901162e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8980002a50 tx=0x7f89800046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8980007cc0 con 0x7f89900fe3e0 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f898000f040 con 0x7f89900fe3e0 2024-05-09T06:37:08.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899010ffe0 con 0x7f89900fe3e0 2024-05-09T06:37:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.339+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898000db30 con 0x7f89900fe3e0 2024-05-09T06:37:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.340+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8990110520 con 0x7f89900fe3e0 2024-05-09T06:37:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.341+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990107530 con 0x7f89900fe3e0 2024-05-09T06:37:08.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.341+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f898000dc90 con 0x7f89900fe3e0 2024-05-09T06:37:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.342+0000 7f8985ffb700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f897c078990 0x7f897c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.342+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f898009a280 con 0x7f89900fe3e0 2024-05-09T06:37:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.342+0000 7f8995090700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f897c078990 0x7f897c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:08.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.342+0000 7f8995090700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f897c078990 0x7f897c07ae40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f898c004890 tx=0x7f898c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:08.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.346+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8980061f40 con 0x7f89900fe3e0 2024-05-09T06:37:08.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:08 smithi046 ceph-mon[110713]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:08.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:08 smithi046 ceph-mon[110713]: osdmap e56: 6 total, 5 up, 6 in 2024-05-09T06:37:08.418 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:08 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/4064681032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:08.418 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:08 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2665699088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:08.418 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:08 smithi046 podman[127023]: 2024-05-09 06:37:08.113127775 +0000 UTC m=+0.391363813 container init 406cbdefd340f15a7cd2bdd3c1ebf119efc58ca34b22fdd26478db16b15db21d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-09T06:37:08.418 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:08 smithi046 podman[127023]: 2024-05-09 06:37:08.118175447 +0000 UTC m=+0.396411493 container start 406cbdefd340f15a7cd2bdd3c1ebf119efc58ca34b22fdd26478db16b15db21d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:08.418 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:08 smithi046 podman[127023]: 2024-05-09 06:37:08.221644376 +0000 UTC m=+0.499880423 container attach 406cbdefd340f15a7cd2bdd3c1ebf119efc58ca34b22fdd26478db16b15db21d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, RELEASE=main-720f8e9) 2024-05-09T06:37:08.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.659+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f89900652f0 con 0x7f89900fe3e0 2024-05-09T06:37:08.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.659+0000 7f8985ffb700 1 -- 172.21.15.46:0/2156629474 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1409 (secure 0 0 0) 0x7f89800618e0 con 0x7f89900fe3e0 2024-05-09T06:37:08.641 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 3 pgs peering; Degraded data redundancy: 31/219 objects degraded (14.155%), 11 pgs degraded 2024-05-09T06:37:08.641 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:08.641 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: osd.1 (root=default,host=smithi046) is down 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.4 is stuck peering for 4m, current state peering, last acting [0,4] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1b is stuck peering for 4m, current state peering, last acting [0,5] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.b is stuck peering for 4m, current state peering, last acting [0,4] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/219 objects degraded (14.155%), 11 pgs degraded 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-05-09T06:37:08.642 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-05-09T06:37:08.643 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-05-09T06:37:08.643 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-05-09T06:37:08.643 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-05-09T06:37:08.643 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f897c078990 msgr2=0x7f897c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f897c078990 0x7f897c07ae40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f898c004890 tx=0x7f898c009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 msgr2=0x7f89901162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 0x7f89901162e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8980002a50 tx=0x7f89800046b0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 shutdown_connections 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f897c078990 0x7f897c07ae40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89900fdad0 0x7f8990115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 --2- 172.21.15.46:0/2156629474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89900fe3e0 0x7f89901162e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 >> 172.21.15.46:0/2156629474 conn(0x7f8990071460 msgr2=0x7f89900f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 shutdown_connections 2024-05-09T06:37:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:08.662+0000 7f89972f4700 1 -- 172.21.15.46:0/2156629474 wait complete. 2024-05-09T06:37:08.790 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:08 smithi046 podman[127023]: 2024-05-09 06:37:08.437754273 +0000 UTC m=+0.715990313 container died 406cbdefd340f15a7cd2bdd3c1ebf119efc58ca34b22fdd26478db16b15db21d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:37:08.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:08 smithi106 ceph-mon[81208]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:08.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:08 smithi106 ceph-mon[81208]: osdmap e56: 6 total, 5 up, 6 in 2024-05-09T06:37:08.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:08 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/4064681032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:08.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:08 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2665699088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:09.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:09 smithi046 ceph-mon[110713]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T06:37:09.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:09 smithi046 ceph-mon[110713]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:09.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:09 smithi046 ceph-mon[110713]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-05-09T06:37:09.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:09 smithi046 ceph-mon[110713]: Health check failed: Degraded data redundancy: 31/219 objects degraded (14.155%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:09.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:09 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2156629474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:37:09.354 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 podman[127095]: 2024-05-09 06:37:09.117700868 +0000 UTC m=+0.673670903 container remove 406cbdefd340f15a7cd2bdd3c1ebf119efc58ca34b22fdd26478db16b15db21d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:09.354 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.1.service: Deactivated successfully. 2024-05-09T06:37:09.354 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 systemd[1]: Stopped Ceph osd.1 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:37:09.354 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.1.service: Consumed 1min 13.663s CPU time. 2024-05-09T06:37:09.354 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 systemd[1]: Starting Ceph osd.1 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:37:09.665 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 podman[127201]: 2024-05-09 06:37:09.577369833 +0000 UTC m=+0.097756346 container create 3a4b8fd954de3108ed23f800dbdb9794f1858414321829f0dc8f97b3ff4cf641 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T06:37:09.666 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 podman[127201]: 2024-05-09 06:37:09.498720786 +0000 UTC m=+0.019107251 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:09.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:09 smithi106 ceph-mon[81208]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T06:37:09.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:09 smithi106 ceph-mon[81208]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:09.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:09 smithi106 ceph-mon[81208]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-05-09T06:37:09.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:09 smithi106 ceph-mon[81208]: Health check failed: Degraded data redundancy: 31/219 objects degraded (14.155%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:09.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:09 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2156629474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:37:10.085 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 podman[127201]: 2024-05-09 06:37:09.788300676 +0000 UTC m=+0.308687147 container init 3a4b8fd954de3108ed23f800dbdb9794f1858414321829f0dc8f97b3ff4cf641 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:37:10.085 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 podman[127201]: 2024-05-09 06:37:09.792154528 +0000 UTC m=+0.312540989 container start 3a4b8fd954de3108ed23f800dbdb9794f1858414321829f0dc8f97b3ff4cf641 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:37:10.085 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:09 smithi046 podman[127201]: 2024-05-09 06:37:09.871324047 +0000 UTC m=+0.391710512 container attach 3a4b8fd954de3108ed23f800dbdb9794f1858414321829f0dc8f97b3ff4cf641 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:37:10.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 bash[127201]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate[127215]: --> ceph-volume raw activate successful for osd ID: 1 2024-05-09T06:37:10.587 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 podman[127201]: 2024-05-09 06:37:10.331700471 +0000 UTC m=+0.852086929 container died 3a4b8fd954de3108ed23f800dbdb9794f1858414321829f0dc8f97b3ff4cf641 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:37:11.226 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:10 smithi046 podman[127343]: 2024-05-09 06:37:10.933509358 +0000 UTC m=+0.596072145 container remove 3a4b8fd954de3108ed23f800dbdb9794f1858414321829f0dc8f97b3ff4cf641 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-09T06:37:11.226 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 podman[127408]: 2024-05-09 06:37:11.167725891 +0000 UTC m=+0.116813177 container create 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True) 2024-05-09T06:37:11.226 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 podman[127408]: 2024-05-09 06:37:11.071026744 +0000 UTC m=+0.020114003 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:11.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:11 smithi046 ceph-mon[110713]: pgmap v69: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T06:37:11.585 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 podman[127408]: 2024-05-09 06:37:11.37868466 +0000 UTC m=+0.327771920 container init 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-09T06:37:11.585 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 podman[127408]: 2024-05-09 06:37:11.382407027 +0000 UTC m=+0.331494273 container start 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS) 2024-05-09T06:37:11.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 ceph-osd[127427]: -- 172.21.15.46:0/1129394177 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56515804b680 con 0x565158014c00 2024-05-09T06:37:11.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 bash[127408]: 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e 2024-05-09T06:37:11.586 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 systemd[1]: Started Ceph osd.1 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:37:11.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:11 smithi106 ceph-mon[81208]: pgmap v69: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-05-09T06:37:12.335 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:11 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[127423]: 2024-05-09T06:37:11.928+0000 7f2680c147c0 -1 Falling back to public interface 2024-05-09T06:37:12.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:12.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:12.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:12.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:12.826 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:12.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:12.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:12.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:12.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:12.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:13.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:13 smithi106 ceph-mon[81208]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:13.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:13 smithi106 ceph-mon[81208]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-05-09T06:37:13.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:13 smithi046 ceph-mon[110713]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:13.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:13 smithi046 ceph-mon[110713]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-05-09T06:37:15.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:15 smithi046 ceph-mon[110713]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:15.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:15 smithi106 ceph-mon[81208]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:17.585 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:17 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[127423]: 2024-05-09T06:37:17.313+0000 7f2680c147c0 -1 osd.1 54 log_to_monitors true 2024-05-09T06:37:17.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:17 smithi046 ceph-mon[110713]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:17.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:17 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 33/219 objects degraded (15.068%), 13 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:17.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:17.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:17.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:17 smithi046 ceph-mon[110713]: from='osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:37:17.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:17 smithi106 ceph-mon[81208]: pgmap v72: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:17 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 33/219 objects degraded (15.068%), 13 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:17 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:17 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:17.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:17 smithi106 ceph-mon[81208]: from='osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T06:37:18.335 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:37:18 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[127423]: 2024-05-09T06:37:18.030+0000 7f267206b700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:37:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:19 smithi046 ceph-mon[110713]: from='osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:37:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:19 smithi046 ceph-mon[110713]: osdmap e57: 6 total, 5 up, 6 in 2024-05-09T06:37:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:19 smithi046 ceph-mon[110713]: from='osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:37:19.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:19 smithi046 ceph-mon[110713]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:19.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:19.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:19 smithi106 ceph-mon[81208]: from='osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T06:37:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:19 smithi106 ceph-mon[81208]: osdmap e57: 6 total, 5 up, 6 in 2024-05-09T06:37:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:19 smithi106 ceph-mon[81208]: from='osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:37:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:19 smithi106 ceph-mon[81208]: pgmap v74: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:20 smithi046 ceph-mon[110713]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:20 smithi046 ceph-mon[110713]: osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906] boot 2024-05-09T06:37:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:20 smithi046 ceph-mon[110713]: osdmap e58: 6 total, 6 up, 6 in 2024-05-09T06:37:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:20 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:37:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:20 smithi106 ceph-mon[81208]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:20 smithi106 ceph-mon[81208]: osd.1 [v2:172.21.15.46:6810/1520508906,v1:172.21.15.46:6811/1520508906] boot 2024-05-09T06:37:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:20 smithi106 ceph-mon[81208]: osdmap e58: 6 total, 6 up, 6 in 2024-05-09T06:37:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:20 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T06:37:21.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:21 smithi106 ceph-mon[81208]: osdmap e59: 6 total, 6 up, 6 in 2024-05-09T06:37:21.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:21 smithi106 ceph-mon[81208]: pgmap v77: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:21.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:21 smithi046 ceph-mon[110713]: osdmap e59: 6 total, 6 up, 6 in 2024-05-09T06:37:21.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:21 smithi046 ceph-mon[110713]: pgmap v77: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:23.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:23.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:23.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:23.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:37:23.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-05-09T06:37:23.324 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:22 smithi106 ceph-mon[81208]: pgmap v78: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-05-09T06:37:23.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:22 smithi046 ceph-mon[110713]: pgmap v78: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-05-09T06:37:24.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:24 smithi106 ceph-mon[81208]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/219 objects degraded (15.068%), 13 pgs degraded) 2024-05-09T06:37:24.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:24 smithi046 ceph-mon[110713]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/219 objects degraded (15.068%), 13 pgs degraded) 2024-05-09T06:37:25.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:25 smithi106 ceph-mon[81208]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:25.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:25 smithi046 ceph-mon[110713]: pgmap v79: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:27 smithi106 ceph-mon[81208]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:27.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:27 smithi046 ceph-mon[110713]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:27.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:27.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:29.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:29 smithi106 ceph-mon[81208]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:29 smithi046 ceph-mon[110713]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:31.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:31 smithi106 ceph-mon[81208]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:31 smithi046 ceph-mon[110713]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:33 smithi106 ceph-mon[81208]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:33 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:33 smithi046 ceph-mon[110713]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:33 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:35.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:35 smithi106 ceph-mon[81208]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:35.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:35 smithi046 ceph-mon[110713]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:37.436 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:37 smithi046 ceph-mon[110713]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:37.436 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:37 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:37.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:37 smithi106 ceph-mon[81208]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:37.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:37 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:38 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:38.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:38 smithi106 ceph-mon[81208]: Upgrade: osd.2 is safe to restart 2024-05-09T06:37:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:38 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-05-09T06:37:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:38 smithi046 ceph-mon[110713]: Upgrade: osd.2 is safe to restart 2024-05-09T06:37:38.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.790+0000 7f672fd8e700 1 -- 172.21.15.46:0/3561943289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 msgr2=0x7f6728102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:38.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.790+0000 7f672fd8e700 1 --2- 172.21.15.46:0/3561943289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f6728102160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f671c004940 tx=0x7f671c009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:38.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.790+0000 7f672fd8e700 1 -- 172.21.15.46:0/3561943289 shutdown_connections 2024-05-09T06:37:38.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.790+0000 7f672fd8e700 1 --2- 172.21.15.46:0/3561943289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67280fbd40 0x7f67280fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:38.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.790+0000 7f672fd8e700 1 --2- 172.21.15.46:0/3561943289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f6728102160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.790+0000 7f672fd8e700 1 -- 172.21.15.46:0/3561943289 >> 172.21.15.46:0/3561943289 conn(0x7f6728071d00 msgr2=0x7f6728072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.791+0000 7f672fd8e700 1 -- 172.21.15.46:0/3561943289 shutdown_connections 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.791+0000 7f672fd8e700 1 -- 172.21.15.46:0/3561943289 wait complete. 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.791+0000 7f672fd8e700 1 Processor -- start 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.791+0000 7f672fd8e700 1 -- start start 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.791+0000 7f672fd8e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67280fbd40 0x7f6728113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.791+0000 7f672fd8e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f67281140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672fd8e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6728114710 con 0x7f6728101d90 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672fd8e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672810db00 con 0x7f67280fbd40 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f67281140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f67281140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52496/0 (socket says 172.21.15.46:52496) 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 -- 172.21.15.46:0/2702533843 learned_addr learned my addr 172.21.15.46:0/2702533843 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672db2a700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67280fbd40 0x7f6728113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:38.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 -- 172.21.15.46:0/2702533843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67280fbd40 msgr2=0x7f6728113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67280fbd40 0x7f6728113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 -- 172.21.15.46:0/2702533843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c005040 con 0x7f6728101d90 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672d329700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f67281140c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f672400c830 tx=0x7f6724004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67240106f0 con 0x7f6728101d90 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6724010d20 con 0x7f6728101d90 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.792+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672810dde0 con 0x7f6728101d90 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.793+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67240113a0 con 0x7f6728101d90 2024-05-09T06:37:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.793+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672810e3a0 con 0x7f6728101d90 2024-05-09T06:37:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.794+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67280fd430 con 0x7f6728101d90 2024-05-09T06:37:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.794+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6724012400 con 0x7f6728101d90 2024-05-09T06:37:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.795+0000 7f671a7fc700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6714078990 0x7f671407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.795+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f672409a5e0 con 0x7f6728101d90 2024-05-09T06:37:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.795+0000 7f672db2a700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6714078990 0x7f671407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:38.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.795+0000 7f672db2a700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6714078990 0x7f671407ae40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f671c004560 tx=0x7f671c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:38.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:38.800+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6724062300 con 0x7f6728101d90 2024-05-09T06:37:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.036+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6728108df0 con 0x7f6714078990 2024-05-09T06:37:39.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.037+0000 7f671a7fc700 1 -- 172.21.15.46:0/2702533843 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6728108df0 con 0x7f6714078990 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.040+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6714078990 msgr2=0x7f671407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.040+0000 7f672fd8e700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6714078990 0x7f671407ae40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f671c004560 tx=0x7f671c009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.040+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 msgr2=0x7f67281140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.040+0000 7f672fd8e700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f67281140c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f672400c830 tx=0x7f6724004470 comp rx=0 tx=0).stop 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 shutdown_connections 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6714078990 0x7f671407ae40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67280fbd40 0x7f6728113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 --2- 172.21.15.46:0/2702533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6728101d90 0x7f67281140c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 >> 172.21.15.46:0/2702533843 conn(0x7f6728071d00 msgr2=0x7f67280fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 shutdown_connections 2024-05-09T06:37:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.041+0000 7f672fd8e700 1 -- 172.21.15.46:0/2702533843 wait complete. 2024-05-09T06:37:39.036 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/1618501974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 msgr2=0x7f6f9c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/1618501974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c1031c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f98004940 tx=0x7f6f98009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/1618501974 shutdown_connections 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/1618501974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 0x7f6f9c0fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/1618501974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c1031c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/1618501974 >> 172.21.15.46:0/1618501974 conn(0x7f6f9c0f8980 msgr2=0x7f6f9c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/1618501974 shutdown_connections 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.154+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/1618501974 wait complete. 2024-05-09T06:37:39.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa3ddd700 1 Processor -- start 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa3ddd700 1 -- start start 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa3ddd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa3ddd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 0x7f6f9c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa3ddd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c070d30 con 0x7f6f9c102df0 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa3ddd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c070e70 con 0x7f6f9c103790 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1b79700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1b79700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52500/0 (socket says 172.21.15.46:52500) 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1b79700 1 -- 172.21.15.46:0/581434051 learned_addr learned my addr 172.21.15.46:0/581434051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1378700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 0x7f6f9c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1b79700 1 -- 172.21.15.46:0/581434051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 msgr2=0x7f6f9c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1b79700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 0x7f6f9c0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1b79700 1 -- 172.21.15.46:0/581434051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98005040 con 0x7f6f9c102df0 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.155+0000 7f6fa1378700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 0x7f6f9c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.156+0000 7f6fa1b79700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c070260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800b3b0 tx=0x7f6f98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:39.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.156+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9800e040 con 0x7f6f9c102df0 2024-05-09T06:37:39.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.156+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f9800bbc0 con 0x7f6f9c102df0 2024-05-09T06:37:39.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.156+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c0710c0 con 0x7f6f9c102df0 2024-05-09T06:37:39.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.156+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9801c3f0 con 0x7f6f9c102df0 2024-05-09T06:37:39.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.156+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c11a310 con 0x7f6f9c102df0 2024-05-09T06:37:39.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.157+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c100100 con 0x7f6f9c102df0 2024-05-09T06:37:39.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.158+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6f9800bd30 con 0x7f6f9c102df0 2024-05-09T06:37:39.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.158+0000 7f6f927fc700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6f88078990 0x7f6f8807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.159+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6f9809b860 con 0x7f6f9c102df0 2024-05-09T06:37:39.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.159+0000 7f6fa1378700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6f88078990 0x7f6f8807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.159+0000 7f6fa1378700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6f88078990 0x7f6f8807ae40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009fd0 tx=0x7f6f8c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:39.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.163+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6f980635a0 con 0x7f6f9c102df0 2024-05-09T06:37:39.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:39 smithi046 ceph-mon[110713]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:39.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:39.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:37:39.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.403+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f9c109f60 con 0x7f6f88078990 2024-05-09T06:37:39.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.404+0000 7f6f927fc700 1 -- 172.21.15.46:0/581434051 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6f9c109f60 con 0x7f6f88078990 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6f88078990 msgr2=0x7f6f8807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6f88078990 0x7f6f8807ae40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009fd0 tx=0x7f6f8c00b040 comp rx=0 tx=0).stop 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 msgr2=0x7f6f9c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c070260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800b3b0 tx=0x7f6f98009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 shutdown_connections 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6f88078990 0x7f6f8807ae40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f9c102df0 0x7f6f9c070260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 --2- 172.21.15.46:0/581434051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f9c103790 0x7f6f9c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 >> 172.21.15.46:0/581434051 conn(0x7f6f9c0f8980 msgr2=0x7f6f9c0facd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:39.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 shutdown_connections 2024-05-09T06:37:39.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.407+0000 7f6fa3ddd700 1 -- 172.21.15.46:0/581434051 wait complete. 2024-05-09T06:37:39.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.515+0000 7f2d89f4f700 1 -- 172.21.15.46:0/157371265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84065640 msgr2=0x7f2d84065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.515+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/157371265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84065640 0x7f2d84065ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d78004940 tx=0x7f2d78009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:39.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.515+0000 7f2d89f4f700 1 -- 172.21.15.46:0/157371265 shutdown_connections 2024-05-09T06:37:39.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.515+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/157371265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84065640 0x7f2d84065ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.515+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/157371265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84102e50 0x7f2d84103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.516+0000 7f2d89f4f700 1 -- 172.21.15.46:0/157371265 >> 172.21.15.46:0/157371265 conn(0x7f2d84071d00 msgr2=0x7f2d84072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:39.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.516+0000 7f2d89f4f700 1 -- 172.21.15.46:0/157371265 shutdown_connections 2024-05-09T06:37:39.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.516+0000 7f2d89f4f700 1 -- 172.21.15.46:0/157371265 wait complete. 2024-05-09T06:37:39.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.516+0000 7f2d89f4f700 1 Processor -- start 2024-05-09T06:37:39.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.516+0000 7f2d89f4f700 1 -- start start 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d89f4f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84065640 0x7f2d84113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d89f4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 0x7f2d841140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d89f4f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84114700 con 0x7f2d84102e50 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d89f4f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8410daf0 con 0x7f2d84065640 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 0x7f2d841140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 0x7f2d841140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52518/0 (socket says 172.21.15.46:52518) 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 -- 172.21.15.46:0/3471489663 learned_addr learned my addr 172.21.15.46:0/3471489663 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d837fe700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84065640 0x7f2d84113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 -- 172.21.15.46:0/3471489663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84065640 msgr2=0x7f2d84113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84065640 0x7f2d84113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 -- 172.21.15.46:0/3471489663 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78005040 con 0x7f2d84102e50 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d837fe700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84065640 0x7f2d84113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:37:39.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d82ffd700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 0x7f2d841140b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009180 tx=0x7f2d78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7800e040 con 0x7f2d84102e50 2024-05-09T06:37:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8410dd70 con 0x7f2d84102e50 2024-05-09T06:37:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d7800bbc0 con 0x7f2d84102e50 2024-05-09T06:37:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7801c630 con 0x7f2d84102e50 2024-05-09T06:37:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.517+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8410e330 con 0x7f2d84102e50 2024-05-09T06:37:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.518+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84100100 con 0x7f2d84102e50 2024-05-09T06:37:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.519+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2d7800bd30 con 0x7f2d84102e50 2024-05-09T06:37:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.520+0000 7f2d6bfff700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2d6c078980 0x7f2d6c07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.520+0000 7f2d837fe700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2d6c078980 0x7f2d6c07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.520+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2d7809bac0 con 0x7f2d84102e50 2024-05-09T06:37:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.520+0000 7f2d837fe700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2d6c078980 0x7f2d6c07ae30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d74007fd0 tx=0x7f2d74009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:39.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.525+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2d78063800 con 0x7f2d84102e50 2024-05-09T06:37:39.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:39 smithi106 ceph-mon[81208]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T06:37:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:37:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.759+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d8410f1c0 con 0x7f2d6c078980 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.769+0000 7f2d6bfff700 1 -- 172.21.15.46:0/3471489663 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2d8410f1c0 con 0x7f2d6c078980 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (4m) 22s ago 15m 24.2M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (91s) 22s ago 15m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (86s) 82s ago 14m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 22s ago 15m 77.9M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (10m) 22s ago 10m 14.2M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:37:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (9m) 22s ago 9m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (10m) 82s ago 10m 17.9M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (9m) 82s ago 9m 15.6M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (6m) 22s ago 16m 517M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (5m) 82s ago 14m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (2m) 22s ago 17m 48.3M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (2m) 82s ago 14m 32.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 22s ago 15m 15.2M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (4m) 82s ago 14m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (65s) 22s ago 13m 96.1M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (28s) 22s ago 13m 12.5M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (12m) 22s ago 12m 221M 1559M 17.2.7-933-g4ba5a836 b96134859c76 8d28807d3204 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (12m) 82s ago 12m 289M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (11m) 82s ago 11m 262M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (11m) 82s ago 11m 238M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:37:39.750 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 22s ago 14m 64.5M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:37:39.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2d6c078980 msgr2=0x7f2d6c07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2d6c078980 0x7f2d6c07ae30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d74007fd0 tx=0x7f2d74009040 comp rx=0 tx=0).stop 2024-05-09T06:37:39.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 msgr2=0x7f2d841140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 0x7f2d841140b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009180 tx=0x7f2d78009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 shutdown_connections 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2d6c078980 0x7f2d6c07ae30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d84065640 0x7f2d84113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 --2- 172.21.15.46:0/3471489663 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d84102e50 0x7f2d841140b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 >> 172.21.15.46:0/3471489663 conn(0x7f2d84071d00 msgr2=0x7f2d840fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.771+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 shutdown_connections 2024-05-09T06:37:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.772+0000 7f2d89f4f700 1 -- 172.21.15.46:0/3471489663 wait complete. 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 -- 172.21.15.46:0/2979767132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 msgr2=0x7f81b8070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 --2- 172.21.15.46:0/2979767132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8070650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81b4004940 tx=0x7f81b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 -- 172.21.15.46:0/2979767132 shutdown_connections 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 --2- 172.21.15.46:0/2979767132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81b8070b90 0x7f81b8109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 --2- 172.21.15.46:0/2979767132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8070650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 -- 172.21.15.46:0/2979767132 >> 172.21.15.46:0/2979767132 conn(0x7f81b80f8990 msgr2=0x7f81b80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 -- 172.21.15.46:0/2979767132 shutdown_connections 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 -- 172.21.15.46:0/2979767132 wait complete. 2024-05-09T06:37:39.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 Processor -- start 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.877+0000 7f81c06af700 1 -- start start 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81c06af700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81c06af700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81b8070b90 0x7f81b81160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81c06af700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8116720 con 0x7f81b8070280 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81c06af700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b810fd00 con 0x7f81b8070b90 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52536/0 (socket says 172.21.15.46:52536) 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 -- 172.21.15.46:0/3284300425 learned_addr learned my addr 172.21.15.46:0/3284300425 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81bdc4a700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81b8070b90 0x7f81b81160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 -- 172.21.15.46:0/3284300425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81b8070b90 msgr2=0x7f81b81160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81b8070b90 0x7f81b81160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 -- 172.21.15.46:0/3284300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4005040 con 0x7f81b8070280 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81be44b700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8115b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009180 tx=0x7f81b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:39.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81b400e040 con 0x7f81b8070280 2024-05-09T06:37:39.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81b4013420 con 0x7f81b8070280 2024-05-09T06:37:39.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b810ff80 con 0x7f81b8070280 2024-05-09T06:37:39.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.878+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81b401c630 con 0x7f81b8070280 2024-05-09T06:37:39.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.879+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b81104c0 con 0x7f81b8070280 2024-05-09T06:37:39.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.879+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b80719c0 con 0x7f81b8070280 2024-05-09T06:37:39.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.880+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f81b4013590 con 0x7f81b8070280 2024-05-09T06:37:39.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.881+0000 7f81aeffd700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f81a4078980 0x7f81a407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:39.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.881+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f81b409b740 con 0x7f81b8070280 2024-05-09T06:37:39.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.881+0000 7f81bdc4a700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f81a4078980 0x7f81a407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:39.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.881+0000 7f81bdc4a700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f81a4078980 0x7f81a407ae30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81b8111430 tx=0x7f81a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:39.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:39.885+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f81b4063520 con 0x7f81b8070280 2024-05-09T06:37:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.200+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f81b81111e0 con 0x7f81b8070280 2024-05-09T06:37:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.200+0000 7f81aeffd700 1 -- 172.21.15.46:0/3284300425 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f81b4062ec0 con 0x7f81b8070280 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4, 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:37:40.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:37:40.182 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:37:40.182 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 8, 2024-05-09T06:37:40.182 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:37:40.182 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:37:40.182 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.202+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f81a4078980 msgr2=0x7f81a407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.202+0000 7f81c06af700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f81a4078980 0x7f81a407ae30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81b8111430 tx=0x7f81a800b040 comp rx=0 tx=0).stop 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.202+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 msgr2=0x7f81b8115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.202+0000 7f81c06af700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8115b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009180 tx=0x7f81b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 shutdown_connections 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f81a4078980 0x7f81a407ae30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b8070280 0x7f81b8115b90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 --2- 172.21.15.46:0/3284300425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81b8070b90 0x7f81b81160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 >> 172.21.15.46:0/3284300425 conn(0x7f81b80f8990 msgr2=0x7f81b8108450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 shutdown_connections 2024-05-09T06:37:40.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.203+0000 7f81c06af700 1 -- 172.21.15.46:0/3284300425 wait complete. 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.309+0000 7f11a19cd700 1 -- 172.21.15.46:0/3414119935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 msgr2=0x7f119c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.309+0000 7f11a19cd700 1 --2- 172.21.15.46:0/3414119935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c0fb830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1190004940 tx=0x7f1190009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.309+0000 7f11a19cd700 1 -- 172.21.15.46:0/3414119935 shutdown_connections 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.309+0000 7f11a19cd700 1 --2- 172.21.15.46:0/3414119935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c0fb830 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.309+0000 7f11a19cd700 1 --2- 172.21.15.46:0/3414119935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 0x7f119c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.309+0000 7f11a19cd700 1 -- 172.21.15.46:0/3414119935 >> 172.21.15.46:0/3414119935 conn(0x7f119c072380 msgr2=0x7f119c072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 -- 172.21.15.46:0/3414119935 shutdown_connections 2024-05-09T06:37:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 -- 172.21.15.46:0/3414119935 wait complete. 2024-05-09T06:37:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 Processor -- start 2024-05-09T06:37:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 -- start start 2024-05-09T06:37:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 0x7f119c113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c1144d0 con 0x7f119c0fb3c0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.310+0000 7f11a19cd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c10dad0 con 0x7f119c102eb0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52550/0 (socket says 172.21.15.46:52550) 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 -- 172.21.15.46:0/1788200623 learned_addr learned my addr 172.21.15.46:0/1788200623 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119a7fc700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 0x7f119c113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 -- 172.21.15.46:0/1788200623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 msgr2=0x7f119c113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 0x7f119c113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 -- 172.21.15.46:0/1788200623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190005040 con 0x7f119c0fb3c0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119a7fc700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 0x7f119c113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f119affd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c113940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f118c00c8e0 tx=0x7f118c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c00a940 con 0x7f119c0fb3c0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f118c00ce80 con 0x7f119c0fb3c0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c10ddb0 con 0x7f119c0fb3c0 2024-05-09T06:37:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c0113a0 con 0x7f119c0fb3c0 2024-05-09T06:37:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.311+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c10e370 con 0x7f119c0fb3c0 2024-05-09T06:37:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.312+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c105290 con 0x7f119c0fb3c0 2024-05-09T06:37:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.313+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f118c012400 con 0x7f119c0fb3c0 2024-05-09T06:37:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.313+0000 7f11837fe700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1184078990 0x7f118407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.314+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f118c09a7c0 con 0x7f119c0fb3c0 2024-05-09T06:37:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.314+0000 7f119a7fc700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1184078990 0x7f118407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.314+0000 7f119a7fc700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1184078990 0x7f118407ae40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1190009fd0 tx=0x7f1190009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:40.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.318+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f118c0624a0 con 0x7f119c0fb3c0 2024-05-09T06:37:40.535 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:40 smithi046 ceph-mon[110713]: Upgrade: Updating osd.2 2024-05-09T06:37:40.535 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:40 smithi046 ceph-mon[110713]: Deploying daemon osd.2 on smithi046 2024-05-09T06:37:40.535 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:40 smithi046 ceph-mon[110713]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:40.535 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:40 smithi046 ceph-mon[110713]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:40.535 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:40 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3284300425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:40.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.587+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f119c10ef90 con 0x7f119c0fb3c0 2024-05-09T06:37:40.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.588+0000 7f11837fe700 1 -- 172.21.15.46:0/1788200623 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f118c061e40 con 0x7f119c0fb3c0 2024-05-09T06:37:40.568 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:37:40.568 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:37:40.568 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:37:40.569 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:37:40.570 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:40.571 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:37:40.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1184078990 msgr2=0x7f118407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1184078990 0x7f118407ae40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1190009fd0 tx=0x7f1190009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:40.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 msgr2=0x7f119c113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c113940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f118c00c8e0 tx=0x7f118c0044c0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 shutdown_connections 2024-05-09T06:37:40.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1184078990 0x7f118407ae40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f119c0fb3c0 0x7f119c113940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 --2- 172.21.15.46:0/1788200623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f119c102eb0 0x7f119c113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 >> 172.21.15.46:0/1788200623 conn(0x7f119c072380 msgr2=0x7f119c0fa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:40.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 shutdown_connections 2024-05-09T06:37:40.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.591+0000 7f11a19cd700 1 -- 172.21.15.46:0/1788200623 wait complete. 2024-05-09T06:37:40.573 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:37:40.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:40 smithi106 ceph-mon[81208]: Upgrade: Updating osd.2 2024-05-09T06:37:40.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:40 smithi106 ceph-mon[81208]: Deploying daemon osd.2 on smithi046 2024-05-09T06:37:40.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:40 smithi106 ceph-mon[81208]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:40.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:40 smithi106 ceph-mon[81208]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:40.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:40 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3284300425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:37:40.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.700+0000 7f2f1085b700 1 -- 172.21.15.46:0/3497981937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 msgr2=0x7f2f0c065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.700+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3497981937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c065ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f00004940 tx=0x7f2f00009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:40.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.701+0000 7f2f1085b700 1 -- 172.21.15.46:0/3497981937 shutdown_connections 2024-05-09T06:37:40.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.701+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3497981937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c065ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.701+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3497981937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c102e50 0x7f2f0c103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.701+0000 7f2f1085b700 1 -- 172.21.15.46:0/3497981937 >> 172.21.15.46:0/3497981937 conn(0x7f2f0c071d00 msgr2=0x7f2f0c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:40.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.701+0000 7f2f1085b700 1 -- 172.21.15.46:0/3497981937 shutdown_connections 2024-05-09T06:37:40.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.701+0000 7f2f1085b700 1 -- 172.21.15.46:0/3497981937 wait complete. 2024-05-09T06:37:40.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f1085b700 1 Processor -- start 2024-05-09T06:37:40.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f1085b700 1 -- start start 2024-05-09T06:37:40.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f1085b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:40.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f1085b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c102e50 0x7f2f0c1140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f1085b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c114700 con 0x7f2f0c065640 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f1085b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c10daf0 con 0x7f2f0c102e50 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f0a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f0a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57642/0 (socket says 172.21.15.46:57642) 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f0a59c700 1 -- 172.21.15.46:0/3257453807 learned_addr learned my addr 172.21.15.46:0/3257453807 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f09d9b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c102e50 0x7f2f0c1140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f0a59c700 1 -- 172.21.15.46:0/3257453807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c102e50 msgr2=0x7f2f0c1140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f0a59c700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c102e50 0x7f2f0c1140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.702+0000 7f2f0a59c700 1 -- 172.21.15.46:0/3257453807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00005040 con 0x7f2f0c065640 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.703+0000 7f2f0a59c700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c113b70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c830 tx=0x7f2efc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.703+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2efc00a760 con 0x7f2f0c065640 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.703+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2efc00ad90 con 0x7f2f0c065640 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.703+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c10ddd0 con 0x7f2f0c065640 2024-05-09T06:37:40.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.703+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2efc0113a0 con 0x7f2f0c065640 2024-05-09T06:37:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.703+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c10e390 con 0x7f2f0c065640 2024-05-09T06:37:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.704+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c100100 con 0x7f2f0c065640 2024-05-09T06:37:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.705+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2efc00a8c0 con 0x7f2f0c065640 2024-05-09T06:37:40.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.705+0000 7f2efaffd700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2ef4078770 0x7f2ef407ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:40.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.705+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2efc09a710 con 0x7f2f0c065640 2024-05-09T06:37:40.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.705+0000 7f2f09d9b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2ef4078770 0x7f2ef407ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:40.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.706+0000 7f2f09d9b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2ef4078770 0x7f2ef407ac20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c10ecb0 tx=0x7f2f00009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:40.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.710+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2efc062450 con 0x7f2f0c065640 2024-05-09T06:37:40.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.948+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f0c05f620 con 0x7f2ef4078770 2024-05-09T06:37:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.950+0000 7f2efaffd700 1 -- 172.21.15.46:0/3257453807 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2f0c05f620 con 0x7f2ef4078770 2024-05-09T06:37:40.930 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:37:40.930 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:37:40.930 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "8/21 daemons upgraded", 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:37:40.931 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:37:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2ef4078770 msgr2=0x7f2ef407ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2ef4078770 0x7f2ef407ac20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c10ecb0 tx=0x7f2f00009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 msgr2=0x7f2f0c113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c113b70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c830 tx=0x7f2efc004470 comp rx=0 tx=0).stop 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 shutdown_connections 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2ef4078770 0x7f2ef407ac20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f0c065640 0x7f2f0c113b70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 --2- 172.21.15.46:0/3257453807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f0c102e50 0x7f2f0c1140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 >> 172.21.15.46:0/3257453807 conn(0x7f2f0c071d00 msgr2=0x7f2f0c0fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 shutdown_connections 2024-05-09T06:37:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:40.952+0000 7f2f1085b700 1 -- 172.21.15.46:0/3257453807 wait complete. 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 -- 172.21.15.46:0/4275844305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac103780 msgr2=0x7f40ac0fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 --2- 172.21.15.46:0/4275844305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac103780 0x7f40ac0fcdf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4098004940 tx=0x7f4098009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 -- 172.21.15.46:0/4275844305 shutdown_connections 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 --2- 172.21.15.46:0/4275844305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac103780 0x7f40ac0fcdf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 --2- 172.21.15.46:0/4275844305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40ac102de0 0x7f40ac1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 -- 172.21.15.46:0/4275844305 >> 172.21.15.46:0/4275844305 conn(0x7f40ac0f8950 msgr2=0x7f40ac0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 -- 172.21.15.46:0/4275844305 shutdown_connections 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.062+0000 7f40b2bef700 1 -- 172.21.15.46:0/4275844305 wait complete. 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b2bef700 1 Processor -- start 2024-05-09T06:37:41.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b2bef700 1 -- start start 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b2bef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 0x7f40ac070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b2bef700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40ac103780 0x7f40ac0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b2bef700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac070d30 con 0x7f40ac102de0 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b2bef700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac070e70 con 0x7f40ac103780 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b098b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 0x7f40ac070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b098b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 0x7f40ac070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57674/0 (socket says 172.21.15.46:57674) 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.063+0000 7f40b098b700 1 -- 172.21.15.46:0/1258854607 learned_addr learned my addr 172.21.15.46:0/1258854607 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40abfff700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40ac103780 0x7f40ac0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40b098b700 1 -- 172.21.15.46:0/1258854607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40ac103780 msgr2=0x7f40ac0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40b098b700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40ac103780 0x7f40ac0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:41.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40b098b700 1 -- 172.21.15.46:0/1258854607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098005040 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40b098b700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 0x7f40ac070260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40a000eb40 tx=0x7f40a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a0007cc0 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40a000f040 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac0710c0 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac11a240 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.064+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a000ca10 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.066+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40900052b0 con 0x7f40ac102de0 2024-05-09T06:37:41.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.066+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f40a000cb70 con 0x7f40ac102de0 2024-05-09T06:37:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.067+0000 7f40a97fa700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f409c078980 0x7f409c07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:37:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.067+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f40a009a130 con 0x7f40ac102de0 2024-05-09T06:37:41.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.067+0000 7f40abfff700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f409c078980 0x7f409c07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:37:41.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.068+0000 7f40abfff700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f409c078980 0x7f409c07ae30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac071ba0 tx=0x7f4098009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:37:41.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.072+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f40a0061e80 con 0x7f40ac102de0 2024-05-09T06:37:41.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.382+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4090005560 con 0x7f40ac102de0 2024-05-09T06:37:41.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.383+0000 7f40a97fa700 1 -- 172.21.15.46:0/1258854607 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f40a0061820 con 0x7f40ac102de0 2024-05-09T06:37:41.363 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:41.363 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:37:41.363 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:37:41.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f409c078980 msgr2=0x7f409c07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f409c078980 0x7f409c07ae30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac071ba0 tx=0x7f4098009e30 comp rx=0 tx=0).stop 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 msgr2=0x7f40ac070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 0x7f40ac070260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40a000eb40 tx=0x7f40a000b040 comp rx=0 tx=0).stop 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 shutdown_connections 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f409c078980 0x7f409c07ae30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac102de0 0x7f40ac070260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 --2- 172.21.15.46:0/1258854607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40ac103780 0x7f40ac0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 >> 172.21.15.46:0/1258854607 conn(0x7f40ac0f8950 msgr2=0x7f40ac0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 shutdown_connections 2024-05-09T06:37:41.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:37:41.385+0000 7f40b2bef700 1 -- 172.21.15.46:0/1258854607 wait complete. 2024-05-09T06:37:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:41 smithi106 ceph-mon[81208]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:41.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:41 smithi106 ceph-mon[81208]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:41.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:41 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1788200623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:41 smithi046 ceph-mon[110713]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:41 smithi046 ceph-mon[110713]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:41 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1788200623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:37:42.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:42 smithi046 ceph-mon[110713]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:42.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:42 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1258854607' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:37:42.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:42.306 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:42 smithi046 systemd[1]: Stopping Ceph osd.2 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:37:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:42 smithi106 ceph-mon[81208]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:37:42.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:42 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1258854607' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:37:42.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:42.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:42 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[60066]: 2024-05-09T06:37:42.325+0000 7fb2a8ddd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:37:42.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:42 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[60066]: 2024-05-09T06:37:42.325+0000 7fb2a8ddd700 -1 osd.2 59 *** Got signal Terminated *** 2024-05-09T06:37:42.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:42 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[60066]: 2024-05-09T06:37:42.325+0000 7fb2a8ddd700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:37:43.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:43 smithi106 ceph-mon[81208]: pgmap v88: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:43 smithi106 ceph-mon[81208]: osd.2 marked itself down and dead 2024-05-09T06:37:43.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:43 smithi046 ceph-mon[110713]: pgmap v88: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:43.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:43 smithi046 ceph-mon[110713]: osd.2 marked itself down and dead 2024-05-09T06:37:44.004 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:43 smithi046 podman[132744]: 2024-05-09 06:37:43.71678274 +0000 UTC m=+1.494044623 container died 8d28807d3204c2774a3301f2d6ce208f9c26cd535a5b7abae29e98adc8260d80 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:44.005 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 podman[132744]: 2024-05-09 06:37:44.024675482 +0000 UTC m=+1.801937367 container cleanup 8d28807d3204c2774a3301f2d6ce208f9c26cd535a5b7abae29e98adc8260d80 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=quincy-4ba5a83) 2024-05-09T06:37:44.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:44 smithi046 ceph-mon[110713]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:37:44.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:44 smithi046 ceph-mon[110713]: osdmap e60: 6 total, 5 up, 6 in 2024-05-09T06:37:44.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 bash[132744]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2 2024-05-09T06:37:44.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 podman[132764]: 2024-05-09 06:37:44.251114269 +0000 UTC m=+0.530066903 container remove 8d28807d3204c2774a3301f2d6ce208f9c26cd535a5b7abae29e98adc8260d80 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=quincy-4ba5a83) 2024-05-09T06:37:44.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:44 smithi106 ceph-mon[81208]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:37:44.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:44 smithi106 ceph-mon[81208]: osdmap e60: 6 total, 5 up, 6 in 2024-05-09T06:37:44.959 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 podman[132854]: 2024-05-09 06:37:44.603333861 +0000 UTC m=+0.019223618 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:44.959 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 podman[132854]: 2024-05-09 06:37:44.77316179 +0000 UTC m=+0.189051575 container create 83738491fd133fb39fff6b4366c74cb001cfe1a24455738796bafe758e3be592 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-09T06:37:44.959 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 podman[132854]: 2024-05-09 06:37:44.979512159 +0000 UTC m=+0.395401904 container init 83738491fd133fb39fff6b4366c74cb001cfe1a24455738796bafe758e3be592 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9) 2024-05-09T06:37:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:45 smithi046 ceph-mon[110713]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:45.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:45 smithi046 ceph-mon[110713]: osdmap e61: 6 total, 5 up, 6 in 2024-05-09T06:37:45.249 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:44 smithi046 podman[132854]: 2024-05-09 06:37:44.983097466 +0000 UTC m=+0.398987208 container start 83738491fd133fb39fff6b4366c74cb001cfe1a24455738796bafe758e3be592 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-09T06:37:45.249 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:45 smithi046 podman[132854]: 2024-05-09 06:37:45.079880207 +0000 UTC m=+0.495769949 container attach 83738491fd133fb39fff6b4366c74cb001cfe1a24455738796bafe758e3be592 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-09T06:37:45.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:45 smithi106 ceph-mon[81208]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:45.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:45 smithi106 ceph-mon[81208]: osdmap e61: 6 total, 5 up, 6 in 2024-05-09T06:37:45.562 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:45 smithi046 podman[132854]: 2024-05-09 06:37:45.291943067 +0000 UTC m=+0.707832812 container died 83738491fd133fb39fff6b4366c74cb001cfe1a24455738796bafe758e3be592 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, GIT_CLEAN=True) 2024-05-09T06:37:46.088 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:45 smithi046 podman[132880]: 2024-05-09 06:37:45.858282722 +0000 UTC m=+0.560702168 container remove 83738491fd133fb39fff6b4366c74cb001cfe1a24455738796bafe758e3be592 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-09T06:37:46.088 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:45 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.2.service: Deactivated successfully. 2024-05-09T06:37:46.088 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:45 smithi046 systemd[1]: Stopped Ceph osd.2 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:37:46.088 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:45 smithi046 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.2.service: Consumed 1min 2.394s CPU time. 2024-05-09T06:37:46.088 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:46 smithi046 systemd[1]: Starting Ceph osd.2 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:37:46.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:46 smithi046 podman[132981]: 2024-05-09 06:37:46.231886261 +0000 UTC m=+0.018919398 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:46.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:46 smithi046 podman[132981]: 2024-05-09 06:37:46.342528903 +0000 UTC m=+0.129562040 container create 42bc4607a1524ce4f586bc15fa555af10ee15a98d90a4d4ed33f6535b6a56dba (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-09T06:37:46.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:46 smithi046 podman[132981]: 2024-05-09 06:37:46.570277824 +0000 UTC m=+0.357310962 container init 42bc4607a1524ce4f586bc15fa555af10ee15a98d90a4d4ed33f6535b6a56dba (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:37:46.585 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:46 smithi046 podman[132981]: 2024-05-09 06:37:46.573952583 +0000 UTC m=+0.360985722 container start 42bc4607a1524ce4f586bc15fa555af10ee15a98d90a4d4ed33f6535b6a56dba (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:37:47.057 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:46 smithi046 podman[132981]: 2024-05-09 06:37:46.678657885 +0000 UTC m=+0.465691023 container attach 42bc4607a1524ce4f586bc15fa555af10ee15a98d90a4d4ed33f6535b6a56dba (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-09T06:37:47.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:47 smithi046 ceph-mon[110713]: pgmap v92: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:47.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:47.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:47.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:47.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 bash[132981]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate[132996]: --> ceph-volume raw activate successful for osd ID: 2 2024-05-09T06:37:47.336 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 podman[132981]: 2024-05-09 06:37:47.103371618 +0000 UTC m=+0.890404750 container died 42bc4607a1524ce4f586bc15fa555af10ee15a98d90a4d4ed33f6535b6a56dba (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-09T06:37:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:47 smithi106 ceph-mon[81208]: pgmap v92: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:37:48.079 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:47 smithi046 podman[133125]: 2024-05-09 06:37:47.840793789 +0000 UTC m=+0.731519080 container remove 42bc4607a1524ce4f586bc15fa555af10ee15a98d90a4d4ed33f6535b6a56dba (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-09T06:37:48.080 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 podman[133189]: 2024-05-09 06:37:47.972598705 +0000 UTC m=+0.019179698 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:37:48.080 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 podman[133189]: 2024-05-09 06:37:48.100193038 +0000 UTC m=+0.146774075 container create 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-09T06:37:48.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:48 smithi046 ceph-mon[110713]: Health check failed: Degraded data redundancy: 32/219 objects degraded (14.612%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:48.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:48 smithi106 ceph-mon[81208]: Health check failed: Degraded data redundancy: 32/219 objects degraded (14.612%), 11 pgs degraded (PG_DEGRADED) 2024-05-09T06:37:48.836 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 podman[133189]: 2024-05-09 06:37:48.361430512 +0000 UTC m=+0.408011514 container init 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux ) 2024-05-09T06:37:48.836 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 podman[133189]: 2024-05-09 06:37:48.365291177 +0000 UTC m=+0.411872170 container start 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, ceph=True, io.buildah.version=1.33.5) 2024-05-09T06:37:48.836 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 ceph-osd[133208]: -- 172.21.15.46:0/4183655480 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616db007680 con 0x5616dafd1000 2024-05-09T06:37:48.836 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 bash[133189]: 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca 2024-05-09T06:37:48.836 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 systemd[1]: Started Ceph osd.2 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:37:49.317 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:48 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[133204]: 2024-05-09T06:37:48.905+0000 7f42825417c0 -1 Falling back to public interface 2024-05-09T06:37:49.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:49 smithi046 ceph-mon[110713]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:49.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:49.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:49.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:49 smithi106 ceph-mon[81208]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:37:51.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:51 smithi106 ceph-mon[81208]: pgmap v94: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:51.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:51 smithi046 ceph-mon[110713]: pgmap v94: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:53.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:53 smithi106 ceph-mon[81208]: pgmap v95: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:53.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:53 smithi046 ceph-mon[110713]: pgmap v95: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:54.335 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:53 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[133204]: 2024-05-09T06:37:53.909+0000 7f42825417c0 -1 osd.2 59 log_to_monitors true 2024-05-09T06:37:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:54 smithi106 ceph-mon[81208]: from='osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:37:55.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:54 smithi106 ceph-mon[81208]: pgmap v96: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:54 smithi046 ceph-mon[110713]: from='osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T06:37:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:54 smithi046 ceph-mon[110713]: pgmap v96: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:55.085 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:37:54 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[133204]: 2024-05-09T06:37:54.813+0000 7f4273998700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:37:55.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:55 smithi046 ceph-mon[110713]: from='osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:37:55.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:55 smithi046 ceph-mon[110713]: osdmap e62: 6 total, 5 up, 6 in 2024-05-09T06:37:55.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:55 smithi046 ceph-mon[110713]: from='osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:37:55.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:55 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:55.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:55 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:56.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:55 smithi106 ceph-mon[81208]: from='osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T06:37:56.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:55 smithi106 ceph-mon[81208]: osdmap e62: 6 total, 5 up, 6 in 2024-05-09T06:37:56.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:55 smithi106 ceph-mon[81208]: from='osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-05-09T06:37:56.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:55 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:56.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:55 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:56.978 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:56 smithi046 ceph-mon[110713]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:56.978 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:56 smithi046 ceph-mon[110713]: osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436] boot 2024-05-09T06:37:56.978 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:56 smithi046 ceph-mon[110713]: osdmap e63: 6 total, 6 up, 6 in 2024-05-09T06:37:56.978 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:56 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:37:56.978 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:56 smithi046 ceph-mon[110713]: pgmap v99: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:57.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:56 smithi106 ceph-mon[81208]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:37:57.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:56 smithi106 ceph-mon[81208]: osd.2 [v2:172.21.15.46:6818/3927170436,v1:172.21.15.46:6819/3927170436] boot 2024-05-09T06:37:57.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:56 smithi106 ceph-mon[81208]: osdmap e63: 6 total, 6 up, 6 in 2024-05-09T06:37:57.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:56 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T06:37:57.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:56 smithi106 ceph-mon[81208]: pgmap v99: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2024-05-09T06:37:58.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:57 smithi106 ceph-mon[81208]: osdmap e64: 6 total, 6 up, 6 in 2024-05-09T06:37:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:57 smithi046 ceph-mon[110713]: osdmap e64: 6 total, 6 up, 6 in 2024-05-09T06:37:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:37:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:37:59.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:58 smithi106 ceph-mon[81208]: pgmap v101: 65 pgs: 5 peering, 5 active+undersized+degraded, 4 active+undersized, 51 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18/219 objects degraded (8.219%) 2024-05-09T06:37:59.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:58 smithi046 ceph-mon[110713]: pgmap v101: 65 pgs: 5 peering, 5 active+undersized+degraded, 4 active+undersized, 51 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18/219 objects degraded (8.219%) 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 18/219 objects degraded (8.219%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:00.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:00.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:00.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:37:59 smithi106 ceph-mon[81208]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 18/219 objects degraded (8.219%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:00.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:00.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:37:59 smithi046 ceph-mon[110713]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-05-09T06:38:01.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:00 smithi106 ceph-mon[81208]: pgmap v102: 65 pgs: 5 peering, 60 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:01.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:00 smithi046 ceph-mon[110713]: pgmap v102: 65 pgs: 5 peering, 60 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:02.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:01 smithi106 ceph-mon[81208]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/219 objects degraded (8.219%), 5 pgs degraded) 2024-05-09T06:38:02.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:01 smithi046 ceph-mon[110713]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/219 objects degraded (8.219%), 5 pgs degraded) 2024-05-09T06:38:03.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:02 smithi106 ceph-mon[81208]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:03.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:02 smithi046 ceph-mon[110713]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:05.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:05 smithi106 ceph-mon[81208]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:05.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:05 smithi046 ceph-mon[110713]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:07.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:07 smithi106 ceph-mon[81208]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:07.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:07 smithi046 ceph-mon[110713]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:08.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:08.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:09.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:09 smithi106 ceph-mon[81208]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:09.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:09 smithi046 ceph-mon[110713]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:11.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:11 smithi046 ceph-mon[110713]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 -- 172.21.15.46:0/2839903226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 msgr2=0x7fcf781021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/2839903226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf781021f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf68004940 tx=0x7fcf68009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 -- 172.21.15.46:0/2839903226 shutdown_connections 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/2839903226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf780fc710 0x7fcf780fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/2839903226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf781021f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 -- 172.21.15.46:0/2839903226 >> 172.21.15.46:0/2839903226 conn(0x7fcf78071460 msgr2=0x7fcf78071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:11.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 -- 172.21.15.46:0/2839903226 shutdown_connections 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.507+0000 7fcf7e44e700 1 -- 172.21.15.46:0/2839903226 wait complete. 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf7e44e700 1 Processor -- start 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf7e44e700 1 -- start start 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf7e44e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf780fc710 0x7fcf78113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf7e44e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf78114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf7e44e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf781146b0 con 0x7fcf78101e20 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf7e44e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7810daa0 con 0x7fcf780fc710 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf6ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf78114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf6ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf78114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41832/0 (socket says 172.21.15.46:41832) 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf6ffff700 1 -- 172.21.15.46:0/1659544709 learned_addr learned my addr 172.21.15.46:0/1659544709 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf77fff700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf780fc710 0x7fcf78113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf6ffff700 1 -- 172.21.15.46:0/1659544709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf780fc710 msgr2=0x7fcf78113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:11.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf6ffff700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf780fc710 0x7fcf78113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.508+0000 7fcf6ffff700 1 -- 172.21.15.46:0/1659544709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68005040 con 0x7fcf78101e20 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.509+0000 7fcf6ffff700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf78114060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000c8c0 tx=0x7fcf600044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.509+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6000a760 con 0x7fcf78101e20 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.509+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7810dd80 con 0x7fcf78101e20 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.509+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf6000ad90 con 0x7fcf78101e20 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.509+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf600113a0 con 0x7fcf78101e20 2024-05-09T06:38:11.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.509+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7810e340 con 0x7fcf78101e20 2024-05-09T06:38:11.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.510+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf780652f0 con 0x7fcf78101e20 2024-05-09T06:38:11.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.511+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fcf60012400 con 0x7fcf78101e20 2024-05-09T06:38:11.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.511+0000 7fcf757fa700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcf64078990 0x7fcf6407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:11.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.512+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcf6009a680 con 0x7fcf78101e20 2024-05-09T06:38:11.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.512+0000 7fcf77fff700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcf64078990 0x7fcf6407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:11.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.512+0000 7fcf77fff700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcf64078990 0x7fcf6407ae40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf68004f90 tx=0x7fcf68009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:11.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.516+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fcf600623a0 con 0x7fcf78101e20 2024-05-09T06:38:11.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:11 smithi106 ceph-mon[81208]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.752+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf781137f0 con 0x7fcf64078990 2024-05-09T06:38:11.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.753+0000 7fcf757fa700 1 -- 172.21.15.46:0/1659544709 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcf781137f0 con 0x7fcf64078990 2024-05-09T06:38:11.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcf64078990 msgr2=0x7fcf6407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:11.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcf64078990 0x7fcf6407ae40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf68004f90 tx=0x7fcf68009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:11.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 msgr2=0x7fcf78114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:11.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf78114060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000c8c0 tx=0x7fcf600044c0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 shutdown_connections 2024-05-09T06:38:11.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcf64078990 0x7fcf6407ae40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf780fc710 0x7fcf78113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 --2- 172.21.15.46:0/1659544709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf78101e20 0x7fcf78114060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 >> 172.21.15.46:0/1659544709 conn(0x7fcf78071460 msgr2=0x7fcf780ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:11.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 shutdown_connections 2024-05-09T06:38:11.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.756+0000 7fcf7e44e700 1 -- 172.21.15.46:0/1659544709 wait complete. 2024-05-09T06:38:11.747 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:38:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 -- 172.21.15.46:0/4053915495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 msgr2=0x7f543c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 --2- 172.21.15.46:0/4053915495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c1031b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5430004940 tx=0x7f5430009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 -- 172.21.15.46:0/4053915495 shutdown_connections 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 --2- 172.21.15.46:0/4053915495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 0x7f543c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 --2- 172.21.15.46:0/4053915495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c1031b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 -- 172.21.15.46:0/4053915495 >> 172.21.15.46:0/4053915495 conn(0x7f543c0f8990 msgr2=0x7f543c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 -- 172.21.15.46:0/4053915495 shutdown_connections 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 -- 172.21.15.46:0/4053915495 wait complete. 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 Processor -- start 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.863+0000 7f5442c74700 1 -- start start 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5442c74700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5442c74700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 0x7f543c113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5442c74700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c114500 con 0x7f543c102de0 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5442c74700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c10db50 con 0x7f543c103780 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41852/0 (socket says 172.21.15.46:41852) 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 -- 172.21.15.46:0/3187073279 learned_addr learned my addr 172.21.15.46:0/3187073279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f543bfff700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 0x7f543c113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 -- 172.21.15.46:0/3187073279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 msgr2=0x7f543c113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 0x7f543c113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 -- 172.21.15.46:0/3187073279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430005040 con 0x7f543c102de0 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f543bfff700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 0x7f543c113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.864+0000 7f5440a10700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c113970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f543000b3b0 tx=0x7f5430009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:11.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.865+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543000e040 con 0x7f543c102de0 2024-05-09T06:38:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.865+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c10ddd0 con 0x7f543c102de0 2024-05-09T06:38:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.865+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f543000bbc0 con 0x7f543c102de0 2024-05-09T06:38:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.865+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543001c3f0 con 0x7f543c102de0 2024-05-09T06:38:11.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.865+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c10e390 con 0x7f543c102de0 2024-05-09T06:38:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.866+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c1000f0 con 0x7f543c102de0 2024-05-09T06:38:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.866+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f543000bd30 con 0x7f543c102de0 2024-05-09T06:38:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.867+0000 7f54397fa700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f542c078990 0x7f542c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.867+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f543009b900 con 0x7f543c102de0 2024-05-09T06:38:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.867+0000 7f543bfff700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f542c078990 0x7f542c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:11.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.867+0000 7f543bfff700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f542c078990 0x7f542c07ae40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5428009fd0 tx=0x7f542800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:11.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:11.872+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f54300635c0 con 0x7f543c102de0 2024-05-09T06:38:12.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.106+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f543c10efc0 con 0x7f542c078990 2024-05-09T06:38:12.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.107+0000 7f54397fa700 1 -- 172.21.15.46:0/3187073279 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f543c10efc0 con 0x7f542c078990 2024-05-09T06:38:12.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f542c078990 msgr2=0x7f542c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f542c078990 0x7f542c07ae40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5428009fd0 tx=0x7f542800b040 comp rx=0 tx=0).stop 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 msgr2=0x7f543c113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c113970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f543000b3b0 tx=0x7f5430009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 shutdown_connections 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f542c078990 0x7f542c07ae40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543c102de0 0x7f543c113970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.109+0000 7f5442c74700 1 --2- 172.21.15.46:0/3187073279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543c103780 0x7f543c113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.110+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 >> 172.21.15.46:0/3187073279 conn(0x7f543c0f8990 msgr2=0x7f543c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:12.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.110+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 shutdown_connections 2024-05-09T06:38:12.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.110+0000 7f5442c74700 1 -- 172.21.15.46:0/3187073279 wait complete. 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 -- 172.21.15.46:0/1015532072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 msgr2=0x7f5224102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 --2- 172.21.15.46:0/1015532072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224102160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5214004940 tx=0x7f5214009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 -- 172.21.15.46:0/1015532072 shutdown_connections 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 --2- 172.21.15.46:0/1015532072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52240fbd40 0x7f52240fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 --2- 172.21.15.46:0/1015532072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224102160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 -- 172.21.15.46:0/1015532072 >> 172.21.15.46:0/1015532072 conn(0x7f5224071d00 msgr2=0x7f5224072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 -- 172.21.15.46:0/1015532072 shutdown_connections 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.218+0000 7f522a100700 1 -- 172.21.15.46:0/1015532072 wait complete. 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f522a100700 1 Processor -- start 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f522a100700 1 -- start start 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f522a100700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52240fbd40 0x7f5224113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f522a100700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f522a100700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52241146e0 con 0x7f5224101d90 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f522a100700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522410dad0 con 0x7f52240fbd40 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f521bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f521bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41868/0 (socket says 172.21.15.46:41868) 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f521bfff700 1 -- 172.21.15.46:0/1947545326 learned_addr learned my addr 172.21.15.46:0/1947545326 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f52237fe700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52240fbd40 0x7f5224113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f521bfff700 1 -- 172.21.15.46:0/1947545326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52240fbd40 msgr2=0x7f5224113b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f521bfff700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52240fbd40 0x7f5224113b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.219+0000 7f521bfff700 1 -- 172.21.15.46:0/1947545326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214005040 con 0x7f5224101d90 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.220+0000 7f521bfff700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224114090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f520c002a50 tx=0x7f520c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.220+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520c007cc0 con 0x7f5224101d90 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.220+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f520c00f040 con 0x7f5224101d90 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.220+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522410ddb0 con 0x7f5224101d90 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.220+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520c009640 con 0x7f5224101d90 2024-05-09T06:38:12.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.220+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522410e370 con 0x7f5224101d90 2024-05-09T06:38:12.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.221+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52240fd430 con 0x7f5224101d90 2024-05-09T06:38:12.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.222+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f520c0097a0 con 0x7f5224101d90 2024-05-09T06:38:12.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.222+0000 7f5220ff9700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5210078980 0x7f521007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.222+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f520c09a480 con 0x7f5224101d90 2024-05-09T06:38:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.222+0000 7f52237fe700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5210078980 0x7f521007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.223+0000 7f52237fe700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5210078980 0x7f521007ae30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f521400b020 tx=0x7f5214009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:12.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.227+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f520c062140 con 0x7f5224101d90 2024-05-09T06:38:12.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.449+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5224108df0 con 0x7f5210078980 2024-05-09T06:38:12.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.461+0000 7f5220ff9700 1 -- 172.21.15.46:0/1947545326 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5224108df0 con 0x7f5210078980 2024-05-09T06:38:12.441 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (4m) 18s ago 16m 24.3M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (2m) 18s ago 16m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (118s) 115s ago 15m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (4m) 18s ago 15m 79.8M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (10m) 18s ago 10m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (10m) 18s ago 10m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:38:12.442 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (10m) 115s ago 10m 17.9M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (10m) 115s ago 10m 15.6M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (7m) 18s ago 17m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (6m) 115s ago 15m 464M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (3m) 18s ago 17m 49.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (2m) 115s ago 14m 32.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 18s ago 16m 15.1M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (5m) 115s ago 15m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:38:12.443 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (97s) 18s ago 14m 96.8M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:38:12.444 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (61s) 18s ago 13m 102M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:38:12.444 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (24s) 18s ago 13m 15.0M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:38:12.444 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (12m) 115s ago 12m 289M 2581M 17.2.7-933-g4ba5a836 b96134859c76 7954a8e5ad92 2024-05-09T06:38:12.444 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (12m) 115s ago 12m 262M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:38:12.444 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (12m) 115s ago 12m 238M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:38:12.444 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 18s ago 15m 66.6M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:38:12.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5210078980 msgr2=0x7f521007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5210078980 0x7f521007ae30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f521400b020 tx=0x7f5214009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:12.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 msgr2=0x7f5224114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224114090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f520c002a50 tx=0x7f520c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 shutdown_connections 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5210078980 0x7f521007ae30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52240fbd40 0x7f5224113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 --2- 172.21.15.46:0/1947545326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5224101d90 0x7f5224114090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 >> 172.21.15.46:0/1947545326 conn(0x7f5224071d00 msgr2=0x7f5224065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 shutdown_connections 2024-05-09T06:38:12.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.463+0000 7f522a100700 1 -- 172.21.15.46:0/1947545326 wait complete. 2024-05-09T06:38:12.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 -- 172.21.15.46:0/3819393757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0103780 msgr2=0x7f5fb00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 --2- 172.21.15.46:0/3819393757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0103780 0x7f5fb00fcdf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4004940 tx=0x7f5fa4009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 -- 172.21.15.46:0/3819393757 shutdown_connections 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 --2- 172.21.15.46:0/3819393757 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0103780 0x7f5fb00fcdf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 --2- 172.21.15.46:0/3819393757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102de0 0x7f5fb01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 -- 172.21.15.46:0/3819393757 >> 172.21.15.46:0/3819393757 conn(0x7f5fb00f8990 msgr2=0x7f5fb00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 -- 172.21.15.46:0/3819393757 shutdown_connections 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.568+0000 7f5fb551c700 1 -- 172.21.15.46:0/3819393757 wait complete. 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fb551c700 1 Processor -- start 2024-05-09T06:38:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fb551c700 1 -- start start 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fb551c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 0x7f5fb0115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fb551c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0103780 0x7f5fb01160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fb551c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0116720 con 0x7f5fb0102de0 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fb551c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb010fd00 con 0x7f5fb0103780 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5faeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 0x7f5fb0115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5faeffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 0x7f5fb0115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41886/0 (socket says 172.21.15.46:41886) 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5faeffd700 1 -- 172.21.15.46:0/2321145248 learned_addr learned my addr 172.21.15.46:0/2321145248 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fae7fc700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0103780 0x7f5fb01160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5faeffd700 1 -- 172.21.15.46:0/2321145248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0103780 msgr2=0x7f5fb01160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5faeffd700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0103780 0x7f5fb01160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5faeffd700 1 -- 172.21.15.46:0/2321145248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4005040 con 0x7f5fb0102de0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.569+0000 7f5fae7fc700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0103780 0x7f5fb01160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.570+0000 7f5faeffd700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 0x7f5fb0115b90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001d80 tx=0x7f5fa0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.570+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa0007d10 con 0x7f5fb0102de0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.570+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb010ffe0 con 0x7f5fb0102de0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.570+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fa0007e70 con 0x7f5fb0102de0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.570+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa0014640 con 0x7f5fb0102de0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.570+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb01105a0 con 0x7f5fb0102de0 2024-05-09T06:38:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.571+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00fe530 con 0x7f5fb0102de0 2024-05-09T06:38:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.572+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f5fa000e960 con 0x7f5fb0102de0 2024-05-09T06:38:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.572+0000 7f5f977fe700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5f98078990 0x7f5f9807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.572+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5fa009a390 con 0x7f5fb0102de0 2024-05-09T06:38:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.572+0000 7f5fae7fc700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5f98078990 0x7f5f9807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.573+0000 7f5fae7fc700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5f98078990 0x7f5f9807ae40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b3b0 tx=0x7f5fa4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:12.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.577+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f5fa0062180 con 0x7f5fb0102de0 2024-05-09T06:38:12.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.889+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5fb01111e0 con 0x7f5fb0102de0 2024-05-09T06:38:12.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.890+0000 7f5f977fe700 1 -- 172.21.15.46:0/2321145248 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f5fa0061b20 con 0x7f5fb0102de0 2024-05-09T06:38:12.870 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:38:12.870 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:38:12.870 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:38:12.870 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:12.870 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 3, 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 3 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 7, 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 7 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:38:12.871 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:38:12.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5f98078990 msgr2=0x7f5f9807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5f98078990 0x7f5f9807ae40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b3b0 tx=0x7f5fa4009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 msgr2=0x7f5fb0115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 0x7f5fb0115b90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0001d80 tx=0x7f5fa0009ec0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 shutdown_connections 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5f98078990 0x7f5f9807ae40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb0102de0 0x7f5fb0115b90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 --2- 172.21.15.46:0/2321145248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0103780 0x7f5fb01160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 >> 172.21.15.46:0/2321145248 conn(0x7f5fb00f8990 msgr2=0x7f5fb0071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 shutdown_connections 2024-05-09T06:38:12.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.892+0000 7f5fb551c700 1 -- 172.21.15.46:0/2321145248 wait complete. 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 -- 172.21.15.46:0/1660242340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c1026b0 msgr2=0x7f2f4c0fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/1660242340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c1026b0 0x7f2f4c0fbd20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f40004940 tx=0x7f2f40009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 -- 172.21.15.46:0/1660242340 shutdown_connections 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/1660242340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c1026b0 0x7f2f4c0fbd20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/1660242340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 -- 172.21.15.46:0/1660242340 >> 172.21.15.46:0/1660242340 conn(0x7f2f4c0f7860 msgr2=0x7f2f4c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 -- 172.21.15.46:0/1660242340 shutdown_connections 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:12.999+0000 7f2f50ccd700 1 -- 172.21.15.46:0/1660242340 wait complete. 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f50ccd700 1 Processor -- start 2024-05-09T06:38:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f50ccd700 1 -- start start 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f50ccd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f50ccd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f4c1026b0 0x7f2f4c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f50ccd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c114530 con 0x7f2f4c101d10 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f50ccd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c10db30 con 0x7f2f4c1026b0 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f4a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f4a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41918/0 (socket says 172.21.15.46:41918) 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f4a59c700 1 -- 172.21.15.46:0/3412014356 learned_addr learned my addr 172.21.15.46:0/3412014356 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.000+0000 7f2f49d9b700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f4c1026b0 0x7f2f4c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f4a59c700 1 -- 172.21.15.46:0/3412014356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f4c1026b0 msgr2=0x7f2f4c113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f4a59c700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f4c1026b0 0x7f2f4c113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f4a59c700 1 -- 172.21.15.46:0/3412014356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40005040 con 0x7f2f4c101d10 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f4a59c700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1139a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c002a50 tx=0x7f2f3c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c007cc0 con 0x7f2f4c101d10 2024-05-09T06:38:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f3c00f040 con 0x7f2f4c101d10 2024-05-09T06:38:12.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c10de10 con 0x7f2f4c101d10 2024-05-09T06:38:12.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c009640 con 0x7f2f4c101d10 2024-05-09T06:38:12.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.001+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c10e3a0 con 0x7f2f4c101d10 2024-05-09T06:38:12.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.002+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c0fd460 con 0x7f2f4c101d10 2024-05-09T06:38:12.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.003+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2f3c0097a0 con 0x7f2f4c101d10 2024-05-09T06:38:12.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.003+0000 7f2f3affd700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2f34078980 0x7f2f3407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:12.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.003+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2f3c09a380 con 0x7f2f4c101d10 2024-05-09T06:38:12.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.003+0000 7f2f49d9b700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2f34078980 0x7f2f3407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:12.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.004+0000 7f2f49d9b700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2f34078980 0x7f2f3407ae30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c10f2d0 tx=0x7f2f40009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:12.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.008+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2f3c0620c0 con 0x7f2f4c101d10 2024-05-09T06:38:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.270+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f4c108e40 con 0x7f2f4c101d10 2024-05-09T06:38:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.271+0000 7f2f3affd700 1 -- 172.21.15.46:0/3412014356 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f2f3c061a60 con 0x7f2f4c101d10 2024-05-09T06:38:13.252 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:38:13.252 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:38:13.252 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:38:13.252 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:38:13.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:13.252 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:38:13.253 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:38:13.254 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:38:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:38:13.256 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:38:13.256 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:38:13.256 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:38:13.256 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:38:13.257 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:38:13.257 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:38:13.257 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:38:13.257 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:13.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:13.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:13.258 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:38:13.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:13.258 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:13.258 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:13.258 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2f34078980 msgr2=0x7f2f3407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2f34078980 0x7f2f3407ae30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c10f2d0 tx=0x7f2f40009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 msgr2=0x7f2f4c1139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1139a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c002a50 tx=0x7f2f3c0046b0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 shutdown_connections 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2f34078980 0x7f2f3407ae30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f4c101d10 0x7f2f4c1139a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 --2- 172.21.15.46:0/3412014356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f4c1026b0 0x7f2f4c113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 >> 172.21.15.46:0/3412014356 conn(0x7f2f4c0f7860 msgr2=0x7f2f4c0662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 shutdown_connections 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.274+0000 7f2f50ccd700 1 -- 172.21.15.46:0/3412014356 wait complete. 2024-05-09T06:38:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:38:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 -- 172.21.15.46:0/1759213107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240102670 msgr2=0x7f12400fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 --2- 172.21.15.46:0/1759213107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240102670 0x7f12400fb600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1234004940 tx=0x7f1234009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 -- 172.21.15.46:0/1759213107 shutdown_connections 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 --2- 172.21.15.46:0/1759213107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240102670 0x7f12400fb600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 --2- 172.21.15.46:0/1759213107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240101cd0 0x7f12401020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 -- 172.21.15.46:0/1759213107 >> 172.21.15.46:0/1759213107 conn(0x7f1240071460 msgr2=0x7f1240071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 -- 172.21.15.46:0/1759213107 shutdown_connections 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.381+0000 7f1245e87700 1 -- 172.21.15.46:0/1759213107 wait complete. 2024-05-09T06:38:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f1245e87700 1 Processor -- start 2024-05-09T06:38:13.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f1245e87700 1 -- start start 2024-05-09T06:38:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f1245e87700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 0x7f1240113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f1245e87700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240102670 0x7f12401140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f1245e87700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240114740 con 0x7f1240101cd0 2024-05-09T06:38:13.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f1245e87700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124010db30 con 0x7f1240102670 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 0x7f1240113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 0x7f1240113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41924/0 (socket says 172.21.15.46:41924) 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123f7fe700 1 -- 172.21.15.46:0/28453780 learned_addr learned my addr 172.21.15.46:0/28453780 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123effd700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240102670 0x7f12401140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123f7fe700 1 -- 172.21.15.46:0/28453780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240102670 msgr2=0x7f12401140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123f7fe700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240102670 0x7f12401140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123f7fe700 1 -- 172.21.15.46:0/28453780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234005040 con 0x7f1240101cd0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.382+0000 7f123effd700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240102670 0x7f12401140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.383+0000 7f123f7fe700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 0x7f1240113bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f123000c830 tx=0x7f1230004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.383+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123000a760 con 0x7f1240101cd0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.383+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124010de10 con 0x7f1240101cd0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.383+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f123000ad90 con 0x7f1240101cd0 2024-05-09T06:38:13.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.383+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12300113a0 con 0x7f1240101cd0 2024-05-09T06:38:13.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.383+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124010e3d0 con 0x7f1240101cd0 2024-05-09T06:38:13.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.384+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1240065200 con 0x7f1240101cd0 2024-05-09T06:38:13.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.385+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f1230012400 con 0x7f1240101cd0 2024-05-09T06:38:13.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.385+0000 7f1227fff700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1228078980 0x7f122807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:13.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.385+0000 7f123effd700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1228078980 0x7f122807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:13.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.385+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f123009a6c0 con 0x7f1240101cd0 2024-05-09T06:38:13.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.386+0000 7f123effd700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1228078980 0x7f122807ae30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f124010ecf0 tx=0x7f1234009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:13.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.390+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f1230062400 con 0x7f1240101cd0 2024-05-09T06:38:13.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:13 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2321145248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: pgmap v108: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:13 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2321145248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:13.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.626+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1240109ed0 con 0x7f1228078980 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.627+0000 7f1227fff700 1 -- 172.21.15.46:0/28453780 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1240109ed0 con 0x7f1228078980 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:38:13.607 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:38:13.608 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:38:13.608 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "9/21 daemons upgraded", 2024-05-09T06:38:13.608 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:38:13.608 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:38:13.608 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1228078980 msgr2=0x7f122807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1228078980 0x7f122807ae30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f124010ecf0 tx=0x7f1234009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 msgr2=0x7f1240113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 0x7f1240113bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f123000c830 tx=0x7f1230004470 comp rx=0 tx=0).stop 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 shutdown_connections 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1228078980 0x7f122807ae30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1240101cd0 0x7f1240113bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 --2- 172.21.15.46:0/28453780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1240102670 0x7f12401140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.629+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 >> 172.21.15.46:0/28453780 conn(0x7f1240071460 msgr2=0x7f12401009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.630+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 shutdown_connections 2024-05-09T06:38:13.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.630+0000 7f1245e87700 1 -- 172.21.15.46:0/28453780 wait complete. 2024-05-09T06:38:13.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 -- 172.21.15.46:0/3935852569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 msgr2=0x7f1c6c065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 --2- 172.21.15.46:0/3935852569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c065ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c58004940 tx=0x7f1c58009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:13.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 -- 172.21.15.46:0/3935852569 shutdown_connections 2024-05-09T06:38:13.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 --2- 172.21.15.46:0/3935852569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c065ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 --2- 172.21.15.46:0/3935852569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c102e50 0x7f1c6c103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 -- 172.21.15.46:0/3935852569 >> 172.21.15.46:0/3935852569 conn(0x7f1c6c071d00 msgr2=0x7f1c6c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:13.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 -- 172.21.15.46:0/3935852569 shutdown_connections 2024-05-09T06:38:13.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.736+0000 7f1c73177700 1 -- 172.21.15.46:0/3935852569 wait complete. 2024-05-09T06:38:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c73177700 1 Processor -- start 2024-05-09T06:38:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c73177700 1 -- start start 2024-05-09T06:38:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c73177700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c73177700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c102e50 0x7f1c6c1140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c73177700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c114700 con 0x7f1c6c065640 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c73177700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c10daf0 con 0x7f1c6c102e50 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c70f13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c70f13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41956/0 (socket says 172.21.15.46:41956) 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c70f13700 1 -- 172.21.15.46:0/3053097035 learned_addr learned my addr 172.21.15.46:0/3053097035 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.737+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c102e50 0x7f1c6c1140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c70f13700 1 -- 172.21.15.46:0/3053097035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c102e50 msgr2=0x7f1c6c1140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c70f13700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c102e50 0x7f1c6c1140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c70f13700 1 -- 172.21.15.46:0/3053097035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58005040 con 0x7f1c6c065640 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c70f13700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c113b70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c60002a50 tx=0x7f1c600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c60007cc0 con 0x7f1c6c065640 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c10ddd0 con 0x7f1c6c065640 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c6000f040 con 0x7f1c6c065640 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6000da30 con 0x7f1c6c065640 2024-05-09T06:38:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.738+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c10e360 con 0x7f1c6c065640 2024-05-09T06:38:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.739+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c100100 con 0x7f1c6c065640 2024-05-09T06:38:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.740+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f1c6000db90 con 0x7f1c6c065640 2024-05-09T06:38:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.740+0000 7f1c697fa700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1c5c078990 0x7f1c5c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.740+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1c5c078990 0x7f1c5c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:13.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.740+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1c6009a420 con 0x7f1c6c065640 2024-05-09T06:38:13.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.741+0000 7f1c6bfff700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1c5c078990 0x7f1c5c07ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c10edd0 tx=0x7f1c58009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:13.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:13.745+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f1c600620e0 con 0x7f1c6c065640 2024-05-09T06:38:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.051+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1c6c10f220 con 0x7f1c6c065640 2024-05-09T06:38:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.051+0000 7f1c697fa700 1 -- 172.21.15.46:0/3053097035 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1c60061a80 con 0x7f1c6c065640 2024-05-09T06:38:14.032 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:38:14.032 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:38:14.032 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1c5c078990 msgr2=0x7f1c5c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1c5c078990 0x7f1c5c07ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c10edd0 tx=0x7f1c58009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 msgr2=0x7f1c6c113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c113b70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c60002a50 tx=0x7f1c600046b0 comp rx=0 tx=0).stop 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 shutdown_connections 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1c5c078990 0x7f1c5c07ae40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c6c065640 0x7f1c6c113b70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 --2- 172.21.15.46:0/3053097035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c6c102e50 0x7f1c6c1140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 >> 172.21.15.46:0/3053097035 conn(0x7f1c6c071d00 msgr2=0x7f1c6c0fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 shutdown_connections 2024-05-09T06:38:14.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:14.054+0000 7f1c73177700 1 -- 172.21.15.46:0/3053097035 wait complete. 2024-05-09T06:38:14.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:14 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3412014356' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:38:14.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:14 smithi046 ceph-mon[110713]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:14.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:14 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:14.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:14 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3053097035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:14.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:14 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3412014356' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:38:14.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:14 smithi106 ceph-mon[81208]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:14.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:14 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:14.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:14 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3053097035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:15.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:15 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:15.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:15 smithi106 ceph-mon[81208]: Upgrade: osd.3 is safe to restart 2024-05-09T06:38:15.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:15 smithi106 ceph-mon[81208]: pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:15.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:15 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-05-09T06:38:15.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:15 smithi046 ceph-mon[110713]: Upgrade: osd.3 is safe to restart 2024-05-09T06:38:15.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:15 smithi046 ceph-mon[110713]: pgmap v109: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:16.785 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:16 smithi106 ceph-mon[81208]: Upgrade: Updating osd.3 2024-05-09T06:38:16.786 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:16 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:16.786 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:16 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:38:16.786 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:16 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:16.786 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:16 smithi106 ceph-mon[81208]: Deploying daemon osd.3 on smithi106 2024-05-09T06:38:16.786 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:16 smithi106 ceph-mon[81208]: pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:17.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:16 smithi046 ceph-mon[110713]: Upgrade: Updating osd.3 2024-05-09T06:38:17.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:17.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T06:38:17.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:17.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:16 smithi046 ceph-mon[110713]: Deploying daemon osd.3 on smithi106 2024-05-09T06:38:17.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:16 smithi046 ceph-mon[110713]: pgmap v110: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:19.033 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:18 smithi106 systemd[1]: Stopping Ceph osd.3 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:38:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:19 smithi106 ceph-mon[81208]: pgmap v111: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:19.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:19 smithi106 ceph-mon[81208]: osd.3 marked itself down and dead 2024-05-09T06:38:19.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:19 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[40271]: 2024-05-09T06:38:19.052+0000 7fce7a5ce700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:38:19.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:19 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[40271]: 2024-05-09T06:38:19.052+0000 7fce7a5ce700 -1 osd.3 64 *** Got signal Terminated *** 2024-05-09T06:38:19.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:19 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[40271]: 2024-05-09T06:38:19.052+0000 7fce7a5ce700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:38:19.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:19 smithi046 ceph-mon[110713]: pgmap v111: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:19.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:19 smithi046 ceph-mon[110713]: osd.3 marked itself down and dead 2024-05-09T06:38:20.016 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:19 smithi106 podman[89901]: 2024-05-09 06:38:19.779279388 +0000 UTC m=+0.824149112 container died 7954a8e5ad9299ec287b7ccb2d0e6cc1c97f952e65609dbcdcdb50f3a7896bda (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, RELEASE=quincy-4ba5a83, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:20.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:20 smithi106 ceph-mon[81208]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:20.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:20 smithi106 ceph-mon[81208]: osdmap e65: 6 total, 5 up, 6 in 2024-05-09T06:38:20.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 podman[89901]: 2024-05-09 06:38:20.127241692 +0000 UTC m=+1.172111413 container cleanup 7954a8e5ad9299ec287b7ccb2d0e6cc1c97f952e65609dbcdcdb50f3a7896bda (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=quincy-4ba5a83, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:20.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 bash[89901]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3 2024-05-09T06:38:20.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:20 smithi046 ceph-mon[110713]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:20.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:20 smithi046 ceph-mon[110713]: osdmap e65: 6 total, 5 up, 6 in 2024-05-09T06:38:20.740 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 podman[89918]: 2024-05-09 06:38:20.445435431 +0000 UTC m=+0.666104300 container remove 7954a8e5ad9299ec287b7ccb2d0e6cc1c97f952e65609dbcdcdb50f3a7896bda (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-09T06:38:21.070 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 podman[90011]: 2024-05-09 06:38:20.662968366 +0000 UTC m=+0.017760346 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:21.070 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 podman[90011]: 2024-05-09 06:38:20.771270367 +0000 UTC m=+0.126062340 container create 1fe9b78888d4602826536f35639593cbd4a218f7f4fa7626383c28bcffeed5f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:21.070 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 podman[90011]: 2024-05-09 06:38:20.990710775 +0000 UTC m=+0.345502749 container init 1fe9b78888d4602826536f35639593cbd4a218f7f4fa7626383c28bcffeed5f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:21.070 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:20 smithi106 podman[90011]: 2024-05-09 06:38:20.99447726 +0000 UTC m=+0.349269235 container start 1fe9b78888d4602826536f35639593cbd4a218f7f4fa7626383c28bcffeed5f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:21.070 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:21 smithi106 podman[90011]: 2024-05-09 06:38:21.090531708 +0000 UTC m=+0.445323700 container attach 1fe9b78888d4602826536f35639593cbd4a218f7f4fa7626383c28bcffeed5f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-05-09T06:38:21.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:21 smithi106 ceph-mon[81208]: pgmap v113: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:21.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:21 smithi106 ceph-mon[81208]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T06:38:21.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:21 smithi106 ceph-mon[81208]: osdmap e66: 6 total, 5 up, 6 in 2024-05-09T06:38:21.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:21 smithi106 podman[90011]: 2024-05-09 06:38:21.288447237 +0000 UTC m=+0.643239211 container died 1fe9b78888d4602826536f35639593cbd4a218f7f4fa7626383c28bcffeed5f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-09T06:38:21.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:21 smithi046 ceph-mon[110713]: pgmap v113: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:21.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:21 smithi046 ceph-mon[110713]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-09T06:38:21.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:21 smithi046 ceph-mon[110713]: osdmap e66: 6 total, 5 up, 6 in 2024-05-09T06:38:22.011 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:21 smithi106 podman[90036]: 2024-05-09 06:38:21.802156057 +0000 UTC m=+0.508047443 container remove 1fe9b78888d4602826536f35639593cbd4a218f7f4fa7626383c28bcffeed5f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-09T06:38:22.011 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:21 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-09T06:38:22.011 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:21 smithi106 systemd[1]: Stopped Ceph osd.3 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:38:22.011 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:21 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.3.service: Consumed 1min 14.792s CPU time. 2024-05-09T06:38:22.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:22 smithi106 ceph-mon[81208]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 3 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:22.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 systemd[1]: Starting Ceph osd.3 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:38:22.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 podman[90139]: 2024-05-09 06:38:22.245329658 +0000 UTC m=+0.111290039 container create 2b28a49edb05e8f795bca59b938405697e41835046f0402d5070beca25ec6c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-09T06:38:22.323 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 podman[90139]: 2024-05-09 06:38:22.152112022 +0000 UTC m=+0.018072360 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:22.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:22 smithi046 ceph-mon[110713]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 3 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:22.822 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 podman[90139]: 2024-05-09 06:38:22.481452298 +0000 UTC m=+0.347412646 container init 2b28a49edb05e8f795bca59b938405697e41835046f0402d5070beca25ec6c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:22.823 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 podman[90139]: 2024-05-09 06:38:22.485119909 +0000 UTC m=+0.351080251 container start 2b28a49edb05e8f795bca59b938405697e41835046f0402d5070beca25ec6c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-09T06:38:22.823 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 podman[90139]: 2024-05-09 06:38:22.581210118 +0000 UTC m=+0.447170458 container attach 2b28a49edb05e8f795bca59b938405697e41835046f0402d5070beca25ec6c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:38:23.235 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 bash[90139]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate[90154]: --> ceph-volume raw activate successful for osd ID: 3 2024-05-09T06:38:23.236 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:22 smithi106 podman[90139]: 2024-05-09 06:38:22.994663787 +0000 UTC m=+0.860624128 container died 2b28a49edb05e8f795bca59b938405697e41835046f0402d5070beca25ec6c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0) 2024-05-09T06:38:23.489 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:23 smithi106 ceph-mon[81208]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-05-09T06:38:23.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:23 smithi046 ceph-mon[110713]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-05-09T06:38:23.811 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:23 smithi106 podman[90294]: 2024-05-09 06:38:23.509973367 +0000 UTC m=+0.506569288 container remove 2b28a49edb05e8f795bca59b938405697e41835046f0402d5070beca25ec6c6a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-activate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-09T06:38:23.812 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:23 smithi106 podman[90356]: 2024-05-09 06:38:23.627633793 +0000 UTC m=+0.018081895 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:23.812 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:23 smithi106 podman[90356]: 2024-05-09 06:38:23.727326981 +0000 UTC m=+0.117775061 container create 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-09T06:38:24.072 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:23 smithi106 podman[90356]: 2024-05-09 06:38:23.91298633 +0000 UTC m=+0.303434418 container init 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:38:24.073 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:23 smithi106 podman[90356]: 2024-05-09 06:38:23.916083272 +0000 UTC m=+0.306531353 container start 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:24.073 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:23 smithi106 ceph-osd[90375]: -- 172.21.15.106:0/3420834321 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a90d135680 con 0x55a90d0fec00 2024-05-09T06:38:24.073 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:24 smithi106 bash[90356]: 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 2024-05-09T06:38:24.073 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:24 smithi106 systemd[1]: Started Ceph osd.3 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:38:24.822 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:24 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:38:24.464+0000 7f8e85b6c7c0 -1 Falling back to public interface 2024-05-09T06:38:25.112 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:25.112 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:25.112 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:25 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:25.112 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:25 smithi106 ceph-mon[81208]: pgmap v116: 65 pgs: 15 active+undersized+degraded, 4 peering, 19 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2024-05-09T06:38:25.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:25.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:25.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:25 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:25.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:25 smithi046 ceph-mon[110713]: pgmap v116: 65 pgs: 15 active+undersized+degraded, 4 peering, 19 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2024-05-09T06:38:26.566 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:26 smithi106 ceph-mon[81208]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T06:38:26.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:26 smithi046 ceph-mon[110713]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-09T06:38:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:27 smithi046 ceph-mon[110713]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:27.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:27.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:27.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:27.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:27 smithi106 ceph-mon[81208]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:27.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:29.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:29 smithi106 ceph-mon[81208]: pgmap v118: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:29.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:29 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:29.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:29 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:29 smithi046 ceph-mon[110713]: pgmap v118: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:29 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:29 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:30.022 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:38:29.695+0000 7f8e85b6c7c0 -1 osd.3 64 log_to_monitors true 2024-05-09T06:38:30.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:30 smithi106 ceph-mon[81208]: from='osd.3 [v2:172.21.15.106:6800/3686280688,v1:172.21.15.106:6801/3686280688]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:38:30.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:30 smithi106 ceph-mon[81208]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:38:30.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:30 smithi046 ceph-mon[110713]: from='osd.3 [v2:172.21.15.106:6800/3686280688,v1:172.21.15.106:6801/3686280688]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:38:30.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:30 smithi046 ceph-mon[110713]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T06:38:31.417 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:38:31 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:38:31.145+0000 7f8e72fbb700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:38:31.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:31 smithi106 ceph-mon[81208]: pgmap v119: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:31.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:31 smithi106 ceph-mon[81208]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:38:31.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:31 smithi106 ceph-mon[81208]: osdmap e67: 6 total, 5 up, 6 in 2024-05-09T06:38:31.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:31 smithi106 ceph-mon[81208]: from='osd.3 [v2:172.21.15.106:6800/3686280688,v1:172.21.15.106:6801/3686280688]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:38:31.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:31 smithi106 ceph-mon[81208]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:38:31.418 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:31 smithi106 ceph-mon[81208]: from='osd.3 ' entity='osd.3' 2024-05-09T06:38:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:31 smithi046 ceph-mon[110713]: pgmap v119: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:31 smithi046 ceph-mon[110713]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T06:38:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:31 smithi046 ceph-mon[110713]: osdmap e67: 6 total, 5 up, 6 in 2024-05-09T06:38:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:31 smithi046 ceph-mon[110713]: from='osd.3 [v2:172.21.15.106:6800/3686280688,v1:172.21.15.106:6801/3686280688]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:38:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:31 smithi046 ceph-mon[110713]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:38:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:31 smithi046 ceph-mon[110713]: from='osd.3 ' entity='osd.3' 2024-05-09T06:38:32.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 46/219 objects degraded (21.005%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:32.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:32.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:32.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:32.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: osd.3 [v2:172.21.15.106:6800/3686280688,v1:172.21.15.106:6801/3686280688] boot 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: osdmap e68: 6 total, 6 up, 6 in 2024-05-09T06:38:32.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:32 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 46/219 objects degraded (21.005%), 17 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:32.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:38:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: osd.3 [v2:172.21.15.106:6800/3686280688,v1:172.21.15.106:6801/3686280688] boot 2024-05-09T06:38:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: osdmap e68: 6 total, 6 up, 6 in 2024-05-09T06:38:32.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:32 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T06:38:33.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:33 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:33 smithi106 ceph-mon[81208]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-05-09T06:38:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:33 smithi106 ceph-mon[81208]: pgmap v122: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:33.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:33 smithi106 ceph-mon[81208]: osdmap e69: 6 total, 6 up, 6 in 2024-05-09T06:38:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:33 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:33 smithi046 ceph-mon[110713]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-05-09T06:38:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:33 smithi046 ceph-mon[110713]: pgmap v122: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-05-09T06:38:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:33 smithi046 ceph-mon[110713]: osdmap e69: 6 total, 6 up, 6 in 2024-05-09T06:38:35.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:35 smithi106 ceph-mon[81208]: pgmap v124: 65 pgs: 15 peering, 11 active+undersized+degraded, 12 active+undersized, 27 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-05-09T06:38:35.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:35 smithi046 ceph-mon[110713]: pgmap v124: 65 pgs: 15 peering, 11 active+undersized+degraded, 12 active+undersized, 27 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/219 objects degraded (12.785%) 2024-05-09T06:38:37.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:37 smithi106 ceph-mon[81208]: pgmap v125: 65 pgs: 15 peering, 1 active+undersized+degraded, 3 active+undersized, 46 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3/219 objects degraded (1.370%) 2024-05-09T06:38:37.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:37 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 3/219 objects degraded (1.370%), 1 pg degraded (PG_DEGRADED) 2024-05-09T06:38:37.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:37 smithi046 ceph-mon[110713]: pgmap v125: 65 pgs: 15 peering, 1 active+undersized+degraded, 3 active+undersized, 46 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3/219 objects degraded (1.370%) 2024-05-09T06:38:37.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:37 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 3/219 objects degraded (1.370%), 1 pg degraded (PG_DEGRADED) 2024-05-09T06:38:38.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:38 smithi106 ceph-mon[81208]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/219 objects degraded (1.370%), 1 pg degraded) 2024-05-09T06:38:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:38 smithi046 ceph-mon[110713]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/219 objects degraded (1.370%), 1 pg degraded) 2024-05-09T06:38:39.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:39 smithi106 ceph-mon[81208]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:39.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:39 smithi046 ceph-mon[110713]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:41 smithi106 ceph-mon[81208]: pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:41 smithi046 ceph-mon[110713]: pgmap v127: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:43 smithi106 ceph-mon[81208]: pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:43.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:43.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:43 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:43.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:43 smithi046 ceph-mon[110713]: pgmap v128: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:43.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:43.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:43 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.174+0000 7f97eac97700 1 -- 172.21.15.46:0/1451164206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 msgr2=0x7f97e41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.174+0000 7f97eac97700 1 --2- 172.21.15.46:0/1451164206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e41031d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97d8004940 tx=0x7f97d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.174+0000 7f97eac97700 1 -- 172.21.15.46:0/1451164206 shutdown_connections 2024-05-09T06:38:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.174+0000 7f97eac97700 1 --2- 172.21.15.46:0/1451164206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97e41037a0 0x7f97e40fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.174+0000 7f97eac97700 1 --2- 172.21.15.46:0/1451164206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e41031d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.174+0000 7f97eac97700 1 -- 172.21.15.46:0/1451164206 >> 172.21.15.46:0/1451164206 conn(0x7f97e40f89b0 msgr2=0x7f97e40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.175+0000 7f97eac97700 1 -- 172.21.15.46:0/1451164206 shutdown_connections 2024-05-09T06:38:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.175+0000 7f97eac97700 1 -- 172.21.15.46:0/1451164206 wait complete. 2024-05-09T06:38:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.175+0000 7f97eac97700 1 Processor -- start 2024-05-09T06:38:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.175+0000 7f97eac97700 1 -- start start 2024-05-09T06:38:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97eac97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e4115dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97eac97700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97e41037a0 0x7f97e4116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97eac97700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4116950 con 0x7f97e4102e00 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97eac97700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e410fd20 con 0x7f97e41037a0 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e4115dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e4115dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44982/0 (socket says 172.21.15.46:44982) 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 -- 172.21.15.46:0/727487235 learned_addr learned my addr 172.21.15.46:0/727487235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e3fff700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97e41037a0 0x7f97e4116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 -- 172.21.15.46:0/727487235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97e41037a0 msgr2=0x7f97e4116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97e41037a0 0x7f97e4116300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 -- 172.21.15.46:0/727487235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8005040 con 0x7f97e4102e00 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e8a33700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e4115dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97d800b3b0 tx=0x7f97d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.176+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d800e040 con 0x7f97e4102e00 2024-05-09T06:38:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.177+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e410ffa0 con 0x7f97e4102e00 2024-05-09T06:38:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.177+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97d800bbc0 con 0x7f97e4102e00 2024-05-09T06:38:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.177+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d801c3f0 con 0x7f97e4102e00 2024-05-09T06:38:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.177+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e4110560 con 0x7f97e4102e00 2024-05-09T06:38:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.178+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e4106a50 con 0x7f97e4102e00 2024-05-09T06:38:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.178+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f97d800bd30 con 0x7f97e4102e00 2024-05-09T06:38:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.179+0000 7f97e17fa700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97d4078990 0x7f97d407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.179+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f97d809b900 con 0x7f97e4102e00 2024-05-09T06:38:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.179+0000 7f97e3fff700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97d4078990 0x7f97d407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.179+0000 7f97e3fff700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97d4078990 0x7f97d407ae40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97e4111660 tx=0x7f97d0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.184+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f97d80635c0 con 0x7f97e4102e00 2024-05-09T06:38:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.418+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97e4109f70 con 0x7f97d4078990 2024-05-09T06:38:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.420+0000 7f97e17fa700 1 -- 172.21.15.46:0/727487235 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f97e4109f70 con 0x7f97d4078990 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97d4078990 msgr2=0x7f97d407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97d4078990 0x7f97d407ae40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97e4111660 tx=0x7f97d0009ee0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 msgr2=0x7f97e4115dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e4115dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97d800b3b0 tx=0x7f97d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 shutdown_connections 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97d4078990 0x7f97d407ae40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e4102e00 0x7f97e4115dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 --2- 172.21.15.46:0/727487235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97e41037a0 0x7f97e4116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 >> 172.21.15.46:0/727487235 conn(0x7f97e40f89b0 msgr2=0x7f97e41073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 shutdown_connections 2024-05-09T06:38:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.422+0000 7f97eac97700 1 -- 172.21.15.46:0/727487235 wait complete. 2024-05-09T06:38:44.414 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 -- 172.21.15.46:0/3868131769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 msgr2=0x7fd0981020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/3868131769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd0981020d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd088004940 tx=0x7fd088009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 -- 172.21.15.46:0/3868131769 shutdown_connections 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/3868131769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 0x7fd0980fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/3868131769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd0981020d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 -- 172.21.15.46:0/3868131769 >> 172.21.15.46:0/3868131769 conn(0x7fd0980f7870 msgr2=0x7fd0980f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 -- 172.21.15.46:0/3868131769 shutdown_connections 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.529+0000 7fd09d5ce700 1 -- 172.21.15.46:0/3868131769 wait complete. 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.530+0000 7fd09d5ce700 1 Processor -- start 2024-05-09T06:38:44.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.530+0000 7fd09d5ce700 1 -- start start 2024-05-09T06:38:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.530+0000 7fd09d5ce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd098113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.530+0000 7fd09d5ce700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 0x7fd098113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.530+0000 7fd09d5ce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981145b0 con 0x7fd098101d00 2024-05-09T06:38:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.530+0000 7fd09d5ce700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09810db20 con 0x7fd0981026a0 2024-05-09T06:38:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd098113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd098113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45002/0 (socket says 172.21.15.46:45002) 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 -- 172.21.15.46:0/732877926 learned_addr learned my addr 172.21.15.46:0/732877926 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd0967fc700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 0x7fd098113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 -- 172.21.15.46:0/732877926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 msgr2=0x7fd098113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 0x7fd098113ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 -- 172.21.15.46:0/732877926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088005040 con 0x7fd098101d00 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd0967fc700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 0x7fd098113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd096ffd700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd098113990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b8b0 tx=0x7fd088009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08800e040 con 0x7fd098101d00 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd088004290 con 0x7fd098101d00 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09810dda0 con 0x7fd098101d00 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08801c3f0 con 0x7fd098101d00 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.531+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09810e360 con 0x7fd098101d00 2024-05-09T06:38:44.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.532+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0980fd450 con 0x7fd098101d00 2024-05-09T06:38:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.533+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fd0880137b0 con 0x7fd098101d00 2024-05-09T06:38:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.534+0000 7fd07f7fe700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd080078990 0x7fd08007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.534+0000 7fd0967fc700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd080078990 0x7fd08007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.534+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd08809b880 con 0x7fd098101d00 2024-05-09T06:38:44.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.534+0000 7fd0967fc700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd080078990 0x7fd08007ae40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd08c006fd0 tx=0x7fd08c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.538+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fd088063660 con 0x7fd098101d00 2024-05-09T06:38:44.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.772+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd09810e5d0 con 0x7fd080078990 2024-05-09T06:38:44.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.774+0000 7fd07f7fe700 1 -- 172.21.15.46:0/732877926 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd09810e5d0 con 0x7fd080078990 2024-05-09T06:38:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd080078990 msgr2=0x7fd08007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd080078990 0x7fd08007ae40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd08c006fd0 tx=0x7fd08c008040 comp rx=0 tx=0).stop 2024-05-09T06:38:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 msgr2=0x7fd098113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd098113990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b8b0 tx=0x7fd088009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 shutdown_connections 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd080078990 0x7fd08007ae40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd098101d00 0x7fd098113990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 --2- 172.21.15.46:0/732877926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0981026a0 0x7fd098113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 >> 172.21.15.46:0/732877926 conn(0x7fd0980f7870 msgr2=0x7fd0980f8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 shutdown_connections 2024-05-09T06:38:44.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.776+0000 7fd09d5ce700 1 -- 172.21.15.46:0/732877926 wait complete. 2024-05-09T06:38:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.883+0000 7fcb9299d700 1 -- 172.21.15.46:0/2548041038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c1035b0 msgr2=0x7fcb8c0fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.883+0000 7fcb9299d700 1 --2- 172.21.15.46:0/2548041038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c1035b0 0x7fcb8c0fcc20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c004940 tx=0x7fcb7c009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 -- 172.21.15.46:0/2548041038 shutdown_connections 2024-05-09T06:38:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 --2- 172.21.15.46:0/2548041038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c1035b0 0x7fcb8c0fcc20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 --2- 172.21.15.46:0/2548041038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb8c102c10 0x7fcb8c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 -- 172.21.15.46:0/2548041038 >> 172.21.15.46:0/2548041038 conn(0x7fcb8c0f8740 msgr2=0x7fcb8c0fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 -- 172.21.15.46:0/2548041038 shutdown_connections 2024-05-09T06:38:44.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 -- 172.21.15.46:0/2548041038 wait complete. 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 Processor -- start 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.884+0000 7fcb9299d700 1 -- start start 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9299d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 0x7fcb8c1139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9299d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb8c1035b0 0x7fcb8c113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9299d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c1145d0 con 0x7fcb8c102c10 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9299d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c10d930 con 0x7fcb8c1035b0 2024-05-09T06:38:44.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 0x7fcb8c1139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 0x7fcb8c1139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45008/0 (socket says 172.21.15.46:45008) 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 -- 172.21.15.46:0/4140571127 learned_addr learned my addr 172.21.15.46:0/4140571127 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9119a700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb8c1035b0 0x7fcb8c113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 -- 172.21.15.46:0/4140571127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb8c1035b0 msgr2=0x7fcb8c113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb8c1035b0 0x7fcb8c113ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 -- 172.21.15.46:0/4140571127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c005040 con 0x7fcb8c102c10 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9199b700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 0x7fcb8c1139b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800b790 tx=0x7fcb88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8800f770 con 0x7fcb8c102c10 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb8800fda0 con 0x7fcb8c102c10 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c10dc10 con 0x7fcb8c102c10 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.885+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8800d310 con 0x7fcb8c102c10 2024-05-09T06:38:44.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.886+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c10e1d0 con 0x7fcb8c102c10 2024-05-09T06:38:44.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.886+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0fe360 con 0x7fcb8c102c10 2024-05-09T06:38:44.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.887+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fcb88010420 con 0x7fcb8c102c10 2024-05-09T06:38:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.888+0000 7fcb827fc700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb78078990 0x7fcb7807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.888+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcb8809a6b0 con 0x7fcb8c102c10 2024-05-09T06:38:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.888+0000 7fcb9119a700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb78078990 0x7fcb7807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:44.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.888+0000 7fcb9119a700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb78078990 0x7fcb7807ae40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c10eaf0 tx=0x7fcb7c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:44.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:44.893+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fcb880623f0 con 0x7fcb8c102c10 2024-05-09T06:38:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.117+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb8c04bed0 con 0x7fcb78078990 2024-05-09T06:38:45.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.128+0000 7fcb827fc700 1 -- 172.21.15.46:0/4140571127 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcb8c04bed0 con 0x7fcb78078990 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 51s ago 16m 24.3M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (2m) 51s ago 16m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (2m) 18s ago 15m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 51s ago 16m 79.8M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (11m) 51s ago 11m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (11m) 51s ago 11m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (11m) 18s ago 11m 18.5M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (11m) 18s ago 11m 16.1M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (7m) 51s ago 18m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (6m) 18s ago 15m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:38:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (3m) 51s ago 18m 49.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (3m) 18s ago 15m 35.5M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 51s ago 16m 15.1M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (6m) 18s ago 15m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (2m) 51s ago 14m 96.8M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (94s) 51s ago 14m 102M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (57s) 51s ago 13m 15.0M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (21s) 18s ago 13m 11.6M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (13m) 18s ago 13m 263M 2581M 17.2.7-933-g4ba5a836 b96134859c76 544462e3e3f9 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (12m) 18s ago 12m 238M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:38:45.110 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 51s ago 15m 66.6M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb78078990 msgr2=0x7fcb7807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb78078990 0x7fcb7807ae40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c10eaf0 tx=0x7fcb7c009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 msgr2=0x7fcb8c1139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 0x7fcb8c1139b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800b790 tx=0x7fcb88009250 comp rx=0 tx=0).stop 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 shutdown_connections 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fcb78078990 0x7fcb7807ae40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb8c102c10 0x7fcb8c1139b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 --2- 172.21.15.46:0/4140571127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb8c1035b0 0x7fcb8c113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 >> 172.21.15.46:0/4140571127 conn(0x7fcb8c0f8740 msgr2=0x7fcb8c0f96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 shutdown_connections 2024-05-09T06:38:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.130+0000 7fcb9299d700 1 -- 172.21.15.46:0/4140571127 wait complete. 2024-05-09T06:38:45.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.235+0000 7f45ebdce700 1 -- 172.21.15.46:0/3249503771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fde10 msgr2=0x7f45e40fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.235+0000 7f45ebdce700 1 --2- 172.21.15.46:0/3249503771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fde10 0x7f45e40fe1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009ce0 tx=0x7f45e0004d10 comp rx=0 tx=0).stop 2024-05-09T06:38:45.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.235+0000 7f45ebdce700 1 -- 172.21.15.46:0/3249503771 shutdown_connections 2024-05-09T06:38:45.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.235+0000 7f45ebdce700 1 --2- 172.21.15.46:0/3249503771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fe7b0 0x7f45e4106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.235+0000 7f45ebdce700 1 --2- 172.21.15.46:0/3249503771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fde10 0x7f45e40fe1e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.235+0000 7f45ebdce700 1 -- 172.21.15.46:0/3249503771 >> 172.21.15.46:0/3249503771 conn(0x7f45e40f78a0 msgr2=0x7f45e40f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 -- 172.21.15.46:0/3249503771 shutdown_connections 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 -- 172.21.15.46:0/3249503771 wait complete. 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 Processor -- start 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 -- start start 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fde10 0x7f45e4115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 0x7f45e4116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e41166e0 con 0x7f45e40fe7b0 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.236+0000 7f45ebdce700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e410fcc0 con 0x7f45e40fde10 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 0x7f45e4116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 0x7f45e4116090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45036/0 (socket says 172.21.15.46:45036) 2024-05-09T06:38:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 -- 172.21.15.46:0/2849278170 learned_addr learned my addr 172.21.15.46:0/2849278170 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9b6a700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fde10 0x7f45e4115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 -- 172.21.15.46:0/2849278170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fde10 msgr2=0x7f45e4115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fde10 0x7f45e4115b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 -- 172.21.15.46:0/2849278170 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0009940 con 0x7f45e40fe7b0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9b6a700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fde10 0x7f45e4115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45e9369700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 0x7f45e4116090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45d400c830 tx=0x7f45d4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d400a760 con 0x7f45e40fe7b0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e410ffa0 con 0x7f45e40fe7b0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45d400ad90 con 0x7f45e40fe7b0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d40113a0 con 0x7f45e40fe7b0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.237+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e41104e0 con 0x7f45e40fe7b0 2024-05-09T06:38:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.238+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e4066b30 con 0x7f45e40fe7b0 2024-05-09T06:38:45.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.239+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f45d4012400 con 0x7f45e40fe7b0 2024-05-09T06:38:45.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.239+0000 7f45da7fc700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f45d0078990 0x7f45d007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:45.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.240+0000 7f45e9b6a700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f45d0078990 0x7f45d007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:45.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.240+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f45d409a760 con 0x7f45e40fe7b0 2024-05-09T06:38:45.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.240+0000 7f45e9b6a700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f45d0078990 0x7f45d007ae40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b740 tx=0x7f45e0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:45.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.244+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f45d4062400 con 0x7f45e40fe7b0 2024-05-09T06:38:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.549+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45e4109ed0 con 0x7f45e40fe7b0 2024-05-09T06:38:45.530 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:45 smithi046 ceph-mon[110713]: pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:45.530 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:45 smithi046 ceph-mon[110713]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.549+0000 7f45da7fc700 1 -- 172.21.15.46:0/2849278170 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f45d4061da0 con 0x7f45e40fe7b0 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:38:45.531 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 2, 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 6, 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 8 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:38:45.532 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:38:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f45d0078990 msgr2=0x7f45d007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f45d0078990 0x7f45d007ae40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b740 tx=0x7f45e0004d10 comp rx=0 tx=0).stop 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 msgr2=0x7f45e4116090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 0x7f45e4116090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45d400c830 tx=0x7f45d4004470 comp rx=0 tx=0).stop 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 shutdown_connections 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f45d0078990 0x7f45d007ae40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45e40fde10 0x7f45e4115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 --2- 172.21.15.46:0/2849278170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e40fe7b0 0x7f45e4116090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.552+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 >> 172.21.15.46:0/2849278170 conn(0x7f45e40f78a0 msgr2=0x7f45e40f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.553+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 shutdown_connections 2024-05-09T06:38:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.553+0000 7f45ebdce700 1 -- 172.21.15.46:0/2849278170 wait complete. 2024-05-09T06:38:45.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:45 smithi106 ceph-mon[81208]: pgmap v129: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:45.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:45 smithi106 ceph-mon[81208]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:45.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/206408844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0102e50 msgr2=0x7ff6a0103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/206408844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0102e50 0x7ff6a0103220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff698009ce0 tx=0x7ff698004d10 comp rx=0 tx=0).stop 2024-05-09T06:38:45.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/206408844 shutdown_connections 2024-05-09T06:38:45.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/206408844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a0065640 0x7ff6a0065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/206408844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0102e50 0x7ff6a0103220 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/206408844 >> 172.21.15.46:0/206408844 conn(0x7ff6a0071d00 msgr2=0x7ff6a0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:45.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/206408844 shutdown_connections 2024-05-09T06:38:45.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.658+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/206408844 wait complete. 2024-05-09T06:38:45.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff6a4e4b700 1 Processor -- start 2024-05-09T06:38:45.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff6a4e4b700 1 -- start start 2024-05-09T06:38:45.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff6a4e4b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 0x7ff6a0113cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:45.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff6a4e4b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a0102e50 0x7ff6a0114230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff6a4e4b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0114880 con 0x7ff6a0065640 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff6a4e4b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a010dc50 con 0x7ff6a0102e50 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 0x7ff6a0113cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 0x7ff6a0113cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45058/0 (socket says 172.21.15.46:45058) 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69e59c700 1 -- 172.21.15.46:0/3212742574 learned_addr learned my addr 172.21.15.46:0/3212742574 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69dd9b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a0102e50 0x7ff6a0114230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69e59c700 1 -- 172.21.15.46:0/3212742574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a0102e50 msgr2=0x7ff6a0114230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69e59c700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a0102e50 0x7ff6a0114230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.659+0000 7ff69e59c700 1 -- 172.21.15.46:0/3212742574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698009940 con 0x7ff6a0065640 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.660+0000 7ff69e59c700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 0x7ff6a0113cf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff698003400 tx=0x7ff698004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.660+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69800e040 con 0x7ff6a0065640 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.660+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff698004610 con 0x7ff6a0065640 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.660+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a010ded0 con 0x7ff6a0065640 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.660+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69801c640 con 0x7ff6a0065640 2024-05-09T06:38:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.660+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a010e490 con 0x7ff6a0065640 2024-05-09T06:38:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.661+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a0100100 con 0x7ff6a0065640 2024-05-09T06:38:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.662+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ff698012a70 con 0x7ff6a0065640 2024-05-09T06:38:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.662+0000 7ff696ffd700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff68c078990 0x7ff68c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.662+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff69809c0b0 con 0x7ff6a0065640 2024-05-09T06:38:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.662+0000 7ff69dd9b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff68c078990 0x7ff68c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:45.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.663+0000 7ff69dd9b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff68c078990 0x7ff68c07ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6a010f590 tx=0x7ff68800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:45.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.667+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff698063d70 con 0x7ff6a0065640 2024-05-09T06:38:45.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.934+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6a0109ef0 con 0x7ff6a0065640 2024-05-09T06:38:45.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.934+0000 7ff696ffd700 1 -- 172.21.15.46:0/3212742574 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7ff698004e10 con 0x7ff6a0065640 2024-05-09T06:38:45.915 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:38:45.915 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:38:45.916 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:38:45.917 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff68c078990 msgr2=0x7ff68c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff68c078990 0x7ff68c07ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6a010f590 tx=0x7ff68800b040 comp rx=0 tx=0).stop 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 msgr2=0x7ff6a0113cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 0x7ff6a0113cf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff698003400 tx=0x7ff698004d10 comp rx=0 tx=0).stop 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 shutdown_connections 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff68c078990 0x7ff68c07ae40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6a0065640 0x7ff6a0113cf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 --2- 172.21.15.46:0/3212742574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a0102e50 0x7ff6a0114230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 >> 172.21.15.46:0/3212742574 conn(0x7ff6a0071d00 msgr2=0x7ff6a00fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 shutdown_connections 2024-05-09T06:38:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:45.937+0000 7ff6a4e4b700 1 -- 172.21.15.46:0/3212742574 wait complete. 2024-05-09T06:38:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:38:46.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.044+0000 7fb33fcb7700 1 -- 172.21.15.46:0/2792230369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338102de0 msgr2=0x7fb3381031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.044+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/2792230369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338102de0 0x7fb3381031b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb334004940 tx=0x7fb334009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:46.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 -- 172.21.15.46:0/2792230369 shutdown_connections 2024-05-09T06:38:46.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/2792230369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb338103780 0x7fb3380fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/2792230369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338102de0 0x7fb3381031b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 -- 172.21.15.46:0/2792230369 >> 172.21.15.46:0/2792230369 conn(0x7fb3380f8990 msgr2=0x7fb3380fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:46.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 -- 172.21.15.46:0/2792230369 shutdown_connections 2024-05-09T06:38:46.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 -- 172.21.15.46:0/2792230369 wait complete. 2024-05-09T06:38:46.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 Processor -- start 2024-05-09T06:38:46.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 -- start start 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.045+0000 7fb33fcb7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb338102de0 0x7fb3381138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33fcb7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 0x7fb338113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33fcb7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338114510 con 0x7fb338103780 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33fcb7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33810da80 con 0x7fb338102de0 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 0x7fb338113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 0x7fb338113e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45076/0 (socket says 172.21.15.46:45076) 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 -- 172.21.15.46:0/214299283 learned_addr learned my addr 172.21.15.46:0/214299283 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33da53700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb338102de0 0x7fb3381138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:46.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 -- 172.21.15.46:0/214299283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb338102de0 msgr2=0x7fb3381138f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb338102de0 0x7fb3381138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 -- 172.21.15.46:0/214299283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334005040 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33d252700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 0x7fb338113e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb32800b790 tx=0x7fb328009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32800f6f0 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33810dd60 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.046+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33810e320 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.047+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb32800fd20 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.047+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3280103a0 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.048+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c0052e0 con 0x7fb338103780 2024-05-09T06:38:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.048+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fb32800f850 con 0x7fb338103780 2024-05-09T06:38:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.049+0000 7fb32e7fc700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb324078990 0x7fb32407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.049+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb32809a370 con 0x7fb338103780 2024-05-09T06:38:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.049+0000 7fb33da53700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb324078990 0x7fb32407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.049+0000 7fb33da53700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb324078990 0x7fb32407ae40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb334004f90 tx=0x7fb334009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.053+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb3280620b0 con 0x7fb338103780 2024-05-09T06:38:46.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.287+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb31c000bf0 con 0x7fb324078990 2024-05-09T06:38:46.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:46 smithi046 ceph-mon[110713]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:46.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:46 smithi046 ceph-mon[110713]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:46.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:46 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2849278170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:46.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:46 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3212742574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:38:46.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.289+0000 7fb32e7fc700 1 -- 172.21.15.46:0/214299283 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb31c000bf0 con 0x7fb324078990 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "10/21 daemons upgraded", 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:38:46.270 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:38:46.271 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb324078990 msgr2=0x7fb32407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb324078990 0x7fb32407ae40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb334004f90 tx=0x7fb334009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 msgr2=0x7fb338113e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 0x7fb338113e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb32800b790 tx=0x7fb328009220 comp rx=0 tx=0).stop 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 shutdown_connections 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb324078990 0x7fb32407ae40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb338102de0 0x7fb3381138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 --2- 172.21.15.46:0/214299283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb338103780 0x7fb338113e30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 >> 172.21.15.46:0/214299283 conn(0x7fb3380f8990 msgr2=0x7fb3380fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 shutdown_connections 2024-05-09T06:38:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.292+0000 7fb33fcb7700 1 -- 172.21.15.46:0/214299283 wait complete. 2024-05-09T06:38:46.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 -- 172.21.15.46:0/3469550437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744065640 msgr2=0x7f4744065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 --2- 172.21.15.46:0/3469550437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744065640 0x7f4744065ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4738004940 tx=0x7f4738009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 -- 172.21.15.46:0/3469550437 shutdown_connections 2024-05-09T06:38:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 --2- 172.21.15.46:0/3469550437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744065640 0x7f4744065ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 --2- 172.21.15.46:0/3469550437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4744102e50 0x7f4744103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 -- 172.21.15.46:0/3469550437 >> 172.21.15.46:0/3469550437 conn(0x7f4744071d00 msgr2=0x7f4744072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 -- 172.21.15.46:0/3469550437 shutdown_connections 2024-05-09T06:38:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.397+0000 7f47492da700 1 -- 172.21.15.46:0/3469550437 wait complete. 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47492da700 1 Processor -- start 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47492da700 1 -- start start 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47492da700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4744065640 0x7f4744113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47492da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 0x7f4744114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47492da700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744114660 con 0x7f4744102e50 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47492da700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474410da50 con 0x7f4744065640 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47427fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 0x7f4744114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47427fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 0x7f4744114010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45088/0 (socket says 172.21.15.46:45088) 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.398+0000 7f47427fc700 1 -- 172.21.15.46:0/1190752557 learned_addr learned my addr 172.21.15.46:0/1190752557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f4742ffd700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4744065640 0x7f4744113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f47427fc700 1 -- 172.21.15.46:0/1190752557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4744065640 msgr2=0x7f4744113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f47427fc700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4744065640 0x7f4744113ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f47427fc700 1 -- 172.21.15.46:0/1190752557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738005040 con 0x7f4744102e50 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f47427fc700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 0x7f4744114010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4738009b30 tx=0x7f4738009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4738021070 con 0x7f4744102e50 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474410dcd0 con 0x7f4744102e50 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4738013c00 con 0x7f4744102e50 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473800e070 con 0x7f4744102e50 2024-05-09T06:38:46.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.399+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474410e1b0 con 0x7f4744102e50 2024-05-09T06:38:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.400+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744100100 con 0x7f4744102e50 2024-05-09T06:38:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.401+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f473801cad0 con 0x7f4744102e50 2024-05-09T06:38:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.401+0000 7f472b7fe700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f472c078990 0x7f472c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:38:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.402+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f473809ba70 con 0x7f4744102e50 2024-05-09T06:38:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.402+0000 7f4742ffd700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f472c078990 0x7f472c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:38:46.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.402+0000 7f4742ffd700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f472c078990 0x7f472c07ae40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4734001470 tx=0x7f473400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:38:46.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.406+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f47380637b0 con 0x7f4744102e50 2024-05-09T06:38:46.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:46 smithi106 ceph-mon[81208]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:46.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:46 smithi106 ceph-mon[81208]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:46.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:46 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2849278170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:38:46.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:46 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3212742574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:38:46.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.711+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f474410f120 con 0x7f4744102e50 2024-05-09T06:38:46.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.712+0000 7f472b7fe700 1 -- 172.21.15.46:0/1190752557 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4738004490 con 0x7f4744102e50 2024-05-09T06:38:46.693 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:38:46.693 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:38:46.693 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:38:46.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f472c078990 msgr2=0x7f472c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f472c078990 0x7f472c07ae40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4734001470 tx=0x7f473400b040 comp rx=0 tx=0).stop 2024-05-09T06:38:46.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 msgr2=0x7f4744114010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:38:46.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 0x7f4744114010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4738009b30 tx=0x7f4738009e30 comp rx=0 tx=0).stop 2024-05-09T06:38:46.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 shutdown_connections 2024-05-09T06:38:46.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f472c078990 0x7f472c07ae40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4744065640 0x7f4744113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 --2- 172.21.15.46:0/1190752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744102e50 0x7f4744114010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:38:46.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 >> 172.21.15.46:0/1190752557 conn(0x7f4744071d00 msgr2=0x7f47440fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:38:46.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 shutdown_connections 2024-05-09T06:38:46.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:38:46.714+0000 7f47492da700 1 -- 172.21.15.46:0/1190752557 wait complete. 2024-05-09T06:38:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:47 smithi106 ceph-mon[81208]: pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:47 smithi106 ceph-mon[81208]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:47.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:47 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1190752557' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:47.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:47 smithi046 ceph-mon[110713]: pgmap v130: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:47 smithi046 ceph-mon[110713]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:38:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:47 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1190752557' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:38:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:48.525 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:48 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:48.525 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:48 smithi106 ceph-mon[81208]: Upgrade: osd.4 is safe to restart 2024-05-09T06:38:48.525 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:48 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:48 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-05-09T06:38:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:48 smithi046 ceph-mon[110713]: Upgrade: osd.4 is safe to restart 2024-05-09T06:38:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:48 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:49.789 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:49 smithi106 ceph-mon[81208]: pgmap v131: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:49.789 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:49 smithi106 ceph-mon[81208]: Upgrade: Updating osd.4 2024-05-09T06:38:49.790 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:49.790 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:38:49.790 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:49 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:49.790 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:49 smithi106 ceph-mon[81208]: Deploying daemon osd.4 on smithi106 2024-05-09T06:38:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:49 smithi046 ceph-mon[110713]: pgmap v131: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:49 smithi046 ceph-mon[110713]: Upgrade: Updating osd.4 2024-05-09T06:38:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T06:38:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:49 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:38:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:49 smithi046 ceph-mon[110713]: Deploying daemon osd.4 on smithi106 2024-05-09T06:38:51.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:51 smithi046 ceph-mon[110713]: pgmap v132: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:51.861 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:51 smithi106 systemd[1]: Stopping Ceph osd.4 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:38:51.861 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:51 smithi106 ceph-mon[81208]: pgmap v132: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:52.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:51 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[46816]: 2024-05-09T06:38:51.879+0000 7f929a233700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:38:52.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:51 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[46816]: 2024-05-09T06:38:51.879+0000 7f929a233700 -1 osd.4 69 *** Got signal Terminated *** 2024-05-09T06:38:52.323 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:51 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[46816]: 2024-05-09T06:38:51.879+0000 7f929a233700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:38:52.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:52 smithi046 ceph-mon[110713]: osd.4 marked itself down and dead 2024-05-09T06:38:52.963 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:52 smithi106 ceph-mon[81208]: osd.4 marked itself down and dead 2024-05-09T06:38:53.260 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:52 smithi106 podman[95174]: 2024-05-09 06:38:52.983561859 +0000 UTC m=+1.199153058 container died 544462e3e3f965917801286ccbaec0262912093fc97de2c5959f9fa26a659f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=quincy-4ba5a83, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-09T06:38:53.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:53 smithi106 podman[95174]: 2024-05-09 06:38:53.371497833 +0000 UTC m=+1.587089032 container cleanup 544462e3e3f965917801286ccbaec0262912093fc97de2c5959f9fa26a659f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4ba5a83, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-09T06:38:53.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:53 smithi106 bash[95174]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4 2024-05-09T06:38:53.920 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:53 smithi106 ceph-mon[81208]: pgmap v133: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:53.920 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:53 smithi106 ceph-mon[81208]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:53.920 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:53 smithi106 ceph-mon[81208]: osdmap e70: 6 total, 5 up, 6 in 2024-05-09T06:38:53.920 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:53 smithi106 podman[95196]: 2024-05-09 06:38:53.616168057 +0000 UTC m=+0.627987802 container remove 544462e3e3f965917801286ccbaec0262912093fc97de2c5959f9fa26a659f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:54.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:53 smithi046 ceph-mon[110713]: pgmap v133: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:54.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:53 smithi046 ceph-mon[110713]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:38:54.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:53 smithi046 ceph-mon[110713]: osdmap e70: 6 total, 5 up, 6 in 2024-05-09T06:38:54.214 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:53 smithi106 podman[95286]: 2024-05-09 06:38:53.940538622 +0000 UTC m=+0.110423568 container create ffdd40e2b6bf8b2382b07e13e7e853bcc339a9af4297207627928127e20fb99a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:54.214 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:53 smithi106 podman[95286]: 2024-05-09 06:38:53.84820034 +0000 UTC m=+0.018085273 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:54.214 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:54 smithi106 podman[95286]: 2024-05-09 06:38:54.151369126 +0000 UTC m=+0.321254033 container init ffdd40e2b6bf8b2382b07e13e7e853bcc339a9af4297207627928127e20fb99a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True) 2024-05-09T06:38:54.214 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:54 smithi106 podman[95286]: 2024-05-09 06:38:54.154865594 +0000 UTC m=+0.324750499 container start ffdd40e2b6bf8b2382b07e13e7e853bcc339a9af4297207627928127e20fb99a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:54.214 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:54 smithi106 podman[95286]: 2024-05-09 06:38:54.234560993 +0000 UTC m=+0.404445934 container attach ffdd40e2b6bf8b2382b07e13e7e853bcc339a9af4297207627928127e20fb99a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , ceph=True) 2024-05-09T06:38:54.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:54 smithi106 podman[95286]: 2024-05-09 06:38:54.450934375 +0000 UTC m=+0.620819289 container died ffdd40e2b6bf8b2382b07e13e7e853bcc339a9af4297207627928127e20fb99a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, io.buildah.version=1.33.5) 2024-05-09T06:38:54.984 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:54 smithi106 ceph-mon[81208]: osdmap e71: 6 total, 5 up, 6 in 2024-05-09T06:38:55.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:54 smithi046 ceph-mon[110713]: osdmap e71: 6 total, 5 up, 6 in 2024-05-09T06:38:55.323 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 podman[95313]: 2024-05-09 06:38:55.004848697 +0000 UTC m=+0.543580338 container remove ffdd40e2b6bf8b2382b07e13e7e853bcc339a9af4297207627928127e20fb99a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-09T06:38:55.323 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.4.service: Deactivated successfully. 2024-05-09T06:38:55.323 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 systemd[1]: Stopped Ceph osd.4 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:38:55.323 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.4.service: Consumed 1min 4.534s CPU time. 2024-05-09T06:38:55.323 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 systemd[1]: Starting Ceph osd.4 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:38:55.696 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:55 smithi106 ceph-mon[81208]: pgmap v136: 65 pgs: 13 peering, 4 stale+active+clean, 48 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:55.696 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:55 smithi106 ceph-mon[81208]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-09T06:38:55.696 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 podman[95415]: 2024-05-09 06:38:55.350868704 +0000 UTC m=+0.018065553 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:55.697 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 podman[95415]: 2024-05-09 06:38:55.456193744 +0000 UTC m=+0.123390630 container create 132fa739410167186427ed2d77d34a30a3b0bd1df59a286794a913f0708b698a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:38:55.697 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 podman[95415]: 2024-05-09 06:38:55.658489353 +0000 UTC m=+0.325686197 container init 132fa739410167186427ed2d77d34a30a3b0bd1df59a286794a913f0708b698a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9) 2024-05-09T06:38:55.697 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 podman[95415]: 2024-05-09 06:38:55.661801484 +0000 UTC m=+0.328998331 container start 132fa739410167186427ed2d77d34a30a3b0bd1df59a286794a913f0708b698a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9) 2024-05-09T06:38:55.697 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:55 smithi106 podman[95415]: 2024-05-09 06:38:55.716759179 +0000 UTC m=+0.383956046 container attach 132fa739410167186427ed2d77d34a30a3b0bd1df59a286794a913f0708b698a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:38:56.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:55 smithi046 ceph-mon[110713]: pgmap v136: 65 pgs: 13 peering, 4 stale+active+clean, 48 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:38:56.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:55 smithi046 ceph-mon[110713]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-09T06:38:56.449 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:56.450 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 bash[95415]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate[95430]: --> ceph-volume raw activate successful for osd ID: 4 2024-05-09T06:38:56.451 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 podman[95415]: 2024-05-09 06:38:56.171127568 +0000 UTC m=+0.838324413 container died 132fa739410167186427ed2d77d34a30a3b0bd1df59a286794a913f0708b698a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:56.708 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:56 smithi106 ceph-mon[81208]: Health check failed: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:56.986 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:56 smithi046 ceph-mon[110713]: Health check failed: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:38:57.009 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 podman[95554]: 2024-05-09 06:38:56.729002151 +0000 UTC m=+0.552673636 container remove 132fa739410167186427ed2d77d34a30a3b0bd1df59a286794a913f0708b698a (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-09T06:38:57.009 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:56 smithi106 podman[95619]: 2024-05-09 06:38:56.848349229 +0000 UTC m=+0.018166577 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:38:57.009 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 podman[95619]: 2024-05-09 06:38:57.029886563 +0000 UTC m=+0.199703901 container create 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-09T06:38:57.653 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 podman[95619]: 2024-05-09 06:38:57.34810434 +0000 UTC m=+0.517921678 container init 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-09T06:38:57.653 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 podman[95619]: 2024-05-09 06:38:57.351411054 +0000 UTC m=+0.521228401 container start 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:38:57.653 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 ceph-osd[95638]: -- 172.21.15.106:0/2418091166 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc1ef69680 con 0x55cc1ef32c00 2024-05-09T06:38:57.653 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 bash[95619]: 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 2024-05-09T06:38:57.653 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 systemd[1]: Started Ceph osd.4 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:38:58.072 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:38:57 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:38:57.889+0000 7fa2e11cc7c0 -1 Falling back to public interface 2024-05-09T06:38:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:57 smithi106 ceph-mon[81208]: pgmap v137: 65 pgs: 5 active+undersized+degraded, 13 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T06:38:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:58.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:57 smithi046 ceph-mon[110713]: pgmap v137: 65 pgs: 5 active+undersized+degraded, 13 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T06:38:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:38:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:38:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:38:59.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:58 smithi106 ceph-mon[81208]: pgmap v138: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:38:59.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:38:58 smithi106 ceph-mon[81208]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-09T06:38:59.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:58 smithi046 ceph-mon[110713]: pgmap v138: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:38:59.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:38:58 smithi046 ceph-mon[110713]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-09T06:39:01.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:01 smithi106 ceph-mon[81208]: pgmap v139: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:01.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:01.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:01.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:01 smithi046 ceph-mon[110713]: pgmap v139: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:01.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:01.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:03.070 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:02 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:03.070 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:02 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:03.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:02 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:03.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:02 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:03.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:39:03 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:39:03.088+0000 7fa2e11cc7c0 -1 osd.4 69 log_to_monitors true 2024-05-09T06:39:03.991 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:03 smithi106 ceph-mon[81208]: pgmap v140: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:03.991 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:03 smithi106 ceph-mon[81208]: from='osd.4 [v2:172.21.15.106:6808/8416138,v1:172.21.15.106:6809/8416138]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:39:03.991 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:03 smithi106 ceph-mon[81208]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:39:04.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:03 smithi046 ceph-mon[110713]: pgmap v140: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:04.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:03 smithi046 ceph-mon[110713]: from='osd.4 [v2:172.21.15.106:6808/8416138,v1:172.21.15.106:6809/8416138]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:39:04.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:03 smithi046 ceph-mon[110713]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T06:39:04.822 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:39:04 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:39:04.566+0000 7fa2ce61b700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:39:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:04 smithi106 ceph-mon[81208]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:39:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:04 smithi106 ceph-mon[81208]: osdmap e72: 6 total, 5 up, 6 in 2024-05-09T06:39:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:04 smithi106 ceph-mon[81208]: from='osd.4 [v2:172.21.15.106:6808/8416138,v1:172.21.15.106:6809/8416138]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:04 smithi106 ceph-mon[81208]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:04.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:04 smithi106 ceph-mon[81208]: from='osd.4 ' entity='osd.4' 2024-05-09T06:39:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:04 smithi046 ceph-mon[110713]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T06:39:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:04 smithi046 ceph-mon[110713]: osdmap e72: 6 total, 5 up, 6 in 2024-05-09T06:39:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:04 smithi046 ceph-mon[110713]: from='osd.4 [v2:172.21.15.106:6808/8416138,v1:172.21.15.106:6809/8416138]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:04 smithi046 ceph-mon[110713]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:04 smithi046 ceph-mon[110713]: from='osd.4 ' entity='osd.4' 2024-05-09T06:39:06.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: pgmap v142: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: osd.4 [v2:172.21.15.106:6808/8416138,v1:172.21.15.106:6809/8416138] boot 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: osdmap e73: 6 total, 6 up, 6 in 2024-05-09T06:39:06.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:05 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:39:06.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: pgmap v142: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:06.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:06.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:06.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:06.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: osd.4 [v2:172.21.15.106:6808/8416138,v1:172.21.15.106:6809/8416138] boot 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: osdmap e73: 6 total, 6 up, 6 in 2024-05-09T06:39:06.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:05 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T06:39:07.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:06 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:07.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:06 smithi106 ceph-mon[81208]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-05-09T06:39:07.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:06 smithi106 ceph-mon[81208]: osdmap e74: 6 total, 6 up, 6 in 2024-05-09T06:39:07.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:06 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:07.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:06 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:07.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:06 smithi046 ceph-mon[110713]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-05-09T06:39:07.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:06 smithi046 ceph-mon[110713]: osdmap e74: 6 total, 6 up, 6 in 2024-05-09T06:39:07.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:06 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 34/219 objects degraded (15.525%), 14 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:08.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:07 smithi106 ceph-mon[81208]: pgmap v144: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:07 smithi046 ceph-mon[110713]: pgmap v144: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 34/219 objects degraded (15.525%) 2024-05-09T06:39:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:09 smithi106 ceph-mon[81208]: pgmap v146: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19/219 objects degraded (8.676%) 2024-05-09T06:39:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:09 smithi046 ceph-mon[110713]: pgmap v146: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19/219 objects degraded (8.676%) 2024-05-09T06:39:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:11 smithi106 ceph-mon[81208]: pgmap v147: 65 pgs: 5 active+undersized+degraded, 5 active+undersized, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T06:39:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:11 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:12.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:11 smithi046 ceph-mon[110713]: pgmap v147: 65 pgs: 5 active+undersized+degraded, 5 active+undersized, 55 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-05-09T06:39:12.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:11 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:13.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:13 smithi106 ceph-mon[81208]: pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:13 smithi106 ceph-mon[81208]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded) 2024-05-09T06:39:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:13 smithi046 ceph-mon[110713]: pgmap v148: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:13 smithi046 ceph-mon[110713]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded) 2024-05-09T06:39:15.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:15 smithi106 ceph-mon[81208]: pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:15.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:15 smithi046 ceph-mon[110713]: pgmap v149: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 -- 172.21.15.46:0/702335435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 msgr2=0x7f04400fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 --2- 172.21.15.46:0/702335435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f04400fe1e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0430004940 tx=0x7f0430009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 -- 172.21.15.46:0/702335435 shutdown_connections 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 --2- 172.21.15.46:0/702335435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04400fe7b0 0x7f0440106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 --2- 172.21.15.46:0/702335435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f04400fe1e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 -- 172.21.15.46:0/702335435 >> 172.21.15.46:0/702335435 conn(0x7f04400f7860 msgr2=0x7f04400f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 -- 172.21.15.46:0/702335435 shutdown_connections 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 -- 172.21.15.46:0/702335435 wait complete. 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 Processor -- start 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.837+0000 7f0446305700 1 -- start start 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f0446305700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f0440113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:16.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f0446305700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04400fe7b0 0x7f0440113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f0446305700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401144b0 con 0x7f04400fde10 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f0446305700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044010dab0 con 0x7f04400fe7b0 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f0440113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f0440113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54550/0 (socket says 172.21.15.46:54550) 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 -- 172.21.15.46:0/2353879587 learned_addr learned my addr 172.21.15.46:0/2353879587 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f0437fff700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04400fe7b0 0x7f0440113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 -- 172.21.15.46:0/2353879587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04400fe7b0 msgr2=0x7f0440113e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04400fe7b0 0x7f0440113e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 -- 172.21.15.46:0/2353879587 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430005040 con 0x7f04400fde10 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043ffff700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f0440113920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0430000c00 tx=0x7f0430009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.838+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0430021070 con 0x7f04400fde10 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.839+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0430013cd0 con 0x7f04400fde10 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.839+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044010dd30 con 0x7f04400fde10 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.839+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f043000e070 con 0x7f04400fde10 2024-05-09T06:39:16.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.839+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044010e270 con 0x7f04400fde10 2024-05-09T06:39:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.840+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440066b50 con 0x7f04400fde10 2024-05-09T06:39:16.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.840+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f043001ca60 con 0x7f04400fde10 2024-05-09T06:39:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.841+0000 7f043d7fa700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f042c078980 0x7f042c07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.841+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f043009bb60 con 0x7f04400fde10 2024-05-09T06:39:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.841+0000 7f0437fff700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f042c078980 0x7f042c07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:16.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.841+0000 7f0437fff700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f042c078980 0x7f042c07ae30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0428004600 tx=0x7f042800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:16.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:16.846+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0430063800 con 0x7f04400fde10 2024-05-09T06:39:17.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.080+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0440109ef0 con 0x7f042c078980 2024-05-09T06:39:17.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.081+0000 7f043d7fa700 1 -- 172.21.15.46:0/2353879587 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0440109ef0 con 0x7f042c078980 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f042c078980 msgr2=0x7f042c07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f042c078980 0x7f042c07ae30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0428004600 tx=0x7f042800b040 comp rx=0 tx=0).stop 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 msgr2=0x7f0440113920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f0440113920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0430000c00 tx=0x7f0430009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 shutdown_connections 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f042c078980 0x7f042c07ae30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04400fde10 0x7f0440113920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 --2- 172.21.15.46:0/2353879587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04400fe7b0 0x7f0440113e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 >> 172.21.15.46:0/2353879587 conn(0x7f04400f7860 msgr2=0x7f04400f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:17.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 shutdown_connections 2024-05-09T06:39:17.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.084+0000 7f0446305700 1 -- 172.21.15.46:0/2353879587 wait complete. 2024-05-09T06:39:17.075 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:39:17.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 -- 172.21.15.46:0/3911290168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 msgr2=0x7f338c0fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 --2- 172.21.15.46:0/3911290168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c0fbd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3380004940 tx=0x7f3380009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 -- 172.21.15.46:0/3911290168 shutdown_connections 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 --2- 172.21.15.46:0/3911290168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c0fbd00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 --2- 172.21.15.46:0/3911290168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f338c101cf0 0x7f338c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 -- 172.21.15.46:0/3911290168 >> 172.21.15.46:0/3911290168 conn(0x7f338c0f7860 msgr2=0x7f338c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 -- 172.21.15.46:0/3911290168 shutdown_connections 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 -- 172.21.15.46:0/3911290168 wait complete. 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 Processor -- start 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.191+0000 7f3391f86700 1 -- start start 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3391f86700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f338c101cf0 0x7f338c1139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3391f86700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3391f86700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c114530 con 0x7f338c102690 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3391f86700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c10db30 con 0x7f338c101cf0 2024-05-09T06:39:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54578/0 (socket says 172.21.15.46:54578) 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 -- 172.21.15.46:0/3317997671 learned_addr learned my addr 172.21.15.46:0/3317997671 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338b7fe700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f338c101cf0 0x7f338c1139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 -- 172.21.15.46:0/3317997671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f338c101cf0 msgr2=0x7f338c1139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f338c101cf0 0x7f338c1139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 -- 172.21.15.46:0/3317997671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380005040 con 0x7f338c102690 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f338affd700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c113ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3380009100 tx=0x7f3380009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338000e040 con 0x7f338c102690 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3380009af0 con 0x7f338c102690 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.192+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c10ddb0 con 0x7f338c102690 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.193+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338001c3f0 con 0x7f338c102690 2024-05-09T06:39:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.193+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c10e370 con 0x7f338c102690 2024-05-09T06:39:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.193+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0fd440 con 0x7f338c102690 2024-05-09T06:39:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.194+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f338000baf0 con 0x7f338c102690 2024-05-09T06:39:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.195+0000 7f3373fff700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3374078990 0x7f337407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.195+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f338009b8d0 con 0x7f338c102690 2024-05-09T06:39:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.195+0000 7f338b7fe700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3374078990 0x7f337407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.195+0000 7f338b7fe700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3374078990 0x7f337407ae40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f337c0041d0 tx=0x7f337c0043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.200+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f3380063610 con 0x7f338c102690 2024-05-09T06:39:17.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.434+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f338c108dd0 con 0x7f3374078990 2024-05-09T06:39:17.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.436+0000 7f3373fff700 1 -- 172.21.15.46:0/3317997671 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f338c108dd0 con 0x7f3374078990 2024-05-09T06:39:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3374078990 msgr2=0x7f337407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3374078990 0x7f337407ae40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f337c0041d0 tx=0x7f337c0043c0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 msgr2=0x7f338c113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c113ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3380009100 tx=0x7f3380009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 shutdown_connections 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3374078990 0x7f337407ae40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f338c101cf0 0x7f338c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 --2- 172.21.15.46:0/3317997671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f338c102690 0x7f338c113ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 >> 172.21.15.46:0/3317997671 conn(0x7f338c0f7860 msgr2=0x7f338c0f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 shutdown_connections 2024-05-09T06:39:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.438+0000 7f3391f86700 1 -- 172.21.15.46:0/3317997671 wait complete. 2024-05-09T06:39:17.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 -- 172.21.15.46:0/1823021624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc101e10 msgr2=0x7f52bc1021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 --2- 172.21.15.46:0/1823021624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc101e10 0x7f52bc1021e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52ac004940 tx=0x7f52ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:17.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 -- 172.21.15.46:0/1823021624 shutdown_connections 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 --2- 172.21.15.46:0/1823021624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52bc0fc630 0x7f52bc0fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 --2- 172.21.15.46:0/1823021624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc101e10 0x7f52bc1021e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 -- 172.21.15.46:0/1823021624 >> 172.21.15.46:0/1823021624 conn(0x7f52bc0714d0 msgr2=0x7f52bc0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 -- 172.21.15.46:0/1823021624 shutdown_connections 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 -- 172.21.15.46:0/1823021624 wait complete. 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.544+0000 7f52c236e700 1 Processor -- start 2024-05-09T06:39:17.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52c236e700 1 -- start start 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52c236e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 0x7f52bc113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52c236e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52bc101e10 0x7f52bc113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52c236e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc114520 con 0x7f52bc0fc630 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52c236e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc10db20 con 0x7f52bc101e10 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 0x7f52bc113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 0x7f52bc113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54594/0 (socket says 172.21.15.46:54594) 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 -- 172.21.15.46:0/3802301959 learned_addr learned my addr 172.21.15.46:0/3802301959 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52b3fff700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52bc101e10 0x7f52bc113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 -- 172.21.15.46:0/3802301959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52bc101e10 msgr2=0x7f52bc113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52bc101e10 0x7f52bc113ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 -- 172.21.15.46:0/3802301959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac005040 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.545+0000 7f52bbfff700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 0x7f52bc113990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009180 tx=0x7f52ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.546+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ac00e040 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.546+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52ac013420 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.546+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc10dda0 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.546+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ac01c630 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.546+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc10e2e0 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.547+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc100140 con 0x7f52bc0fc630 2024-05-09T06:39:17.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.547+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f52ac013590 con 0x7f52bc0fc630 2024-05-09T06:39:17.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.548+0000 7f52b97fa700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f52a8078980 0x7f52a807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.548+0000 7f52b3fff700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f52a8078980 0x7f52a807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.548+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f52ac09b800 con 0x7f52bc0fc630 2024-05-09T06:39:17.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.548+0000 7f52b3fff700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f52a8078980 0x7f52a807ae30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52bc10ece0 tx=0x7f52a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:17.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.553+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f52ac063520 con 0x7f52bc0fc630 2024-05-09T06:39:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.776+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52bc10efe0 con 0x7f52a8078980 2024-05-09T06:39:17.756 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:17 smithi046 ceph-mon[110713]: pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:17.756 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:17 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:17.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.786+0000 7f52b97fa700 1 -- 172.21.15.46:0/3802301959 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f52bc10efe0 con 0x7f52a8078980 2024-05-09T06:39:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:39:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 83s ago 17m 24.3M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:39:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (3m) 83s ago 17m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:39:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (3m) 17s ago 16m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:39:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 83s ago 16m 79.8M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (11m) 83s ago 11m 14.4M - 17.2.7-933-g4ba5a836 b96134859c76 440359c178ea 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (11m) 83s ago 11m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (11m) 17s ago 11m 18.6M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (11m) 17s ago 11m 16.3M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (8m) 83s ago 18m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (7m) 17s ago 16m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (4m) 83s ago 18m 49.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (3m) 17s ago 16m 36.7M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 83s ago 17m 15.1M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (6m) 17s ago 16m 15.5M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (2m) 83s ago 15m 96.8M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 83s ago 14m 102M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (89s) 83s ago 14m 15.0M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (54s) 17s ago 14m 112M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:39:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (20s) 17s ago 13m 12.7M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 19b53c23db28 2024-05-09T06:39:17.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (13m) 17s ago 13m 239M 2581M 17.2.7-933-g4ba5a836 b96134859c76 b78ef0652cfe 2024-05-09T06:39:17.768 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 83s ago 16m 66.6M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f52a8078980 msgr2=0x7f52a807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f52a8078980 0x7f52a807ae30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52bc10ece0 tx=0x7f52a400b040 comp rx=0 tx=0).stop 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 msgr2=0x7f52bc113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 0x7f52bc113990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009180 tx=0x7f52ac009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 shutdown_connections 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f52a8078980 0x7f52a807ae30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52bc0fc630 0x7f52bc113990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 --2- 172.21.15.46:0/3802301959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52bc101e10 0x7f52bc113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 >> 172.21.15.46:0/3802301959 conn(0x7f52bc0714d0 msgr2=0x7f52bc1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:17.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 shutdown_connections 2024-05-09T06:39:17.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.789+0000 7f52c236e700 1 -- 172.21.15.46:0/3802301959 wait complete. 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 -- 172.21.15.46:0/2350021784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fe800 msgr2=0x7f3744106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 --2- 172.21.15.46:0/2350021784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fe800 0x7f3744106e40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3730004940 tx=0x7f3730009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 -- 172.21.15.46:0/2350021784 shutdown_connections 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 --2- 172.21.15.46:0/2350021784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fe800 0x7f3744106e40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 --2- 172.21.15.46:0/2350021784 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440fde60 0x7f37440fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 -- 172.21.15.46:0/2350021784 >> 172.21.15.46:0/2350021784 conn(0x7f37440f7870 msgr2=0x7f37440f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 -- 172.21.15.46:0/2350021784 shutdown_connections 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.894+0000 7f374aec1700 1 -- 172.21.15.46:0/2350021784 wait complete. 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f374aec1700 1 Processor -- start 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f374aec1700 1 -- start start 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f374aec1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 0x7f3744113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f374aec1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440fe800 0x7f3744113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f374aec1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441144d0 con 0x7f37440fde60 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f374aec1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374410dad0 con 0x7f37440fe800 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f3748c5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 0x7f3744113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f3748c5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 0x7f3744113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54612/0 (socket says 172.21.15.46:54612) 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.895+0000 7f3748c5d700 1 -- 172.21.15.46:0/3553146954 learned_addr learned my addr 172.21.15.46:0/3553146954 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f3743fff700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440fe800 0x7f3744113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f3748c5d700 1 -- 172.21.15.46:0/3553146954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440fe800 msgr2=0x7f3744113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f3748c5d700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440fe800 0x7f3744113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f3748c5d700 1 -- 172.21.15.46:0/3553146954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730005040 con 0x7f37440fde60 2024-05-09T06:39:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f3748c5d700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 0x7f3744113940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f373800c8c0 tx=0x7f37380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373800a760 con 0x7f37440fde60 2024-05-09T06:39:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f373800ad90 con 0x7f37440fde60 2024-05-09T06:39:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37380113a0 con 0x7f37440fde60 2024-05-09T06:39:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374410ddb0 con 0x7f37440fde60 2024-05-09T06:39:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.896+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374410e2a0 con 0x7f37440fde60 2024-05-09T06:39:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.897+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744066ad0 con 0x7f37440fde60 2024-05-09T06:39:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.898+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f3738012400 con 0x7f37440fde60 2024-05-09T06:39:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.898+0000 7f37417fa700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3734078980 0x7f373407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.899+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f373809a6b0 con 0x7f37440fde60 2024-05-09T06:39:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.899+0000 7f3743fff700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3734078980 0x7f373407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.899+0000 7f3743fff700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3734078980 0x7f373407ae30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f374410ec90 tx=0x7f3730009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:17.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:17.903+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f37380623f0 con 0x7f37440fde60 2024-05-09T06:39:18.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:17 smithi106 ceph-mon[81208]: pgmap v150: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:18.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:17 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:18.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.208+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3744109e20 con 0x7f37440fde60 2024-05-09T06:39:18.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.208+0000 7f37417fa700 1 -- 172.21.15.46:0/3553146954 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f3738061d90 con 0x7f37440fde60 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 5 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:39:18.189 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 4 2024-05-09T06:39:18.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:18.190 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:39:18.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 5, 2024-05-09T06:39:18.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 9 2024-05-09T06:39:18.190 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:39:18.190 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:39:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3734078980 msgr2=0x7f373407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3734078980 0x7f373407ae30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f374410ec90 tx=0x7f3730009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 msgr2=0x7f3744113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 0x7f3744113940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f373800c8c0 tx=0x7f37380044c0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 shutdown_connections 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3734078980 0x7f373407ae30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37440fde60 0x7f3744113940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 --2- 172.21.15.46:0/3553146954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440fe800 0x7f3744113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 >> 172.21.15.46:0/3553146954 conn(0x7f37440f7870 msgr2=0x7f37441016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 shutdown_connections 2024-05-09T06:39:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.211+0000 7f374aec1700 1 -- 172.21.15.46:0/3553146954 wait complete. 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 -- 172.21.15.46:0/1073035419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fde70 msgr2=0x7f91300fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 --2- 172.21.15.46:0/1073035419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fde70 0x7f91300fe240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9124004940 tx=0x7f9124009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 -- 172.21.15.46:0/1073035419 shutdown_connections 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 --2- 172.21.15.46:0/1073035419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91300fe810 0x7f9130106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 --2- 172.21.15.46:0/1073035419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fde70 0x7f91300fe240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 -- 172.21.15.46:0/1073035419 >> 172.21.15.46:0/1073035419 conn(0x7f91300f7860 msgr2=0x7f91300f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 -- 172.21.15.46:0/1073035419 shutdown_connections 2024-05-09T06:39:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.317+0000 7f913821e700 1 -- 172.21.15.46:0/1073035419 wait complete. 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f913821e700 1 Processor -- start 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f913821e700 1 -- start start 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f913821e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91300fde70 0x7f9130113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f913821e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 0x7f9130113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f913821e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9130114550 con 0x7f91300fe810 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f913821e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913010dac0 con 0x7f91300fde70 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f91357b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 0x7f9130113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f91357b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 0x7f9130113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54630/0 (socket says 172.21.15.46:54630) 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f91357b9700 1 -- 172.21.15.46:0/4271273762 learned_addr learned my addr 172.21.15.46:0/4271273762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.318+0000 7f9135fba700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91300fde70 0x7f9130113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91357b9700 1 -- 172.21.15.46:0/4271273762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91300fde70 msgr2=0x7f9130113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91357b9700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91300fde70 0x7f9130113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91357b9700 1 -- 172.21.15.46:0/4271273762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124005040 con 0x7f91300fe810 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91357b9700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 0x7f9130113e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f912c00b790 tx=0x7f912c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c00f6f0 con 0x7f91300fe810 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f912c00fd20 con 0x7f91300fe810 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913010dda0 con 0x7f91300fe810 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c0103a0 con 0x7f91300fe810 2024-05-09T06:39:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.319+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913010e2e0 con 0x7f91300fe810 2024-05-09T06:39:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.320+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9130066af0 con 0x7f91300fe810 2024-05-09T06:39:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.321+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f912c011400 con 0x7f91300fe810 2024-05-09T06:39:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.321+0000 7f91227fc700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f911c078990 0x7f911c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.321+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f912c09a380 con 0x7f91300fe810 2024-05-09T06:39:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.321+0000 7f9135fba700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f911c078990 0x7f911c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.322+0000 7f9135fba700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f911c078990 0x7f911c07ae40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9124004f90 tx=0x7f9124009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.326+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f912c062160 con 0x7f91300fe810 2024-05-09T06:39:18.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.587+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9130109eb0 con 0x7f91300fe810 2024-05-09T06:39:18.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.587+0000 7f91227fc700 1 -- 172.21.15.46:0/4271273762 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f912c061b00 con 0x7f91300fe810 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:e16 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:39:18.568 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:39:18.569 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1596433396,v1:172.21.15.46:6827/1596433396] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:18.570 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f911c078990 msgr2=0x7f911c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f911c078990 0x7f911c07ae40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9124004f90 tx=0x7f9124009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 msgr2=0x7f9130113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 0x7f9130113e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f912c00b790 tx=0x7f912c009250 comp rx=0 tx=0).stop 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 shutdown_connections 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f911c078990 0x7f911c07ae40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91300fde70 0x7f9130113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 --2- 172.21.15.46:0/4271273762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91300fe810 0x7f9130113e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 >> 172.21.15.46:0/4271273762 conn(0x7f91300f7860 msgr2=0x7f91300f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:18.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 shutdown_connections 2024-05-09T06:39:18.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.591+0000 7f913821e700 1 -- 172.21.15.46:0/4271273762 wait complete. 2024-05-09T06:39:18.572 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 16 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 -- 172.21.15.46:0/1129340377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 msgr2=0x7f23f8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 --2- 172.21.15.46:0/1129340377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8106e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f23e8004940 tx=0x7f23e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 -- 172.21.15.46:0/1129340377 shutdown_connections 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 --2- 172.21.15.46:0/1129340377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8106e60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 --2- 172.21.15.46:0/1129340377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f80fddf0 0x7f23f80fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 -- 172.21.15.46:0/1129340377 >> 172.21.15.46:0/1129340377 conn(0x7f23f80f7870 msgr2=0x7f23f80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 -- 172.21.15.46:0/1129340377 shutdown_connections 2024-05-09T06:39:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 -- 172.21.15.46:0/1129340377 wait complete. 2024-05-09T06:39:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 Processor -- start 2024-05-09T06:39:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.699+0000 7f23fec4c700 1 -- start start 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23fec4c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f80fddf0 0x7f23f8113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23fec4c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23fec4c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8114520 con 0x7f23f80fe790 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23fec4c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f810db20 con 0x7f23f80fddf0 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54646/0 (socket says 172.21.15.46:54646) 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 -- 172.21.15.46:0/2451799350 learned_addr learned my addr 172.21.15.46:0/2451799350 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23fc9e8700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f80fddf0 0x7f23f8113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 -- 172.21.15.46:0/2451799350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f80fddf0 msgr2=0x7f23f8113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f80fddf0 0x7f23f8113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 -- 172.21.15.46:0/2451799350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8005040 con 0x7f23f80fe790 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.700+0000 7f23effff700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8113ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009180 tx=0x7f23e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.701+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e800e040 con 0x7f23f80fe790 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.701+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23e8013420 con 0x7f23f80fe790 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.701+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f810dda0 con 0x7f23f80fe790 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.701+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e801c630 con 0x7f23f80fe790 2024-05-09T06:39:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.701+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f810e2e0 con 0x7f23f80fe790 2024-05-09T06:39:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.702+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f8066ab0 con 0x7f23f80fe790 2024-05-09T06:39:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.702+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f23e8013590 con 0x7f23f80fe790 2024-05-09T06:39:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.703+0000 7f23ed7fa700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23e0078980 0x7f23e007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.703+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f23e809bab0 con 0x7f23f80fe790 2024-05-09T06:39:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.703+0000 7f23fc9e8700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23e0078980 0x7f23e007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.703+0000 7f23fc9e8700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23e0078980 0x7f23e007ae30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23f4007fd0 tx=0x7f23f4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.708+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f23e809de60 con 0x7f23f80fe790 2024-05-09T06:39:18.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:18 smithi046 ceph-mon[110713]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:18.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:18 smithi046 ceph-mon[110713]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:18.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:18 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3553146954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:18.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:18 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/4271273762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:18.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.942+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23f8109e80 con 0x7f23e0078980 2024-05-09T06:39:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.943+0000 7f23ed7fa700 1 -- 172.21.15.46:0/2451799350 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f23f8109e80 con 0x7f23e0078980 2024-05-09T06:39:18.923 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:39:18.923 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:39:18.923 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "11/21 daemons upgraded", 2024-05-09T06:39:18.924 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-05-09T06:39:18.925 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:39:18.925 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:39:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23e0078980 msgr2=0x7f23e007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23e0078980 0x7f23e007ae30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23f4007fd0 tx=0x7f23f4009040 comp rx=0 tx=0).stop 2024-05-09T06:39:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 msgr2=0x7f23f8113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8113ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009180 tx=0x7f23e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 shutdown_connections 2024-05-09T06:39:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23e0078980 0x7f23e007ae30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23f80fddf0 0x7f23f8113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 --2- 172.21.15.46:0/2451799350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80fe790 0x7f23f8113ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.945+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 >> 172.21.15.46:0/2451799350 conn(0x7f23f80f7870 msgr2=0x7f23f80f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.946+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 shutdown_connections 2024-05-09T06:39:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:18.946+0000 7f23fec4c700 1 -- 172.21.15.46:0/2451799350 wait complete. 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.052+0000 7f963679d700 1 -- 172.21.15.46:0/1028141017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96301024f0 msgr2=0x7f96300fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.052+0000 7f963679d700 1 --2- 172.21.15.46:0/1028141017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96301024f0 0x7f96300fbb60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9620004940 tx=0x7f9620009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 -- 172.21.15.46:0/1028141017 shutdown_connections 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 --2- 172.21.15.46:0/1028141017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96301024f0 0x7f96300fbb60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 --2- 172.21.15.46:0/1028141017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9630101b50 0x7f9630101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 -- 172.21.15.46:0/1028141017 >> 172.21.15.46:0/1028141017 conn(0x7f96300f76c0 msgr2=0x7f96300f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 -- 172.21.15.46:0/1028141017 shutdown_connections 2024-05-09T06:39:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 -- 172.21.15.46:0/1028141017 wait complete. 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 Processor -- start 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.053+0000 7f963679d700 1 -- start start 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963679d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 0x7f963010eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963679d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96301024f0 0x7f963010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963679d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963010f590 con 0x7f9630101b50 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963679d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963010f6d0 con 0x7f96301024f0 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 0x7f963010eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 0x7f963010eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54658/0 (socket says 172.21.15.46:54658) 2024-05-09T06:39:19.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 -- 172.21.15.46:0/3937925859 learned_addr learned my addr 172.21.15.46:0/3937925859 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f9634f9a700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96301024f0 0x7f963010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 -- 172.21.15.46:0/3937925859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96301024f0 msgr2=0x7f963010f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96301024f0 0x7f963010f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 -- 172.21.15.46:0/3937925859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620005040 con 0x7f9630101b50 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963579b700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 0x7f963010eb10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c8c0 tx=0x7f962c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962c00a980 con 0x7f9630101b50 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f962c00ce60 con 0x7f9630101b50 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96301179c0 con 0x7f9630101b50 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.054+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962c0115e0 con 0x7f9630101b50 2024-05-09T06:39:19.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.055+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9630117f50 con 0x7f9630101b50 2024-05-09T06:39:19.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.056+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96300fd2a0 con 0x7f9630101b50 2024-05-09T06:39:19.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.056+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f962c012400 con 0x7f9630101b50 2024-05-09T06:39:19.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.057+0000 7f9625ffb700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f961c078990 0x7f961c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:19.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.057+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f962c09a870 con 0x7f9630101b50 2024-05-09T06:39:19.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.057+0000 7f9634f9a700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f961c078990 0x7f961c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:19.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.057+0000 7f9634f9a700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f961c078990 0x7f961c07ae40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f962000b3b0 tx=0x7f9620009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:19.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.062+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f962c062510 con 0x7f9630101b50 2024-05-09T06:39:19.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:18 smithi106 ceph-mon[81208]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:19.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:18 smithi106 ceph-mon[81208]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:19.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:18 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3553146954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:19.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:18 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/4271273762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.368+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f963004bed0 con 0x7f9630101b50 2024-05-09T06:39:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.368+0000 7f9625ffb700 1 -- 172.21.15.46:0/3937925859 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f962c05ce60 con 0x7f9630101b50 2024-05-09T06:39:19.348 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:19.348 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:19.348 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f961c078990 msgr2=0x7f961c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f961c078990 0x7f961c07ae40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f962000b3b0 tx=0x7f9620009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 msgr2=0x7f963010eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 0x7f963010eb10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c8c0 tx=0x7f962c0044c0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 shutdown_connections 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f961c078990 0x7f961c07ae40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9630101b50 0x7f963010eb10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 --2- 172.21.15.46:0/3937925859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96301024f0 0x7f963010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:19.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 >> 172.21.15.46:0/3937925859 conn(0x7f96300f76c0 msgr2=0x7f96300f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:19.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 shutdown_connections 2024-05-09T06:39:19.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:19.371+0000 7f963679d700 1 -- 172.21.15.46:0/3937925859 wait complete. 2024-05-09T06:39:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:19 smithi106 ceph-mon[81208]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:19 smithi106 ceph-mon[81208]: pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:19 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3937925859' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:20.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:19 smithi046 ceph-mon[110713]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:19 smithi046 ceph-mon[110713]: pgmap v151: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:19 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3937925859' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:21.034 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:20 smithi106 ceph-mon[81208]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:21.034 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:20 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:21.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:20 smithi046 ceph-mon[110713]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:21.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:20 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:22.002 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:21 smithi106 ceph-mon[81208]: pgmap v152: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:22.002 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:21 smithi106 ceph-mon[81208]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:22.002 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:21 smithi106 ceph-mon[81208]: Upgrade: osd.5 is safe to restart 2024-05-09T06:39:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:21 smithi046 ceph-mon[110713]: pgmap v152: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:21 smithi046 ceph-mon[110713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-05-09T06:39:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:21 smithi046 ceph-mon[110713]: Upgrade: osd.5 is safe to restart 2024-05-09T06:39:23.300 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:23 smithi106 ceph-mon[81208]: Upgrade: Updating osd.5 2024-05-09T06:39:23.300 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:23 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:23.300 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:23 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:39:23.300 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:23 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:23.300 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:23 smithi106 ceph-mon[81208]: Deploying daemon osd.5 on smithi106 2024-05-09T06:39:23.300 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:23 smithi106 ceph-mon[81208]: pgmap v153: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:23 smithi046 ceph-mon[110713]: Upgrade: Updating osd.5 2024-05-09T06:39:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T06:39:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:23 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:23 smithi046 ceph-mon[110713]: Deploying daemon osd.5 on smithi106 2024-05-09T06:39:23.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:23 smithi046 ceph-mon[110713]: pgmap v153: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:25.497 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:25 smithi106 ceph-mon[81208]: pgmap v154: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:25.497 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:25 smithi106 systemd[1]: Stopping Ceph osd.5 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:39:25.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:25 smithi046 ceph-mon[110713]: pgmap v154: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:25.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:25 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[53529]: 2024-05-09T06:39:25.515+0000 7f5e71fc9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:39:25.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:25 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[53529]: 2024-05-09T06:39:25.515+0000 7f5e71fc9700 -1 osd.5 74 *** Got signal Terminated *** 2024-05-09T06:39:25.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:25 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[53529]: 2024-05-09T06:39:25.515+0000 7f5e71fc9700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:39:26.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:26 smithi106 ceph-mon[81208]: osd.5 marked itself down and dead 2024-05-09T06:39:26.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:26 smithi046 ceph-mon[110713]: osd.5 marked itself down and dead 2024-05-09T06:39:26.971 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:26 smithi106 podman[99998]: 2024-05-09 06:39:26.702650083 +0000 UTC m=+1.290903367 container died b78ef0652cfe97c4cbf4c89f50fd974398cc23051157dd28c834a0599a80d0d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-4ba5a83, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-09T06:39:27.322 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[99998]: 2024-05-09 06:39:27.082445456 +0000 UTC m=+1.670698728 container cleanup b78ef0652cfe97c4cbf4c89f50fd974398cc23051157dd28c834a0599a80d0d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, RELEASE=quincy-4ba5a83, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:39:27.322 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 bash[99998]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5 2024-05-09T06:39:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:27 smithi106 ceph-mon[81208]: pgmap v155: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:27 smithi106 ceph-mon[81208]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:39:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:27 smithi106 ceph-mon[81208]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-09T06:39:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:27 smithi106 ceph-mon[81208]: osdmap e75: 6 total, 5 up, 6 in 2024-05-09T06:39:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:27.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:27 smithi046 ceph-mon[110713]: pgmap v155: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-05-09T06:39:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:27 smithi046 ceph-mon[110713]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-09T06:39:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:27 smithi046 ceph-mon[110713]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-05-09T06:39:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:27 smithi046 ceph-mon[110713]: osdmap e75: 6 total, 5 up, 6 in 2024-05-09T06:39:27.486 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:27.487 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:27.682 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[100015]: 2024-05-09 06:39:27.375570874 +0000 UTC m=+0.662459604 container remove b78ef0652cfe97c4cbf4c89f50fd974398cc23051157dd28c834a0599a80d0d3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1fecd12aecccb37151416464d9ece47004238d8a3637749369bead3b1c2e4228, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=quincy-4ba5a83, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:39:27.959 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[100110]: 2024-05-09 06:39:27.60580003 +0000 UTC m=+0.018115411 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:39:27.959 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[100110]: 2024-05-09 06:39:27.710022382 +0000 UTC m=+0.122337796 container create f660286217dd7eab51ded29084c8692a14ab0bd1f89c5f46fb816a862e36ee91 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:39:27.959 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[100110]: 2024-05-09 06:39:27.912586812 +0000 UTC m=+0.324902183 container init f660286217dd7eab51ded29084c8692a14ab0bd1f89c5f46fb816a862e36ee91 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-09T06:39:27.959 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[100110]: 2024-05-09 06:39:27.915993831 +0000 UTC m=+0.328309209 container start f660286217dd7eab51ded29084c8692a14ab0bd1f89c5f46fb816a862e36ee91 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-09T06:39:27.959 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:27 smithi106 podman[100110]: 2024-05-09 06:39:27.97895847 +0000 UTC m=+0.391273846 container attach f660286217dd7eab51ded29084c8692a14ab0bd1f89c5f46fb816a862e36ee91 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, CEPH_POINT_RELEASE=) 2024-05-09T06:39:28.212 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:28 smithi106 podman[100110]: 2024-05-09 06:39:28.208510762 +0000 UTC m=+0.620826133 container died f660286217dd7eab51ded29084c8692a14ab0bd1f89c5f46fb816a862e36ee91 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-09T06:39:28.478 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:28 smithi106 ceph-mon[81208]: osdmap e76: 6 total, 5 up, 6 in 2024-05-09T06:39:28.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:28 smithi046 ceph-mon[110713]: osdmap e76: 6 total, 5 up, 6 in 2024-05-09T06:39:29.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:28 smithi106 podman[100137]: 2024-05-09 06:39:28.74925669 +0000 UTC m=+0.534983589 container remove f660286217dd7eab51ded29084c8692a14ab0bd1f89c5f46fb816a862e36ee91 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9) 2024-05-09T06:39:29.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:28 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.5.service: Deactivated successfully. 2024-05-09T06:39:29.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:28 smithi106 systemd[1]: Stopped Ceph osd.5 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:39:29.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:28 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.5.service: Consumed 1min 3.834s CPU time. 2024-05-09T06:39:29.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:28 smithi106 systemd[1]: Starting Ceph osd.5 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:39:29.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:29 smithi106 ceph-mon[81208]: pgmap v158: 65 pgs: 2 active+undersized+degraded, 3 peering, 10 stale+active+clean, 1 active+undersized, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2/219 objects degraded (0.913%) 2024-05-09T06:39:29.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:29 smithi106 ceph-mon[81208]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-09T06:39:29.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:29 smithi106 ceph-mon[81208]: Health check failed: Degraded data redundancy: 2/219 objects degraded (0.913%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:29.474 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 podman[100241]: 2024-05-09 06:39:29.100463594 +0000 UTC m=+0.018821815 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:39:29.474 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 podman[100241]: 2024-05-09 06:39:29.208452964 +0000 UTC m=+0.126811189 container create 749e3447a16867cb5264f2e4af744546f4507c70e77b2171072ab2dfcfcc72c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-720f8e9) 2024-05-09T06:39:29.474 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 podman[100241]: 2024-05-09 06:39:29.436392152 +0000 UTC m=+0.354750386 container init 749e3447a16867cb5264f2e4af744546f4507c70e77b2171072ab2dfcfcc72c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-09T06:39:29.475 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 podman[100241]: 2024-05-09 06:39:29.439699647 +0000 UTC m=+0.358057869 container start 749e3447a16867cb5264f2e4af744546f4507c70e77b2171072ab2dfcfcc72c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-09T06:39:29.475 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 podman[100241]: 2024-05-09 06:39:29.494556573 +0000 UTC m=+0.412914804 container attach 749e3447a16867cb5264f2e4af744546f4507c70e77b2171072ab2dfcfcc72c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-05-09T06:39:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:29 smithi046 ceph-mon[110713]: pgmap v158: 65 pgs: 2 active+undersized+degraded, 3 peering, 10 stale+active+clean, 1 active+undersized, 49 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2/219 objects degraded (0.913%) 2024-05-09T06:39:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:29 smithi046 ceph-mon[110713]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-09T06:39:29.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:29 smithi046 ceph-mon[110713]: Health check failed: Degraded data redundancy: 2/219 objects degraded (0.913%), 2 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:39:30.220 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 bash[100241]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate[100256]: --> ceph-volume raw activate successful for osd ID: 5 2024-05-09T06:39:30.221 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:29 smithi106 podman[100241]: 2024-05-09 06:39:29.945054349 +0000 UTC m=+0.863412573 container died 749e3447a16867cb5264f2e4af744546f4507c70e77b2171072ab2dfcfcc72c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-09T06:39:30.824 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:30 smithi106 podman[100380]: 2024-05-09 06:39:30.523277162 +0000 UTC m=+0.573041873 container remove 749e3447a16867cb5264f2e4af744546f4507c70e77b2171072ab2dfcfcc72c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-09T06:39:30.824 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:30 smithi106 podman[100441]: 2024-05-09 06:39:30.643616559 +0000 UTC m=+0.018108052 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:39:30.824 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:30 smithi106 podman[100441]: 2024-05-09 06:39:30.749096261 +0000 UTC m=+0.123587731 container create 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-09T06:39:31.216 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:30 smithi106 podman[100441]: 2024-05-09 06:39:30.960609273 +0000 UTC m=+0.335100755 container init 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-09T06:39:31.216 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:30 smithi106 podman[100441]: 2024-05-09 06:39:30.965078684 +0000 UTC m=+0.339570160 container start 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-09T06:39:31.216 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:30 smithi106 ceph-osd[100461]: -- 172.21.15.106:0/3658297374 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55569ca79680 con 0x55569ca43000 2024-05-09T06:39:31.216 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:31 smithi106 bash[100441]: 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d 2024-05-09T06:39:31.216 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:31 smithi106 systemd[1]: Started Ceph osd.5 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:39:31.497 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:31 smithi106 ceph-mon[81208]: pgmap v159: 65 pgs: 7 active+undersized+degraded, 3 peering, 3 stale+active+clean, 8 active+undersized, 44 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-05-09T06:39:31.498 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:31 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:31.498 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:31 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:31.498 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:31 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:31 smithi046 ceph-mon[110713]: pgmap v159: 65 pgs: 7 active+undersized+degraded, 3 peering, 3 stale+active+clean, 8 active+undersized, 44 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13/219 objects degraded (5.936%) 2024-05-09T06:39:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:31 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:31 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:31.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:31 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:31.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:31 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:39:31.517+0000 7f3c50c957c0 -1 Falling back to public interface 2024-05-09T06:39:32.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:32 smithi106 ceph-mon[81208]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-09T06:39:32.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:32 smithi046 ceph-mon[110713]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-09T06:39:33.570 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:33 smithi106 ceph-mon[81208]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:33.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:33 smithi046 ceph-mon[110713]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:35.247 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:34 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:35.247 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:34 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:35.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:34 smithi046 ceph-mon[110713]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:35.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:34 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:35.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:34 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:35.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:34 smithi106 ceph-mon[81208]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:36.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:36 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:36.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:36 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:36.323 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:36 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:39:36.213+0000 7f3c50c957c0 -1 osd.5 74 log_to_monitors true 2024-05-09T06:39:36.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:36 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:36.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:36 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:37.322 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:39:37 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:39:37.109+0000 7f3c420ec700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T06:39:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:37 smithi106 ceph-mon[81208]: pgmap v162: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:37 smithi106 ceph-mon[81208]: from='osd.5 [v2:172.21.15.106:6816/3688804832,v1:172.21.15.106:6817/3688804832]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:39:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:37 smithi106 ceph-mon[81208]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:39:37.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:37 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:37.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:37 smithi046 ceph-mon[110713]: pgmap v162: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:37.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:37 smithi046 ceph-mon[110713]: from='osd.5 [v2:172.21.15.106:6816/3688804832,v1:172.21.15.106:6817/3688804832]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:39:37.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:37 smithi046 ceph-mon[110713]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T06:39:37.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:37 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 12 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:38.364 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:38 smithi106 ceph-mon[81208]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:39:38.364 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:38 smithi106 ceph-mon[81208]: osdmap e77: 6 total, 5 up, 6 in 2024-05-09T06:39:38.364 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:38 smithi106 ceph-mon[81208]: from='osd.5 [v2:172.21.15.106:6816/3688804832,v1:172.21.15.106:6817/3688804832]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:38.364 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:38 smithi106 ceph-mon[81208]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:38 smithi046 ceph-mon[110713]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T06:39:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:38 smithi046 ceph-mon[110713]: osdmap e77: 6 total, 5 up, 6 in 2024-05-09T06:39:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:38 smithi046 ceph-mon[110713]: from='osd.5 [v2:172.21.15.106:6816/3688804832,v1:172.21.15.106:6817/3688804832]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:38 smithi046 ceph-mon[110713]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: osd.5 [v2:172.21.15.106:6816/3688804832,v1:172.21.15.106:6817/3688804832] boot 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: osdmap e78: 6 total, 6 up, 6 in 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: pgmap v165: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:39.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all osd 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-09T06:39:39.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: Upgrade: Setting require_osd_release to 19 squid 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-09T06:39:39.575 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:39 smithi106 ceph-mon[81208]: osdmap e79: 6 total, 6 up, 6 in 2024-05-09T06:39:39.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-09T06:39:39.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: osd.5 [v2:172.21.15.106:6816/3688804832,v1:172.21.15.106:6817/3688804832] boot 2024-05-09T06:39:39.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: osdmap e78: 6 total, 6 up, 6 in 2024-05-09T06:39:39.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: pgmap v165: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all osd 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-05-09T06:39:39.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: Upgrade: Setting require_osd_release to 19 squid 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-05-09T06:39:39.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:39 smithi046 ceph-mon[110713]: osdmap e79: 6 total, 6 up, 6 in 2024-05-09T06:39:41.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:41 smithi046 ceph-mon[110713]: pgmap v167: 65 pgs: 3 peering, 9 active+undersized+degraded, 14 active+undersized, 39 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-05-09T06:39:41.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:41.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:41.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:41 smithi106 ceph-mon[81208]: pgmap v167: 65 pgs: 3 peering, 9 active+undersized+degraded, 14 active+undersized, 39 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-05-09T06:39:41.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:41.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.easboa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:41.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:42.454 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:42 smithi046 ceph-mon[110713]: Upgrade: Updating mds.cephfs.smithi046.easboa 2024-05-09T06:39:42.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:42 smithi046 ceph-mon[110713]: Deploying daemon mds.cephfs.smithi046.easboa on smithi046 2024-05-09T06:39:42.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:42 smithi046 ceph-mon[110713]: Health check update: Degraded data redundancy: 23/219 objects degraded (10.502%), 9 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:42.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:42.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:42 smithi106 ceph-mon[81208]: Upgrade: Updating mds.cephfs.smithi046.easboa 2024-05-09T06:39:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:42 smithi106 ceph-mon[81208]: Deploying daemon mds.cephfs.smithi046.easboa on smithi046 2024-05-09T06:39:42.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:42 smithi106 ceph-mon[81208]: Health check update: Degraded data redundancy: 23/219 objects degraded (10.502%), 9 pgs degraded (PG_DEGRADED) 2024-05-09T06:39:42.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:42.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:43.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:43 smithi046 ceph-mon[110713]: pgmap v168: 65 pgs: 3 peering, 1 active+undersized+degraded, 1 active+undersized, 60 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1/219 objects degraded (0.457%) 2024-05-09T06:39:43.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:43 smithi106 ceph-mon[81208]: pgmap v168: 65 pgs: 3 peering, 1 active+undersized+degraded, 1 active+undersized, 60 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1/219 objects degraded (0.457%) 2024-05-09T06:39:44.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:44 smithi106 ceph-mon[81208]: osdmap e80: 6 total, 6 up, 6 in 2024-05-09T06:39:44.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:44 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 2 up:standby 2024-05-09T06:39:44.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:44 smithi046 ceph-mon[110713]: osdmap e80: 6 total, 6 up, 6 in 2024-05-09T06:39:44.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:44 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 2 up:standby 2024-05-09T06:39:45.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:45 smithi046 ceph-mon[110713]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:45.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:45 smithi046 ceph-mon[110713]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/219 objects degraded (0.457%), 1 pg degraded) 2024-05-09T06:39:45.473 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:45 smithi106 ceph-mon[81208]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:45.474 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:45 smithi106 ceph-mon[81208]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/219 objects degraded (0.457%), 1 pg degraded) 2024-05-09T06:39:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:47 smithi106 ceph-mon[81208]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:47.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:47 smithi046 ceph-mon[110713]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:48.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:48 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:boot 2024-05-09T06:39:48.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:48 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:39:48.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:48 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:39:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:48 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:boot 2024-05-09T06:39:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:48 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.pkuwsr=up:active} 3 up:standby 2024-05-09T06:39:48.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:48 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 -- 172.21.15.46:0/1523038651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2190101d90 msgr2=0x7f2190102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 --2- 172.21.15.46:0/1523038651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2190101d90 0x7f2190102160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2180004940 tx=0x7f2180009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 -- 172.21.15.46:0/1523038651 shutdown_connections 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 --2- 172.21.15.46:0/1523038651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21900fbd40 0x7f21900fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 --2- 172.21.15.46:0/1523038651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2190101d90 0x7f2190102160 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 -- 172.21.15.46:0/1523038651 >> 172.21.15.46:0/1523038651 conn(0x7f2190071d00 msgr2=0x7f2190072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:49.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.481+0000 7f2195177700 1 -- 172.21.15.46:0/1523038651 shutdown_connections 2024-05-09T06:39:49.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.482+0000 7f2195177700 1 -- 172.21.15.46:0/1523038651 wait complete. 2024-05-09T06:39:49.463 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:49 smithi046 ceph-mon[110713]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.482+0000 7f2195177700 1 Processor -- start 2024-05-09T06:39:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.482+0000 7f2195177700 1 -- start start 2024-05-09T06:39:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f2195177700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 0x7f21901129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f2195177700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2190101d90 0x7f2190112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f2195177700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190113570 con 0x7f21900fbd40 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f2195177700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219010c960 con 0x7f2190101d90 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 0x7f21901129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 0x7f21901129e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60334/0 (socket says 172.21.15.46:60334) 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 -- 172.21.15.46:0/510144560 learned_addr learned my addr 172.21.15.46:0/510144560 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218e59c700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2190101d90 0x7f2190112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 -- 172.21.15.46:0/510144560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2190101d90 msgr2=0x7f2190112f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2190101d90 0x7f2190112f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 -- 172.21.15.46:0/510144560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180005040 con 0x7f21900fbd40 2024-05-09T06:39:49.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.483+0000 7f218ed9d700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 0x7f21901129e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2180009180 tx=0x7f2180009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:49.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.484+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f218000e040 con 0x7f21900fbd40 2024-05-09T06:39:49.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.484+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f218000bdd0 con 0x7f21900fbd40 2024-05-09T06:39:49.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.484+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219010cbe0 con 0x7f21900fbd40 2024-05-09T06:39:49.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.484+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2180013660 con 0x7f21900fbd40 2024-05-09T06:39:49.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.484+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219010d140 con 0x7f21900fbd40 2024-05-09T06:39:49.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.485+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21900fd430 con 0x7f21900fbd40 2024-05-09T06:39:49.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.485+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f218001ea80 con 0x7f21900fbd40 2024-05-09T06:39:49.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.486+0000 7f21777fe700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2178078980 0x7f217807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:49.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.486+0000 7f218e59c700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2178078980 0x7f217807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:49.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.486+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f218009e440 con 0x7f21900fbd40 2024-05-09T06:39:49.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.487+0000 7f218e59c700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2178078980 0x7f217807ae30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f219010db20 tx=0x7f218400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:49.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.491+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2180066120 con 0x7f21900fbd40 2024-05-09T06:39:49.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:49 smithi106 ceph-mon[81208]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:49.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.752+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f219004bed0 con 0x7f2178078980 2024-05-09T06:39:49.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.754+0000 7f21777fe700 1 -- 172.21.15.46:0/510144560 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f219004bed0 con 0x7f2178078980 2024-05-09T06:39:49.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2178078980 msgr2=0x7f217807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:49.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2178078980 0x7f217807ae30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f219010db20 tx=0x7f218400b040 comp rx=0 tx=0).stop 2024-05-09T06:39:49.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 msgr2=0x7f21901129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:49.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 0x7f21901129e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2180009180 tx=0x7f2180009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 shutdown_connections 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2178078980 0x7f217807ae30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21900fbd40 0x7f21901129e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 --2- 172.21.15.46:0/510144560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2190101d90 0x7f2190112f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.756+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 >> 172.21.15.46:0/510144560 conn(0x7f2190071d00 msgr2=0x7f21900fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.757+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 shutdown_connections 2024-05-09T06:39:49.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.757+0000 7f2195177700 1 -- 172.21.15.46:0/510144560 wait complete. 2024-05-09T06:39:49.747 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 -- 172.21.15.46:0/3812370366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 msgr2=0x7fc9f00fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 --2- 172.21.15.46:0/3812370366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f00fcb80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8004940 tx=0x7fc9d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 -- 172.21.15.46:0/3812370366 shutdown_connections 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 --2- 172.21.15.46:0/3812370366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f00fcb80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 --2- 172.21.15.46:0/3812370366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 0x7fc9f01021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 -- 172.21.15.46:0/3812370366 >> 172.21.15.46:0/3812370366 conn(0x7fc9f0071460 msgr2=0x7fc9f0071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 -- 172.21.15.46:0/3812370366 shutdown_connections 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.864+0000 7fc9f6146700 1 -- 172.21.15.46:0/3812370366 wait complete. 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9f6146700 1 Processor -- start 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9f6146700 1 -- start start 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9f6146700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f010eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9f6146700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 0x7fc9f010f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9f6146700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f010f6b0 con 0x7fc9f00fc710 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9f6146700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f010f7f0 con 0x7fc9f0101e20 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f010eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9ef7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f010eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60358/0 (socket says 172.21.15.46:60358) 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.865+0000 7fc9ef7fe700 1 -- 172.21.15.46:0/894573419 learned_addr learned my addr 172.21.15.46:0/894573419 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9e7fff700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 0x7fc9f010f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ef7fe700 1 -- 172.21.15.46:0/894573419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 msgr2=0x7fc9f010f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ef7fe700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 0x7fc9f010f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ef7fe700 1 -- 172.21.15.46:0/894573419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8005040 con 0x7fc9f00fc710 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9e7fff700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 0x7fc9f010f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ef7fe700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f010eb20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c8c0 tx=0x7fc9e00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e000a980 con 0x7fc9f00fc710 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f0117b90 con 0x7fc9f00fc710 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9e000ce60 con 0x7fc9f00fc710 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e00115e0 con 0x7fc9f00fc710 2024-05-09T06:39:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.866+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f01180f0 con 0x7fc9f00fc710 2024-05-09T06:39:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.867+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f0104200 con 0x7fc9f00fc710 2024-05-09T06:39:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.868+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc9e0012400 con 0x7fc9f00fc710 2024-05-09T06:39:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.868+0000 7fc9ecff9700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc9dc078980 0x7fc9dc07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.868+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc9e009a790 con 0x7fc9f00fc710 2024-05-09T06:39:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.868+0000 7fc9e7fff700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc9dc078980 0x7fc9dc07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.869+0000 7fc9e7fff700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc9dc078980 0x7fc9dc07ae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b3b0 tx=0x7fc9d8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:49.873+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc9e00624d0 con 0x7fc9f00fc710 2024-05-09T06:39:50.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.125+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9f004bed0 con 0x7fc9dc078980 2024-05-09T06:39:50.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.127+0000 7fc9ecff9700 1 -- 172.21.15.46:0/894573419 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc9f004bed0 con 0x7fc9dc078980 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc9dc078980 msgr2=0x7fc9dc07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc9dc078980 0x7fc9dc07ae30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b3b0 tx=0x7fc9d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 msgr2=0x7fc9f010eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f010eb20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c8c0 tx=0x7fc9e00044c0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 shutdown_connections 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc9dc078980 0x7fc9dc07ae30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9f00fc710 0x7fc9f010eb20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 --2- 172.21.15.46:0/894573419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9f0101e20 0x7fc9f010f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 >> 172.21.15.46:0/894573419 conn(0x7fc9f0071460 msgr2=0x7fc9f00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 shutdown_connections 2024-05-09T06:39:50.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.130+0000 7fc9f6146700 1 -- 172.21.15.46:0/894573419 wait complete. 2024-05-09T06:39:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 -- 172.21.15.46:0/1766179544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 msgr2=0x7f0d140fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 --2- 172.21.15.46:0/1766179544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d140fcdf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc004940 tx=0x7f0cfc009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 -- 172.21.15.46:0/1766179544 shutdown_connections 2024-05-09T06:39:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 --2- 172.21.15.46:0/1766179544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d140fcdf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 --2- 172.21.15.46:0/1766179544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 0x7f0d141031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 -- 172.21.15.46:0/1766179544 >> 172.21.15.46:0/1766179544 conn(0x7f0d140f8990 msgr2=0x7f0d140fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 -- 172.21.15.46:0/1766179544 shutdown_connections 2024-05-09T06:39:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.236+0000 7f0d19319700 1 -- 172.21.15.46:0/1766179544 wait complete. 2024-05-09T06:39:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.237+0000 7f0d19319700 1 Processor -- start 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.237+0000 7f0d19319700 1 -- start start 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.237+0000 7f0d19319700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 0x7f0d14115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.237+0000 7f0d19319700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d141160f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.237+0000 7f0d19319700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14116740 con 0x7f0d14103780 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.237+0000 7f0d19319700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1410fd20 con 0x7f0d14102de0 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d141160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d141160f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60378/0 (socket says 172.21.15.46:60378) 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 -- 172.21.15.46:0/3527867988 learned_addr learned my addr 172.21.15.46:0/3527867988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d12ffd700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 0x7f0d14115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 -- 172.21.15.46:0/3527867988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 msgr2=0x7f0d14115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 0x7f0d14115bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 -- 172.21.15.46:0/3527867988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc005040 con 0x7f0d14103780 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d12ffd700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 0x7f0d14115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d127fc700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d141160f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009100 tx=0x7f0cfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cfc00e040 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cfc013420 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cfc01c610 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1410ffa0 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.238+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d14110560 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.239+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d140fe530 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.240+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f0cfc00baf0 con 0x7f0d14103780 2024-05-09T06:39:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.241+0000 7f0d0b7fe700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0d00078990 0x7f0d0007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.241+0000 7f0d12ffd700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0d00078990 0x7f0d0007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.241+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0cfc09b870 con 0x7f0d14103780 2024-05-09T06:39:50.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.241+0000 7f0d12ffd700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0d00078990 0x7f0d0007ae40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d04004d60 tx=0x7f0d0400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.245+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0cfc063590 con 0x7f0d14103780 2024-05-09T06:39:50.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.472+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d14109ec0 con 0x7f0d00078990 2024-05-09T06:39:50.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.482+0000 7f0d0b7fe700 1 -- 172.21.15.46:0/3527867988 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0d14109ec0 con 0x7f0d00078990 2024-05-09T06:39:50.462 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:39:50.462 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 116s ago 17m 24.3M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:39:50.462 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (3m) 116s ago 17m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:39:50.462 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (3m) 16s ago 16m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:39:50.462 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 116s ago 17m 79.8M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 starting - - - - 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (12m) 116s ago 12m 155M - 17.2.7-933-g4ba5a836 b96134859c76 e1d9d93feec4 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (12m) 16s ago 12m 18.8M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (12m) 16s ago 12m 16.4M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (8m) 116s ago 19m 519M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (7m) 16s ago 16m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (4m) 116s ago 19m 49.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (4m) 16s ago 16m 37.0M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 116s ago 17m 15.1M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (7m) 16s ago 16m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 116s ago 15m 96.8M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 116s ago 15m 102M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 116s ago 14m 15.0M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (86s) 16s ago 14m 112M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (53s) 16s ago 14m 108M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 19b53c23db28 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (19s) 16s ago 13m 12.4M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 45571448b3f7 2024-05-09T06:39:50.463 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 116s ago 17m 66.6M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:39:50.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0d00078990 msgr2=0x7f0d0007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0d00078990 0x7f0d0007ae40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d04004d60 tx=0x7f0d0400b040 comp rx=0 tx=0).stop 2024-05-09T06:39:50.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 msgr2=0x7f0d141160f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d141160f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009100 tx=0x7f0cfc009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 shutdown_connections 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0d00078990 0x7f0d0007ae40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d14102de0 0x7f0d14115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.484+0000 7f0d19319700 1 --2- 172.21.15.46:0/3527867988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d14103780 0x7f0d141160f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.485+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 >> 172.21.15.46:0/3527867988 conn(0x7f0d140f8990 msgr2=0x7f0d140f98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.485+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 shutdown_connections 2024-05-09T06:39:50.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.485+0000 7f0d19319700 1 -- 172.21.15.46:0/3527867988 wait complete. 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 -- 172.21.15.46:0/3876015352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070280 msgr2=0x7fc95c070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 --2- 172.21.15.46:0/3876015352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070280 0x7fc95c070650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009ce0 tx=0x7fc94c004d10 comp rx=0 tx=0).stop 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 -- 172.21.15.46:0/3876015352 shutdown_connections 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 --2- 172.21.15.46:0/3876015352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc95c070b90 0x7fc95c109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 --2- 172.21.15.46:0/3876015352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070280 0x7fc95c070650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 -- 172.21.15.46:0/3876015352 >> 172.21.15.46:0/3876015352 conn(0x7fc95c0f8950 msgr2=0x7fc95c0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 -- 172.21.15.46:0/3876015352 shutdown_connections 2024-05-09T06:39:50.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.589+0000 7fc963f85700 1 -- 172.21.15.46:0/3876015352 wait complete. 2024-05-09T06:39:50.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc963f85700 1 Processor -- start 2024-05-09T06:39:50.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc963f85700 1 -- start start 2024-05-09T06:39:50.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc963f85700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc95c070280 0x7fc95c115f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:50.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc963f85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 0x7fc95c116470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc963f85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c116b50 con 0x7fc95c070b90 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc963f85700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c10fe90 con 0x7fc95c070280 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 0x7fc95c116470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 0x7fc95c116470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60400/0 (socket says 172.21.15.46:60400) 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 -- 172.21.15.46:0/1222340359 learned_addr learned my addr 172.21.15.46:0/1222340359 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961d21700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc95c070280 0x7fc95c115f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 -- 172.21.15.46:0/1222340359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc95c070280 msgr2=0x7fc95c115f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc95c070280 0x7fc95c115f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 -- 172.21.15.46:0/1222340359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c009940 con 0x7fc95c070b90 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.590+0000 7fc961520700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 0x7fc95c116470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc95000b790 tx=0x7fc950009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.591+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc95000f770 con 0x7fc95c070b90 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.591+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc95000fda0 con 0x7fc95c070b90 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.591+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c110110 con 0x7fc95c070b90 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.591+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc95000d310 con 0x7fc95c070b90 2024-05-09T06:39:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.591+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c110650 con 0x7fc95c070b90 2024-05-09T06:39:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.592+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c0719c0 con 0x7fc95c070b90 2024-05-09T06:39:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.592+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc950010420 con 0x7fc95c070b90 2024-05-09T06:39:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.593+0000 7fc95a7fc700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc944078980 0x7fc94407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.593+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc95009a750 con 0x7fc95c070b90 2024-05-09T06:39:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.593+0000 7fc961d21700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc944078980 0x7fc94407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:50.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.593+0000 7fc961d21700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc944078980 0x7fc94407ae30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00b740 tx=0x7fc94c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.598+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc9500623f0 con 0x7fc95c070b90 2024-05-09T06:39:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.919+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc95c05f5c0 con 0x7fc95c070b90 2024-05-09T06:39:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.920+0000 7fc95a7fc700 1 -- 172.21.15.46:0/1222340359 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fc950061d90 con 0x7fc95c070b90 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 3, 2024-05-09T06:39:50.903 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 1 2024-05-09T06:39:50.904 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:39:50.904 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:39:50.904 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 3, 2024-05-09T06:39:50.904 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 11 2024-05-09T06:39:50.904 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:39:50.904 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc944078980 msgr2=0x7fc94407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc944078980 0x7fc94407ae30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00b740 tx=0x7fc94c004d10 comp rx=0 tx=0).stop 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 msgr2=0x7fc95c116470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 0x7fc95c116470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc95000b790 tx=0x7fc950009250 comp rx=0 tx=0).stop 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 shutdown_connections 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc944078980 0x7fc94407ae30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc95c070280 0x7fc95c115f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 --2- 172.21.15.46:0/1222340359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc95c070b90 0x7fc95c116470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 >> 172.21.15.46:0/1222340359 conn(0x7fc95c0f8950 msgr2=0x7fc95c0f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 shutdown_connections 2024-05-09T06:39:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:50.923+0000 7fc963f85700 1 -- 172.21.15.46:0/1222340359 wait complete. 2024-05-09T06:39:51.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 -- 172.21.15.46:0/1969014814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 msgr2=0x7f74980fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 --2- 172.21.15.46:0/1969014814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f74980fbf70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7494009ce0 tx=0x7f7494004d10 comp rx=0 tx=0).stop 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 -- 172.21.15.46:0/1969014814 shutdown_connections 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 --2- 172.21.15.46:0/1969014814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74980fc4b0 0x7f7498109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 --2- 172.21.15.46:0/1969014814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f74980fbf70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 -- 172.21.15.46:0/1969014814 >> 172.21.15.46:0/1969014814 conn(0x7f74980f7850 msgr2=0x7f74980f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 -- 172.21.15.46:0/1969014814 shutdown_connections 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 -- 172.21.15.46:0/1969014814 wait complete. 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.032+0000 7f749fdc5700 1 Processor -- start 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749fdc5700 1 -- start start 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749fdc5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f7498115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749fdc5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74980fc4b0 0x7f74981161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749fdc5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7498116880 con 0x7f74980fbba0 2024-05-09T06:39:51.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749fdc5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749810fbc0 con 0x7f74980fc4b0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f7498115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f7498115c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40586/0 (socket says 172.21.15.46:40586) 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 -- 172.21.15.46:0/3018570649 learned_addr learned my addr 172.21.15.46:0/3018570649 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 -- 172.21.15.46:0/3018570649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74980fc4b0 msgr2=0x7f74981161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74980fc4b0 0x7f74981161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 -- 172.21.15.46:0/3018570649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009940 con 0x7f74980fbba0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f749db61700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f7498115c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7494007c00 tx=0x7f7494004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f749400e070 con 0x7f74980fbba0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.033+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f749400be70 con 0x7f74980fbba0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.034+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749810fe40 con 0x7f74980fbba0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.034+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f749401ba10 con 0x7f74980fbba0 2024-05-09T06:39:51.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.034+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7498110400 con 0x7f74980fbba0 2024-05-09T06:39:51.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.035+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74980666f0 con 0x7f74980fbba0 2024-05-09T06:39:51.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.035+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f7494019040 con 0x7f74980fbba0 2024-05-09T06:39:51.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.036+0000 7f748e7fc700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7484078990 0x7f748407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.036+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f749409bb60 con 0x7f74980fbba0 2024-05-09T06:39:51.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.036+0000 7f749d360700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7484078990 0x7f748407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.036+0000 7f749d360700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7484078990 0x7f748407ae40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7488006fd0 tx=0x7f7488006db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:51.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.045+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f74940638a0 con 0x7f74980fbba0 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.313+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f749810c070 con 0x7f74980fbba0 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.313+0000 7f748e7fc700 1 -- 172.21.15.46:0/3018570649 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1882 (secure 0 0 0) 0x7f749406c070 con 0x7f74980fbba0 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout:e18 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:39:51.293 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:27:48.012161+0000 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:39:51.294 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14492} 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{0:14492} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.46:6828/3210268761,v1:172.21.15.46:6829/3210268761] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:51.295 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:39:51.296 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:39:51.296 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:24273} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:51.296 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:39:51.296 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:34372} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:39:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.315+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7484078990 msgr2=0x7f748407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.315+0000 7f749fdc5700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7484078990 0x7f748407ae40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7488006fd0 tx=0x7f7488006db0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 msgr2=0x7f7498115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f7498115c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7494007c00 tx=0x7f7494004d10 comp rx=0 tx=0).stop 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 shutdown_connections 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f7484078990 0x7f748407ae40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74980fbba0 0x7f7498115c60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 --2- 172.21.15.46:0/3018570649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74980fc4b0 0x7f74981161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 >> 172.21.15.46:0/3018570649 conn(0x7f74980f7850 msgr2=0x7f74980f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 shutdown_connections 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.316+0000 7f749fdc5700 1 -- 172.21.15.46:0/3018570649 wait complete. 2024-05-09T06:39:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1081900634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 msgr2=0x7f13f8070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1081900634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8070670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f13e8004970 tx=0x7f13e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1081900634 shutdown_connections 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1081900634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13f8070bb0 0x7f13f8109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1081900634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8070670 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1081900634 >> 172.21.15.46:0/1081900634 conn(0x7f13f80f8990 msgr2=0x7f13f80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1081900634 shutdown_connections 2024-05-09T06:39:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.434+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1081900634 wait complete. 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13fd3f0700 1 Processor -- start 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13fd3f0700 1 -- start start 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13fd3f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8115a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13fd3f0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13f8070bb0 0x7f13f8115fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13fd3f0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8116600 con 0x7f13f80702a0 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13fd3f0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f810fc90 con 0x7f13f8070bb0 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8115a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8115a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40598/0 (socket says 172.21.15.46:40598) 2024-05-09T06:39:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13f6ffd700 1 -- 172.21.15.46:0/1771506892 learned_addr learned my addr 172.21.15.46:0/1771506892 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.435+0000 7f13f67fc700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13f8070bb0 0x7f13f8115fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13f6ffd700 1 -- 172.21.15.46:0/1771506892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13f8070bb0 msgr2=0x7f13f8115fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13f6ffd700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13f8070bb0 0x7f13f8115fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13f6ffd700 1 -- 172.21.15.46:0/1771506892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8005040 con 0x7f13f80702a0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13f6ffd700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8115a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13e8004f50 tx=0x7f13e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e800e040 con 0x7f13f80702a0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13e8004290 con 0x7f13f80702a0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f810ff10 con 0x7f13f80702a0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e801c3f0 con 0x7f13f80702a0 2024-05-09T06:39:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.436+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f8110450 con 0x7f13f80702a0 2024-05-09T06:39:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.437+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f80719e0 con 0x7f13f80702a0 2024-05-09T06:39:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.438+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f13e8013420 con 0x7f13f80702a0 2024-05-09T06:39:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.439+0000 7f13df7fe700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f13e0078980 0x7f13e007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.439+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f13e809c350 con 0x7f13f80702a0 2024-05-09T06:39:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.439+0000 7f13f67fc700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f13e0078980 0x7f13e007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.440+0000 7f13f67fc700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f13e0078980 0x7f13e007ae30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13f8104a10 tx=0x7f13ec0043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.443+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f13e8064130 con 0x7f13f80702a0 2024-05-09T06:39:51.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:51 smithi106 ceph-mon[81208]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:51 smithi106 ceph-mon[81208]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:51 smithi106 ceph-mon[81208]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:51 smithi106 ceph-mon[81208]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:51.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:51 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1222340359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:51.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:51 smithi046 ceph-mon[110713]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:51.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:51 smithi046 ceph-mon[110713]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:51.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:51 smithi046 ceph-mon[110713]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:51.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:51 smithi046 ceph-mon[110713]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:51.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:51 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1222340359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.715+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13f810c0d0 con 0x7f13e0078980 2024-05-09T06:39:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.717+0000 7f13df7fe700 1 -- 172.21.15.46:0/1771506892 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f13f810c0d0 con 0x7f13e0078980 2024-05-09T06:39:51.696 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "12/21 daemons upgraded", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:39:51.697 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f13e0078980 msgr2=0x7f13e007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f13e0078980 0x7f13e007ae30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13f8104a10 tx=0x7f13ec0043c0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 msgr2=0x7f13f8115a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8115a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13e8004f50 tx=0x7f13e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 shutdown_connections 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f13e0078980 0x7f13e007ae30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13f80702a0 0x7f13f8115a70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 --2- 172.21.15.46:0/1771506892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13f8070bb0 0x7f13f8115fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 >> 172.21.15.46:0/1771506892 conn(0x7f13f80f8990 msgr2=0x7f13f80f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 shutdown_connections 2024-05-09T06:39:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.719+0000 7f13fd3f0700 1 -- 172.21.15.46:0/1771506892 wait complete. 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 -- 172.21.15.46:0/3433976817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580103780 msgr2=0x7fc5800fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 --2- 172.21.15.46:0/3433976817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580103780 0x7fc5800fcdf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc568004940 tx=0x7fc568009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 -- 172.21.15.46:0/3433976817 shutdown_connections 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 --2- 172.21.15.46:0/3433976817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580103780 0x7fc5800fcdf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 --2- 172.21.15.46:0/3433976817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc580102de0 0x7fc5801031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 -- 172.21.15.46:0/3433976817 >> 172.21.15.46:0/3433976817 conn(0x7fc5800f8950 msgr2=0x7fc5800fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 -- 172.21.15.46:0/3433976817 shutdown_connections 2024-05-09T06:39:51.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.825+0000 7fc586795700 1 -- 172.21.15.46:0/3433976817 wait complete. 2024-05-09T06:39:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc586795700 1 Processor -- start 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc586795700 1 -- start start 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc586795700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 0x7fc580113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc586795700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc580103780 0x7fc5801140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc586795700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580114730 con 0x7fc580102de0 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc586795700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58010db20 con 0x7fc580103780 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc57ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 0x7fc580113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc57ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 0x7fc580113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40614/0 (socket says 172.21.15.46:40614) 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.826+0000 7fc57ffff700 1 -- 172.21.15.46:0/2570835067 learned_addr learned my addr 172.21.15.46:0/2570835067 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc577fff700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc580103780 0x7fc5801140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57ffff700 1 -- 172.21.15.46:0/2570835067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc580103780 msgr2=0x7fc5801140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57ffff700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc580103780 0x7fc5801140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57ffff700 1 -- 172.21.15.46:0/2570835067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568005040 con 0x7fc580102de0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57ffff700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 0x7fc580113ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c830 tx=0x7fc570004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57000a760 con 0x7fc580102de0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc57000ad90 con 0x7fc580102de0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58010de00 con 0x7fc580102de0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5700113a0 con 0x7fc580102de0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.827+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58010e3c0 con 0x7fc580102de0 2024-05-09T06:39:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.828+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5800fe530 con 0x7fc580102de0 2024-05-09T06:39:51.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.829+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc570012400 con 0x7fc580102de0 2024-05-09T06:39:51.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.829+0000 7fc57d7fa700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc56c078990 0x7fc56c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:39:51.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.829+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc57009a6d0 con 0x7fc580102de0 2024-05-09T06:39:51.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.829+0000 7fc577fff700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc56c078990 0x7fc56c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:39:51.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.830+0000 7fc577fff700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc56c078990 0x7fc56c07ae40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc58010ece0 tx=0x7fc568009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:39:51.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:51.834+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc570062410 con 0x7fc580102de0 2024-05-09T06:39:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.152+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc580109ef0 con 0x7fc580102de0 2024-05-09T06:39:52.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.152+0000 7fc57d7fa700 1 -- 172.21.15.46:0/2570835067 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc570061db0 con 0x7fc580102de0 2024-05-09T06:39:52.133 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:52.133 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:39:52.133 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc56c078990 msgr2=0x7fc56c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc56c078990 0x7fc56c07ae40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc58010ece0 tx=0x7fc568009e30 comp rx=0 tx=0).stop 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 msgr2=0x7fc580113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 0x7fc580113ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c830 tx=0x7fc570004470 comp rx=0 tx=0).stop 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 shutdown_connections 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc56c078990 0x7fc56c07ae40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc580102de0 0x7fc580113ba0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 --2- 172.21.15.46:0/2570835067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc580103780 0x7fc5801140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:39:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 >> 172.21.15.46:0/2570835067 conn(0x7fc5800f8950 msgr2=0x7fc5800f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:39:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 shutdown_connections 2024-05-09T06:39:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:39:52.155+0000 7fc586795700 1 -- 172.21.15.46:0/2570835067 wait complete. 2024-05-09T06:39:52.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:52 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3018570649' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:52.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:52 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2570835067' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:52.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:52 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:52.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:52 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3018570649' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:39:52.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:52 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2570835067' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:39:52.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:52 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:53.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:53 smithi106 ceph-mon[81208]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:53 smithi106 ceph-mon[81208]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:53 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:53.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:53 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:53.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:53 smithi046 ceph-mon[110713]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:39:53.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:53 smithi046 ceph-mon[110713]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:53.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:53 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:53.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:53 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:54.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:54.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:54 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:54.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:54.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:54 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:55.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:55 smithi106 ceph-mon[81208]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:55.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:55 smithi046 ceph-mon[110713]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:57.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:39:59.788 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:59 smithi046 ceph-mon[110713]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:59.788 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:59.788 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:59.788 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:39:59 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:39:59.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:59 smithi106 ceph-mon[81208]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:39:59.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:39:59.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.pkuwsr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:39:59.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:39:59 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:00.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:00 smithi046 ceph-mon[110713]: Upgrade: Updating mds.cephfs.smithi046.pkuwsr 2024-05-09T06:40:00.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:00 smithi046 ceph-mon[110713]: Deploying daemon mds.cephfs.smithi046.pkuwsr on smithi046 2024-05-09T06:40:00.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:00 smithi046 ceph-mon[110713]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:00.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:00 smithi106 ceph-mon[81208]: Upgrade: Updating mds.cephfs.smithi046.pkuwsr 2024-05-09T06:40:00.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:00 smithi106 ceph-mon[81208]: Deploying daemon mds.cephfs.smithi046.pkuwsr on smithi046 2024-05-09T06:40:00.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:00 smithi106 ceph-mon[81208]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:01.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[110709]: 2024-05-09T06:40:01.312+0000 7f78243ce700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:01.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:01.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:01.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:01.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: osdmap e81: 6 total, 6 up, 6 in 2024-05-09T06:40:01.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: Standby daemon mds.cephfs.smithi106.fqgqkm assigned to filesystem cephfs as rank 0 2024-05-09T06:40:01.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:01.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:01.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:01 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi106.fqgqkm=up:replay} 2 up:standby 2024-05-09T06:40:01.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:40:01.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:01.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:01.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: osdmap e81: 6 total, 6 up, 6 in 2024-05-09T06:40:01.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: Standby daemon mds.cephfs.smithi106.fqgqkm assigned to filesystem cephfs as rank 0 2024-05-09T06:40:01.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:01.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:01.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:01 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi106.fqgqkm=up:replay} 2 up:standby 2024-05-09T06:40:03.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:03 smithi106 ceph-mon[81208]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-05-09T06:40:03.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:03 smithi046 ceph-mon[110713]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-05-09T06:40:05.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:05 smithi106 ceph-mon[81208]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-05-09T06:40:05.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:05 smithi046 ceph-mon[110713]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-05-09T06:40:07.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:07 smithi106 ceph-mon[81208]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-05-09T06:40:07.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:07 smithi046 ceph-mon[110713]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-05-09T06:40:09.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:09 smithi106 ceph-mon[81208]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T06:40:09.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:09 smithi046 ceph-mon[110713]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-05-09T06:40:10.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: reconnect by client.14530 v1:172.21.15.106:0/655094447 after 0 2024-05-09T06:40:10.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:reconnect 2024-05-09T06:40:10.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi106.fqgqkm=up:reconnect} 2 up:standby 2024-05-09T06:40:10.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: reconnect by client.14524 v1:192.168.0.1:0/176593620 after 0.00699983 2024-05-09T06:40:10.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:rejoin 2024-05-09T06:40:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.46:6828/1650120770,v1:172.21.15.46:6829/1650120770] up:boot 2024-05-09T06:40:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi106.fqgqkm=up:rejoin} 3 up:standby 2024-05-09T06:40:10.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:40:10.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: reconnect by client.14530 v1:172.21.15.106:0/655094447 after 0 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:reconnect 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi106.fqgqkm=up:reconnect} 2 up:standby 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: reconnect by client.14524 v1:192.168.0.1:0/176593620 after 0.00699983 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:rejoin 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.46:6828/1650120770,v1:172.21.15.46:6829/1650120770] up:boot 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi106.fqgqkm=up:rejoin} 3 up:standby 2024-05-09T06:40:10.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:40:11.821 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:11 smithi106 ceph-mon[81208]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:11.821 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:11 smithi106 ceph-mon[81208]: daemon mds.cephfs.smithi106.fqgqkm is now active in filesystem cephfs as rank 0 2024-05-09T06:40:11.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:11 smithi046 ceph-mon[110713]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:11.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:11 smithi046 ceph-mon[110713]: daemon mds.cephfs.smithi106.fqgqkm is now active in filesystem cephfs as rank 0 2024-05-09T06:40:12.590 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:12 smithi046 ceph-mon[110713]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:40:12.590 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:12 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:active 2024-05-09T06:40:12.591 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:12 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi106.fqgqkm=up:active} 3 up:standby 2024-05-09T06:40:12.591 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:12.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:12 smithi106 ceph-mon[81208]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:40:12.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:12 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6824/2740455125,v1:172.21.15.106:6825/2740455125] up:active 2024-05-09T06:40:12.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:12 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi106.fqgqkm=up:active} 3 up:standby 2024-05-09T06:40:12.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:13.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:13 smithi046 ceph-mon[110713]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-05-09T06:40:13.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:13 smithi106 ceph-mon[81208]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-05-09T06:40:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:15 smithi046 ceph-mon[110713]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-05-09T06:40:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:15 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:15.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:15 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:15.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:15 smithi106 ceph-mon[81208]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-05-09T06:40:15.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:15 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:15.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:15 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:16.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:16.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:16 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:17.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:16 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:17.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:16 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:17.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:17 smithi046 ceph-mon[110713]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-05-09T06:40:18.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:17 smithi106 ceph-mon[81208]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-05-09T06:40:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-09T06:40:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:19 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:20.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:19 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:21.957 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:21 smithi106 ceph-mon[81208]: pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-05-09T06:40:21.958 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:21.958 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:40:21.958 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:21 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:21 smithi046 ceph-mon[110713]: pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-05-09T06:40:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.fqgqkm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:40:22.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:21 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:22.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 -- 172.21.15.46:0/742662380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468103760 msgr2=0x7fe4680fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/742662380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468103760 0x7fe4680fcdd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe45c004940 tx=0x7fe45c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:22.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 -- 172.21.15.46:0/742662380 shutdown_connections 2024-05-09T06:40:22.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/742662380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468103760 0x7fe4680fcdd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/742662380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe468102dc0 0x7fe468103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 -- 172.21.15.46:0/742662380 >> 172.21.15.46:0/742662380 conn(0x7fe4680f8930 msgr2=0x7fe4680fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:22.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 -- 172.21.15.46:0/742662380 shutdown_connections 2024-05-09T06:40:22.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.275+0000 7fe46dbc6700 1 -- 172.21.15.46:0/742662380 wait complete. 2024-05-09T06:40:22.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe46dbc6700 1 Processor -- start 2024-05-09T06:40:22.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe46dbc6700 1 -- start start 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe46dbc6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 0x7fe468115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe46dbc6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe468103760 0x7fe468116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe46dbc6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4681166e0 con 0x7fe468102dc0 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe46dbc6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46810fcc0 con 0x7fe468103760 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe4677fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 0x7fe468115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe4677fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 0x7fe468115b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39450/0 (socket says 172.21.15.46:39450) 2024-05-09T06:40:22.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe4677fe700 1 -- 172.21.15.46:0/212946665 learned_addr learned my addr 172.21.15.46:0/212946665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.276+0000 7fe466ffd700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe468103760 0x7fe468116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe4677fe700 1 -- 172.21.15.46:0/212946665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe468103760 msgr2=0x7fe468116090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe4677fe700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe468103760 0x7fe468116090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe4677fe700 1 -- 172.21.15.46:0/212946665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c005040 con 0x7fe468102dc0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe4677fe700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 0x7fe468115b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c8c0 tx=0x7fe4580044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45800a760 con 0x7fe468102dc0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46810ffa0 con 0x7fe468102dc0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe45800ad90 con 0x7fe468102dc0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4580113a0 con 0x7fe468102dc0 2024-05-09T06:40:22.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.277+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe468110560 con 0x7fe468102dc0 2024-05-09T06:40:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.278+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4680fe510 con 0x7fe468102dc0 2024-05-09T06:40:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.279+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fe458012400 con 0x7fe468102dc0 2024-05-09T06:40:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.279+0000 7fe44ffff700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe450078980 0x7fe45007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.279+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe45809a700 con 0x7fe468102dc0 2024-05-09T06:40:22.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.279+0000 7fe466ffd700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe450078980 0x7fe45007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.280+0000 7fe466ffd700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe450078980 0x7fe45007ae30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4681113f0 tx=0x7fe45c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:22.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.284+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe4580623f0 con 0x7fe468102dc0 2024-05-09T06:40:22.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.518+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4681111a0 con 0x7fe450078980 2024-05-09T06:40:22.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.519+0000 7fe44ffff700 1 -- 172.21.15.46:0/212946665 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe4681111a0 con 0x7fe450078980 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe450078980 msgr2=0x7fe45007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe450078980 0x7fe45007ae30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4681113f0 tx=0x7fe45c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 msgr2=0x7fe468115b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 0x7fe468115b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c8c0 tx=0x7fe4580044c0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 shutdown_connections 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe450078980 0x7fe45007ae30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe468102dc0 0x7fe468115b50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 --2- 172.21.15.46:0/212946665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe468103760 0x7fe468116090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 >> 172.21.15.46:0/212946665 conn(0x7fe4680f8930 msgr2=0x7fe4680f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 shutdown_connections 2024-05-09T06:40:22.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.522+0000 7fe46dbc6700 1 -- 172.21.15.46:0/212946665 wait complete. 2024-05-09T06:40:22.514 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:40:22.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 -- 172.21.15.46:0/544134773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0065640 msgr2=0x7f33f0065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 --2- 172.21.15.46:0/544134773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0065640 0x7f33f0065ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33d8004940 tx=0x7f33d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:22.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 -- 172.21.15.46:0/544134773 shutdown_connections 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 --2- 172.21.15.46:0/544134773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0065640 0x7f33f0065ab0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 --2- 172.21.15.46:0/544134773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33f0102e50 0x7f33f0103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 -- 172.21.15.46:0/544134773 >> 172.21.15.46:0/544134773 conn(0x7f33f0071d00 msgr2=0x7f33f0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 -- 172.21.15.46:0/544134773 shutdown_connections 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.629+0000 7f33f62ec700 1 -- 172.21.15.46:0/544134773 wait complete. 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33f62ec700 1 Processor -- start 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33f62ec700 1 -- start start 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33f62ec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33f0065640 0x7f33f0113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33f62ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 0x7f33f01140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33f62ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0114700 con 0x7f33f0102e50 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33f62ec700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f010daf0 con 0x7f33f0065640 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33e7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 0x7f33f01140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33e7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 0x7f33f01140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39468/0 (socket says 172.21.15.46:39468) 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33e7fff700 1 -- 172.21.15.46:0/4110569420 learned_addr learned my addr 172.21.15.46:0/4110569420 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:22.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33effff700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33f0065640 0x7f33f0113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33e7fff700 1 -- 172.21.15.46:0/4110569420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33f0065640 msgr2=0x7f33f0113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33e7fff700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33f0065640 0x7f33f0113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.630+0000 7f33e7fff700 1 -- 172.21.15.46:0/4110569420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8005040 con 0x7f33f0102e50 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.631+0000 7f33e7fff700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 0x7f33f01140b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f33d800b3b0 tx=0x7f33d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.631+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d800e040 con 0x7f33f0102e50 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.631+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f010dd70 con 0x7f33f0102e50 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.631+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33d8013420 con 0x7f33f0102e50 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.631+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d801c630 con 0x7f33f0102e50 2024-05-09T06:40:22.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.631+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f010e330 con 0x7f33f0102e50 2024-05-09T06:40:22.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.632+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f0100100 con 0x7f33f0102e50 2024-05-09T06:40:22.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.633+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f33d8013590 con 0x7f33f0102e50 2024-05-09T06:40:22.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.633+0000 7f33ed7fa700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f33dc078990 0x7f33dc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.633+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f33d809b8d0 con 0x7f33f0102e50 2024-05-09T06:40:22.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.633+0000 7f33effff700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f33dc078990 0x7f33dc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.634+0000 7f33effff700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f33dc078990 0x7f33dc07ae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33e0004f40 tx=0x7f33e000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:22.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.638+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f33d80635c0 con 0x7f33f0102e50 2024-05-09T06:40:22.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:22 smithi046 ceph-mon[110713]: Upgrade: Updating mds.cephfs.smithi106.fqgqkm 2024-05-09T06:40:22.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:22 smithi046 ceph-mon[110713]: Deploying daemon mds.cephfs.smithi106.fqgqkm on smithi106 2024-05-09T06:40:22.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.872+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33f010f1c0 con 0x7f33dc078990 2024-05-09T06:40:22.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.873+0000 7f33ed7fa700 1 -- 172.21.15.46:0/4110569420 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f33f010f1c0 con 0x7f33dc078990 2024-05-09T06:40:22.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.875+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f33dc078990 msgr2=0x7f33dc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.875+0000 7f33f62ec700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f33dc078990 0x7f33dc07ae40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33e0004f40 tx=0x7f33e000b040 comp rx=0 tx=0).stop 2024-05-09T06:40:22.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.875+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 msgr2=0x7f33f01140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.875+0000 7f33f62ec700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 0x7f33f01140b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f33d800b3b0 tx=0x7f33d8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.875+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 shutdown_connections 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.875+0000 7f33f62ec700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f33dc078990 0x7f33dc07ae40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.876+0000 7f33f62ec700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33f0065640 0x7f33f0113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.876+0000 7f33f62ec700 1 --2- 172.21.15.46:0/4110569420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33f0102e50 0x7f33f01140b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.876+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 >> 172.21.15.46:0/4110569420 conn(0x7f33f0071d00 msgr2=0x7f33f00fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.876+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 shutdown_connections 2024-05-09T06:40:22.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.876+0000 7f33f62ec700 1 -- 172.21.15.46:0/4110569420 wait complete. 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 -- 172.21.15.46:0/1238142985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44101cf0 msgr2=0x7fdf441020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/1238142985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44101cf0 0x7fdf441020c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdf34004940 tx=0x7fdf34009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 -- 172.21.15.46:0/1238142985 shutdown_connections 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/1238142985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44102690 0x7fdf440fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/1238142985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44101cf0 0x7fdf441020c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 -- 172.21.15.46:0/1238142985 >> 172.21.15.46:0/1238142985 conn(0x7fdf440f7860 msgr2=0x7fdf440f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 -- 172.21.15.46:0/1238142985 shutdown_connections 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 -- 172.21.15.46:0/1238142985 wait complete. 2024-05-09T06:40:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 Processor -- start 2024-05-09T06:40:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.982+0000 7fdf48bcf700 1 -- start start 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf48bcf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44101cf0 0x7fdf44113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf48bcf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 0x7fdf44113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf48bcf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44114580 con 0x7fdf44102690 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf48bcf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4410daf0 con 0x7fdf44101cf0 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 0x7fdf44113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 0x7fdf44113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39484/0 (socket says 172.21.15.46:39484) 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 -- 172.21.15.46:0/3849980020 learned_addr learned my addr 172.21.15.46:0/3849980020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf4259c700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44101cf0 0x7fdf44113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 -- 172.21.15.46:0/3849980020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44101cf0 msgr2=0x7fdf44113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44101cf0 0x7fdf44113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 -- 172.21.15.46:0/3849980020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34005040 con 0x7fdf44102690 2024-05-09T06:40:22.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf41d9b700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 0x7fdf44113ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800b790 tx=0x7fdf38009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3800f6f0 con 0x7fdf44102690 2024-05-09T06:40:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf3800fd20 con 0x7fdf44102690 2024-05-09T06:40:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.983+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4410ddd0 con 0x7fdf44102690 2024-05-09T06:40:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.984+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf380103a0 con 0x7fdf44102690 2024-05-09T06:40:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.984+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4410e390 con 0x7fdf44102690 2024-05-09T06:40:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.984+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440fd440 con 0x7fdf44102690 2024-05-09T06:40:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.985+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fdf38011400 con 0x7fdf44102690 2024-05-09T06:40:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.986+0000 7fdf32ffd700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fdf2c078980 0x7fdf2c07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.986+0000 7fdf4259c700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fdf2c078980 0x7fdf2c07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.986+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdf3809a470 con 0x7fdf44102690 2024-05-09T06:40:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.986+0000 7fdf4259c700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fdf2c078980 0x7fdf2c07ae30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400b3b0 tx=0x7fdf34009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:22.991+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fdf38062160 con 0x7fdf44102690 2024-05-09T06:40:23.024 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:22 smithi106 ceph-mon[81208]: Upgrade: Updating mds.cephfs.smithi106.fqgqkm 2024-05-09T06:40:23.024 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:22 smithi106 ceph-mon[81208]: Deploying daemon mds.cephfs.smithi106.fqgqkm on smithi106 2024-05-09T06:40:23.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.213+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf44109fd0 con 0x7fdf2c078980 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.223+0000 7fdf32ffd700 1 -- 172.21.15.46:0/3849980020 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdf44109fd0 con 0x7fdf2c078980 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 8s ago 18m 23.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (4m) 8s ago 18m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (4m) 49s ago 17m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 8s ago 17m 78.7M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (36s) 8s ago 12m 12.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 505f13a2ec8b 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (13s) 8s ago 12m 13.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e4b34f0292a9 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (12m) 49s ago 12m 18.8M - 17.2.7-933-g4ba5a836 b96134859c76 3fb01a7920b3 2024-05-09T06:40:23.204 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (12m) 49s ago 12m 16.4M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (9m) 8s ago 19m 523M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (8m) 49s ago 17m 466M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (5m) 8s ago 19m 56.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (4m) 49s ago 17m 37.0M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 8s ago 18m 16.6M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (7m) 49s ago 17m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 8s ago 16m 105M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 8s ago 15m 117M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 8s ago 15m 101M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (119s) 49s ago 15m 112M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (86s) 49s ago 14m 108M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 19b53c23db28 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (52s) 49s ago 14m 12.4M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 45571448b3f7 2024-05-09T06:40:23.205 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (7m) 8s ago 17m 66.7M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fdf2c078980 msgr2=0x7fdf2c07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fdf2c078980 0x7fdf2c07ae30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400b3b0 tx=0x7fdf34009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 msgr2=0x7fdf44113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 0x7fdf44113ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800b790 tx=0x7fdf38009220 comp rx=0 tx=0).stop 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 shutdown_connections 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fdf2c078980 0x7fdf2c07ae30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44101cf0 0x7fdf44113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 --2- 172.21.15.46:0/3849980020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf44102690 0x7fdf44113ea0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 >> 172.21.15.46:0/3849980020 conn(0x7fdf440f7860 msgr2=0x7fdf440f8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 shutdown_connections 2024-05-09T06:40:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.226+0000 7fdf48bcf700 1 -- 172.21.15.46:0/3849980020 wait complete. 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 -- 172.21.15.46:0/377430050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 msgr2=0x7fa67c0fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 --2- 172.21.15.46:0/377430050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c0fbd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa664004940 tx=0x7fa664009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 -- 172.21.15.46:0/377430050 shutdown_connections 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 --2- 172.21.15.46:0/377430050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c0fbd20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 --2- 172.21.15.46:0/377430050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 0x7fa67c1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 -- 172.21.15.46:0/377430050 >> 172.21.15.46:0/377430050 conn(0x7fa67c0f7860 msgr2=0x7fa67c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 -- 172.21.15.46:0/377430050 shutdown_connections 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 -- 172.21.15.46:0/377430050 wait complete. 2024-05-09T06:40:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 Processor -- start 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.345+0000 7fa681b0f700 1 -- start start 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa681b0f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 0x7fa67c115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa681b0f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa681b0f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c116700 con 0x7fa67c1026b0 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa681b0f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c10fd20 con 0x7fa67c101d10 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa672ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c1160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa672ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c1160b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39494/0 (socket says 172.21.15.46:39494) 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa67b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 0x7fa67c115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa672ffd700 1 -- 172.21.15.46:0/3727794543 learned_addr learned my addr 172.21.15.46:0/3727794543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa67b7fe700 1 -- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 msgr2=0x7fa67c1160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa67b7fe700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c1160b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa67b7fe700 1 -- 172.21.15.46:0/3727794543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664005040 con 0x7fa67c101d10 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa672ffd700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa67b7fe700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 0x7fa67c115b70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009fd0 tx=0x7fa66c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.346+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66c004e90 con 0x7fa67c101d10 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.347+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa66c00f040 con 0x7fa67c101d10 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.347+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66c00ca50 con 0x7fa67c101d10 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.347+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c10ffa0 con 0x7fa67c101d10 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.347+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c1104e0 con 0x7fa67c101d10 2024-05-09T06:40:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.347+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c0fd460 con 0x7fa67c101d10 2024-05-09T06:40:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.348+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa66c007cc0 con 0x7fa67c101d10 2024-05-09T06:40:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.349+0000 7fa678ff9700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa668078980 0x7fa66807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.349+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa66c09a1d0 con 0x7fa67c101d10 2024-05-09T06:40:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.349+0000 7fa672ffd700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa668078980 0x7fa66807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:23.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.349+0000 7fa672ffd700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa668078980 0x7fa66807ae30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa67c111450 tx=0x7fa664009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.353+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa66c061ea0 con 0x7fa67c101d10 2024-05-09T06:40:23.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[110709]: 2024-05-09T06:40:23.285+0000 7f78243ce700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:23.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.657+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa67c111200 con 0x7fa67c101d10 2024-05-09T06:40:23.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.658+0000 7fa678ff9700 1 -- 172.21.15.46:0/3727794543 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fa66c061840 con 0x7fa67c101d10 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:40:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 17.2.7-933-g4ba5a836 (4ba5a836bc8be559bfb15d04b24d35764bba0eaf) quincy (stable)": 1, 2024-05-09T06:40:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 12 2024-05-09T06:40:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:40:23.640 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:40:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa668078980 msgr2=0x7fa66807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa668078980 0x7fa66807ae30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa67c111450 tx=0x7fa664009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 msgr2=0x7fa67c115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 0x7fa67c115b70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009fd0 tx=0x7fa66c00b040 comp rx=0 tx=0).stop 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 shutdown_connections 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa668078980 0x7fa66807ae30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67c101d10 0x7fa67c115b70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 --2- 172.21.15.46:0/3727794543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa67c1026b0 0x7fa67c1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.660+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 >> 172.21.15.46:0/3727794543 conn(0x7fa67c0f7860 msgr2=0x7fa67c0662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.661+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 shutdown_connections 2024-05-09T06:40:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.661+0000 7fa681b0f700 1 -- 172.21.15.46:0/3727794543 wait complete. 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 -- 172.21.15.46:0/1133919066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 msgr2=0x7f1188065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 --2- 172.21.15.46:0/1133919066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188065ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f117c004940 tx=0x7f117c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 -- 172.21.15.46:0/1133919066 shutdown_connections 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 --2- 172.21.15.46:0/1133919066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188065ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 --2- 172.21.15.46:0/1133919066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1188102e50 0x7f1188103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 -- 172.21.15.46:0/1133919066 >> 172.21.15.46:0/1133919066 conn(0x7f1188071d00 msgr2=0x7f1188072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 -- 172.21.15.46:0/1133919066 shutdown_connections 2024-05-09T06:40:23.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.770+0000 7f118f2df700 1 -- 172.21.15.46:0/1133919066 wait complete. 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118f2df700 1 Processor -- start 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118f2df700 1 -- start start 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118f2df700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118f2df700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1188102e50 0x7f1188114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118f2df700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1188114660 con 0x7f1188065640 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118f2df700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118810da50 con 0x7f1188102e50 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118d07b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118d07b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39502/0 (socket says 172.21.15.46:39502) 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118d07b700 1 -- 172.21.15.46:0/4168706384 learned_addr learned my addr 172.21.15.46:0/4168706384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:23.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118c87a700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1188102e50 0x7f1188114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118d07b700 1 -- 172.21.15.46:0/4168706384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1188102e50 msgr2=0x7f1188114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118d07b700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1188102e50 0x7f1188114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.771+0000 7f118d07b700 1 -- 172.21.15.46:0/4168706384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c005040 con 0x7f1188065640 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.772+0000 7f118d07b700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188113ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1178001db0 tx=0x7f1178009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.772+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117800ed50 con 0x7f1188065640 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.772+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1178007df0 con 0x7f1188065640 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.772+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118810dd30 con 0x7f1188065640 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.772+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1178014640 con 0x7f1188065640 2024-05-09T06:40:23.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.772+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118810e2f0 con 0x7f1188065640 2024-05-09T06:40:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.773+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1188100100 con 0x7f1188065640 2024-05-09T06:40:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.774+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f1178007920 con 0x7f1188065640 2024-05-09T06:40:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.774+0000 7f1185ffb700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1170078990 0x7f117007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.774+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f117809a3d0 con 0x7f1188065640 2024-05-09T06:40:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.774+0000 7f118c87a700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1170078990 0x7f117007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:23.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.775+0000 7f118c87a700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1170078990 0x7f117007ae40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f118810ec10 tx=0x7f117c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:23.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:23.779+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f1178062120 con 0x7f1188065640 2024-05-09T06:40:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.041+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f118810f120 con 0x7f1188065640 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: osdmap e82: 6 total, 6 up, 6 in 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: Standby daemon mds.cephfs.smithi106.ugnujp assigned to filesystem cephfs as rank 0 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:24.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi106.ugnujp=up:replay} 2 up:standby 2024-05-09T06:40:24.023 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:23 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3727794543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.041+0000 7f1185ffb700 1 -- 172.21.15.46:0/4168706384 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1705 (secure 0 0 0) 0x7f1178061ac0 con 0x7f1188065640 2024-05-09T06:40:24.023 INFO:teuthology.orchestra.run.smithi046.stdout:e25 2024-05-09T06:40:24.023 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:40:24.023 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 25 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:40:23.292373+0000 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:40:24.026 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 82 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=24285} 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:40:24.027 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{0:24285} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{-1:34372} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:24.028 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/1650120770,v1:172.21.15.46:6829/1650120770] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1170078990 msgr2=0x7f117007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1170078990 0x7f117007ae40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f118810ec10 tx=0x7f117c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 msgr2=0x7f1188113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188113ad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1178001db0 tx=0x7f1178009ee0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 shutdown_connections 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1170078990 0x7f117007ae40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1188065640 0x7f1188113ad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 --2- 172.21.15.46:0/4168706384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1188102e50 0x7f1188114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 >> 172.21.15.46:0/4168706384 conn(0x7f1188071d00 msgr2=0x7f11880fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:24.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 shutdown_connections 2024-05-09T06:40:24.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.044+0000 7f118f2df700 1 -- 172.21.15.46:0/4168706384 wait complete. 2024-05-09T06:40:24.030 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 25 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: osdmap e82: 6 total, 6 up, 6 in 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: Standby daemon mds.cephfs.smithi106.ugnujp assigned to filesystem cephfs as rank 0 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi106.ugnujp=up:replay} 2 up:standby 2024-05-09T06:40:24.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:23 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3727794543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 -- 172.21.15.46:0/3690410346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 msgr2=0x7f48900fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 --2- 172.21.15.46:0/3690410346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900fcdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4884004940 tx=0x7f4884009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 -- 172.21.15.46:0/3690410346 shutdown_connections 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 --2- 172.21.15.46:0/3690410346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900fcdf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 --2- 172.21.15.46:0/3690410346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 0x7f48901031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 -- 172.21.15.46:0/3690410346 >> 172.21.15.46:0/3690410346 conn(0x7f48900f8990 msgr2=0x7f48900fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 -- 172.21.15.46:0/3690410346 shutdown_connections 2024-05-09T06:40:24.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.151+0000 7f48970a6700 1 -- 172.21.15.46:0/3690410346 wait complete. 2024-05-09T06:40:24.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f48970a6700 1 Processor -- start 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f48970a6700 1 -- start start 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f48970a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 0x7f4890070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f48970a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f48970a6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900721b0 con 0x7f4890103780 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f48970a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890070ce0 con 0x7f4890102de0 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f488ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f488ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39532/0 (socket says 172.21.15.46:39532) 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f488ffff700 1 -- 172.21.15.46:0/1071149314 learned_addr learned my addr 172.21.15.46:0/1071149314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f4894e42700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 0x7f4890070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f488ffff700 1 -- 172.21.15.46:0/1071149314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 msgr2=0x7f4890070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f488ffff700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 0x7f4890070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f488ffff700 1 -- 172.21.15.46:0/1071149314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884005040 con 0x7f4890103780 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.152+0000 7f4894e42700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 0x7f4890070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.153+0000 7f488ffff700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900707a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:24.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.153+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4884021070 con 0x7f4890103780 2024-05-09T06:40:24.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.153+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4884013c00 con 0x7f4890103780 2024-05-09T06:40:24.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.153+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488400e070 con 0x7f4890103780 2024-05-09T06:40:24.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.153+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4890070f60 con 0x7f4890103780 2024-05-09T06:40:24.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.153+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890119fa0 con 0x7f4890103780 2024-05-09T06:40:24.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.154+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900fe530 con 0x7f4890103780 2024-05-09T06:40:24.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.155+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f488401ca60 con 0x7f4890103780 2024-05-09T06:40:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.155+0000 7f488d7fa700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4878078990 0x7f487807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.155+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f488409ba40 con 0x7f4890103780 2024-05-09T06:40:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.155+0000 7f4894e42700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4878078990 0x7f487807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:24.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.156+0000 7f4894e42700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4878078990 0x7f487807ae40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4880009b80 tx=0x7f488000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:24.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.160+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f48840637a0 con 0x7f4890103780 2024-05-09T06:40:24.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.395+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48900f9fb0 con 0x7f4878078990 2024-05-09T06:40:24.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.397+0000 7f488d7fa700 1 -- 172.21.15.46:0/1071149314 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f48900f9fb0 con 0x7f4878078990 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "14/21 daemons upgraded", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:40:24.378 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:40:24.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4878078990 msgr2=0x7f487807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4878078990 0x7f487807ae40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4880009b80 tx=0x7f488000b040 comp rx=0 tx=0).stop 2024-05-09T06:40:24.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 msgr2=0x7f48900707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900707a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 shutdown_connections 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4878078990 0x7f487807ae40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4890102de0 0x7f4890070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 --2- 172.21.15.46:0/1071149314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4890103780 0x7f48900707a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 >> 172.21.15.46:0/1071149314 conn(0x7f48900f8990 msgr2=0x7f48900f98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 shutdown_connections 2024-05-09T06:40:24.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.399+0000 7f48970a6700 1 -- 172.21.15.46:0/1071149314 wait complete. 2024-05-09T06:40:24.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 -- 172.21.15.46:0/3562618093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c103790 msgr2=0x7eff0c0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 --2- 172.21.15.46:0/3562618093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c103790 0x7eff0c0fce00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efefc004940 tx=0x7efefc009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 -- 172.21.15.46:0/3562618093 shutdown_connections 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 --2- 172.21.15.46:0/3562618093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c103790 0x7eff0c0fce00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 --2- 172.21.15.46:0/3562618093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff0c102df0 0x7eff0c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 -- 172.21.15.46:0/3562618093 >> 172.21.15.46:0/3562618093 conn(0x7eff0c0f8980 msgr2=0x7eff0c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 -- 172.21.15.46:0/3562618093 shutdown_connections 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.506+0000 7eff13a78700 1 -- 172.21.15.46:0/3562618093 wait complete. 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff13a78700 1 Processor -- start 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff13a78700 1 -- start start 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff13a78700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 0x7eff0c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff13a78700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff0c103790 0x7eff0c1140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:24.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff13a78700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c114720 con 0x7eff0c102df0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff13a78700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c10db10 con 0x7eff0c103790 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11814700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 0x7eff0c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11814700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 0x7eff0c113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39550/0 (socket says 172.21.15.46:39550) 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11814700 1 -- 172.21.15.46:0/1519261600 learned_addr learned my addr 172.21.15.46:0/1519261600 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11013700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff0c103790 0x7eff0c1140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11814700 1 -- 172.21.15.46:0/1519261600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff0c103790 msgr2=0x7eff0c1140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11814700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff0c103790 0x7eff0c1140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.507+0000 7eff11814700 1 -- 172.21.15.46:0/1519261600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc005040 con 0x7eff0c102df0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.508+0000 7eff11814700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 0x7eff0c113b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7eff08002a50 tx=0x7eff080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.508+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff08007cc0 con 0x7eff0c102df0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.508+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c10ddf0 con 0x7eff0c102df0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.508+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff0800f040 con 0x7eff0c102df0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.508+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff0800da30 con 0x7eff0c102df0 2024-05-09T06:40:24.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.508+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c10e380 con 0x7eff0c102df0 2024-05-09T06:40:24.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.509+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c0fe540 con 0x7eff0c102df0 2024-05-09T06:40:24.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.509+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7eff0800dbb0 con 0x7eff0c102df0 2024-05-09T06:40:24.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.510+0000 7eff027fc700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efef8078990 0x7efef807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.510+0000 7eff11013700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efef8078990 0x7efef807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.510+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7eff0809a530 con 0x7eff0c102df0 2024-05-09T06:40:24.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.510+0000 7eff11013700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efef8078990 0x7efef807ae40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efefc004890 tx=0x7efefc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:24.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.515+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7eff080620d0 con 0x7eff0c102df0 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.822+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7eff0c109ed0 con 0x7eff0c102df0 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.822+0000 7eff027fc700 1 -- 172.21.15.46:0/1519261600 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7eff08061a70 con 0x7eff0c102df0 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:24.803 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:40:24.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efef8078990 msgr2=0x7efef807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efef8078990 0x7efef807ae40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efefc004890 tx=0x7efefc009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:24.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 msgr2=0x7eff0c113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:24.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 0x7eff0c113b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7eff08002a50 tx=0x7eff080046b0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 shutdown_connections 2024-05-09T06:40:24.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7efef8078990 0x7efef807ae40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff0c102df0 0x7eff0c113b90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 --2- 172.21.15.46:0/1519261600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff0c103790 0x7eff0c1140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:24.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 >> 172.21.15.46:0/1519261600 conn(0x7eff0c0f8980 msgr2=0x7eff0c0f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:24.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 shutdown_connections 2024-05-09T06:40:24.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:24.824+0000 7eff13a78700 1 -- 172.21.15.46:0/1519261600 wait complete. 2024-05-09T06:40:25.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:24 smithi106 ceph-mon[81208]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:25.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:24 smithi106 ceph-mon[81208]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:25.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:24 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/4168706384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:40:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:24 smithi046 ceph-mon[110713]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:24 smithi046 ceph-mon[110713]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:24 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/4168706384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:40:26.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:25 smithi106 ceph-mon[81208]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 204 B/s wr, 2 op/s 2024-05-09T06:40:26.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:25 smithi106 ceph-mon[81208]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:26.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:25 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1519261600' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:26.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:25 smithi046 ceph-mon[110713]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 204 B/s wr, 2 op/s 2024-05-09T06:40:26.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:25 smithi046 ceph-mon[110713]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:26.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:25 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1519261600' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:28.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:27 smithi106 ceph-mon[81208]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-05-09T06:40:28.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:28.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:28.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:27 smithi046 ceph-mon[110713]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-05-09T06:40:28.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:28.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:29.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:29 smithi046 ceph-mon[110713]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-09T06:40:30.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:29 smithi106 ceph-mon[81208]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-09T06:40:32.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:31 smithi106 ceph-mon[81208]: pgmap v195: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-05-09T06:40:32.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:31 smithi046 ceph-mon[110713]: pgmap v195: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-05-09T06:40:33.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:32 smithi106 ceph-mon[81208]: reconnect by client.14530 v1:172.21.15.106:0/655094447 after 0.000999976 2024-05-09T06:40:33.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:32 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:reconnect 2024-05-09T06:40:33.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:32 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi106.ugnujp=up:reconnect} 2 up:standby 2024-05-09T06:40:33.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:32 smithi106 ceph-mon[81208]: reconnect by client.14524 v1:192.168.0.1:0/176593620 after 0.00799981 2024-05-09T06:40:33.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:32 smithi046 ceph-mon[110713]: reconnect by client.14530 v1:172.21.15.106:0/655094447 after 0.000999976 2024-05-09T06:40:33.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:32 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:reconnect 2024-05-09T06:40:33.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:32 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi106.ugnujp=up:reconnect} 2 up:standby 2024-05-09T06:40:33.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:32 smithi046 ceph-mon[110713]: reconnect by client.14524 v1:192.168.0.1:0/176593620 after 0.00799981 2024-05-09T06:40:34.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:33 smithi106 ceph-mon[81208]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-05-09T06:40:34.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:33 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:rejoin 2024-05-09T06:40:34.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:33 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi106.ugnujp=up:rejoin} 2 up:standby 2024-05-09T06:40:34.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:33 smithi106 ceph-mon[81208]: daemon mds.cephfs.smithi106.ugnujp is now active in filesystem cephfs as rank 0 2024-05-09T06:40:34.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:33 smithi046 ceph-mon[110713]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-05-09T06:40:34.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:33 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:rejoin 2024-05-09T06:40:34.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:33 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi106.ugnujp=up:rejoin} 2 up:standby 2024-05-09T06:40:34.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:33 smithi046 ceph-mon[110713]: daemon mds.cephfs.smithi106.ugnujp is now active in filesystem cephfs as rank 0 2024-05-09T06:40:34.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:34 smithi106 ceph-mon[81208]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:40:34.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:34 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:active 2024-05-09T06:40:34.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:34 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi106.ugnujp=up:active} 2 up:standby 2024-05-09T06:40:35.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:34 smithi046 ceph-mon[110713]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:40:35.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:34 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6826/3262788331,v1:172.21.15.106:6827/3262788331] up:active 2024-05-09T06:40:35.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:34 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi106.ugnujp=up:active} 2 up:standby 2024-05-09T06:40:35.950 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:35 smithi106 ceph-mon[81208]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:36.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:35 smithi046 ceph-mon[110713]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:36.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:36 smithi106 ceph-mon[81208]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 7 op/s 2024-05-09T06:40:37.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:36 smithi046 ceph-mon[110713]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 7 op/s 2024-05-09T06:40:38.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:38.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:38.322 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:38.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:38 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6824/958476339,v1:172.21.15.106:6825/958476339] up:boot 2024-05-09T06:40:38.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:38 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi106.ugnujp=up:active} 3 up:standby 2024-05-09T06:40:38.323 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:38 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:40:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:38 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6824/958476339,v1:172.21.15.106:6825/958476339] up:boot 2024-05-09T06:40:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:38 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi106.ugnujp=up:active} 3 up:standby 2024-05-09T06:40:38.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:38 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:40:39.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:39 smithi106 ceph-mon[81208]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T06:40:39.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:39 smithi046 ceph-mon[110713]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T06:40:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:41 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:41 smithi106 ceph-mon[81208]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:40:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:41 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:41.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:41 smithi046 ceph-mon[110713]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 170 B/s wr, 4 op/s 2024-05-09T06:40:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:42.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:42.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:42.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:42.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:43.462 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:43 smithi106 ceph-mon[81208]: pgmap v201: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:40:43.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:43 smithi046 ceph-mon[110713]: pgmap v201: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-05-09T06:40:45.733 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:45.733 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:45.734 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:45 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:46.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:45 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:47.568 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:47 smithi106 ceph-mon[81208]: pgmap v203: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:47.569 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:47 smithi106 ceph-mon[81208]: Upgrade: Updating mds.cephfs.smithi106.ugnujp 2024-05-09T06:40:47.569 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:47.569 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:40:47.569 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:47 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:47.569 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:47 smithi106 ceph-mon[81208]: Deploying daemon mds.cephfs.smithi106.ugnujp on smithi106 2024-05-09T06:40:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:47 smithi046 ceph-mon[110713]: pgmap v203: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-09T06:40:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:47 smithi046 ceph-mon[110713]: Upgrade: Updating mds.cephfs.smithi106.ugnujp 2024-05-09T06:40:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi106.ugnujp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T06:40:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:47 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:40:47.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:47 smithi046 ceph-mon[110713]: Deploying daemon mds.cephfs.smithi106.ugnujp on smithi106 2024-05-09T06:40:48.822 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:40:48 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:40:48.442+0000 7f8e5cf8f700 -1 bdev(0x55a90d218000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-05-09T06:40:48.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:48 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[110709]: 2024-05-09T06:40:48.420+0000 7f78243ce700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:49.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-05-09T06:40:49.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:49.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:49.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: osdmap e83: 6 total, 6 up, 6 in 2024-05-09T06:40:49.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: Standby daemon mds.cephfs.smithi046.easboa assigned to filesystem cephfs as rank 0 2024-05-09T06:40:49.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:49.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:49 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi046.easboa=up:replay} 2 up:standby 2024-05-09T06:40:49.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-05-09T06:40:49.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:40:49.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:40:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: osdmap e83: 6 total, 6 up, 6 in 2024-05-09T06:40:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: Standby daemon mds.cephfs.smithi046.easboa assigned to filesystem cephfs as rank 0 2024-05-09T06:40:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:40:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-05-09T06:40:49.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:49 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi046.easboa=up:replay} 2 up:standby 2024-05-09T06:40:51.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:51 smithi106 ceph-mon[81208]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.0 KiB/s wr, 2 op/s 2024-05-09T06:40:51.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:51 smithi046 ceph-mon[110713]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.0 KiB/s wr, 2 op/s 2024-05-09T06:40:53.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:53 smithi106 ceph-mon[81208]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-05-09T06:40:53.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:53 smithi046 ceph-mon[110713]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 -- 172.21.15.46:0/3312070831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8102e50 msgr2=0x7fb3d8103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/3312070831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8102e50 0x7fb3d8103220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8004940 tx=0x7fb3c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 -- 172.21.15.46:0/3312070831 shutdown_connections 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/3312070831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3d8065640 0x7fb3d8065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/3312070831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8102e50 0x7fb3d8103220 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 -- 172.21.15.46:0/3312070831 >> 172.21.15.46:0/3312070831 conn(0x7fb3d8071d00 msgr2=0x7fb3d8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 -- 172.21.15.46:0/3312070831 shutdown_connections 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.934+0000 7fb3dddf8700 1 -- 172.21.15.46:0/3312070831 wait complete. 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.935+0000 7fb3dddf8700 1 Processor -- start 2024-05-09T06:40:54.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.935+0000 7fb3dddf8700 1 -- start start 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.935+0000 7fb3dddf8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 0x7fb3d80fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.935+0000 7fb3dddf8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3d8102e50 0x7fb3d80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.935+0000 7fb3dddf8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80fc910 con 0x7fb3d8065640 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.935+0000 7fb3dddf8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80fca50 con 0x7fb3d8102e50 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 0x7fb3d80fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 0x7fb3d80fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51012/0 (socket says 172.21.15.46:51012) 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 -- 172.21.15.46:0/2841684759 learned_addr learned my addr 172.21.15.46:0/2841684759 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d6ffd700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3d8102e50 0x7fb3d80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 -- 172.21.15.46:0/2841684759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3d8102e50 msgr2=0x7fb3d80fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:54.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3d8102e50 0x7fb3d80fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 -- 172.21.15.46:0/2841684759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8005040 con 0x7fb3d8065640 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3d77fe700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 0x7fb3d80fbdb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800b3b0 tx=0x7fb3c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c800e040 con 0x7fb3d8065640 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3c8013420 con 0x7fb3d8065640 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3c801c630 con 0x7fb3d8065640 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.936+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d8119e80 con 0x7fb3d8065640 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.937+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d811a360 con 0x7fb3d8065640 2024-05-09T06:40:54.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.937+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d80fe540 con 0x7fb3d8065640 2024-05-09T06:40:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.939+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fb3c8013590 con 0x7fb3d8065640 2024-05-09T06:40:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.939+0000 7fb3bffff700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb3c0078990 0x7fb3c007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.939+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb3c809c370 con 0x7fb3d8065640 2024-05-09T06:40:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.939+0000 7fb3d6ffd700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb3c0078990 0x7fb3c007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:54.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.940+0000 7fb3d6ffd700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb3c0078990 0x7fb3c007ae40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80fd6f0 tx=0x7fb3cc0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:54.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:54.948+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb3c8064050 con 0x7fb3d8065640 2024-05-09T06:40:55.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.181+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3d804bf40 con 0x7fb3c0078990 2024-05-09T06:40:55.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.183+0000 7fb3bffff700 1 -- 172.21.15.46:0/2841684759 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb3d804bf40 con 0x7fb3c0078990 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb3c0078990 msgr2=0x7fb3c007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb3c0078990 0x7fb3c007ae40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80fd6f0 tx=0x7fb3cc0091a0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 msgr2=0x7fb3d80fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 0x7fb3d80fbdb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800b3b0 tx=0x7fb3c8009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 shutdown_connections 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb3c0078990 0x7fb3c007ae40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3d8065640 0x7fb3d80fbdb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 --2- 172.21.15.46:0/2841684759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3d8102e50 0x7fb3d80fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.185+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 >> 172.21.15.46:0/2841684759 conn(0x7fb3d8071d00 msgr2=0x7fb3d80fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.186+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 shutdown_connections 2024-05-09T06:40:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.186+0000 7fb3dddf8700 1 -- 172.21.15.46:0/2841684759 wait complete. 2024-05-09T06:40:55.176 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2215459099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8103780 msgr2=0x7f6bd80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2215459099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8103780 0x7f6bd80fcdf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc004940 tx=0x7f6bcc009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2215459099 shutdown_connections 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2215459099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8103780 0x7f6bd80fcdf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2215459099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bd8102de0 0x7f6bd81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2215459099 >> 172.21.15.46:0/2215459099 conn(0x7f6bd80f89b0 msgr2=0x7f6bd80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2215459099 shutdown_connections 2024-05-09T06:40:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.294+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2215459099 wait complete. 2024-05-09T06:40:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.295+0000 7f6bdea5f700 1 Processor -- start 2024-05-09T06:40:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.295+0000 7f6bdea5f700 1 -- start start 2024-05-09T06:40:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.295+0000 7f6bdea5f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 0x7f6bd8113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.295+0000 7f6bdea5f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bd8103780 0x7f6bd8114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.295+0000 7f6bdea5f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8114660 con 0x7f6bd8102de0 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.295+0000 7f6bdea5f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd810da50 con 0x7f6bd8103780 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 0x7f6bd8113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 0x7f6bd8113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51016/0 (socket says 172.21.15.46:51016) 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 -- 172.21.15.46:0/2524542707 learned_addr learned my addr 172.21.15.46:0/2524542707 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd77fe700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bd8103780 0x7f6bd8114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 -- 172.21.15.46:0/2524542707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bd8103780 msgr2=0x7f6bd8114010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bd8103780 0x7f6bd8114010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 -- 172.21.15.46:0/2524542707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc005040 con 0x7f6bd8102de0 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd7fff700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 0x7f6bd8113ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800eb40 tx=0x7f6bc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bc8007cc0 con 0x7f6bd8102de0 2024-05-09T06:40:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bc800f040 con 0x7f6bd8102de0 2024-05-09T06:40:55.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bc8009620 con 0x7f6bd8102de0 2024-05-09T06:40:55.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd810dcd0 con 0x7f6bd8102de0 2024-05-09T06:40:55.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.296+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd810e1e0 con 0x7f6bd8102de0 2024-05-09T06:40:55.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.298+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd80fe530 con 0x7f6bd8102de0 2024-05-09T06:40:55.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.298+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f6bc8009780 con 0x7f6bd8102de0 2024-05-09T06:40:55.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.299+0000 7f6bd4ff9700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6bc0078990 0x7f6bc007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:55.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.299+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6bc809a2c0 con 0x7f6bd8102de0 2024-05-09T06:40:55.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.299+0000 7f6bd77fe700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6bc0078990 0x7f6bc007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:55.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.299+0000 7f6bd77fe700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6bc0078990 0x7f6bc007ae40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009b30 tx=0x7f6bcc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:55.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.308+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f6bc8061f00 con 0x7f6bd8102de0 2024-05-09T06:40:55.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.542+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bd8109f10 con 0x7f6bc0078990 2024-05-09T06:40:55.522 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:55 smithi046 ceph-mon[110713]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-09T06:40:55.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.544+0000 7f6bd4ff9700 1 -- 172.21.15.46:0/2524542707 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6bd8109f10 con 0x7f6bc0078990 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6bc0078990 msgr2=0x7f6bc007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6bc0078990 0x7f6bc007ae40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009b30 tx=0x7f6bcc009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 msgr2=0x7f6bd8113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 0x7f6bd8113ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800eb40 tx=0x7f6bc800b040 comp rx=0 tx=0).stop 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 shutdown_connections 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6bc0078990 0x7f6bc007ae40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8102de0 0x7f6bd8113ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 --2- 172.21.15.46:0/2524542707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bd8103780 0x7f6bd8114010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 >> 172.21.15.46:0/2524542707 conn(0x7f6bd80f89b0 msgr2=0x7f6bd80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 shutdown_connections 2024-05-09T06:40:55.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.546+0000 7f6bdea5f700 1 -- 172.21.15.46:0/2524542707 wait complete. 2024-05-09T06:40:55.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 -- 172.21.15.46:0/2051944966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 msgr2=0x7f485c0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 --2- 172.21.15.46:0/2051944966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c0fcb60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f484c004940 tx=0x7f484c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 -- 172.21.15.46:0/2051944966 shutdown_connections 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 --2- 172.21.15.46:0/2051944966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f485c0fd0a0 0x7f485c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 --2- 172.21.15.46:0/2051944966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c0fcb60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 -- 172.21.15.46:0/2051944966 >> 172.21.15.46:0/2051944966 conn(0x7f485c071d00 msgr2=0x7f485c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 -- 172.21.15.46:0/2051944966 shutdown_connections 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.653+0000 7f48626c4700 1 -- 172.21.15.46:0/2051944966 wait complete. 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.654+0000 7f48626c4700 1 Processor -- start 2024-05-09T06:40:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.654+0000 7f48626c4700 1 -- start start 2024-05-09T06:40:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.654+0000 7f48626c4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.654+0000 7f48626c4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f485c0fd0a0 0x7f485c1162e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.654+0000 7f48626c4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c116930 con 0x7f485c0fc790 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.654+0000 7f48626c4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c10fd40 con 0x7f485c0fd0a0 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c115da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51032/0 (socket says 172.21.15.46:51032) 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 -- 172.21.15.46:0/1347061886 learned_addr learned my addr 172.21.15.46:0/1347061886 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485b7fe700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f485c0fd0a0 0x7f485c1162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 -- 172.21.15.46:0/1347061886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f485c0fd0a0 msgr2=0x7f485c1162e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f485c0fd0a0 0x7f485c1162e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 -- 172.21.15.46:0/1347061886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c005040 con 0x7f485c0fc790 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f485bfff700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c115da0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f484c009150 tx=0x7f484c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484c00e040 con 0x7f485c0fc790 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c10ffc0 con 0x7f485c0fc790 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f484c013420 con 0x7f485c0fc790 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f484c01c630 con 0x7f485c0fc790 2024-05-09T06:40:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.655+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c110500 con 0x7f485c0fc790 2024-05-09T06:40:55.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.657+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0fc330 con 0x7f485c0fc790 2024-05-09T06:40:55.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.658+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f484c013590 con 0x7f485c0fc790 2024-05-09T06:40:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.659+0000 7f4858ff9700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4844078980 0x7f484407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.659+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f484c09b900 con 0x7f485c0fc790 2024-05-09T06:40:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.659+0000 7f485b7fe700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4844078980 0x7f484407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.659+0000 7f485b7fe700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4844078980 0x7f484407ae30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f485c111680 tx=0x7f4850009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.664+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f484c0635e0 con 0x7f485c0fc790 2024-05-09T06:40:55.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:55 smithi106 ceph-mon[81208]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-05-09T06:40:55.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.915+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f485c04bf40 con 0x7f4844078980 2024-05-09T06:40:55.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.925+0000 7f4858ff9700 1 -- 172.21.15.46:0/1347061886 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f485c04bf40 con 0x7f4844078980 2024-05-09T06:40:55.905 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 41s ago 18m 23.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (4m) 41s ago 19m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (4m) 15s ago 17m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 41s ago 18m 78.7M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (69s) 41s ago 13m 12.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 505f13a2ec8b 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (46s) 41s ago 13m 13.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e4b34f0292a9 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (19s) 15s ago 13m 14.8M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6d610c71e632 2024-05-09T06:40:55.906 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (13m) 15s ago 13m 79.1M - 17.2.7-933-g4ba5a836 b96134859c76 0a3468c56689 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (9m) 41s ago 20m 523M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (8m) 15s ago 17m 467M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (5m) 41s ago 20m 56.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (5m) 15s ago 17m 41.6M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 41s ago 18m 16.6M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (8m) 15s ago 17m 16.0M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 41s ago 16m 105M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:40:55.907 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 41s ago 16m 117M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:40:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 41s ago 16m 101M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:40:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (2m) 15s ago 15m 125M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:40:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (119s) 15s ago 15m 112M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 19b53c23db28 2024-05-09T06:40:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (85s) 15s ago 14m 100M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 45571448b3f7 2024-05-09T06:40:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (7m) 41s ago 18m 66.7M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:40:55.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4844078980 msgr2=0x7f484407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4844078980 0x7f484407ae30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f485c111680 tx=0x7f4850009ee0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 msgr2=0x7f485c115da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c115da0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f484c009150 tx=0x7f484c009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 shutdown_connections 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f4844078980 0x7f484407ae30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f485c0fc790 0x7f485c115da0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 --2- 172.21.15.46:0/1347061886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f485c0fd0a0 0x7f485c1162e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 >> 172.21.15.46:0/1347061886 conn(0x7f485c071d00 msgr2=0x7f485c0f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 shutdown_connections 2024-05-09T06:40:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:55.928+0000 7f48626c4700 1 -- 172.21.15.46:0/1347061886 wait complete. 2024-05-09T06:40:56.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 -- 172.21.15.46:0/3937728389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 msgr2=0x7faddc065ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 --2- 172.21.15.46:0/3937728389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc065ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadd0004940 tx=0x7fadd0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 -- 172.21.15.46:0/3937728389 shutdown_connections 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 --2- 172.21.15.46:0/3937728389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc065ad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 --2- 172.21.15.46:0/3937728389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 0x7faddc103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 -- 172.21.15.46:0/3937728389 >> 172.21.15.46:0/3937728389 conn(0x7faddc072b60 msgr2=0x7faddc072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 -- 172.21.15.46:0/3937728389 shutdown_connections 2024-05-09T06:40:56.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.036+0000 7fade235a700 1 -- 172.21.15.46:0/3937728389 wait complete. 2024-05-09T06:40:56.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7fade235a700 1 Processor -- start 2024-05-09T06:40:56.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7fade235a700 1 -- start start 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7fade235a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7fade235a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 0x7faddc113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7fade235a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc114630 con 0x7faddc065660 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7fade235a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc10da20 con 0x7faddc102d80 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7faddbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7faddbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51040/0 (socket says 172.21.15.46:51040) 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.037+0000 7faddbfff700 1 -- 172.21.15.46:0/90262081 learned_addr learned my addr 172.21.15.46:0/90262081 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7faddb7fe700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 0x7faddc113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7faddbfff700 1 -- 172.21.15.46:0/90262081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 msgr2=0x7faddc113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7faddbfff700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 0x7faddc113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7faddbfff700 1 -- 172.21.15.46:0/90262081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0005040 con 0x7faddc065660 2024-05-09T06:40:56.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7faddb7fe700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 0x7faddc113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:40:56.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7faddbfff700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc113aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00eb40 tx=0x7fadcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:56.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadcc007cc0 con 0x7faddc065660 2024-05-09T06:40:56.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadcc00f040 con 0x7faddc065660 2024-05-09T06:40:56.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc10dca0 con 0x7faddc065660 2024-05-09T06:40:56.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadcc009620 con 0x7faddc065660 2024-05-09T06:40:56.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.038+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc10e1b0 con 0x7faddc065660 2024-05-09T06:40:56.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.040+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc0fe4e0 con 0x7faddc065660 2024-05-09T06:40:56.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.040+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fadcc009780 con 0x7faddc065660 2024-05-09T06:40:56.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.040+0000 7fadd8ff9700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fadc4078990 0x7fadc407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.041+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fadcc09a400 con 0x7faddc065660 2024-05-09T06:40:56.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.041+0000 7faddb7fe700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fadc4078990 0x7fadc407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.041+0000 7faddb7fe700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fadc4078990 0x7fadc407ae40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faddc10ed00 tx=0x7fadd0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:56.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.045+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fadcc062070 con 0x7faddc065660 2024-05-09T06:40:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.396+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faddc109e70 con 0x7faddc065660 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.396+0000 7fadd8ff9700 1 -- 172.21.15.46:0/90262081 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fadcc061a10 con 0x7faddc065660 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:56.376 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 3 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 13 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:40:56.377 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:40:56.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.398+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fadc4078990 msgr2=0x7fadc407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.398+0000 7fade235a700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fadc4078990 0x7fadc407ae40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faddc10ed00 tx=0x7fadd0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.398+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 msgr2=0x7faddc113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.398+0000 7fade235a700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc113aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00eb40 tx=0x7fadcc00b040 comp rx=0 tx=0).stop 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 shutdown_connections 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fadc4078990 0x7fadc407ae40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faddc065660 0x7faddc113aa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 --2- 172.21.15.46:0/90262081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faddc102d80 0x7faddc113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 >> 172.21.15.46:0/90262081 conn(0x7faddc072b60 msgr2=0x7faddc0fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 shutdown_connections 2024-05-09T06:40:56.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.399+0000 7fade235a700 1 -- 172.21.15.46:0/90262081 wait complete. 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.505+0000 7f13ab843700 1 -- 172.21.15.46:0/1805474152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4065640 msgr2=0x7f13a4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.505+0000 7f13ab843700 1 --2- 172.21.15.46:0/1805474152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4065640 0x7f13a4065ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1394004940 tx=0x7f1394009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.505+0000 7f13ab843700 1 -- 172.21.15.46:0/1805474152 shutdown_connections 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.505+0000 7f13ab843700 1 --2- 172.21.15.46:0/1805474152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4065640 0x7f13a4065ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.505+0000 7f13ab843700 1 --2- 172.21.15.46:0/1805474152 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4102e50 0x7f13a4103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.505+0000 7f13ab843700 1 -- 172.21.15.46:0/1805474152 >> 172.21.15.46:0/1805474152 conn(0x7f13a4071d00 msgr2=0x7f13a4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.506+0000 7f13ab843700 1 -- 172.21.15.46:0/1805474152 shutdown_connections 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.506+0000 7f13ab843700 1 -- 172.21.15.46:0/1805474152 wait complete. 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.506+0000 7f13ab843700 1 Processor -- start 2024-05-09T06:40:56.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.506+0000 7f13ab843700 1 -- start start 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13ab843700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4065640 0x7f13a4113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13ab843700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 0x7f13a41140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13ab843700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4114700 con 0x7f13a4102e50 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13ab843700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a410daf0 con 0x7f13a4065640 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a8dde700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 0x7f13a41140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a8dde700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 0x7f13a41140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51050/0 (socket says 172.21.15.46:51050) 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a8dde700 1 -- 172.21.15.46:0/3824048139 learned_addr learned my addr 172.21.15.46:0/3824048139 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a95df700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4065640 0x7f13a4113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a8dde700 1 -- 172.21.15.46:0/3824048139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4065640 msgr2=0x7f13a4113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a8dde700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4065640 0x7f13a4113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a8dde700 1 -- 172.21.15.46:0/3824048139 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394005040 con 0x7f13a4102e50 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.507+0000 7f13a95df700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4065640 0x7f13a4113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.508+0000 7f13a8dde700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 0x7f13a41140b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f139400b3b0 tx=0x7f1394009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.508+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f139400e040 con 0x7f13a4102e50 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.508+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f139400bbc0 con 0x7f13a4102e50 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.508+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a410dd70 con 0x7f13a4102e50 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.508+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f139401c3f0 con 0x7f13a4102e50 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.508+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a410e330 con 0x7f13a4102e50 2024-05-09T06:40:56.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.509+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a4100100 con 0x7f13a4102e50 2024-05-09T06:40:56.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.510+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f139400bd30 con 0x7f13a4102e50 2024-05-09T06:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.511+0000 7f1399ffb700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f139007cda0 0x7f139007f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.511+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f139409baa0 con 0x7f13a4102e50 2024-05-09T06:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.511+0000 7f13a95df700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f139007cda0 0x7f139007f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.512+0000 7f13a95df700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f139007cda0 0x7f139007f250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009fd0 tx=0x7f13a0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.516+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f13940635c0 con 0x7f13a4102e50 2024-05-09T06:40:56.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.773+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13a405f5f0 con 0x7f13a4102e50 2024-05-09T06:40:56.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:56 smithi046 ceph-mon[110713]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:56.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:56 smithi046 ceph-mon[110713]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.774+0000 7f1399ffb700 1 -- 172.21.15.46:0/3824048139 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) v1 ==== 76+0+1748 (secure 0 0 0) 0x7f1394062f60 con 0x7f13a4102e50 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:56.754 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 31 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:40:48.425824+0000 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 83 2024-05-09T06:40:56.755 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=34372} 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-05-09T06:40:56.756 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{0:34372} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:56.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:56.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:56.757 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:40:56.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:40:56.757 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/1650120770,v1:172.21.15.46:6829/1650120770] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:56.757 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.106:6824/958476339,v1:172.21.15.106:6825/958476339] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.777+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f139007cda0 msgr2=0x7f139007f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.777+0000 7f13ab843700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f139007cda0 0x7f139007f250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009fd0 tx=0x7f13a0009ee0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.777+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 msgr2=0x7f13a41140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.777+0000 7f13ab843700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 0x7f13a41140b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f139400b3b0 tx=0x7f1394009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.777+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 shutdown_connections 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.777+0000 7f13ab843700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f139007cda0 0x7f139007f250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.778+0000 7f13ab843700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13a4065640 0x7f13a4113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.778+0000 7f13ab843700 1 --2- 172.21.15.46:0/3824048139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13a4102e50 0x7f13a41140b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.778+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 >> 172.21.15.46:0/3824048139 conn(0x7f13a4071d00 msgr2=0x7f13a40fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.778+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 shutdown_connections 2024-05-09T06:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.778+0000 7f13ab843700 1 -- 172.21.15.46:0/3824048139 wait complete. 2024-05-09T06:40:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T06:40:56.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:56 smithi106 ceph-mon[81208]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:56.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:56 smithi106 ceph-mon[81208]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3259949731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8065640 msgr2=0x7fadb8065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3259949731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8065640 0x7fadb8065ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fadac004940 tx=0x7fadac009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3259949731 shutdown_connections 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3259949731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8065640 0x7fadb8065ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3259949731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8102e50 0x7fadb8103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3259949731 >> 172.21.15.46:0/3259949731 conn(0x7fadb8071d00 msgr2=0x7fadb8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:56.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3259949731 shutdown_connections 2024-05-09T06:40:56.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.894+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3259949731 wait complete. 2024-05-09T06:40:56.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.895+0000 7fadbdc2f700 1 Processor -- start 2024-05-09T06:40:56.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.895+0000 7fadbdc2f700 1 -- start start 2024-05-09T06:40:56.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.895+0000 7fadbdc2f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8065640 0x7fadb8113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.895+0000 7fadbdc2f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 0x7fadb81140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.895+0000 7fadbdc2f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8114700 con 0x7fadb8102e50 2024-05-09T06:40:56.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.895+0000 7fadbdc2f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb810daf0 con 0x7fadb8065640 2024-05-09T06:40:56.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 0x7fadb81140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 0x7fadb81140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51066/0 (socket says 172.21.15.46:51066) 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 -- 172.21.15.46:0/3885754873 learned_addr learned my addr 172.21.15.46:0/3885754873 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb77fe700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8065640 0x7fadb8113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 -- 172.21.15.46:0/3885754873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8065640 msgr2=0x7fadb8113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8065640 0x7fadb8113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 -- 172.21.15.46:0/3885754873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac005040 con 0x7fadb8102e50 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb77fe700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8065640 0x7fadb8113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fadb6ffd700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 0x7fadb81140b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fadac009180 tx=0x7fadac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadac00e040 con 0x7fadb8102e50 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.896+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadac013420 con 0x7fadb8102e50 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.897+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadac01c630 con 0x7fadb8102e50 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.897+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb810dd70 con 0x7fadb8102e50 2024-05-09T06:40:56.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.897+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb810e2e0 con 0x7fadb8102e50 2024-05-09T06:40:56.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.898+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb8100100 con 0x7fadb8102e50 2024-05-09T06:40:56.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.899+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fadac013590 con 0x7fadb8102e50 2024-05-09T06:40:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.899+0000 7fad9ffff700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fada0078980 0x7fada007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.900+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fadac09b930 con 0x7fadb8102e50 2024-05-09T06:40:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.900+0000 7fadb77fe700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fada0078980 0x7fada007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:56.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.900+0000 7fadb77fe700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fada0078980 0x7fada007ae30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fada8010520 tx=0x7fada800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:56.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:56.905+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fadac063570 con 0x7fadb8102e50 2024-05-09T06:40:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.141+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadb8113840 con 0x7fada0078980 2024-05-09T06:40:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.143+0000 7fad9ffff700 1 -- 172.21.15.46:0/3885754873 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fadb8113840 con 0x7fada0078980 2024-05-09T06:40:57.122 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:40:57.122 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "mon" 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "15/21 daemons upgraded", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:40:57.123 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:40:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fada0078980 msgr2=0x7fada007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fada0078980 0x7fada007ae30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fada8010520 tx=0x7fada800b040 comp rx=0 tx=0).stop 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 msgr2=0x7fadb81140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 0x7fadb81140b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fadac009180 tx=0x7fadac009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 shutdown_connections 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fada0078980 0x7fada007ae30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadb8065640 0x7fadb8113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 --2- 172.21.15.46:0/3885754873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadb8102e50 0x7fadb81140b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 >> 172.21.15.46:0/3885754873 conn(0x7fadb8071d00 msgr2=0x7fadb80fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 shutdown_connections 2024-05-09T06:40:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.145+0000 7fadbdc2f700 1 -- 172.21.15.46:0/3885754873 wait complete. 2024-05-09T06:40:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.252+0000 7f0ccbea5700 1 -- 172.21.15.46:0/4140369109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 msgr2=0x7f0cc40fbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.252+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/4140369109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc40fbf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0004940 tx=0x7f0cc0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- 172.21.15.46:0/4140369109 shutdown_connections 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/4140369109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cc40fc4d0 0x7f0cc4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/4140369109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc40fbf90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- 172.21.15.46:0/4140369109 >> 172.21.15.46:0/4140369109 conn(0x7f0cc40f7870 msgr2=0x7f0cc40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- 172.21.15.46:0/4140369109 shutdown_connections 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- 172.21.15.46:0/4140369109 wait complete. 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 Processor -- start 2024-05-09T06:40:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- start start 2024-05-09T06:40:57.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc4115a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:57.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cc40fc4d0 0x7f0cc4115fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:57.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4116620 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.253+0000 7f0ccbea5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc410fc00 con 0x7f0cc40fc4d0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc4115a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc4115a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51086/0 (socket says 172.21.15.46:51086) 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 -- 172.21.15.46:0/165583846 learned_addr learned my addr 172.21.15.46:0/165583846 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 -- 172.21.15.46:0/165583846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cc40fc4d0 msgr2=0x7f0cc4115fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9440700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cc40fc4d0 0x7f0cc4115fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cc40fc4d0 0x7f0cc4115fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 -- 172.21.15.46:0/165583846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0005040 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cc9c41700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc4115a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009380 tx=0x7f0cc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cc000e040 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc410fee0 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cc0009af0 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cc001c630 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.254+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc41104a0 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.255+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc4066ad0 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.256+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f0cc000bbc0 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.256+0000 7f0cba7fc700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0cb0078990 0x7f0cb007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:40:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.257+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0cc009ba20 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.257+0000 7f0cc9440700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0cb0078990 0x7f0cb007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:40:57.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.257+0000 7f0cc9440700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0cb0078990 0x7f0cb007ae40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4111330 tx=0x7f0cb4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:40:57.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.261+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f0cc0063660 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.575+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0cc404c710 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.575+0000 7f0cba7fc700 1 -- 172.21.15.46:0/165583846 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7f0cc0063000 con 0x7f0cc40fbbc0 2024-05-09T06:40:57.558 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:57.558 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-05-09T06:40:57.558 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-05-09T06:40:57.558 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:40:57.558 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.577+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0cb0078990 msgr2=0x7f0cb007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.577+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0cb0078990 0x7f0cb007ae40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4111330 tx=0x7f0cb4009040 comp rx=0 tx=0).stop 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.577+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 msgr2=0x7f0cc4115a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.577+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc4115a90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009380 tx=0x7f0cc0009e30 comp rx=0 tx=0).stop 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 shutdown_connections 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f0cb0078990 0x7f0cb007ae40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cc40fbbc0 0x7f0cc4115a90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 --2- 172.21.15.46:0/165583846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cc40fc4d0 0x7f0cc4115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:40:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 >> 172.21.15.46:0/165583846 conn(0x7f0cc40f7870 msgr2=0x7f0cc40f7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:40:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 shutdown_connections 2024-05-09T06:40:57.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:40:57.578+0000 7f0ccbea5700 1 -- 172.21.15.46:0/165583846 wait complete. 2024-05-09T06:40:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:57 smithi106 ceph-mon[81208]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:57 smithi106 ceph-mon[81208]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:57 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/90262081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:57 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3824048139' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:40:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:57.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:57.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:57 smithi046 ceph-mon[110713]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:57.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:57 smithi046 ceph-mon[110713]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-05-09T06:40:57.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:57 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/90262081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:40:57.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:57 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3824048139' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:40:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:40:57.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:40:58.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:58 smithi106 ceph-mon[81208]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:58.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:58 smithi106 ceph-mon[81208]: reconnect by client.14524 v1:192.168.0.1:0/176593620 after 0 2024-05-09T06:40:58.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:58 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:reconnect 2024-05-09T06:40:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:58 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi046.easboa=up:reconnect} 2 up:standby 2024-05-09T06:40:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:58 smithi106 ceph-mon[81208]: reconnect by client.14530 v1:172.21.15.106:0/655094447 after 0.00799991 2024-05-09T06:40:58.823 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:58 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/165583846' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:58.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:58 smithi046 ceph-mon[110713]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:40:58.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:58 smithi046 ceph-mon[110713]: reconnect by client.14524 v1:192.168.0.1:0/176593620 after 0 2024-05-09T06:40:58.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:58 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:reconnect 2024-05-09T06:40:58.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:58 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi046.easboa=up:reconnect} 2 up:standby 2024-05-09T06:40:58.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:58 smithi046 ceph-mon[110713]: reconnect by client.14530 v1:172.21.15.106:0/655094447 after 0.00799991 2024-05-09T06:40:58.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:58 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/165583846' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:40:59.758 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:59 smithi106 ceph-mon[81208]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T06:40:59.758 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:59 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:rejoin 2024-05-09T06:40:59.758 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:59 smithi106 ceph-mon[81208]: fsmap cephfs:1/1 {0=cephfs.smithi046.easboa=up:rejoin} 2 up:standby 2024-05-09T06:40:59.758 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:40:59 smithi106 ceph-mon[81208]: daemon mds.cephfs.smithi046.easboa is now active in filesystem cephfs as rank 0 2024-05-09T06:40:59.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:59 smithi046 ceph-mon[110713]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-05-09T06:40:59.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:59 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:rejoin 2024-05-09T06:40:59.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:59 smithi046 ceph-mon[110713]: fsmap cephfs:1/1 {0=cephfs.smithi046.easboa=up:rejoin} 2 up:standby 2024-05-09T06:40:59.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:40:59 smithi046 ceph-mon[110713]: daemon mds.cephfs.smithi046.easboa is now active in filesystem cephfs as rank 0 2024-05-09T06:41:00.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:00 smithi106 ceph-mon[81208]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:41:00.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:00 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:active 2024-05-09T06:41:00.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:00 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2 up:standby 2024-05-09T06:41:00.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:00 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:00.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:00 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:00.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:00 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:00.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:00 smithi046 ceph-mon[110713]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:41:00.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:00 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] up:active 2024-05-09T06:41:00.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:00 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 2 up:standby 2024-05-09T06:41:00.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:00 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:00.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:00 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:00.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:00 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:01.735 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:01 smithi106 ceph-mon[81208]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-05-09T06:41:01.735 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:01 smithi106 ceph-mon[81208]: mds.? [v2:172.21.15.106:6826/2800643990,v1:172.21.15.106:6827/2800643990] up:boot 2024-05-09T06:41:01.735 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:01 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:41:01.735 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:01 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:41:01.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:01 smithi046 ceph-mon[110713]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-05-09T06:41:01.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:01 smithi046 ceph-mon[110713]: mds.? [v2:172.21.15.106:6826/2800643990,v1:172.21.15.106:6827/2800643990] up:boot 2024-05-09T06:41:01.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:01 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:41:01.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:01 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:41:03.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:03 smithi106 ceph-mon[81208]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-05-09T06:41:03.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:03 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:03.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:03 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:03.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:03 smithi046 ceph-mon[110713]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-05-09T06:41:03.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:03 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:03.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:03 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:04.977 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:04.977 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:04 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:05.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:04 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:06.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:05 smithi106 ceph-mon[81208]: pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 9.9 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-09T06:41:06.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:05 smithi046 ceph-mon[110713]: pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 9.9 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-09T06:41:08.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:41:08.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.easboa"}]': finished 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.pkuwsr"}]': finished 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.fqgqkm"}]': finished 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.ugnujp"}]': finished 2024-05-09T06:41:08.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:07 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.easboa"}]: dispatch 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.easboa"}]': finished 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.pkuwsr"}]: dispatch 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.pkuwsr"}]': finished 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.fqgqkm"}]: dispatch 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.fqgqkm"}]': finished 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.ugnujp"}]: dispatch 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi106.ugnujp"}]': finished 2024-05-09T06:41:08.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:07 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all mds 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: Upgrade: Setting filesystem cephfs Joinable 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:41:09.075 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.076 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:09.077 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:08 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all mds 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: Upgrade: Setting filesystem cephfs Joinable 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: fsmap cephfs:1 {0=cephfs.smithi046.easboa=up:active} 3 up:standby 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-09T06:41:09.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.088 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:41:09.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:08 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all rgw 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all nfs 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:41:10.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Finalizing container_image settings 2024-05-09T06:41:10.073 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:09 smithi106 ceph-mon[81208]: Upgrade: Complete! 2024-05-09T06:41:10.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:41:10.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all rgw 2024-05-09T06:41:10.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all rbd-mirror 2024-05-09T06:41:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all ceph-exporter 2024-05-09T06:41:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all iscsi 2024-05-09T06:41:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all nfs 2024-05-09T06:41:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Setting container_image for all nvmeof 2024-05-09T06:41:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Finalizing container_image settings 2024-05-09T06:41:10.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:09 smithi046 ceph-mon[110713]: Upgrade: Complete! 2024-05-09T06:41:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:11 smithi106 ceph-mon[81208]: pgmap v216: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:41:12.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:11 smithi046 ceph-mon[110713]: pgmap v216: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-09T06:41:13.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:13.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:13 smithi106 ceph-mon[81208]: pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 3 op/s 2024-05-09T06:41:13.573 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:13 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:13 smithi046 ceph-mon[110713]: pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.4 KiB/s wr, 3 op/s 2024-05-09T06:41:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:13 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:41:15.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:15 smithi106 ceph-mon[81208]: pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2024-05-09T06:41:15.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:15 smithi046 ceph-mon[110713]: pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2024-05-09T06:41:17.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:17 smithi106 ceph-mon[81208]: pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:17.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:17 smithi046 ceph-mon[110713]: pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:19.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:19 smithi106 ceph-mon[81208]: pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:19.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:19 smithi046 ceph-mon[110713]: pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:21.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:21 smithi106 ceph-mon[81208]: pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:21.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:21 smithi046 ceph-mon[110713]: pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:23.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:23 smithi106 ceph-mon[81208]: pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:23.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:23 smithi046 ceph-mon[110713]: pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:25.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:25 smithi106 ceph-mon[81208]: pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:25.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:25 smithi046 ceph-mon[110713]: pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:27.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:27 smithi106 ceph-mon[81208]: pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:27.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:27.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:27 smithi046 ceph-mon[110713]: pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:27.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.696+0000 7f944c2b3700 1 -- 172.21.15.46:0/2624789891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 msgr2=0x7f9444070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.696+0000 7f944c2b3700 1 --2- 172.21.15.46:0/2624789891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444070670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9440004970 tx=0x7f9440009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 -- 172.21.15.46:0/2624789891 shutdown_connections 2024-05-09T06:41:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 --2- 172.21.15.46:0/2624789891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9444070bb0 0x7f9444109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 --2- 172.21.15.46:0/2624789891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444070670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 -- 172.21.15.46:0/2624789891 >> 172.21.15.46:0/2624789891 conn(0x7f94440f8990 msgr2=0x7f94440fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 -- 172.21.15.46:0/2624789891 shutdown_connections 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 -- 172.21.15.46:0/2624789891 wait complete. 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 Processor -- start 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.697+0000 7f944c2b3700 1 -- start start 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944c2b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944c2b3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9444070bb0 0x7f9444116060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944c2b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94441166b0 con 0x7f94440702a0 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944c2b3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944410fc90 con 0x7f9444070bb0 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444115b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60072/0 (socket says 172.21.15.46:60072) 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 -- 172.21.15.46:0/35444610 learned_addr learned my addr 172.21.15.46:0/35444610 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944984e700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9444070bb0 0x7f9444116060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 -- 172.21.15.46:0/35444610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9444070bb0 msgr2=0x7f9444116060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9444070bb0 0x7f9444116060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 -- 172.21.15.46:0/35444610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440005040 con 0x7f94440702a0 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f944a04f700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444115b20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f9440009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.698+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f944000e040 con 0x7f94440702a0 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.699+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f944000bc10 con 0x7f94440702a0 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.699+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944410ff10 con 0x7f94440702a0 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.699+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f944001c630 con 0x7f94440702a0 2024-05-09T06:41:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.699+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9444110450 con 0x7f94440702a0 2024-05-09T06:41:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.700+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94440719e0 con 0x7f94440702a0 2024-05-09T06:41:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.700+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f944000bd80 con 0x7f94440702a0 2024-05-09T06:41:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.701+0000 7f943affd700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9430078990 0x7f943007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.701+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f944009b950 con 0x7f94440702a0 2024-05-09T06:41:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.701+0000 7f944984e700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9430078990 0x7f943007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.701+0000 7f944984e700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9430078990 0x7f943007ae40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94441113c0 tx=0x7f9434009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:27.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.706+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9440063630 con 0x7f94440702a0 2024-05-09T06:41:27.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.938+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f944410c170 con 0x7f9430078990 2024-05-09T06:41:27.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.940+0000 7f943affd700 1 -- 172.21.15.46:0/35444610 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f9434004e30 con 0x7f9430078990 2024-05-09T06:41:27.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9430078990 msgr2=0x7f943007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9430078990 0x7f943007ae40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94441113c0 tx=0x7f9434009ee0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 msgr2=0x7f9444115b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444115b20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f9440009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 shutdown_connections 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9430078990 0x7f943007ae40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94440702a0 0x7f9444115b20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 --2- 172.21.15.46:0/35444610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9444070bb0 0x7f9444116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 >> 172.21.15.46:0/35444610 conn(0x7f94440f8990 msgr2=0x7f94440f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 shutdown_connections 2024-05-09T06:41:27.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:27.942+0000 7f944c2b3700 1 -- 172.21.15.46:0/35444610 wait complete. 2024-05-09T06:41:28.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch ps' 2024-05-09T06:41:29.019 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:41:29.446 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:29 smithi046 ceph-mon[110713]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:41:29.446 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:29 smithi046 ceph-mon[110713]: pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:29.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:29 smithi106 ceph-mon[81208]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:41:29.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:29 smithi106 ceph-mon[81208]: pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 -- 172.21.15.46:0/2028470739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 msgr2=0x7f26580fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 --2- 172.21.15.46:0/2028470739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f26580fcdd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f264c004940 tx=0x7f264c009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 -- 172.21.15.46:0/2028470739 shutdown_connections 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 --2- 172.21.15.46:0/2028470739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f26580fcdd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 --2- 172.21.15.46:0/2028470739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2658102dc0 0x7f2658103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 -- 172.21.15.46:0/2028470739 >> 172.21.15.46:0/2028470739 conn(0x7f26580f8930 msgr2=0x7f26580fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 -- 172.21.15.46:0/2028470739 shutdown_connections 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.824+0000 7f265ceaf700 1 -- 172.21.15.46:0/2028470739 wait complete. 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265ceaf700 1 Processor -- start 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265ceaf700 1 -- start start 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265ceaf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2658102dc0 0x7f26581138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265ceaf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f2658113e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265ceaf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2658114450 con 0x7f2658103760 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265ceaf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265810da50 con 0x7f2658102dc0 2024-05-09T06:41:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f2655d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f2658113e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f2655d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f2658113e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45358/0 (socket says 172.21.15.46:45358) 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f2655d9b700 1 -- 172.21.15.46:0/3699935814 learned_addr learned my addr 172.21.15.46:0/3699935814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f265659c700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2658102dc0 0x7f26581138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f2655d9b700 1 -- 172.21.15.46:0/3699935814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2658102dc0 msgr2=0x7f26581138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f2655d9b700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2658102dc0 0x7f26581138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.825+0000 7f2655d9b700 1 -- 172.21.15.46:0/3699935814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c005040 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.826+0000 7f2655d9b700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f2658113e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.826+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264c021070 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.826+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f264c013cd0 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.826+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265810dcd0 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.826+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264c00e070 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.826+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265810e1b0 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.827+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26580fe510 con 0x7f2658103760 2024-05-09T06:41:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.828+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f264c01caf0 con 0x7f2658103760 2024-05-09T06:41:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.828+0000 7f2646ffd700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2640078990 0x7f264007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.828+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f264c09bc10 con 0x7f2658103760 2024-05-09T06:41:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.828+0000 7f265659c700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2640078990 0x7f264007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.829+0000 7f265659c700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2640078990 0x7f264007ae40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2648004600 tx=0x7f264800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:30.833+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f264c063850 con 0x7f2658103760 2024-05-09T06:41:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.065+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2658109ea0 con 0x7f2640078990 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.076+0000 7f2646ffd700 1 -- 172.21.15.46:0/3699935814 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2658109ea0 con 0x7f2640078990 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 76s ago 19m 23.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 76s ago 19m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (5m) 28s ago 18m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 76s ago 19m 78.7M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:41:31.056 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (104s) 76s ago 13m 12.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 505f13a2ec8b 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (81s) 76s ago 13m 13.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e4b34f0292a9 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (54s) 28s ago 13m 15.0M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6d610c71e632 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (31s) 28s ago 13m 12.0M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 10ba9bc4f6c5 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (10m) 76s ago 20m 523M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (9m) 28s ago 18m 467M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (6m) 76s ago 20m 56.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (6m) 28s ago 18m 42.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 76s ago 19m 16.6M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (8m) 28s ago 18m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 76s ago 17m 105M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 76s ago 17m 117M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 76s ago 16m 101M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (3m) 28s ago 16m 126M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (2m) 28s ago 15m 113M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 19b53c23db28 2024-05-09T06:41:31.057 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (2m) 28s ago 15m 101M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 45571448b3f7 2024-05-09T06:41:31.058 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (8m) 76s ago 18m 66.7M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:41:31.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2640078990 msgr2=0x7f264007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2640078990 0x7f264007ae40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2648004600 tx=0x7f264800b040 comp rx=0 tx=0).stop 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 msgr2=0x7f2658113e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f2658113e00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f264c000c00 tx=0x7f264c009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 shutdown_connections 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2640078990 0x7f264007ae40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2658102dc0 0x7f26581138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 --2- 172.21.15.46:0/3699935814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2658103760 0x7f2658113e00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 >> 172.21.15.46:0/3699935814 conn(0x7f26580f8930 msgr2=0x7f26580f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 shutdown_connections 2024-05-09T06:41:31.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:31.078+0000 7f265ceaf700 1 -- 172.21.15.46:0/3699935814 wait complete. 2024-05-09T06:41:31.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:31 smithi046 ceph-mon[110713]: pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:31.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:31 smithi106 ceph-mon[81208]: pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:31.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch upgrade status' 2024-05-09T06:41:32.029 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:41:32.428 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:32 smithi046 ceph-mon[110713]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:41:32.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:32 smithi106 ceph-mon[81208]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:41:33.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:33 smithi046 ceph-mon[110713]: pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:33.574 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:33 smithi106 ceph-mon[81208]: pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:33.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 -- 172.21.15.46:0/535129635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 msgr2=0x7f3f100fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 --2- 172.21.15.46:0/535129635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f100fb970 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c004940 tx=0x7f3f0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 -- 172.21.15.46:0/535129635 shutdown_connections 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 --2- 172.21.15.46:0/535129635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 0x7f3f10101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 --2- 172.21.15.46:0/535129635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f100fb970 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 -- 172.21.15.46:0/535129635 >> 172.21.15.46:0/535129635 conn(0x7f3f10073350 msgr2=0x7f3f10073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 -- 172.21.15.46:0/535129635 shutdown_connections 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 -- 172.21.15.46:0/535129635 wait complete. 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.721+0000 7f3f1811a700 1 Processor -- start 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f1811a700 1 -- start start 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f1811a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f10113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f1811a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 0x7f3f10113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f1811a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f10114510 con 0x7f3f100fb5a0 2024-05-09T06:41:33.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f1811a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1010db30 con 0x7f3f100fbf40 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f10113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f10113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45382/0 (socket says 172.21.15.46:45382) 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 -- 172.21.15.46:0/1105267331 learned_addr learned my addr 172.21.15.46:0/1105267331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f156b5700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 0x7f3f10113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 -- 172.21.15.46:0/1105267331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 msgr2=0x7f3f10113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 0x7f3f10113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 -- 172.21.15.46:0/1105267331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c005040 con 0x7f3f100fb5a0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f156b5700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 0x7f3f10113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.722+0000 7f3f15eb6700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f10113980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00b3b0 tx=0x7f3f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.723+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0c00e040 con 0x7f3f100fb5a0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.723+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f0c00bbc0 con 0x7f3f100fb5a0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.723+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1010ddb0 con 0x7f3f100fb5a0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.723+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0c01c3f0 con 0x7f3f100fb5a0 2024-05-09T06:41:33.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.723+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1010e2f0 con 0x7f3f100fb5a0 2024-05-09T06:41:33.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.724+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f100fe670 con 0x7f3f100fb5a0 2024-05-09T06:41:33.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.724+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f3f0c00bd30 con 0x7f3f100fb5a0 2024-05-09T06:41:33.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.725+0000 7f3f067fc700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3efc078990 0x7f3efc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:33.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.725+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3f0c09b9e0 con 0x7f3f100fb5a0 2024-05-09T06:41:33.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.725+0000 7f3f156b5700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3efc078990 0x7f3efc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:33.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.725+0000 7f3f156b5700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3efc078990 0x7f3efc07ae40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009fd0 tx=0x7f3f00009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:33.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.730+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f3f0c063580 con 0x7f3f100fb5a0 2024-05-09T06:41:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.969+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f1010f040 con 0x7f3efc078990 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.970+0000 7f3f067fc700 1 -- 172.21.15.46:0/1105267331 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3f1010f040 con 0x7f3efc078990 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": null, 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": false, 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "", 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": null, 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-05-09T06:41:33.951 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-05-09T06:41:33.952 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:41:33.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3efc078990 msgr2=0x7f3efc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:33.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3efc078990 0x7f3efc07ae40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009fd0 tx=0x7f3f00009ee0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 msgr2=0x7f3f10113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:33.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f10113980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00b3b0 tx=0x7f3f0c009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 shutdown_connections 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3efc078990 0x7f3efc07ae40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f100fb5a0 0x7f3f10113980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 --2- 172.21.15.46:0/1105267331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f100fbf40 0x7f3f10113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.973+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 >> 172.21.15.46:0/1105267331 conn(0x7f3f10073350 msgr2=0x7f3f10100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.974+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 shutdown_connections 2024-05-09T06:41:33.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:33.974+0000 7f3f1811a700 1 -- 172.21.15.46:0/1105267331 wait complete. 2024-05-09T06:41:34.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph health detail' 2024-05-09T06:41:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:41:35.452 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:35 smithi046 ceph-mon[110713]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:41:35.452 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:35 smithi046 ceph-mon[110713]: pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:35.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:35 smithi106 ceph-mon[81208]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:41:35.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:35 smithi106 ceph-mon[81208]: pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 -- 172.21.15.46:0/3126094264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 msgr2=0x7f13340fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 --2- 172.21.15.46:0/3126094264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f13340fc1b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1328004940 tx=0x7f1328009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 -- 172.21.15.46:0/3126094264 shutdown_connections 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 --2- 172.21.15.46:0/3126094264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f13340fc1b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 --2- 172.21.15.46:0/3126094264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1334101d90 0x7f1334102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 -- 172.21.15.46:0/3126094264 >> 172.21.15.46:0/3126094264 conn(0x7f1334071d00 msgr2=0x7f1334072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 -- 172.21.15.46:0/3126094264 shutdown_connections 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.696+0000 7f133a1ee700 1 -- 172.21.15.46:0/3126094264 wait complete. 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f133a1ee700 1 Processor -- start 2024-05-09T06:41:36.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f133a1ee700 1 -- start start 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f133a1ee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f1334102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f133a1ee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1334101d90 0x7f1334103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f133a1ee700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13341035f0 con 0x7f13340fbd40 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f133a1ee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334103730 con 0x7f1334101d90 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f13337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f1334102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f13337fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f1334102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45386/0 (socket says 172.21.15.46:45386) 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f13337fe700 1 -- 172.21.15.46:0/2780882436 learned_addr learned my addr 172.21.15.46:0/2780882436 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.697+0000 7f1332ffd700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1334101d90 0x7f1334103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f13337fe700 1 -- 172.21.15.46:0/2780882436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1334101d90 msgr2=0x7f1334103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f13337fe700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1334101d90 0x7f1334103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f13337fe700 1 -- 172.21.15.46:0/2780882436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328005040 con 0x7f13340fbd40 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f13337fe700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f1334102b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1324001d80 tx=0x7f1324009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1324007d10 con 0x7f13340fbd40 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1324001e80 con 0x7f13340fbd40 2024-05-09T06:41:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1334119e80 con 0x7f13340fbd40 2024-05-09T06:41:36.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1324014640 con 0x7f13340fbd40 2024-05-09T06:41:36.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.698+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133411a300 con 0x7f13340fbd40 2024-05-09T06:41:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.699+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13340fd430 con 0x7f13340fbd40 2024-05-09T06:41:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.700+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f132400e960 con 0x7f13340fbd40 2024-05-09T06:41:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.700+0000 7f131bfff700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f131c078980 0x7f131c07ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.700+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f132409a560 con 0x7f13340fbd40 2024-05-09T06:41:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.700+0000 7f1332ffd700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f131c078980 0x7f131c07ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:36.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.701+0000 7f1332ffd700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f131c078980 0x7f131c07ae30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1334104460 tx=0x7f1328009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:36.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:36.705+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f1324062130 con 0x7f13340fbd40 2024-05-09T06:41:36.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.014+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1334104210 con 0x7f13340fbd40 2024-05-09T06:41:36.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.014+0000 7f131bfff700 1 -- 172.21.15.46:0/2780882436 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f13240097e0 con 0x7f13340fbd40 2024-05-09T06:41:36.995 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-05-09T06:41:36.995 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-05-09T06:41:36.995 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-05-09T06:41:36.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f131c078980 msgr2=0x7f131c07ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:36.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f131c078980 0x7f131c07ae30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1334104460 tx=0x7f1328009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:36.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 msgr2=0x7f1334102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:36.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f1334102b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1324001d80 tx=0x7f1324009ec0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 shutdown_connections 2024-05-09T06:41:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f131c078980 0x7f131c07ae30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13340fbd40 0x7f1334102b20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 --2- 172.21.15.46:0/2780882436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1334101d90 0x7f1334103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 >> 172.21.15.46:0/2780882436 conn(0x7f1334071d00 msgr2=0x7f13340fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 shutdown_connections 2024-05-09T06:41:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:37.016+0000 7f133a1ee700 1 -- 172.21.15.46:0/2780882436 wait complete. 2024-05-09T06:41:37.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:37 smithi106 ceph-mon[81208]: pgmap v229: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:37.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:37 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2780882436' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:41:37.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:37 smithi046 ceph-mon[110713]: pgmap v229: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:37.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:37 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2780882436' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-09T06:41:37.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions' 2024-05-09T06:41:37.911 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:41:39.475 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:39 smithi046 ceph-mon[110713]: pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:39.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:39 smithi106 ceph-mon[81208]: pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 -- 172.21.15.46:0/10111673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 msgr2=0x7f643c101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 --2- 172.21.15.46:0/10111673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c101a30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f642c004940 tx=0x7f642c009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 -- 172.21.15.46:0/10111673 shutdown_connections 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 --2- 172.21.15.46:0/10111673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c101a30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 --2- 172.21.15.46:0/10111673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f643c0fb5a0 0x7f643c0fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 -- 172.21.15.46:0/10111673 >> 172.21.15.46:0/10111673 conn(0x7f643c073350 msgr2=0x7f643c073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 -- 172.21.15.46:0/10111673 shutdown_connections 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.597+0000 7f644359b700 1 -- 172.21.15.46:0/10111673 wait complete. 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f644359b700 1 Processor -- start 2024-05-09T06:41:39.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f644359b700 1 -- start start 2024-05-09T06:41:39.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f644359b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f643c0fb5a0 0x7f643c1139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f644359b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f644359b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c114530 con 0x7f643c0fbf40 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f644359b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c10db50 con 0x7f643c0fb5a0 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45404/0 (socket says 172.21.15.46:45404) 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 -- 172.21.15.46:0/3502725999 learned_addr learned my addr 172.21.15.46:0/3502725999 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6441337700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f643c0fb5a0 0x7f643c1139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 -- 172.21.15.46:0/3502725999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f643c0fb5a0 msgr2=0x7f643c1139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f643c0fb5a0 0x7f643c1139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 -- 172.21.15.46:0/3502725999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c005040 con 0x7f643c0fbf40 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.598+0000 7f6440b36700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c113ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f642c000c00 tx=0x7f642c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.599+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f642c00e040 con 0x7f643c0fbf40 2024-05-09T06:41:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.599+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f642c013420 con 0x7f643c0fbf40 2024-05-09T06:41:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.599+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c10ddd0 con 0x7f643c0fbf40 2024-05-09T06:41:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.599+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f642c01c630 con 0x7f643c0fbf40 2024-05-09T06:41:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.599+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c10e310 con 0x7f643c0fbf40 2024-05-09T06:41:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.600+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c0fe670 con 0x7f643c0fbf40 2024-05-09T06:41:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.601+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f642c013590 con 0x7f643c0fbf40 2024-05-09T06:41:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.601+0000 7f6431ffb700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6428078990 0x7f642807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:41:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.601+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f642c09b960 con 0x7f643c0fbf40 2024-05-09T06:41:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.601+0000 7f6441337700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6428078990 0x7f642807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:41:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.602+0000 7f6441337700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6428078990 0x7f642807ae40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6438004cc0 tx=0x7f643800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:41:39.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.606+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f642c0635a0 con 0x7f643c0fbf40 2024-05-09T06:41:39.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.912+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f643c109f00 con 0x7f643c0fbf40 2024-05-09T06:41:39.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.913+0000 7f6431ffb700 1 -- 172.21.15.46:0/3502725999 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f642c062f40 con 0x7f643c0fbf40 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:41:39.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:41:39.895 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:41:39.895 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 14 2024-05-09T06:41:39.895 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:41:39.895 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6428078990 msgr2=0x7f642807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6428078990 0x7f642807ae40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6438004cc0 tx=0x7f643800b040 comp rx=0 tx=0).stop 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 msgr2=0x7f643c113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c113ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f642c000c00 tx=0x7f642c009e30 comp rx=0 tx=0).stop 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 shutdown_connections 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f6428078990 0x7f642807ae40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f643c0fb5a0 0x7f643c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 --2- 172.21.15.46:0/3502725999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f643c0fbf40 0x7f643c113ee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 >> 172.21.15.46:0/3502725999 conn(0x7f643c073350 msgr2=0x7f643c100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 shutdown_connections 2024-05-09T06:41:39.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:41:39.915+0000 7f644359b700 1 -- 172.21.15.46:0/3502725999 wait complete. 2024-05-09T06:41:40.520 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:40 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3502725999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:40.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-05-09T06:41:40.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:40 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3502725999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:41:40.820 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:41:41.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:41 smithi046 ceph-mon[110713]: pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:41.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:41 smithi106 ceph-mon[81208]: pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:42.522 INFO:teuthology.orchestra.run.smithi046.stdout:wait for servicemap items w/ changing names to refresh 2024-05-09T06:41:42.522 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:43.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'sleep 60' 2024-05-09T06:41:43.463 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:41:43.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:43 smithi106 ceph-mon[81208]: pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:43.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:43 smithi046 ceph-mon[110713]: pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:45.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:45 smithi106 ceph-mon[81208]: pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:45.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:45 smithi046 ceph-mon[110713]: pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:47.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:47 smithi106 ceph-mon[81208]: pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:47.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:47 smithi046 ceph-mon[110713]: pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:49.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:49 smithi106 ceph-mon[81208]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:49.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:49 smithi046 ceph-mon[110713]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:51.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:51 smithi106 ceph-mon[81208]: pgmap v236: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:51.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:51 smithi046 ceph-mon[110713]: pgmap v236: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:53.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:53 smithi106 ceph-mon[81208]: pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:53.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:53 smithi046 ceph-mon[110713]: pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:55.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:55 smithi106 ceph-mon[81208]: pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:55.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:55 smithi046 ceph-mon[110713]: pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:57.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:57 smithi106 ceph-mon[81208]: pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:57.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:57.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:57 smithi046 ceph-mon[110713]: pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:57.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:41:59.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:41:59 smithi106 ceph-mon[81208]: pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:41:59.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:41:59 smithi046 ceph-mon[110713]: pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:01.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:01 smithi106 ceph-mon[81208]: pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:01.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:01 smithi046 ceph-mon[110713]: pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:03.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:03 smithi106 ceph-mon[81208]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:03.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:03 smithi046 ceph-mon[110713]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:05.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:05 smithi106 ceph-mon[81208]: pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:05.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:05 smithi046 ceph-mon[110713]: pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:07.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:07 smithi106 ceph-mon[81208]: pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:07.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:07 smithi046 ceph-mon[110713]: pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:09.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:09 smithi106 ceph-mon[81208]: pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:09.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:09 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:42:09.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:09 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:42:09.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:09 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:42:09.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:09 smithi046 ceph-mon[110713]: pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:09.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:09 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:42:09.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:09 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:42:09.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:09 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:42:10.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:42:10.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:42:10.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:42:10.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:42:10.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:42:10.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:42:11.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:11 smithi106 ceph-mon[81208]: pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:11.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:11 smithi046 ceph-mon[110713]: pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:12.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:13.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:13 smithi106 ceph-mon[81208]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:13.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:13 smithi046 ceph-mon[110713]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:15.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:15 smithi046 ceph-mon[110713]: pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:15.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:15 smithi106 ceph-mon[81208]: pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:17.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:17 smithi046 ceph-mon[110713]: pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:17.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:17 smithi106 ceph-mon[81208]: pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:19.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:19 smithi046 ceph-mon[110713]: pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:19.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:19 smithi106 ceph-mon[81208]: pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:21.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:21 smithi046 ceph-mon[110713]: pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:21.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:21 smithi106 ceph-mon[81208]: pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:23.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:23 smithi046 ceph-mon[110713]: pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:23.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:23 smithi106 ceph-mon[81208]: pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:25.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:25 smithi046 ceph-mon[110713]: pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:25.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:25 smithi106 ceph-mon[81208]: pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:27.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:27 smithi106 ceph-mon[81208]: pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:27.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:27.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:27 smithi046 ceph-mon[110713]: pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:27.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:29.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:29 smithi106 ceph-mon[81208]: pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:29.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:29 smithi046 ceph-mon[110713]: pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:31.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:31 smithi106 ceph-mon[81208]: pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:31.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:31 smithi046 ceph-mon[110713]: pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:33.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:33 smithi106 ceph-mon[81208]: pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:33.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:33 smithi046 ceph-mon[110713]: pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:35.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:35 smithi046 ceph-mon[110713]: pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:35.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:35 smithi106 ceph-mon[81208]: pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:37.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:37 smithi106 ceph-mon[81208]: pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:37.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:37 smithi046 ceph-mon[110713]: pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:39.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:39 smithi106 ceph-mon[81208]: pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:39.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:39 smithi046 ceph-mon[110713]: pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:41.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:41 smithi106 ceph-mon[81208]: pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:41.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:41 smithi046 ceph-mon[110713]: pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:43.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:43.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:44.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:43 smithi106 ceph-mon[81208]: pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:44.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:43 smithi046 ceph-mon[110713]: pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:45.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph orch ps' 2024-05-09T06:42:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:42:46.029 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:45 smithi046 ceph-mon[110713]: pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:46.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:45 smithi106 ceph-mon[81208]: pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.573+0000 7fc48442a700 1 -- 172.21.15.46:0/498850091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c101d90 msgr2=0x7fc47c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.573+0000 7fc48442a700 1 --2- 172.21.15.46:0/498850091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c101d90 0x7fc47c102160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc478004940 tx=0x7fc478009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.573+0000 7fc48442a700 1 -- 172.21.15.46:0/498850091 shutdown_connections 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.573+0000 7fc48442a700 1 --2- 172.21.15.46:0/498850091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc47c0fbd40 0x7fc47c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.573+0000 7fc48442a700 1 --2- 172.21.15.46:0/498850091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c101d90 0x7fc47c102160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.573+0000 7fc48442a700 1 -- 172.21.15.46:0/498850091 >> 172.21.15.46:0/498850091 conn(0x7fc47c071d00 msgr2=0x7fc47c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 -- 172.21.15.46:0/498850091 shutdown_connections 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 -- 172.21.15.46:0/498850091 wait complete. 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 Processor -- start 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 -- start start 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 0x7fc47c102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc47c101d90 0x7fc47c103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1035f0 con 0x7fc47c0fbd40 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.574+0000 7fc48442a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c103730 con 0x7fc47c101d90 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 0x7fc47c102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 0x7fc47c102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48582/0 (socket says 172.21.15.46:48582) 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 -- 172.21.15.46:0/3109211420 learned_addr learned my addr 172.21.15.46:0/3109211420 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4819c5700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc47c101d90 0x7fc47c103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 -- 172.21.15.46:0/3109211420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc47c101d90 msgr2=0x7fc47c103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc47c101d90 0x7fc47c103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 -- 172.21.15.46:0/3109211420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478005040 con 0x7fc47c0fbd40 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc4821c6700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 0x7fc47c102b20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc47800b3b0 tx=0x7fc478009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc47800e040 con 0x7fc47c0fbd40 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c103980 con 0x7fc47c0fbd40 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc478013420 con 0x7fc47c0fbd40 2024-05-09T06:42:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc47801c630 con 0x7fc47c0fbd40 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.575+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c11a2d0 con 0x7fc47c0fbd40 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.576+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c0fd430 con 0x7fc47c0fbd40 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.577+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc478013590 con 0x7fc47c0fbd40 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.577+0000 7fc46effd700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc468078990 0x7fc46807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.578+0000 7fc4819c5700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc468078990 0x7fc46807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.578+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc47809b9d0 con 0x7fc47c0fbd40 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.578+0000 7fc4819c5700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc468078990 0x7fc46807ae40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc47c104460 tx=0x7fc47000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.582+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc478063610 con 0x7fc47c0fbd40 2024-05-09T06:42:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.806+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 --> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc47c104210 con 0x7fc468078990 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.816+0000 7fc46effd700 1 -- 172.21.15.46:0/3109211420 <== mgr.34104 v2:172.21.15.46:6800/120732432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc47c104210 con 0x7fc468078990 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (9m) 2m ago 20m 23.9M - 0.25.0 c8568f914cd2 4261a02cf396 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (6m) 2m ago 20m 6665k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 fb12c8c3ee55 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi106 smithi106 running (6m) 105s ago 19m 6669k - 19.0.0-3575-g720f8e95 8ec306cbfbd6 420f0ccb639e 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (9m) 2m ago 20m 78.7M - 9.4.12 2bacad6d85d8 c927e4e5386c 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.easboa smithi046 running (3m) 2m ago 15m 12.1M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 505f13a2ec8b 2024-05-09T06:42:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.pkuwsr smithi046 running (2m) 2m ago 15m 13.5M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 e4b34f0292a9 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.fqgqkm smithi106 running (2m) 105s ago 15m 15.0M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6d610c71e632 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi106.ugnujp smithi106 running (107s) 105s ago 15m 12.0M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 10ba9bc4f6c5 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.nvpcui smithi046 *:8443,9283,8765 running (11m) 2m ago 22m 523M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 364ee595b18c 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi106.nlgnpx smithi106 *:8443,9283,8765 running (10m) 105s ago 19m 467M - 19.0.0-3575-g720f8e95 8ec306cbfbd6 6663a118b70e 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (7m) 2m ago 22m 56.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 f5a8b8e67820 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi106 smithi106 running (7m) 105s ago 19m 42.4M 2048M 19.0.0-3575-g720f8e95 8ec306cbfbd6 4aba5ac7db17 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (10m) 2m ago 20m 16.6M - 1.5.0 0da6a335fe13 5539ee3090e8 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi106 smithi106 *:9100 running (10m) 105s ago 19m 15.7M - 1.5.0 0da6a335fe13 7a6dbaa67dc9 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 2m ago 18m 105M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1aaa97258f18 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 2m ago 18m 117M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 1830d3551415 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 2m ago 17m 101M 1559M 19.0.0-3575-g720f8e95 8ec306cbfbd6 017ad4ce8786 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi106 running (4m) 105s ago 17m 126M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 47b9d1f58fbd 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi106 running (3m) 105s ago 17m 113M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 19b53c23db28 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi106 running (3m) 105s ago 16m 101M 2581M 19.0.0-3575-g720f8e95 8ec306cbfbd6 45571448b3f7 2024-05-09T06:42:47.797 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (9m) 2m ago 20m 66.7M - 2.43.0 a07b618ecd1d 786d72c8df38 2024-05-09T06:42:47.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc468078990 msgr2=0x7fc46807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc468078990 0x7fc46807ae40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc47c104460 tx=0x7fc47000b040 comp rx=0 tx=0).stop 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 msgr2=0x7fc47c102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 0x7fc47c102b20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc47800b3b0 tx=0x7fc478009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 shutdown_connections 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc468078990 0x7fc46807ae40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc47c0fbd40 0x7fc47c102b20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 --2- 172.21.15.46:0/3109211420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc47c101d90 0x7fc47c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 >> 172.21.15.46:0/3109211420 conn(0x7fc47c071d00 msgr2=0x7fc47c0fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 shutdown_connections 2024-05-09T06:42:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:47.819+0000 7fc48442a700 1 -- 172.21.15.46:0/3109211420 wait complete. 2024-05-09T06:42:47.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:47 smithi046 ceph-mon[110713]: pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:48.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:47 smithi106 ceph-mon[81208]: pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:48.519 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions' 2024-05-09T06:42:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:42:49.772 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:49 smithi046 ceph-mon[110713]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:42:49.773 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:49 smithi046 ceph-mon[110713]: pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:50.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:49 smithi106 ceph-mon[81208]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T06:42:50.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:49 smithi106 ceph-mon[81208]: pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:50.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.316+0000 7f3290225700 1 -- 172.21.15.46:0/4035745578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 msgr2=0x7f32880fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.316+0000 7f3290225700 1 --2- 172.21.15.46:0/4035745578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32880fbd10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3278004940 tx=0x7f3278009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- 172.21.15.46:0/4035745578 shutdown_connections 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 --2- 172.21.15.46:0/4035745578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32880fbd10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 --2- 172.21.15.46:0/4035745578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3288101d00 0x7f32881020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- 172.21.15.46:0/4035745578 >> 172.21.15.46:0/4035745578 conn(0x7f32880f7870 msgr2=0x7f32880f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- 172.21.15.46:0/4035745578 shutdown_connections 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- 172.21.15.46:0/4035745578 wait complete. 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 Processor -- start 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- start start 2024-05-09T06:42:50.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3288101d00 0x7f3288106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32881070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288108af0 con 0x7f32881026a0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f3290225700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288107620 con 0x7f3288101d00 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.317+0000 7f328d7c0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32881070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328d7c0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32881070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48602/0 (socket says 172.21.15.46:48602) 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328d7c0700 1 -- 172.21.15.46:0/966823043 learned_addr learned my addr 172.21.15.46:0/966823043 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328dfc1700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3288101d00 0x7f3288106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328d7c0700 1 -- 172.21.15.46:0/966823043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3288101d00 msgr2=0x7f3288106ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328d7c0700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3288101d00 0x7f3288106ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328d7c0700 1 -- 172.21.15.46:0/966823043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278005040 con 0x7f32881026a0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f328d7c0700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32881070e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3278009100 tx=0x7f3278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327800e040 con 0x7f32881026a0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32881078a0 con 0x7f32881026a0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3278004290 con 0x7f32881026a0 2024-05-09T06:42:50.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328811a0f0 con 0x7f32881026a0 2024-05-09T06:42:50.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.318+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327801c3f0 con 0x7f32881026a0 2024-05-09T06:42:50.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.319+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32880fd450 con 0x7f32881026a0 2024-05-09T06:42:50.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.320+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f3278013790 con 0x7f32881026a0 2024-05-09T06:42:50.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.320+0000 7f327e7fc700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3274078980 0x7f327407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:50.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.321+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f327809bb30 con 0x7f32881026a0 2024-05-09T06:42:50.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.321+0000 7f328dfc1700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3274078980 0x7f327407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:50.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.321+0000 7f328dfc1700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3274078980 0x7f327407ae30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3284007fd0 tx=0x7f3284009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:50.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.325+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f32780636d0 con 0x7f32881026a0 2024-05-09T06:42:50.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.634+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3288109ed0 con 0x7f32881026a0 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.634+0000 7f327e7fc700 1 -- 172.21.15.46:0/966823043 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3278013420 con 0x7f32881026a0 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 2 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:42:50.614 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 6 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 4 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)": 14 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-05-09T06:42:50.615 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-09T06:42:50.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3274078980 msgr2=0x7f327407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:50.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3274078980 0x7f327407ae30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3284007fd0 tx=0x7f3284009040 comp rx=0 tx=0).stop 2024-05-09T06:42:50.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 msgr2=0x7f32881070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:50.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32881070e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3278009100 tx=0x7f3278009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 shutdown_connections 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3274078980 0x7f327407ae30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3288101d00 0x7f3288106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 --2- 172.21.15.46:0/966823043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32881026a0 0x7f32881070e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 >> 172.21.15.46:0/966823043 conn(0x7f32880f7870 msgr2=0x7f32880f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 shutdown_connections 2024-05-09T06:42:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:50.637+0000 7f3290225700 1 -- 172.21.15.46:0/966823043 wait complete. 2024-05-09T06:42:50.971 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:50 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/966823043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:51.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:50 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/966823043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:51.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-05-09T06:42:51.586 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:42:51.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:51 smithi046 ceph-mon[110713]: pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:52.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:51 smithi106 ceph-mon[81208]: pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 -- 172.21.15.46:0/2240852798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954101cf0 msgr2=0x7f29541020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 --2- 172.21.15.46:0/2240852798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954101cf0 0x7f29541020c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2950004940 tx=0x7f2950009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 -- 172.21.15.46:0/2240852798 shutdown_connections 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 --2- 172.21.15.46:0/2240852798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954102690 0x7f29540fbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 --2- 172.21.15.46:0/2240852798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954101cf0 0x7f29541020c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 -- 172.21.15.46:0/2240852798 >> 172.21.15.46:0/2240852798 conn(0x7f29540f7860 msgr2=0x7f29540f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 -- 172.21.15.46:0/2240852798 shutdown_connections 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 -- 172.21.15.46:0/2240852798 wait complete. 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 Processor -- start 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.259+0000 7f295c1b8700 1 -- start start 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f295c1b8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954101cf0 0x7f2954113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f295c1b8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 0x7f2954113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f295c1b8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29541144f0 con 0x7f2954102690 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f295c1b8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295410daf0 con 0x7f2954101cf0 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 0x7f2954113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 0x7f2954113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57264/0 (socket says 172.21.15.46:57264) 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 -- 172.21.15.46:0/3964162910 learned_addr learned my addr 172.21.15.46:0/3964162910 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959f54700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954101cf0 0x7f2954113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 -- 172.21.15.46:0/3964162910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954101cf0 msgr2=0x7f2954113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954101cf0 0x7f2954113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 -- 172.21.15.46:0/3964162910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950005040 con 0x7f2954102690 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959f54700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954101cf0 0x7f2954113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.260+0000 7f2959753700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 0x7f2954113ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2944002a50 tx=0x7f2944004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.261+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2944007cc0 con 0x7f2954102690 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.261+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295410ddd0 con 0x7f2954102690 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.261+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f294400f040 con 0x7f2954102690 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.261+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f294400daf0 con 0x7f2954102690 2024-05-09T06:42:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.261+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295410e390 con 0x7f2954102690 2024-05-09T06:42:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.262+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29540fd440 con 0x7f2954102690 2024-05-09T06:42:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.263+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2944009810 con 0x7f2954102690 2024-05-09T06:42:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.263+0000 7f294a7fc700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2940078980 0x7f294007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.263+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f294409a450 con 0x7f2954102690 2024-05-09T06:42:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.263+0000 7f2959f54700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2940078980 0x7f294007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.264+0000 7f2959f54700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2940078980 0x7f294007ae30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2950000c00 tx=0x7f2950009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:53.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.268+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f2944062090 con 0x7f2954102690 2024-05-09T06:42:53.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.576+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2954108df0 con 0x7f2954102690 2024-05-09T06:42:53.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.576+0000 7f294a7fc700 1 -- 172.21.15.46:0/3964162910 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f2944061a30 con 0x7f2954102690 2024-05-09T06:42:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2940078980 msgr2=0x7f294007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2940078980 0x7f294007ae30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2950000c00 tx=0x7f2950009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 msgr2=0x7f2954113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 0x7f2954113ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2944002a50 tx=0x7f2944004600 comp rx=0 tx=0).stop 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 shutdown_connections 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f2940078980 0x7f294007ae30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954101cf0 0x7f2954113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 --2- 172.21.15.46:0/3964162910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2954102690 0x7f2954113ea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 >> 172.21.15.46:0/3964162910 conn(0x7f29540f7860 msgr2=0x7f2954066300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 shutdown_connections 2024-05-09T06:42:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:53.579+0000 7f295c1b8700 1 -- 172.21.15.46:0/3964162910 wait complete. 2024-05-09T06:42:53.568 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-05-09T06:42:53.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:53 smithi046 ceph-mon[110713]: pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:53.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:53 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3964162910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:54.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:53 smithi106 ceph-mon[81208]: pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:54.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:53 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3964162910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:54.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -e sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-05-09T06:42:54.453 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:42:55.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:55 smithi046 ceph-mon[110713]: pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:56.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:55 smithi106 ceph-mon[81208]: pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 -- 172.21.15.46:0/2717450805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108065640 msgr2=0x7fd108065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 --2- 172.21.15.46:0/2717450805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108065640 0x7fd108065ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004940 tx=0x7fd0fc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:56.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 -- 172.21.15.46:0/2717450805 shutdown_connections 2024-05-09T06:42:56.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 --2- 172.21.15.46:0/2717450805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108065640 0x7fd108065ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:56.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 --2- 172.21.15.46:0/2717450805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108102e50 0x7fd108103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:56.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 -- 172.21.15.46:0/2717450805 >> 172.21.15.46:0/2717450805 conn(0x7fd108071d00 msgr2=0x7fd108072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:56.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 -- 172.21.15.46:0/2717450805 shutdown_connections 2024-05-09T06:42:56.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.112+0000 7fd10c920700 1 -- 172.21.15.46:0/2717450805 wait complete. 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10c920700 1 Processor -- start 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10c920700 1 -- start start 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10c920700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108065640 0x7fd1080fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10c920700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 0x7fd1080fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10c920700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080fc880 con 0x7fd108102e50 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10c920700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080fc9c0 con 0x7fd108065640 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd105d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 0x7fd1080fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd105d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 0x7fd1080fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57272/0 (socket says 172.21.15.46:57272) 2024-05-09T06:42:56.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd105d9b700 1 -- 172.21.15.46:0/1036596593 learned_addr learned my addr 172.21.15.46:0/1036596593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10659c700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108065640 0x7fd1080fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd105d9b700 1 -- 172.21.15.46:0/1036596593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108065640 msgr2=0x7fd1080fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd105d9b700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108065640 0x7fd1080fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd105d9b700 1 -- 172.21.15.46:0/1036596593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc005040 con 0x7fd108102e50 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.113+0000 7fd10659c700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108065640 0x7fd1080fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.114+0000 7fd105d9b700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 0x7fd1080fc2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00b8b0 tx=0x7fd0fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.114+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc00e040 con 0x7fd108102e50 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.114+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1080fcc10 con 0x7fd108102e50 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.114+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0fc004290 con 0x7fd108102e50 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.114+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc01c3f0 con 0x7fd108102e50 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.114+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10811a280 con 0x7fd108102e50 2024-05-09T06:42:56.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.115+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd108100100 con 0x7fd108102e50 2024-05-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.116+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fd0fc0137b0 con 0x7fd108102e50 2024-05-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.116+0000 7fd0f6ffd700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd0f0078990 0x7fd0f007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.116+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd0fc09ba90 con 0x7fd108102e50 2024-05-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.116+0000 7fd10659c700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd0f0078990 0x7fd0f007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:56.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.117+0000 7fd10659c700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd0f0078990 0x7fd0f007ae40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009fd0 tx=0x7fd0f8009f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:56.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.121+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fd0fc0636d0 con 0x7fd108102e50 2024-05-09T06:42:56.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.430+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd1080fd4d0 con 0x7fd108102e50 2024-05-09T06:42:56.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.431+0000 7fd0f6ffd700 1 -- 172.21.15.46:0/1036596593 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fd0fc063070 con 0x7fd108102e50 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd0f0078990 msgr2=0x7fd0f007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd0f0078990 0x7fd0f007ae40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009fd0 tx=0x7fd0f8009f40 comp rx=0 tx=0).stop 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 msgr2=0x7fd1080fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 0x7fd1080fc2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00b8b0 tx=0x7fd0fc009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 shutdown_connections 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd0f0078990 0x7fd0f007ae40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd108065640 0x7fd1080fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 --2- 172.21.15.46:0/1036596593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd108102e50 0x7fd1080fc2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 >> 172.21.15.46:0/1036596593 conn(0x7fd108071d00 msgr2=0x7fd1080fafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 shutdown_connections 2024-05-09T06:42:56.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:56.433+0000 7fd10c920700 1 -- 172.21.15.46:0/1036596593 wait complete. 2024-05-09T06:42:56.423 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)" 2024-05-09T06:42:56.735 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:56 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1036596593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:57.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:56 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1036596593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-09T06:42:57.073 DEBUG:teuthology.parallel:result is None 2024-05-09T06:42:57.073 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T06:42:57.084 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:42:57.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T06:42:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:42:58.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:57 smithi106 ceph-mon[81208]: pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:58.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:58.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:57 smithi046 ceph-mon[110713]: pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:42:58.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:42:59.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 -- 172.21.15.46:0/4139816709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca58101d00 msgr2=0x7fca581020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:59.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 --2- 172.21.15.46:0/4139816709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca58101d00 0x7fca581020d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca54004940 tx=0x7fca54009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:59.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 -- 172.21.15.46:0/4139816709 shutdown_connections 2024-05-09T06:42:59.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 --2- 172.21.15.46:0/4139816709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca581026a0 0x7fca580fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:59.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 --2- 172.21.15.46:0/4139816709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca58101d00 0x7fca581020d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:59.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 -- 172.21.15.46:0/4139816709 >> 172.21.15.46:0/4139816709 conn(0x7fca580f7870 msgr2=0x7fca580f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 -- 172.21.15.46:0/4139816709 shutdown_connections 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.096+0000 7fca5f355700 1 -- 172.21.15.46:0/4139816709 wait complete. 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5f355700 1 Processor -- start 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5f355700 1 -- start start 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5f355700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca58101d00 0x7fca5810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5f355700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 0x7fca5810f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5f355700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5810f5b0 con 0x7fca581026a0 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5f355700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5810f6f0 con 0x7fca58101d00 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5c8f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 0x7fca5810f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:59.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5c8f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 0x7fca5810f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57296/0 (socket says 172.21.15.46:57296) 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5c8f0700 1 -- 172.21.15.46:0/4124604350 learned_addr learned my addr 172.21.15.46:0/4124604350 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5d0f1700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca58101d00 0x7fca5810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5c8f0700 1 -- 172.21.15.46:0/4124604350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca58101d00 msgr2=0x7fca5810eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5c8f0700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca58101d00 0x7fca5810eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.097+0000 7fca5c8f0700 1 -- 172.21.15.46:0/4124604350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54005040 con 0x7fca581026a0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.098+0000 7fca5c8f0700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 0x7fca5810f070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca48002a50 tx=0x7fca48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.098+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca48007cc0 con 0x7fca581026a0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.098+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58117ba0 con 0x7fca581026a0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.098+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca4800f040 con 0x7fca581026a0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.098+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4800d9c0 con 0x7fca581026a0 2024-05-09T06:42:59.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.098+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58117f70 con 0x7fca581026a0 2024-05-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.099+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca580fd450 con 0x7fca581026a0 2024-05-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.100+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fca48009730 con 0x7fca581026a0 2024-05-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.100+0000 7fca4dffb700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fca44078980 0x7fca4407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:42:59.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.100+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fca4809a430 con 0x7fca581026a0 2024-05-09T06:42:59.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.100+0000 7fca5d0f1700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fca44078980 0x7fca4407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:42:59.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.101+0000 7fca5d0f1700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fca44078980 0x7fca4407ae30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca5400b3b0 tx=0x7fca54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:42:59.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.105+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fca48061ff0 con 0x7fca581026a0 2024-05-09T06:42:59.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.365+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fca58118160 con 0x7fca581026a0 2024-05-09T06:42:59.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.365+0000 7fca4dffb700 1 -- 172.21.15.46:0/4124604350 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1937 (secure 0 0 0) 0x7fca48061990 con 0x7fca581026a0 2024-05-09T06:42:59.345 INFO:teuthology.orchestra.run.smithi046.stdout:e36 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 36 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-09T06:27:29.142337+0000 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-05-09T06:41:07.346314+0000 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-05-09T06:42:59.346 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 83 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=34372} 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-05-09T06:42:59.347 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 34372 members: 34372 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.easboa{0:34372} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.46:6826/2862387261,v1:172.21.15.46:6827/2862387261] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.pkuwsr{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/1650120770,v1:172.21.15.46:6829/1650120770] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.fqgqkm{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.106:6824/958476339,v1:172.21.15.106:6825/958476339] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:59.348 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi106.ugnujp{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.106:6826/2800643990,v1:172.21.15.106:6827/2800643990] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T06:42:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fca44078980 msgr2=0x7fca4407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fca44078980 0x7fca4407ae30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca5400b3b0 tx=0x7fca54009e30 comp rx=0 tx=0).stop 2024-05-09T06:42:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 msgr2=0x7fca5810f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:42:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 0x7fca5810f070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca48002a50 tx=0x7fca48004600 comp rx=0 tx=0).stop 2024-05-09T06:42:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 shutdown_connections 2024-05-09T06:42:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fca44078980 0x7fca4407ae30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca58101d00 0x7fca5810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 --2- 172.21.15.46:0/4124604350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca581026a0 0x7fca5810f070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:42:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 >> 172.21.15.46:0/4124604350 conn(0x7fca580f7870 msgr2=0x7fca580f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:42:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 shutdown_connections 2024-05-09T06:42:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:42:59.368+0000 7fca5f355700 1 -- 172.21.15.46:0/4124604350 wait complete. 2024-05-09T06:42:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T06:43:00.017 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:59 smithi046 ceph-mon[110713]: pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:00.018 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:42:59 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/4124604350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:43:00.049 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-05-09T06:43:00.059 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T06:43:00.071 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:59 smithi106 ceph-mon[81208]: pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:00.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:42:59 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/4124604350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T06:43:00.338 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:01.781 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:01 smithi046 ceph-mon[110713]: pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 -- 172.21.15.46:0/2312055972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644102de0 msgr2=0x7f26441031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 --2- 172.21.15.46:0/2312055972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644102de0 0x7f26441031b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2634004940 tx=0x7f2634009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 -- 172.21.15.46:0/2312055972 shutdown_connections 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 --2- 172.21.15.46:0/2312055972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2644103780 0x7f26440fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 --2- 172.21.15.46:0/2312055972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644102de0 0x7f26441031b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 -- 172.21.15.46:0/2312055972 >> 172.21.15.46:0/2312055972 conn(0x7f26440f8990 msgr2=0x7f26440fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 -- 172.21.15.46:0/2312055972 shutdown_connections 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.010+0000 7f2649add700 1 -- 172.21.15.46:0/2312055972 wait complete. 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2649add700 1 Processor -- start 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2649add700 1 -- start start 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2649add700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2644102de0 0x7f2644113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2649add700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 0x7f2644113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2649add700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644114500 con 0x7f2644103780 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2649add700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264410db50 con 0x7f2644102de0 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2642ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 0x7f2644113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2642ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 0x7f2644113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33544/0 (socket says 172.21.15.46:33544) 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.011+0000 7f2642ffd700 1 -- 172.21.15.46:0/262806460 learned_addr learned my addr 172.21.15.46:0/262806460 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f26437fe700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2644102de0 0x7f2644113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f2642ffd700 1 -- 172.21.15.46:0/262806460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2644102de0 msgr2=0x7f2644113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f2642ffd700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2644102de0 0x7f2644113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f2642ffd700 1 -- 172.21.15.46:0/262806460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634005040 con 0x7f2644103780 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f2642ffd700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 0x7f2644113eb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2638002a50 tx=0x7f2638004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2638007cc0 con 0x7f2644103780 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264410de30 con 0x7f2644103780 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f263800f040 con 0x7f2644103780 2024-05-09T06:43:01.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263800d9c0 con 0x7f2644103780 2024-05-09T06:43:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.012+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264410e3f0 con 0x7f2644103780 2024-05-09T06:43:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.013+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26441000f0 con 0x7f2644103780 2024-05-09T06:43:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.014+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f2638009730 con 0x7f2644103780 2024-05-09T06:43:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.014+0000 7f262bfff700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f262c078990 0x7f262c07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.015+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f263809a500 con 0x7f2644103780 2024-05-09T06:43:01.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.015+0000 7f26437fe700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f262c078990 0x7f262c07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.015+0000 7f26437fe700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f262c078990 0x7f262c07ae40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2634004f90 tx=0x7f2634009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.019+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f26380620c0 con 0x7f2644103780 2024-05-09T06:43:02.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:01 smithi106 ceph-mon[81208]: pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:02.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.279+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264410efc0 con 0x7f2644103780 2024-05-09T06:43:02.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.280+0000 7f262bfff700 1 -- 172.21.15.46:0/262806460 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5210 (secure 0 0 0) 0x7f2638061a60 con 0x7f2644103780 2024-05-09T06:43:02.260 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:02.260 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6827/2800643990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2800643990},{"type":"v1","addr":"172.21.15.106:6827","nonce":2800643990}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:41:07.346314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi046.easboa","rank":0,"incarnation":31,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34372,"qdb_cluster":[34372]},"id":1}]} 2024-05-09T06:43:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f262c078990 msgr2=0x7f262c07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f262c078990 0x7f262c07ae40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2634004f90 tx=0x7f2634009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 msgr2=0x7f2644113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 0x7f2644113eb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2638002a50 tx=0x7f2638004600 comp rx=0 tx=0).stop 2024-05-09T06:43:02.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 shutdown_connections 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f262c078990 0x7f262c07ae40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2644102de0 0x7f2644113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 --2- 172.21.15.46:0/262806460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2644103780 0x7f2644113eb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 >> 172.21.15.46:0/262806460 conn(0x7f26440f8990 msgr2=0x7f2644107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 shutdown_connections 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:02.282+0000 7f2649add700 1 -- 172.21.15.46:0/262806460 wait complete. 2024-05-09T06:43:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-05-09T06:43:02.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:02 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/262806460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:43:02.937 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 18} 2024-05-09T06:43:02.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 17 2024-05-09T06:43:03.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:02 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/262806460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:43:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:04.014 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:03 smithi046 ceph-mon[110713]: pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:04.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:03 smithi106 ceph-mon[81208]: pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 -- 172.21.15.46:0/3423590963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5801026a0 msgr2=0x7fa5800fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 --2- 172.21.15.46:0/3423590963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5801026a0 0x7fa5800fbd10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa56c004940 tx=0x7fa56c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 -- 172.21.15.46:0/3423590963 shutdown_connections 2024-05-09T06:43:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 --2- 172.21.15.46:0/3423590963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5801026a0 0x7fa5800fbd10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 --2- 172.21.15.46:0/3423590963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa580101d00 0x7fa5801020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:05.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 -- 172.21.15.46:0/3423590963 >> 172.21.15.46:0/3423590963 conn(0x7fa5800f7870 msgr2=0x7fa5800f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.045+0000 7fa586d29700 1 -- 172.21.15.46:0/3423590963 shutdown_connections 2024-05-09T06:43:05.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.046+0000 7fa586d29700 1 -- 172.21.15.46:0/3423590963 wait complete. 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.046+0000 7fa586d29700 1 Processor -- start 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.046+0000 7fa586d29700 1 -- start start 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.046+0000 7fa586d29700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 0x7fa580113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa586d29700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5801026a0 0x7fa580113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa586d29700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580114500 con 0x7fa580101d00 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa586d29700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58010db20 con 0x7fa5801026a0 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 0x7fa580113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 0x7fa580113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33562/0 (socket says 172.21.15.46:33562) 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 -- 172.21.15.46:0/847833235 learned_addr learned my addr 172.21.15.46:0/847833235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa57ffff700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5801026a0 0x7fa580113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 -- 172.21.15.46:0/847833235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5801026a0 msgr2=0x7fa580113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5801026a0 0x7fa580113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:05.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 -- 172.21.15.46:0/847833235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c005040 con 0x7fa580101d00 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa57ffff700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5801026a0 0x7fa580113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa584ac5700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 0x7fa580113970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c830 tx=0x7fa574004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57400a760 con 0x7fa580101d00 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa57400ad90 con 0x7fa580101d00 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58010de00 con 0x7fa580101d00 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.047+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5740113a0 con 0x7fa580101d00 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.048+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58010e3c0 con 0x7fa580101d00 2024-05-09T06:43:05.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.049+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5800fd450 con 0x7fa580101d00 2024-05-09T06:43:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.049+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa574012400 con 0x7fa580101d00 2024-05-09T06:43:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.050+0000 7fa57d7fa700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa570078990 0x7fa57007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.050+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa57409a7d0 con 0x7fa580101d00 2024-05-09T06:43:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.050+0000 7fa57ffff700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa570078990 0x7fa57007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:05.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.050+0000 7fa57ffff700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa570078990 0x7fa57007ae40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b3b0 tx=0x7fa56c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:05.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.054+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa574062410 con 0x7fa580101d00 2024-05-09T06:43:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.320+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fa58004c710 con 0x7fa580101d00 2024-05-09T06:43:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.321+0000 7fa57d7fa700 1 -- 172.21.15.46:0/847833235 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+4084 (secure 0 0 0) 0x7fa574061db0 con 0x7fa580101d00 2024-05-09T06:43:05.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:05.302 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:27:48.012161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi046.pkuwsr","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6829/3210268761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3210268761},{"type":"v1","addr":"172.21.15.46:6829","nonce":3210268761}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.323+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa570078990 msgr2=0x7fa57007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.323+0000 7fa586d29700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa570078990 0x7fa57007ae40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b3b0 tx=0x7fa56c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.323+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 msgr2=0x7fa580113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:05.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.323+0000 7fa586d29700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 0x7fa580113970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c830 tx=0x7fa574004470 comp rx=0 tx=0).stop 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 shutdown_connections 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa570078990 0x7fa57007ae40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa580101d00 0x7fa580113970 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 --2- 172.21.15.46:0/847833235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5801026a0 0x7fa580113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 >> 172.21.15.46:0/847833235 conn(0x7fa5800f7870 msgr2=0x7fa5800f8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 shutdown_connections 2024-05-09T06:43:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:05.324+0000 7fa586d29700 1 -- 172.21.15.46:0/847833235 wait complete. 2024-05-09T06:43:05.306 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-05-09T06:43:05.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:05 smithi046 ceph-mon[110713]: pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:05.835 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:05 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/847833235' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-05-09T06:43:05.960 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 18 2024-05-09T06:43:06.071 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:05 smithi106 ceph-mon[81208]: pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:06.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:05 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/847833235' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-05-09T06:43:06.234 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 -- 172.21.15.46:0/3076831250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 msgr2=0x7fc2d81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 --2- 172.21.15.46:0/3076831250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d81031c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4004940 tx=0x7fc2d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 -- 172.21.15.46:0/3076831250 shutdown_connections 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 --2- 172.21.15.46:0/3076831250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d8103790 0x7fc2d80fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 --2- 172.21.15.46:0/3076831250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d81031c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 -- 172.21.15.46:0/3076831250 >> 172.21.15.46:0/3076831250 conn(0x7fc2d80f8980 msgr2=0x7fc2d80fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 -- 172.21.15.46:0/3076831250 shutdown_connections 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 -- 172.21.15.46:0/3076831250 wait complete. 2024-05-09T06:43:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 Processor -- start 2024-05-09T06:43:07.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.893+0000 7fc2e0245700 1 -- start start 2024-05-09T06:43:07.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2e0245700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d8113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:07.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2e0245700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d8103790 0x7fc2d81140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:07.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2e0245700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8114730 con 0x7fc2d8102df0 2024-05-09T06:43:07.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2e0245700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d810db40 con 0x7fc2d8103790 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d8113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d8113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33582/0 (socket says 172.21.15.46:33582) 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 -- 172.21.15.46:0/1994438851 learned_addr learned my addr 172.21.15.46:0/1994438851 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2dd7e0700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d8103790 0x7fc2d81140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 -- 172.21.15.46:0/1994438851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d8103790 msgr2=0x7fc2d81140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d8103790 0x7fc2d81140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 -- 172.21.15.46:0/1994438851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4005040 con 0x7fc2d8102df0 2024-05-09T06:43:07.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.894+0000 7fc2ddfe1700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d8113ba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b3b0 tx=0x7fc2d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.895+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d400e040 con 0x7fc2d8102df0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.895+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d810ddc0 con 0x7fc2d8102df0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.895+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2d4013420 con 0x7fc2d8102df0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.895+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d401c630 con 0x7fc2d8102df0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.895+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d810e380 con 0x7fc2d8102df0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.896+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8100100 con 0x7fc2d8102df0 2024-05-09T06:43:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.897+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fc2d4013590 con 0x7fc2d8102df0 2024-05-09T06:43:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.897+0000 7fc2ce7fc700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc2c4078990 0x7fc2c407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.897+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc2d409b980 con 0x7fc2d8102df0 2024-05-09T06:43:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.897+0000 7fc2dd7e0700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc2c4078990 0x7fc2c407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.898+0000 7fc2dd7e0700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc2c4078990 0x7fc2c407ae40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc2d810f440 tx=0x7fc2c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:07.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:07.902+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fc2d40635c0 con 0x7fc2d8102df0 2024-05-09T06:43:07.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:07 smithi046 ceph-mon[110713]: pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:08.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:07 smithi106 ceph-mon[81208]: pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.163+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fc2d8109f50 con 0x7fc2d8102df0 2024-05-09T06:43:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.164+0000 7fc2ce7fc700 1 -- 172.21.15.46:0/1994438851 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4931 (secure 0 0 0) 0x7fc2d4062f60 con 0x7fc2d8102df0 2024-05-09T06:43:08.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:08.144 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:27:48.012161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14492":{"gid":14492,"name":"cephfs.smithi046.pkuwsr","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.46:6829/3210268761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3210268761},{"type":"v1","addr":"172.21.15.46:6829","nonce":3210268761}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:08.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc2c4078990 msgr2=0x7fc2c407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc2c4078990 0x7fc2c407ae40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc2d810f440 tx=0x7fc2c800b040 comp rx=0 tx=0).stop 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 msgr2=0x7fc2d8113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d8113ba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400b3b0 tx=0x7fc2d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 shutdown_connections 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fc2c4078990 0x7fc2c407ae40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d8102df0 0x7fc2d8113ba0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 --2- 172.21.15.46:0/1994438851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d8103790 0x7fc2d81140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 >> 172.21.15.46:0/1994438851 conn(0x7fc2d80f8980 msgr2=0x7fc2d80facd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 shutdown_connections 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:08.166+0000 7fc2e0245700 1 -- 172.21.15.46:0/1994438851 wait complete. 2024-05-09T06:43:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-05-09T06:43:08.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:08 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1994438851' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-05-09T06:43:08.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 19 2024-05-09T06:43:09.071 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:08 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1994438851' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-05-09T06:43:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:09.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:09 smithi046 ceph-mon[110713]: pgmap v275: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:10.071 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:09 smithi106 ceph-mon[81208]: pgmap v275: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:10.807 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:43:10.807 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:43:10.807 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:10 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 -- 172.21.15.46:0/2902359024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53441026a0 msgr2=0x7f53440fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 --2- 172.21.15.46:0/2902359024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53441026a0 0x7f53440fbd10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5334004940 tx=0x7f5334009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 -- 172.21.15.46:0/2902359024 shutdown_connections 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 --2- 172.21.15.46:0/2902359024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53441026a0 0x7f53440fbd10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 --2- 172.21.15.46:0/2902359024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5344101d00 0x7f53441020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 -- 172.21.15.46:0/2902359024 >> 172.21.15.46:0/2902359024 conn(0x7f53440f7870 msgr2=0x7f53440f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 -- 172.21.15.46:0/2902359024 shutdown_connections 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 -- 172.21.15.46:0/2902359024 wait complete. 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.830+0000 7f534c1fb700 1 Processor -- start 2024-05-09T06:43:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f534c1fb700 1 -- start start 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f534c1fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 0x7f5344112880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f534c1fb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53441026a0 0x7f5344112dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f534c1fb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344113410 con 0x7f5344101d00 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f534c1fb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534410ca10 con 0x7f53441026a0 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349f97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 0x7f5344112880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349f97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 0x7f5344112880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33118/0 (socket says 172.21.15.46:33118) 2024-05-09T06:43:10.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349f97700 1 -- 172.21.15.46:0/1882715383 learned_addr learned my addr 172.21.15.46:0/1882715383 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349796700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53441026a0 0x7f5344112dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349f97700 1 -- 172.21.15.46:0/1882715383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53441026a0 msgr2=0x7f5344112dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349f97700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53441026a0 0x7f5344112dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.831+0000 7f5349f97700 1 -- 172.21.15.46:0/1882715383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334005040 con 0x7f5344101d00 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.832+0000 7f5349f97700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 0x7f5344112880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5340002a80 tx=0x7f53400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.832+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5340007cc0 con 0x7f5344101d00 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.832+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f534000f040 con 0x7f5344101d00 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.832+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534410ccf0 con 0x7f5344101d00 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.832+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f534000dac0 con 0x7f5344101d00 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.832+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534410d200 con 0x7f5344101d00 2024-05-09T06:43:10.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.833+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53440fd450 con 0x7f5344101d00 2024-05-09T06:43:10.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.833+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f534000dc20 con 0x7f5344101d00 2024-05-09T06:43:10.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.834+0000 7f533a7fc700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5330078980 0x7f533007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:10.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.834+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f534009a3b0 con 0x7f5344101d00 2024-05-09T06:43:10.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.834+0000 7f5349796700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5330078980 0x7f533007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:10.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.834+0000 7f5349796700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5330078980 0x7f533007ae30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f534410dcf0 tx=0x7f5334009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:10.839+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f5340061f70 con 0x7f5344101d00 2024-05-09T06:43:11.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:43:11.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:43:11.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:10 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:43:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.101+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f5344108e10 con 0x7f5344101d00 2024-05-09T06:43:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.101+0000 7f533a7fc700 1 -- 172.21.15.46:0/1882715383 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4141 (secure 0 0 0) 0x7f5340061910 con 0x7f5344101d00 2024-05-09T06:43:11.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:11.082 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:01.313945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:11.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5330078980 msgr2=0x7f533007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:11.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5330078980 0x7f533007ae30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f534410dcf0 tx=0x7f5334009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:11.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 msgr2=0x7f5344112880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:11.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 0x7f5344112880 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5340002a80 tx=0x7f53400046b0 comp rx=0 tx=0).stop 2024-05-09T06:43:11.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 shutdown_connections 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f5330078980 0x7f533007ae30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5344101d00 0x7f5344112880 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 --2- 172.21.15.46:0/1882715383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53441026a0 0x7f5344112dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 >> 172.21.15.46:0/1882715383 conn(0x7f53440f7870 msgr2=0x7f53440f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 shutdown_connections 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:11.104+0000 7f534c1fb700 1 -- 172.21.15.46:0/1882715383 wait complete. 2024-05-09T06:43:11.085 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-05-09T06:43:11.744 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:11 smithi046 ceph-mon[110713]: pgmap v276: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:11.744 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:11 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1882715383' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-09T06:43:11.744 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:11 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:43:11.744 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:11 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:43:11.744 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:11 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:43:11.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 20 2024-05-09T06:43:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:11 smithi106 ceph-mon[81208]: pgmap v276: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:11 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1882715383' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-05-09T06:43:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:11 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:43:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:11 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:43:12.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:11 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' 2024-05-09T06:43:12.751 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:12 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:13.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:12 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 -- 172.21.15.46:0/3018592418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64065640 msgr2=0x7faa64065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/3018592418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64065640 0x7faa64065ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faa54004940 tx=0x7faa54009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 -- 172.21.15.46:0/3018592418 shutdown_connections 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/3018592418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64065640 0x7faa64065ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/3018592418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa64102e50 0x7faa64103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 -- 172.21.15.46:0/3018592418 >> 172.21.15.46:0/3018592418 conn(0x7faa64071d00 msgr2=0x7faa64072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 -- 172.21.15.46:0/3018592418 shutdown_connections 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.578+0000 7faa6bb3a700 1 -- 172.21.15.46:0/3018592418 wait complete. 2024-05-09T06:43:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa6bb3a700 1 Processor -- start 2024-05-09T06:43:13.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa6bb3a700 1 -- start start 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa6bb3a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa64065640 0x7faa640fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa6bb3a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 0x7faa640fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa6bb3a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640fc880 con 0x7faa64102e50 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa6bb3a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640fc9c0 con 0x7faa64065640 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa690d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 0x7faa640fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa690d5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 0x7faa640fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33138/0 (socket says 172.21.15.46:33138) 2024-05-09T06:43:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa690d5700 1 -- 172.21.15.46:0/2243567406 learned_addr learned my addr 172.21.15.46:0/2243567406 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa698d6700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa64065640 0x7faa640fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.579+0000 7faa690d5700 1 -- 172.21.15.46:0/2243567406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa64065640 msgr2=0x7faa640fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa690d5700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa64065640 0x7faa640fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa690d5700 1 -- 172.21.15.46:0/2243567406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54005040 con 0x7faa64102e50 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa690d5700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 0x7faa640fc2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa54009150 tx=0x7faa54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5400e040 con 0x7faa64102e50 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa54013420 con 0x7faa64102e50 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa640fcc10 con 0x7faa64102e50 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5401c630 con 0x7faa64102e50 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.580+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6411a2a0 con 0x7faa64102e50 2024-05-09T06:43:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.581+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64100100 con 0x7faa64102e50 2024-05-09T06:43:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.582+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7faa54013590 con 0x7faa64102e50 2024-05-09T06:43:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.582+0000 7faa5a7fc700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7faa50078980 0x7faa5007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.582+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7faa5409b8e0 con 0x7faa64102e50 2024-05-09T06:43:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.582+0000 7faa698d6700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7faa50078980 0x7faa5007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:13.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.583+0000 7faa698d6700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7faa50078980 0x7faa5007ae30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa60004990 tx=0x7faa60009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.587+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7faa540635c0 con 0x7faa64102e50 2024-05-09T06:43:13.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.851+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7faa640fe540 con 0x7faa64102e50 2024-05-09T06:43:13.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:13 smithi046 ceph-mon[110713]: pgmap v277: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:13.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.851+0000 7faa5a7fc700 1 -- 172.21.15.46:0/2243567406 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4152 (secure 0 0 0) 0x7faa54062f60 con 0x7faa64102e50 2024-05-09T06:43:13.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:13.832 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:01.319091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":0,"incarnation":20,"state":"up:replay","state_seq":3,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7faa50078980 msgr2=0x7faa5007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7faa50078980 0x7faa5007ae30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa60004990 tx=0x7faa60009ee0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 msgr2=0x7faa640fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 0x7faa640fc2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa54009150 tx=0x7faa54009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 shutdown_connections 2024-05-09T06:43:13.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7faa50078980 0x7faa5007ae30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa64065640 0x7faa640fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 --2- 172.21.15.46:0/2243567406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa64102e50 0x7faa640fc2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 >> 172.21.15.46:0/2243567406 conn(0x7faa64071d00 msgr2=0x7faa640fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 shutdown_connections 2024-05-09T06:43:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:13.854+0000 7faa6bb3a700 1 -- 172.21.15.46:0/2243567406 wait complete. 2024-05-09T06:43:13.835 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-05-09T06:43:14.071 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:13 smithi106 ceph-mon[81208]: pgmap v277: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:14.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 21 2024-05-09T06:43:14.737 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:14.970 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:14 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2243567406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-09T06:43:15.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:14 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2243567406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-05-09T06:43:15.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:15 smithi046 ceph-mon[110713]: pgmap v278: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:15.973 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:15 smithi106 ceph-mon[81208]: pgmap v278: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:16.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.326+0000 7f60f0056700 1 -- 172.21.15.46:0/2435252887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 msgr2=0x7f60e80fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:16.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.326+0000 7f60f0056700 1 --2- 172.21.15.46:0/2435252887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e80fcdd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f60dc004940 tx=0x7f60dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:16.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.326+0000 7f60f0056700 1 -- 172.21.15.46:0/2435252887 shutdown_connections 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.326+0000 7f60f0056700 1 --2- 172.21.15.46:0/2435252887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e80fcdd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.326+0000 7f60f0056700 1 --2- 172.21.15.46:0/2435252887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e8102dc0 0x7f60e8103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.326+0000 7f60f0056700 1 -- 172.21.15.46:0/2435252887 >> 172.21.15.46:0/2435252887 conn(0x7f60e80f8950 msgr2=0x7f60e80fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 -- 172.21.15.46:0/2435252887 shutdown_connections 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 -- 172.21.15.46:0/2435252887 wait complete. 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 Processor -- start 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 -- start start 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e8102dc0 0x7f60e8113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e81140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8114790 con 0x7f60e8103760 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60f0056700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e810db40 con 0x7f60e8102dc0 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60ed5f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e81140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60ed5f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e81140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33166/0 (socket says 172.21.15.46:33166) 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.327+0000 7f60ed5f1700 1 -- 172.21.15.46:0/4287153247 learned_addr learned my addr 172.21.15.46:0/4287153247 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:16.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60eddf2700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e8102dc0 0x7f60e8113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60ed5f1700 1 -- 172.21.15.46:0/4287153247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e8102dc0 msgr2=0x7f60e8113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60ed5f1700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e8102dc0 0x7f60e8113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60ed5f1700 1 -- 172.21.15.46:0/4287153247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc005040 con 0x7f60e8103760 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60ed5f1700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e81140b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009100 tx=0x7f60dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60dc00e040 con 0x7f60e8103760 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60dc013420 con 0x7f60e8103760 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e810ddc0 con 0x7f60e8103760 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60dc01c610 con 0x7f60e8103760 2024-05-09T06:43:16.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.328+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e810e380 con 0x7f60e8103760 2024-05-09T06:43:16.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.329+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e81000d0 con 0x7f60e8103760 2024-05-09T06:43:16.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.330+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f60dc013590 con 0x7f60e8103760 2024-05-09T06:43:16.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.330+0000 7f60e67fc700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f60d0078990 0x7f60d007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:16.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.330+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f60dc09b8e0 con 0x7f60e8103760 2024-05-09T06:43:16.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.330+0000 7f60eddf2700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f60d0078990 0x7f60d007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:16.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.331+0000 7f60eddf2700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f60d0078990 0x7f60d007ae40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009f50 tx=0x7f60d8009590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:16.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.335+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f60dc0635c0 con 0x7f60e8103760 2024-05-09T06:43:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.594+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f60e80fe510 con 0x7f60e8103760 2024-05-09T06:43:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.595+0000 7f60e67fc700 1 -- 172.21.15.46:0/4287153247 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4157 (secure 0 0 0) 0x7f60dc062f60 con 0x7f60e8103760 2024-05-09T06:43:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:16.575 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:09.358118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":190,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f60d0078990 msgr2=0x7f60d007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f60d0078990 0x7f60d007ae40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009f50 tx=0x7f60d8009590 comp rx=0 tx=0).stop 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 msgr2=0x7f60e81140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e81140b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009100 tx=0x7f60dc009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 shutdown_connections 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f60d0078990 0x7f60d007ae40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60e8102dc0 0x7f60e8113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 --2- 172.21.15.46:0/4287153247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60e8103760 0x7f60e81140b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.597+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 >> 172.21.15.46:0/4287153247 conn(0x7f60e80f8950 msgr2=0x7f60e8107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.598+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 shutdown_connections 2024-05-09T06:43:16.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:16.598+0000 7f60f0056700 1 -- 172.21.15.46:0/4287153247 wait complete. 2024-05-09T06:43:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-05-09T06:43:16.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:16 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/4287153247' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-09T06:43:17.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:16 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/4287153247' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-05-09T06:43:17.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 22 2024-05-09T06:43:17.564 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:17.970 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:17 smithi046 ceph-mon[110713]: pgmap v279: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:18.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:17 smithi106 ceph-mon[81208]: pgmap v279: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 -- 172.21.15.46:0/2009988474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4102df0 msgr2=0x7f23c41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 --2- 172.21.15.46:0/2009988474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4102df0 0x7f23c41031c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23b4004940 tx=0x7f23b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 -- 172.21.15.46:0/2009988474 shutdown_connections 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 --2- 172.21.15.46:0/2009988474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c4103790 0x7f23c40fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 --2- 172.21.15.46:0/2009988474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4102df0 0x7f23c41031c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 -- 172.21.15.46:0/2009988474 >> 172.21.15.46:0/2009988474 conn(0x7f23c40f8980 msgr2=0x7f23c40fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 -- 172.21.15.46:0/2009988474 shutdown_connections 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.149+0000 7f23c902e700 1 -- 172.21.15.46:0/2009988474 wait complete. 2024-05-09T06:43:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c902e700 1 Processor -- start 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c902e700 1 -- start start 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c902e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c4102df0 0x7f23c4113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c902e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 0x7f23c41140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c902e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c4114710 con 0x7f23c4103790 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c902e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c410db00 con 0x7f23c4102df0 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 0x7f23c41140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 0x7f23c41140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33186/0 (socket says 172.21.15.46:33186) 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c259c700 1 -- 172.21.15.46:0/1989855463 learned_addr learned my addr 172.21.15.46:0/1989855463 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.150+0000 7f23c2d9d700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c4102df0 0x7f23c4113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23c259c700 1 -- 172.21.15.46:0/1989855463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c4102df0 msgr2=0x7f23c4113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23c259c700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c4102df0 0x7f23c4113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23c259c700 1 -- 172.21.15.46:0/1989855463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4005040 con 0x7f23c4103790 2024-05-09T06:43:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23c259c700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 0x7f23c41140c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c800 tx=0x7f23b8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23b80106f0 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23b8010d20 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c410dde0 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23b80113a0 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.151+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c410e3a0 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.152+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c4100100 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.153+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f23b8012400 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.153+0000 7f23ab7fe700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23ac078990 0x7f23ac07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.153+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f23b809a710 con 0x7f23c4103790 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.153+0000 7f23c2d9d700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23ac078990 0x7f23ac07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:19.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.154+0000 7f23c2d9d700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23ac078990 0x7f23ac07ae40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23b4004f90 tx=0x7f23b4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:19.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.158+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f23b8062350 con 0x7f23c4103790 2024-05-09T06:43:19.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.418+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f23c410f1d0 con 0x7f23c4103790 2024-05-09T06:43:19.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.419+0000 7f23ab7fe700 1 -- 172.21.15.46:0/1989855463 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+5001 (secure 0 0 0) 0x7f23b8061cf0 con 0x7f23c4103790 2024-05-09T06:43:19.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:19.399 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:09.572314+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":191,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:19.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23ac078990 msgr2=0x7f23ac07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23ac078990 0x7f23ac07ae40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23b4004f90 tx=0x7f23b4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 msgr2=0x7f23c41140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 0x7f23c41140c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c800 tx=0x7f23b8004470 comp rx=0 tx=0).stop 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 shutdown_connections 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f23ac078990 0x7f23ac07ae40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c4102df0 0x7f23c4113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 --2- 172.21.15.46:0/1989855463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c4103790 0x7f23c41140c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 >> 172.21.15.46:0/1989855463 conn(0x7f23c40f8980 msgr2=0x7f23c4107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 shutdown_connections 2024-05-09T06:43:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:19.421+0000 7f23c902e700 1 -- 172.21.15.46:0/1989855463 wait complete. 2024-05-09T06:43:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2024-05-09T06:43:19.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:19 smithi046 ceph-mon[110713]: pgmap v280: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:19.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:19 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1989855463' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-09T06:43:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:19 smithi106 ceph-mon[81208]: pgmap v280: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:20.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:19 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1989855463' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-05-09T06:43:20.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 23 2024-05-09T06:43:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/2708949111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec0fbd40 msgr2=0x7fd4ec0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/2708949111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec0fbd40 0x7fd4ec0fc1b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4004940 tx=0x7fd4d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/2708949111 shutdown_connections 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/2708949111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec0fbd40 0x7fd4ec0fc1b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/2708949111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4ec101d90 0x7fd4ec102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/2708949111 >> 172.21.15.46:0/2708949111 conn(0x7fd4ec071d00 msgr2=0x7fd4ec072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/2708949111 shutdown_connections 2024-05-09T06:43:21.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.965+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/2708949111 wait complete. 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4f0b9b700 1 Processor -- start 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4f0b9b700 1 -- start start 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4f0b9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4ec0fbd40 0x7fd4ec102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4f0b9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 0x7fd4ec103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4f0b9b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec103610 con 0x7fd4ec101d90 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4f0b9b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec103780 con 0x7fd4ec0fbd40 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4e9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 0x7fd4ec103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4e9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 0x7fd4ec103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47436/0 (socket says 172.21.15.46:47436) 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.966+0000 7fd4e9d9b700 1 -- 172.21.15.46:0/3929786372 learned_addr learned my addr 172.21.15.46:0/3929786372 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4ea59c700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4ec0fbd40 0x7fd4ec102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e9d9b700 1 -- 172.21.15.46:0/3929786372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4ec0fbd40 msgr2=0x7fd4ec102b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e9d9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4ec0fbd40 0x7fd4ec102b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e9d9b700 1 -- 172.21.15.46:0/3929786372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d4005040 con 0x7fd4ec101d90 2024-05-09T06:43:21.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e9d9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 0x7fd4ec103060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009180 tx=0x7fd4d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:21.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d400e040 con 0x7fd4ec101d90 2024-05-09T06:43:21.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4d400bc90 con 0x7fd4ec101d90 2024-05-09T06:43:21.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4d401c630 con 0x7fd4ec101d90 2024-05-09T06:43:21.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec119eb0 con 0x7fd4ec101d90 2024-05-09T06:43:21.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.967+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec11a2c0 con 0x7fd4ec101d90 2024-05-09T06:43:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.968+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec0fd430 con 0x7fd4ec101d90 2024-05-09T06:43:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.969+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fd4d4013980 con 0x7fd4ec101d90 2024-05-09T06:43:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.970+0000 7fd4e2ffd700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd4d8078980 0x7fd4d807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.970+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd4d409bb20 con 0x7fd4ec101d90 2024-05-09T06:43:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.970+0000 7fd4ea59c700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd4d8078980 0x7fd4d807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:21.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.970+0000 7fd4ea59c700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd4d8078980 0x7fd4d807ae30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc004990 tx=0x7fd4dc009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:21.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:21.975+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fd4d4063800 con 0x7fd4ec101d90 2024-05-09T06:43:22.072 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:21 smithi106 ceph-mon[81208]: pgmap v281: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:22.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:21 smithi046 ceph-mon[110713]: pgmap v281: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.238+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fd4ec05f5c0 con 0x7fd4ec101d90 2024-05-09T06:43:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.238+0000 7fd4e2ffd700 1 -- 172.21.15.46:0/3929786372 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+5010 (secure 0 0 0) 0x7fd4d40631a0 con 0x7fd4ec101d90 2024-05-09T06:43:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:11.574028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi106.fqgqkm","rank":0,"incarnation":20,"state":"up:active","state_seq":192,"addr":"172.21.15.106:6825/2740455125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2740455125},{"type":"v1","addr":"172.21.15.106:6825","nonce":2740455125}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24273,"qdb_cluster":[24273]},"id":1}]} 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd4d8078980 msgr2=0x7fd4d807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd4d8078980 0x7fd4d807ae30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc004990 tx=0x7fd4dc009ee0 comp rx=0 tx=0).stop 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 msgr2=0x7fd4ec103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 0x7fd4ec103060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009180 tx=0x7fd4d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 shutdown_connections 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fd4d8078980 0x7fd4d807ae30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4ec0fbd40 0x7fd4ec102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 --2- 172.21.15.46:0/3929786372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ec101d90 0x7fd4ec103060 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 >> 172.21.15.46:0/3929786372 conn(0x7fd4ec071d00 msgr2=0x7fd4ec065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 shutdown_connections 2024-05-09T06:43:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:22.241+0000 7fd4f0b9b700 1 -- 172.21.15.46:0/3929786372 wait complete. 2024-05-09T06:43:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-05-09T06:43:22.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:22 smithi046 ceph-mon[110713]: pgmap v282: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:22.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:22 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3929786372' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-09T06:43:22.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 24 2024-05-09T06:43:23.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:22 smithi106 ceph-mon[81208]: pgmap v282: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:23.074 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:22 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3929786372' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-05-09T06:43:23.076 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.720+0000 7f39e22c1700 1 -- 172.21.15.46:0/4033805652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 msgr2=0x7f39dc102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.720+0000 7f39e22c1700 1 --2- 172.21.15.46:0/4033805652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc102160 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39cc004940 tx=0x7f39cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- 172.21.15.46:0/4033805652 shutdown_connections 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 --2- 172.21.15.46:0/4033805652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39dc0fbd40 0x7f39dc0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 --2- 172.21.15.46:0/4033805652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc102160 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- 172.21.15.46:0/4033805652 >> 172.21.15.46:0/4033805652 conn(0x7f39dc071d00 msgr2=0x7f39dc072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:24.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- 172.21.15.46:0/4033805652 shutdown_connections 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- 172.21.15.46:0/4033805652 wait complete. 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 Processor -- start 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- start start 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39dc0fbd40 0x7f39dc102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1035f0 con 0x7f39dc101d90 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.721+0000 7f39e22c1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc103730 con 0x7f39dc0fbd40 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47448/0 (socket says 172.21.15.46:47448) 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 -- 172.21.15.46:0/1879761907 learned_addr learned my addr 172.21.15.46:0/1879761907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39dbfff700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39dc0fbd40 0x7f39dc102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 -- 172.21.15.46:0/1879761907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39dc0fbd40 msgr2=0x7f39dc102b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39dc0fbd40 0x7f39dc102b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 -- 172.21.15.46:0/1879761907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc005040 con 0x7f39dc101d90 2024-05-09T06:43:24.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d3fff700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc103060 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39c400eb40 tx=0x7f39c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4007cc0 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc103980 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc11a170 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39c400f040 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.722+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c4009620 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.723+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc0052b0 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.724+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f39c4009780 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.724+0000 7f39d97fa700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f39c8078980 0x7f39c807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.725+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f39c409a400 con 0x7f39dc101d90 2024-05-09T06:43:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.725+0000 7f39dbfff700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f39c8078980 0x7f39c807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:24.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.725+0000 7f39dbfff700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f39c8078980 0x7f39c807ae30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00b0d0 tx=0x7f39cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:24.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.729+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f39c4061fd0 con 0x7f39dc101d90 2024-05-09T06:43:24.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.994+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f39bc005560 con 0x7f39dc101d90 2024-05-09T06:43:24.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.995+0000 7f39d97fa700 1 -- 172.21.15.46:0/1879761907 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4206 (secure 0 0 0) 0x7f39c4061970 con 0x7f39dc101d90 2024-05-09T06:43:24.975 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:24.976 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:23.286961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:24.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.997+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f39c8078980 msgr2=0x7f39c807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:24.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.997+0000 7f39e22c1700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f39c8078980 0x7f39c807ae30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00b0d0 tx=0x7f39cc009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:24.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.997+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 msgr2=0x7f39dc103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:24.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.997+0000 7f39e22c1700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc103060 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39c400eb40 tx=0x7f39c400b040 comp rx=0 tx=0).stop 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 shutdown_connections 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f39c8078980 0x7f39c807ae30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39dc0fbd40 0x7f39dc102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 --2- 172.21.15.46:0/1879761907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39dc101d90 0x7f39dc103060 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 >> 172.21.15.46:0/1879761907 conn(0x7f39dc071d00 msgr2=0x7f39dc0fb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 shutdown_connections 2024-05-09T06:43:24.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:24.998+0000 7f39e22c1700 1 -- 172.21.15.46:0/1879761907 wait complete. 2024-05-09T06:43:24.980 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-05-09T06:43:25.550 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:25 smithi046 ceph-mon[110713]: pgmap v283: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:25.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:25 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1879761907' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-09T06:43:25.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:25 smithi106 ceph-mon[81208]: pgmap v283: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:25.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:25 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1879761907' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-05-09T06:43:25.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 25 2024-05-09T06:43:25.853 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:27.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:27 smithi046 ceph-mon[110713]: pgmap v284: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:27.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:27 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:27.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 -- 172.21.15.46:0/66174860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954103760 msgr2=0x7f39540fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 --2- 172.21.15.46:0/66174860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954103760 0x7f39540fcdd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3944004940 tx=0x7f3944009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 -- 172.21.15.46:0/66174860 shutdown_connections 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 --2- 172.21.15.46:0/66174860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954103760 0x7f39540fcdd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 --2- 172.21.15.46:0/66174860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954102dc0 0x7f3954103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 -- 172.21.15.46:0/66174860 >> 172.21.15.46:0/66174860 conn(0x7f39540f8930 msgr2=0x7f39540fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 -- 172.21.15.46:0/66174860 shutdown_connections 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 -- 172.21.15.46:0/66174860 wait complete. 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 Processor -- start 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.453+0000 7f395b615700 1 -- start start 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f395b615700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 0x7f3954113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:27.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f395b615700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954103760 0x7f3954113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f395b615700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39541144e0 con 0x7f3954102dc0 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f395b615700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395410dae0 con 0x7f3954103760 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 0x7f3954113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 0x7f3954113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47472/0 (socket says 172.21.15.46:47472) 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 -- 172.21.15.46:0/3507881481 learned_addr learned my addr 172.21.15.46:0/3507881481 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 -- 172.21.15.46:0/3507881481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954103760 msgr2=0x7f3954113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f3958bb0700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954103760 0x7f3954113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954103760 0x7f3954113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 -- 172.21.15.46:0/3507881481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944005040 con 0x7f3954102dc0 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f3958bb0700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954103760 0x7f3954113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:43:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f39593b1700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 0x7f3954113950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3950002a50 tx=0x7f39500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:27.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950007cc0 con 0x7f3954102dc0 2024-05-09T06:43:27.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f395000f040 con 0x7f3954102dc0 2024-05-09T06:43:27.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395410ddc0 con 0x7f3954102dc0 2024-05-09T06:43:27.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.454+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3950009640 con 0x7f3954102dc0 2024-05-09T06:43:27.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.455+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395410e380 con 0x7f3954102dc0 2024-05-09T06:43:27.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.456+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39540fe510 con 0x7f3954102dc0 2024-05-09T06:43:27.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.456+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f39500097a0 con 0x7f3954102dc0 2024-05-09T06:43:27.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.457+0000 7f3949ffb700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3940078990 0x7f394007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:27.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.457+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f395009a580 con 0x7f3954102dc0 2024-05-09T06:43:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.457+0000 7f3958bb0700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3940078990 0x7f394007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.457+0000 7f3958bb0700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3940078990 0x7f394007ae40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f394400b3b0 tx=0x7f3944009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:27.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.462+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f3950062140 con 0x7f3954102dc0 2024-05-09T06:43:27.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:27 smithi106 ceph-mon[81208]: pgmap v284: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:27.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:27 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.725+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f3954109ea0 con 0x7f3954102dc0 2024-05-09T06:43:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.726+0000 7f3949ffb700 1 -- 172.21.15.46:0/3507881481 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4217 (secure 0 0 0) 0x7f3950061ae0 con 0x7f3954102dc0 2024-05-09T06:43:27.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:27.707 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:23.292373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3940078990 msgr2=0x7f394007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3940078990 0x7f394007ae40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f394400b3b0 tx=0x7f3944009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 msgr2=0x7f3954113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 0x7f3954113950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3950002a50 tx=0x7f39500046b0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 shutdown_connections 2024-05-09T06:43:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f3940078990 0x7f394007ae40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3954102dc0 0x7f3954113950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 --2- 172.21.15.46:0/3507881481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954103760 0x7f3954113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 >> 172.21.15.46:0/3507881481 conn(0x7f39540f8930 msgr2=0x7f39540f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 shutdown_connections 2024-05-09T06:43:27.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:27.728+0000 7f395b615700 1 -- 172.21.15.46:0/3507881481 wait complete. 2024-05-09T06:43:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 25 2024-05-09T06:43:28.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:28 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3507881481' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-09T06:43:28.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 26 2024-05-09T06:43:28.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:28 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3507881481' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-05-09T06:43:28.689 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:29.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:29 smithi106 ceph-mon[81208]: pgmap v285: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:29.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:29 smithi046 ceph-mon[110713]: pgmap v285: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.301+0000 7f972fbf9700 1 -- 172.21.15.46:0/2239745521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 msgr2=0x7f97281031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.301+0000 7f972fbf9700 1 --2- 172.21.15.46:0/2239745521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f97281031b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9724009ce0 tx=0x7f9724004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.301+0000 7f972fbf9700 1 -- 172.21.15.46:0/2239745521 shutdown_connections 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.301+0000 7f972fbf9700 1 --2- 172.21.15.46:0/2239745521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 0x7f97280fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.301+0000 7f972fbf9700 1 --2- 172.21.15.46:0/2239745521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f97281031b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.301+0000 7f972fbf9700 1 -- 172.21.15.46:0/2239745521 >> 172.21.15.46:0/2239745521 conn(0x7f97280f8990 msgr2=0x7f97280fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:30.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.302+0000 7f972fbf9700 1 -- 172.21.15.46:0/2239745521 shutdown_connections 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.302+0000 7f972fbf9700 1 -- 172.21.15.46:0/2239745521 wait complete. 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.302+0000 7f972fbf9700 1 Processor -- start 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.302+0000 7f972fbf9700 1 -- start start 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972fbf9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f9728113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972fbf9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 0x7f9728113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972fbf9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9728114690 con 0x7f9728102de0 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972fbf9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972810dbe0 con 0x7f9728103780 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f9728113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f9728113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47492/0 (socket says 172.21.15.46:47492) 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 -- 172.21.15.46:0/1312083130 learned_addr learned my addr 172.21.15.46:0/1312083130 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 -- 172.21.15.46:0/1312083130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 msgr2=0x7f9728113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d194700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 0x7f9728113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:30.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 0x7f9728113fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 -- 172.21.15.46:0/1312083130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724009940 con 0x7f9728102de0 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d194700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 0x7f9728113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972d995700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f9728113a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f972400be90 tx=0x7f9724004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f972400e040 con 0x7f9728102de0 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9724008ea0 con 0x7f9728102de0 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f972401c810 con 0x7f9728102de0 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.303+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972810de00 con 0x7f9728102de0 2024-05-09T06:43:30.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.304+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972810e3c0 con 0x7f9728102de0 2024-05-09T06:43:30.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.304+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97281000f0 con 0x7f9728102de0 2024-05-09T06:43:30.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.305+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f9724012c00 con 0x7f9728102de0 2024-05-09T06:43:30.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.306+0000 7f971e7fc700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97140789d0 0x7f971407ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:30.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.306+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f972409c490 con 0x7f9728102de0 2024-05-09T06:43:30.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.306+0000 7f972d194700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97140789d0 0x7f971407ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:30.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.306+0000 7f972d194700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97140789d0 0x7f971407ae80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9718006fd0 tx=0x7f9718008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:30.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.311+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9724063fb0 con 0x7f9728102de0 2024-05-09T06:43:30.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.573+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f97280fe530 con 0x7f9728102de0 2024-05-09T06:43:30.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.574+0000 7f971e7fc700 1 -- 172.21.15.46:0/1312083130 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4222 (secure 0 0 0) 0x7f9724004e10 con 0x7f9728102de0 2024-05-09T06:43:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:30.554 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:31.321042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":194,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97140789d0 msgr2=0x7f971407ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97140789d0 0x7f971407ae80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9718006fd0 tx=0x7f9718008040 comp rx=0 tx=0).stop 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 msgr2=0x7f9728113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f9728113a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f972400be90 tx=0x7f9724004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 shutdown_connections 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f97140789d0 0x7f971407ae80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9728102de0 0x7f9728113a70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 --2- 172.21.15.46:0/1312083130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9728103780 0x7f9728113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:30.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 >> 172.21.15.46:0/1312083130 conn(0x7f97280f8990 msgr2=0x7f97280fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 shutdown_connections 2024-05-09T06:43:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:30.577+0000 7f972fbf9700 1 -- 172.21.15.46:0/1312083130 wait complete. 2024-05-09T06:43:30.558 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 26 2024-05-09T06:43:31.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 27 2024-05-09T06:43:31.454 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:31.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:31 smithi106 ceph-mon[81208]: pgmap v286: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:31.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:31 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1312083130' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-09T06:43:31.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:31 smithi046 ceph-mon[110713]: pgmap v286: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:31.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:31 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1312083130' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.041+0000 7f195cd82700 1 -- 172.21.15.46:0/4071799642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 msgr2=0x7f19580fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.041+0000 7f195cd82700 1 --2- 172.21.15.46:0/4071799642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fbd10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1940004940 tx=0x7f1940009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 -- 172.21.15.46:0/4071799642 shutdown_connections 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 --2- 172.21.15.46:0/4071799642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fbd10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 --2- 172.21.15.46:0/4071799642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1958101d00 0x7f19581020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 -- 172.21.15.46:0/4071799642 >> 172.21.15.46:0/4071799642 conn(0x7f19580f7870 msgr2=0x7f19580f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 -- 172.21.15.46:0/4071799642 shutdown_connections 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 -- 172.21.15.46:0/4071799642 wait complete. 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 Processor -- start 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.042+0000 7f195cd82700 1 -- start start 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f195cd82700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1958101d00 0x7f19580fd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f195cd82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f195cd82700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580ff920 con 0x7f19581026a0 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f195cd82700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580fe400 con 0x7f1958101d00 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57882/0 (socket says 172.21.15.46:57882) 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 -- 172.21.15.46:0/2352294341 learned_addr learned my addr 172.21.15.46:0/2352294341 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f195659c700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1958101d00 0x7f19580fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 -- 172.21.15.46:0/2352294341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1958101d00 msgr2=0x7f19580fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1958101d00 0x7f19580fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:33.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 -- 172.21.15.46:0/2352294341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940005040 con 0x7f19581026a0 2024-05-09T06:43:33.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f1955d9b700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fdec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1940009180 tx=0x7f1940009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.043+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194000e040 con 0x7f19581026a0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.044+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19580fe650 con 0x7f19581026a0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.044+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1940013420 con 0x7f19581026a0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.044+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f194001c610 con 0x7f19581026a0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.044+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195811a010 con 0x7f19581026a0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.045+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1958101220 con 0x7f19581026a0 2024-05-09T06:43:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.045+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f1940013a00 con 0x7f19581026a0 2024-05-09T06:43:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.046+0000 7f194effd700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1944078990 0x7f194407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.046+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f194009c310 con 0x7f19581026a0 2024-05-09T06:43:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.046+0000 7f195659c700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1944078990 0x7f194407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.047+0000 7f195659c700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1944078990 0x7f194407ae40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1948009fd0 tx=0x7f194800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:33.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.050+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f19400640a0 con 0x7f19581026a0 2024-05-09T06:43:33.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.310+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f19580feec0 con 0x7f19581026a0 2024-05-09T06:43:33.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:33 smithi046 ceph-mon[110713]: pgmap v287: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:33.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.310+0000 7f194effd700 1 -- 172.21.15.46:0/2352294341 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4219 (secure 0 0 0) 0x7f1940063a40 con 0x7f19581026a0 2024-05-09T06:43:33.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:33.292 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:31.696186+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":195,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.312+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1944078990 msgr2=0x7f194407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.312+0000 7f195cd82700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1944078990 0x7f194407ae40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1948009fd0 tx=0x7f194800b040 comp rx=0 tx=0).stop 2024-05-09T06:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 msgr2=0x7f19580fdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fdec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1940009180 tx=0x7f1940009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 shutdown_connections 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f1944078990 0x7f194407ae40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1958101d00 0x7f19580fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 --2- 172.21.15.46:0/2352294341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19581026a0 0x7f19580fdec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 >> 172.21.15.46:0/2352294341 conn(0x7f19580f7870 msgr2=0x7f1958066c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 shutdown_connections 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:33.313+0000 7f195cd82700 1 -- 172.21.15.46:0/2352294341 wait complete. 2024-05-09T06:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-05-09T06:43:33.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:33 smithi106 ceph-mon[81208]: pgmap v287: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:33.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 28 2024-05-09T06:43:34.214 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:34.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:34 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2352294341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-09T06:43:34.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:34 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2352294341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-05-09T06:43:35.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:35 smithi106 ceph-mon[81208]: pgmap v288: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:35.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:35 smithi046 ceph-mon[110713]: pgmap v288: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:35.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 -- 172.21.15.46:0/2632333227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8400fbd40 msgr2=0x7fe8400fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:35.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 --2- 172.21.15.46:0/2632333227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8400fbd40 0x7fe8400fc1b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe834004940 tx=0x7fe834009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:35.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 -- 172.21.15.46:0/2632333227 shutdown_connections 2024-05-09T06:43:35.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 --2- 172.21.15.46:0/2632333227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8400fbd40 0x7fe8400fc1b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:35.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 --2- 172.21.15.46:0/2632333227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe840101d90 0x7fe840102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:35.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 -- 172.21.15.46:0/2632333227 >> 172.21.15.46:0/2632333227 conn(0x7fe840071d00 msgr2=0x7fe840072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:35.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 -- 172.21.15.46:0/2632333227 shutdown_connections 2024-05-09T06:43:35.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.998+0000 7fe845db1700 1 -- 172.21.15.46:0/2632333227 wait complete. 2024-05-09T06:43:35.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.999+0000 7fe845db1700 1 Processor -- start 2024-05-09T06:43:35.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.999+0000 7fe845db1700 1 -- start start 2024-05-09T06:43:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.999+0000 7fe845db1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8400fbd40 0x7fe84010eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.999+0000 7fe845db1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 0x7fe84010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:35.999+0000 7fe845db1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84010f6d0 con 0x7fe840101d90 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe845db1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84010f810 con 0x7fe8400fbd40 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 0x7fe84010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 0x7fe84010f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57900/0 (socket says 172.21.15.46:57900) 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 -- 172.21.15.46:0/1815075887 learned_addr learned my addr 172.21.15.46:0/1815075887 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83f7fe700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8400fbd40 0x7fe84010eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 -- 172.21.15.46:0/1815075887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8400fbd40 msgr2=0x7fe84010eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8400fbd40 0x7fe84010eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 -- 172.21.15.46:0/1815075887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834005040 con 0x7fe840101d90 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe83effd700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 0x7fe84010f080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe834009150 tx=0x7fe834009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe834021070 con 0x7fe840101d90 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe840117bb0 con 0x7fe840101d90 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe834013c00 con 0x7fe840101d90 2024-05-09T06:43:35.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83400e070 con 0x7fe840101d90 2024-05-09T06:43:35.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.000+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe840118010 con 0x7fe840101d90 2024-05-09T06:43:35.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.001+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8400fd430 con 0x7fe840101d90 2024-05-09T06:43:35.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.002+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fe83401c400 con 0x7fe840101d90 2024-05-09T06:43:35.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.002+0000 7fe827fff700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe828078980 0x7fe82807ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:35.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.003+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe83409bbc0 con 0x7fe840101d90 2024-05-09T06:43:35.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.003+0000 7fe83f7fe700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe828078980 0x7fe82807ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:35.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.003+0000 7fe83f7fe700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe828078980 0x7fe82807ae30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe830001490 tx=0x7fe83000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.007+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fe8340638c0 con 0x7fe840101d90 2024-05-09T06:43:36.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.266+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fe84004bed0 con 0x7fe840101d90 2024-05-09T06:43:36.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.266+0000 7fe827fff700 1 -- 172.21.15.46:0/1815075887 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4228 (secure 0 0 0) 0x7fe834063260 con 0x7fe840101d90 2024-05-09T06:43:36.247 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:36.247 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:33.697205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":0,"incarnation":25,"state":"up:active","state_seq":196,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe828078980 msgr2=0x7fe82807ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe828078980 0x7fe82807ae30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe830001490 tx=0x7fe83000b040 comp rx=0 tx=0).stop 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 msgr2=0x7fe84010f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 0x7fe84010f080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe834009150 tx=0x7fe834009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 shutdown_connections 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fe828078980 0x7fe82807ae30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8400fbd40 0x7fe84010eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:36.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 --2- 172.21.15.46:0/1815075887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe840101d90 0x7fe84010f080 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:36.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.269+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 >> 172.21.15.46:0/1815075887 conn(0x7fe840071d00 msgr2=0x7fe8400f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:36.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.270+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 shutdown_connections 2024-05-09T06:43:36.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:36.270+0000 7fe845db1700 1 -- 172.21.15.46:0/1815075887 wait complete. 2024-05-09T06:43:36.251 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-05-09T06:43:36.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:36 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1815075887' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-09T06:43:36.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:36 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1815075887' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-05-09T06:43:36.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 29 2024-05-09T06:43:37.119 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:37.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:37 smithi106 ceph-mon[81208]: pgmap v289: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:37.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:37 smithi046 ceph-mon[110713]: pgmap v289: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:38.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 -- 172.21.15.46:0/1221824092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704102de0 msgr2=0x7fa7041031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:38.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 --2- 172.21.15.46:0/1221824092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704102de0 0x7fa7041031b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009ce0 tx=0x7fa6f4004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:38.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 -- 172.21.15.46:0/1221824092 shutdown_connections 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 --2- 172.21.15.46:0/1221824092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa704103780 0x7fa7040fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 --2- 172.21.15.46:0/1221824092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704102de0 0x7fa7041031b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 -- 172.21.15.46:0/1221824092 >> 172.21.15.46:0/1221824092 conn(0x7fa7040f8950 msgr2=0x7fa7040fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 -- 172.21.15.46:0/1221824092 shutdown_connections 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.786+0000 7fa70ae33700 1 -- 172.21.15.46:0/1221824092 wait complete. 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.787+0000 7fa70ae33700 1 Processor -- start 2024-05-09T06:43:38.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.787+0000 7fa70ae33700 1 -- start start 2024-05-09T06:43:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa70ae33700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa704102de0 0x7fa704113d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa70ae33700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 0x7fa704114280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:38.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa70ae33700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041148d0 con 0x7fa704103780 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa70ae33700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70410dca0 con 0x7fa704102de0 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 0x7fa704114280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 0x7fa704114280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57930/0 (socket says 172.21.15.46:57930) 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa708bcf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa704102de0 0x7fa704113d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 -- 172.21.15.46:0/4033929350 learned_addr learned my addr 172.21.15.46:0/4033929350 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 -- 172.21.15.46:0/4033929350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa704102de0 msgr2=0x7fa704113d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa704102de0 0x7fa704113d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 -- 172.21.15.46:0/4033929350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009940 con 0x7fa704103780 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa703fff700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 0x7fa704114280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec002a50 tx=0x7fa6ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ec007cc0 con 0x7fa704103780 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6ec00f040 con 0x7fa704103780 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.788+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70410df80 con 0x7fa704103780 2024-05-09T06:43:38.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.789+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ec00d9c0 con 0x7fa704103780 2024-05-09T06:43:38.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.789+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70410e540 con 0x7fa704103780 2024-05-09T06:43:38.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.790+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7041000f0 con 0x7fa704103780 2024-05-09T06:43:38.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.790+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa6ec00dc00 con 0x7fa704103780 2024-05-09T06:43:38.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.791+0000 7fa7017fa700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6f0078980 0x7fa6f007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:38.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.791+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa6ec09a580 con 0x7fa704103780 2024-05-09T06:43:38.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.791+0000 7fa708bcf700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6f0078980 0x7fa6f007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:38.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.791+0000 7fa708bcf700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6f0078980 0x7fa6f007ae30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400b740 tx=0x7fa6f4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:38.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:38.796+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa6ec0620a0 con 0x7fa704103780 2024-05-09T06:43:39.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.059+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fa7040fe530 con 0x7fa704103780 2024-05-09T06:43:39.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.060+0000 7fa7017fa700 1 -- 172.21.15.46:0/4033929350 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+5075 (secure 0 0 0) 0x7fa6ec061a40 con 0x7fa704103780 2024-05-09T06:43:39.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:39.041 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:33.697205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi106.ugnujp","rank":0,"incarnation":25,"state":"up:active","state_seq":196,"addr":"172.21.15.106:6827/3262788331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":3262788331},{"type":"v1","addr":"172.21.15.106:6827","nonce":3262788331}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-05-09T06:43:39.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6f0078980 msgr2=0x7fa6f007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6f0078980 0x7fa6f007ae30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400b740 tx=0x7fa6f4004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 msgr2=0x7fa704114280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 0x7fa704114280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec002a50 tx=0x7fa6ec004600 comp rx=0 tx=0).stop 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 shutdown_connections 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6f0078980 0x7fa6f007ae30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa704102de0 0x7fa704113d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.062+0000 7fa70ae33700 1 --2- 172.21.15.46:0/4033929350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa704103780 0x7fa704114280 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.063+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 >> 172.21.15.46:0/4033929350 conn(0x7fa7040f8950 msgr2=0x7fa704106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.063+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 shutdown_connections 2024-05-09T06:43:39.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:39.063+0000 7fa70ae33700 1 -- 172.21.15.46:0/4033929350 wait complete. 2024-05-09T06:43:39.044 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-05-09T06:43:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:39 smithi046 ceph-mon[110713]: pgmap v290: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:39 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/4033929350' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-09T06:43:39.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:39 smithi106 ceph-mon[81208]: pgmap v290: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:39.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:39 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/4033929350' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-05-09T06:43:39.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 30 2024-05-09T06:43:39.987 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.563+0000 7fa6ba008700 1 -- 172.21.15.46:0/972791054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 msgr2=0x7fa6b41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.563+0000 7fa6ba008700 1 --2- 172.21.15.46:0/972791054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b41031b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4004940 tx=0x7fa6a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 -- 172.21.15.46:0/972791054 shutdown_connections 2024-05-09T06:43:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 --2- 172.21.15.46:0/972791054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6b4103780 0x7fa6b40fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:41.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 --2- 172.21.15.46:0/972791054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b41031b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:41.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 -- 172.21.15.46:0/972791054 >> 172.21.15.46:0/972791054 conn(0x7fa6b40f8990 msgr2=0x7fa6b40fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:41.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 -- 172.21.15.46:0/972791054 shutdown_connections 2024-05-09T06:43:41.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 -- 172.21.15.46:0/972791054 wait complete. 2024-05-09T06:43:41.545 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:41 smithi046 ceph-mon[110713]: pgmap v291: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 Processor -- start 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.564+0000 7fa6ba008700 1 -- start start 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6ba008700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6ba008700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6b4103780 0x7fa6b40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6ba008700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4072160 con 0x7fa6b4102de0 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6ba008700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4070ce0 con 0x7fa6b4103780 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b4070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58634/0 (socket says 172.21.15.46:58634) 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 -- 172.21.15.46:0/2689688991 learned_addr learned my addr 172.21.15.46:0/2689688991 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6aaffd700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6b4103780 0x7fa6b40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 -- 172.21.15.46:0/2689688991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6b4103780 msgr2=0x7fa6b40707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6b4103780 0x7fa6b40707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 -- 172.21.15.46:0/2689688991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a4005040 con 0x7fa6b4102de0 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.565+0000 7fa6b37fe700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b4070260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b3b0 tx=0x7fa6a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:41.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.566+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a400e040 con 0x7fa6b4102de0 2024-05-09T06:43:41.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.566+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b4070f60 con 0x7fa6b4102de0 2024-05-09T06:43:41.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.566+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6a4013420 con 0x7fa6b4102de0 2024-05-09T06:43:41.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.566+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a401c630 con 0x7fa6b4102de0 2024-05-09T06:43:41.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.566+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b411a110 con 0x7fa6b4102de0 2024-05-09T06:43:41.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.567+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b41000f0 con 0x7fa6b4102de0 2024-05-09T06:43:41.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.567+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fa6a4013590 con 0x7fa6b4102de0 2024-05-09T06:43:41.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.568+0000 7fa6b0ff9700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6a0078990 0x7fa6a007ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:41.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.568+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa6a409b870 con 0x7fa6b4102de0 2024-05-09T06:43:41.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.568+0000 7fa6aaffd700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6a0078990 0x7fa6a007ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:41.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.569+0000 7fa6aaffd700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6a0078990 0x7fa6a007ae40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4071940 tx=0x7fa69c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:41.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.573+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fa6a4063550 con 0x7fa6b4102de0 2024-05-09T06:43:41.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:41 smithi106 ceph-mon[81208]: pgmap v291: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.835+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fa6b40717b0 con 0x7fa6b4102de0 2024-05-09T06:43:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.835+0000 7fa6b0ff9700 1 -- 172.21.15.46:0/2689688991 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+4271 (secure 0 0 0) 0x7fa6a4062ef0 con 0x7fa6b4102de0 2024-05-09T06:43:41.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi046.easboa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:48.420665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6a0078990 msgr2=0x7fa6a007ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6a0078990 0x7fa6a007ae40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4071940 tx=0x7fa69c00b040 comp rx=0 tx=0).stop 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 msgr2=0x7fa6b4070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b4070260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b3b0 tx=0x7fa6a4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 shutdown_connections 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fa6a0078990 0x7fa6a007ae40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6b4102de0 0x7fa6b4070260 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:41.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 --2- 172.21.15.46:0/2689688991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6b4103780 0x7fa6b40707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 >> 172.21.15.46:0/2689688991 conn(0x7fa6b40f8990 msgr2=0x7fa6b4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 shutdown_connections 2024-05-09T06:43:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:41.838+0000 7fa6ba008700 1 -- 172.21.15.46:0/2689688991 wait complete. 2024-05-09T06:43:41.819 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2024-05-09T06:43:42.464 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:42 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/2689688991' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-09T06:43:42.464 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:42 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:42.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 31 2024-05-09T06:43:42.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:42 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/2689688991' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-05-09T06:43:42.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:42 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:42.760 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:43.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:43 smithi106 ceph-mon[81208]: pgmap v292: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:43.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:43 smithi046 ceph-mon[110713]: pgmap v292: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.459+0000 7fb083bcd700 1 -- 172.21.15.46:0/1510600964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c1026b0 msgr2=0x7fb07c0fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.459+0000 7fb083bcd700 1 --2- 172.21.15.46:0/1510600964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c1026b0 0x7fb07c0fbd20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb070004940 tx=0x7fb070009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.459+0000 7fb083bcd700 1 -- 172.21.15.46:0/1510600964 shutdown_connections 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.459+0000 7fb083bcd700 1 --2- 172.21.15.46:0/1510600964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c1026b0 0x7fb07c0fbd20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.459+0000 7fb083bcd700 1 --2- 172.21.15.46:0/1510600964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb07c101d10 0x7fb07c1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.459+0000 7fb083bcd700 1 -- 172.21.15.46:0/1510600964 >> 172.21.15.46:0/1510600964 conn(0x7fb07c0f7860 msgr2=0x7fb07c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:44.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 -- 172.21.15.46:0/1510600964 shutdown_connections 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 -- 172.21.15.46:0/1510600964 wait complete. 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 Processor -- start 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 -- start start 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 0x7fb07c0fd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb07c1026b0 0x7fb07c0fded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ff8e0 con 0x7fb07c101d10 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb083bcd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0fe410 con 0x7fb07c1026b0 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.460+0000 7fb081969700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 0x7fb07c0fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081969700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 0x7fb07c0fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58654/0 (socket says 172.21.15.46:58654) 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081969700 1 -- 172.21.15.46:0/3243824604 learned_addr learned my addr 172.21.15.46:0/3243824604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081168700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb07c1026b0 0x7fb07c0fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081969700 1 -- 172.21.15.46:0/3243824604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb07c1026b0 msgr2=0x7fb07c0fded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081969700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb07c1026b0 0x7fb07c0fded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081969700 1 -- 172.21.15.46:0/3243824604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070005040 con 0x7fb07c101d10 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb081969700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 0x7fb07c0fd990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c8c0 tx=0x7fb06c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c00a980 con 0x7fb07c101d10 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb06c00ce60 con 0x7fb07c101d10 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0fe6f0 con 0x7fb07c101d10 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c0115e0 con 0x7fb07c101d10 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.461+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c11a120 con 0x7fb07c101d10 2024-05-09T06:43:44.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.462+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0fd460 con 0x7fb07c101d10 2024-05-09T06:43:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.463+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7fb06c012400 con 0x7fb07c101d10 2024-05-09T06:43:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.463+0000 7fb07a7fc700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb064078990 0x7fb06407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.463+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb06c09a930 con 0x7fb07c101d10 2024-05-09T06:43:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.464+0000 7fb081168700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb064078990 0x7fb06407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:44.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.464+0000 7fb081168700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb064078990 0x7fb06407ae40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b3b0 tx=0x7fb070009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.468+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7fb06c0624d0 con 0x7fb07c101d10 2024-05-09T06:43:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.729+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fb07c04c710 con 0x7fb07c101d10 2024-05-09T06:43:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.730+0000 7fb07a7fc700 1 -- 172.21.15.46:0/3243824604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4350 (secure 0 0 0) 0x7fb06c0126b0 con 0x7fb07c101d10 2024-05-09T06:43:44.710 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:48.425824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi046.easboa","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb064078990 msgr2=0x7fb06407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb064078990 0x7fb06407ae40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b3b0 tx=0x7fb070009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 msgr2=0x7fb07c0fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 0x7fb07c0fd990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c8c0 tx=0x7fb06c0044c0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 shutdown_connections 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7fb064078990 0x7fb06407ae40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb07c101d10 0x7fb07c0fd990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 --2- 172.21.15.46:0/3243824604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb07c1026b0 0x7fb07c0fded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 >> 172.21.15.46:0/3243824604 conn(0x7fb07c0f7860 msgr2=0x7fb07c066270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 shutdown_connections 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:44.732+0000 7fb083bcd700 1 -- 172.21.15.46:0/3243824604 wait complete. 2024-05-09T06:43:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-05-09T06:43:45.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 32 2024-05-09T06:43:45.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:45 smithi106 ceph-mon[81208]: pgmap v293: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:45.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:45 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3243824604' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-09T06:43:45.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:45 smithi046 ceph-mon[110713]: pgmap v293: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:45.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:45 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3243824604' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-05-09T06:43:45.612 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.254+0000 7ff9e5753700 1 -- 172.21.15.46:0/2741486596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 msgr2=0x7ff9e00fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.254+0000 7ff9e5753700 1 --2- 172.21.15.46:0/2741486596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e00fc1b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4004940 tx=0x7ff9d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:47.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.254+0000 7ff9e5753700 1 -- 172.21.15.46:0/2741486596 shutdown_connections 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.254+0000 7ff9e5753700 1 --2- 172.21.15.46:0/2741486596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e00fc1b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.254+0000 7ff9e5753700 1 --2- 172.21.15.46:0/2741486596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9e0101d90 0x7ff9e0102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.254+0000 7ff9e5753700 1 -- 172.21.15.46:0/2741486596 >> 172.21.15.46:0/2741486596 conn(0x7ff9e0071d00 msgr2=0x7ff9e0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.255+0000 7ff9e5753700 1 -- 172.21.15.46:0/2741486596 shutdown_connections 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.255+0000 7ff9e5753700 1 -- 172.21.15.46:0/2741486596 wait complete. 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.255+0000 7ff9e5753700 1 Processor -- start 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.255+0000 7ff9e5753700 1 -- start start 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9e5753700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e0102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9e5753700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9e0101d90 0x7ff9e0103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9e5753700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0103610 con 0x7ff9e00fbd40 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9e5753700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0103780 con 0x7ff9e0101d90 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e0102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e0102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58662/0 (socket says 172.21.15.46:58662) 2024-05-09T06:43:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 -- 172.21.15.46:0/279844950 learned_addr learned my addr 172.21.15.46:0/279844950 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9de7fc700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9e0101d90 0x7ff9e0103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 -- 172.21.15.46:0/279844950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9e0101d90 msgr2=0x7ff9e0103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9e0101d90 0x7ff9e0103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 -- 172.21.15.46:0/279844950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4005040 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9deffd700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e0102b20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0002a50 tx=0x7ff9d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9d0007cc0 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9d000f040 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e0119eb0 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.256+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9d000da30 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.257+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e011a310 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.257+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e00fd430 con 0x7ff9e00fbd40 2024-05-09T06:43:47.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.258+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7ff9d000db90 con 0x7ff9e00fbd40 2024-05-09T06:43:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.259+0000 7ff9c77fe700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff9c8078990 0x7ff9c807ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.259+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff9d009a540 con 0x7ff9e00fbd40 2024-05-09T06:43:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.259+0000 7ff9de7fc700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff9c8078990 0x7ff9c807ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.259+0000 7ff9de7fc700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff9c8078990 0x7ff9c807ae40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0104460 tx=0x7ff9d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.264+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7ff9d0062100 con 0x7ff9e00fbd40 2024-05-09T06:43:47.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.525+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7ff9e005f5c0 con 0x7ff9e00fbd40 2024-05-09T06:43:47.505 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:47 smithi046 ceph-mon[110713]: pgmap v294: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:47.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.526+0000 7ff9c77fe700 1 -- 172.21.15.46:0/279844950 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+4354 (secure 0 0 0) 0x7ff9d0061aa0 con 0x7ff9e00fbd40 2024-05-09T06:43:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:47.506 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:57.109538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi046.easboa","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff9c8078990 msgr2=0x7ff9c807ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff9c8078990 0x7ff9c807ae40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0104460 tx=0x7ff9d4009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 msgr2=0x7ff9e0102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e0102b20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0002a50 tx=0x7ff9d00046b0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 shutdown_connections 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7ff9c8078990 0x7ff9c807ae40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e00fbd40 0x7ff9e0102b20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 --2- 172.21.15.46:0/279844950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9e0101d90 0x7ff9e0103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 >> 172.21.15.46:0/279844950 conn(0x7ff9e0071d00 msgr2=0x7ff9e0065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 shutdown_connections 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:47.528+0000 7ff9e5753700 1 -- 172.21.15.46:0/279844950 wait complete. 2024-05-09T06:43:47.509 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 32 2024-05-09T06:43:47.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:47 smithi106 ceph-mon[81208]: pgmap v294: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:48.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 33 2024-05-09T06:43:48.391 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:48.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:48 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/279844950' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-05-09T06:43:48.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:48 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/279844950' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-05-09T06:43:49.532 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:49 smithi046 ceph-mon[110713]: pgmap v295: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:49.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:49 smithi106 ceph-mon[81208]: pgmap v295: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:50.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 -- 172.21.15.46:0/3533210566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c101d90 msgr2=0x7f817c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:50.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 --2- 172.21.15.46:0/3533210566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c101d90 0x7f817c102160 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f816c004940 tx=0x7f816c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:50.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 -- 172.21.15.46:0/3533210566 shutdown_connections 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 --2- 172.21.15.46:0/3533210566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c0fbd40 0x7f817c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 --2- 172.21.15.46:0/3533210566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c101d90 0x7f817c102160 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 -- 172.21.15.46:0/3533210566 >> 172.21.15.46:0/3533210566 conn(0x7f817c071d00 msgr2=0x7f817c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 -- 172.21.15.46:0/3533210566 shutdown_connections 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.060+0000 7f8182496700 1 -- 172.21.15.46:0/3533210566 wait complete. 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f8182496700 1 Processor -- start 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f8182496700 1 -- start start 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f8182496700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 0x7f817c113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f8182496700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c101d90 0x7f817c114150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f8182496700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c1147a0 con 0x7f817c0fbd40 2024-05-09T06:43:50.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f8182496700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c10db90 con 0x7f817c101d90 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f817bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 0x7f817c113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f817bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 0x7f817c113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58666/0 (socket says 172.21.15.46:58666) 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f817bfff700 1 -- 172.21.15.46:0/3327037338 learned_addr learned my addr 172.21.15.46:0/3327037338 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.061+0000 7f817b7fe700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c101d90 0x7f817c114150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f817bfff700 1 -- 172.21.15.46:0/3327037338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c101d90 msgr2=0x7f817c114150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f817bfff700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c101d90 0x7f817c114150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f817bfff700 1 -- 172.21.15.46:0/3327037338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c005040 con 0x7f817c0fbd40 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f817bfff700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 0x7f817c113c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f816c009180 tx=0x7f816c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c00e040 con 0x7f817c0fbd40 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c10de10 con 0x7f817c0fbd40 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816c00bbc0 con 0x7f817c0fbd40 2024-05-09T06:43:50.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c01c3f0 con 0x7f817c0fbd40 2024-05-09T06:43:50.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.062+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c10e350 con 0x7f817c0fbd40 2024-05-09T06:43:50.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.063+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c0fd430 con 0x7f817c0fbd40 2024-05-09T06:43:50.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.064+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f816c00bd30 con 0x7f817c0fbd40 2024-05-09T06:43:50.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.064+0000 7f8178ff9700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8164078980 0x7f816407ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:50.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.064+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f816c09ba90 con 0x7f817c0fbd40 2024-05-09T06:43:50.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.064+0000 7f817b7fe700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8164078980 0x7f816407ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:50.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.065+0000 7f817b7fe700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8164078980 0x7f816407ae30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f817c10f440 tx=0x7f8170009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:50.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.069+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f816c063630 con 0x7f817c0fbd40 2024-05-09T06:43:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.332+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f817c04bed0 con 0x7f817c0fbd40 2024-05-09T06:43:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.333+0000 7f8178ff9700 1 -- 172.21.15.46:0/3327037338 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+4351 (secure 0 0 0) 0x7f816c062fd0 con 0x7f817c0fbd40 2024-05-09T06:43:50.313 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:50.313 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:57.392884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi046.easboa","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T06:43:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8164078980 msgr2=0x7f816407ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8164078980 0x7f816407ae30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f817c10f440 tx=0x7f8170009040 comp rx=0 tx=0).stop 2024-05-09T06:43:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 msgr2=0x7f817c113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 0x7f817c113c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f816c009180 tx=0x7f816c009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 shutdown_connections 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8164078980 0x7f816407ae30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f817c0fbd40 0x7f817c113c10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 --2- 172.21.15.46:0/3327037338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c101d90 0x7f817c114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 >> 172.21.15.46:0/3327037338 conn(0x7f817c071d00 msgr2=0x7f817c0655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 shutdown_connections 2024-05-09T06:43:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:50.335+0000 7f8182496700 1 -- 172.21.15.46:0/3327037338 wait complete. 2024-05-09T06:43:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 33 2024-05-09T06:43:50.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 34 2024-05-09T06:43:51.224 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:51.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:51 smithi046 ceph-mon[110713]: pgmap v296: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:51.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:51 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3327037338' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-05-09T06:43:51.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:51 smithi106 ceph-mon[81208]: pgmap v296: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:51.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:51 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3327037338' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/757220647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 msgr2=0x7f9f84065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/757220647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f84065ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004940 tx=0x7f9f74009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/757220647 shutdown_connections 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/757220647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f84065ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/757220647 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f84102e50 0x7f9f84103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/757220647 >> 172.21.15.46:0/757220647 conn(0x7f9f84071d00 msgr2=0x7f9f84072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/757220647 shutdown_connections 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/757220647 wait complete. 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 Processor -- start 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- start start 2024-05-09T06:43:52.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f840fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f84102e50 0x7f9f840fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840fc880 con 0x7f9f84065640 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.748+0000 7f9f8b9b9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840fc9c0 con 0x7f9f84102e50 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f840fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f840fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37940/0 (socket says 172.21.15.46:37940) 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 -- 172.21.15.46:0/758503620 learned_addr learned my addr 172.21.15.46:0/758503620 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f88f54700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f84102e50 0x7f9f840fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 -- 172.21.15.46:0/758503620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f84102e50 msgr2=0x7f9f840fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f84102e50 0x7f9f840fc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 -- 172.21.15.46:0/758503620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f74005040 con 0x7f9f84065640 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f89755700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f840fbdb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c8c0 tx=0x7f9f800044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8000a980 con 0x7f9f84065640 2024-05-09T06:43:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f8000ce60 con 0x7f9f84065640 2024-05-09T06:43:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84119e70 con 0x7f9f84065640 2024-05-09T06:43:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.749+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f800115e0 con 0x7f9f84065640 2024-05-09T06:43:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.750+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8411a2f0 con 0x7f9f84065640 2024-05-09T06:43:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.750+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f84100100 con 0x7f9f84065640 2024-05-09T06:43:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.751+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f9f80012400 con 0x7f9f84065640 2024-05-09T06:43:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.752+0000 7f9f79ffb700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9f70078980 0x7f9f7007ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.752+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9f8009a7e0 con 0x7f9f84065640 2024-05-09T06:43:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.752+0000 7f9f88f54700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9f70078980 0x7f9f7007ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.752+0000 7f9f88f54700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9f70078980 0x7f9f7007ae30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f840fd6f0 tx=0x7f9f74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:52.757+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f9f800624c0 con 0x7f9f84065640 2024-05-09T06:43:52.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.018+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f9f840fe540 con 0x7f9f84065640 2024-05-09T06:43:52.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.019+0000 7f9f79ffb700 1 -- 172.21.15.46:0/758503620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+4360 (secure 0 0 0) 0x7f9f800126b0 con 0x7f9f84065640 2024-05-09T06:43:52.999 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:52.999 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:59.389800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi046.easboa","rank":0,"incarnation":31,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34372,"qdb_cluster":[34372]},"id":1}]} 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.021+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9f70078980 msgr2=0x7f9f7007ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.021+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9f70078980 0x7f9f7007ae30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9f840fd6f0 tx=0x7f9f74009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.021+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 msgr2=0x7f9f840fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.021+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f840fbdb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c8c0 tx=0x7f9f800044c0 comp rx=0 tx=0).stop 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 shutdown_connections 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f9f70078980 0x7f9f7007ae30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f84065640 0x7f9f840fbdb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 --2- 172.21.15.46:0/758503620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f84102e50 0x7f9f840fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 >> 172.21.15.46:0/758503620 conn(0x7f9f84071d00 msgr2=0x7f9f840fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:53.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 shutdown_connections 2024-05-09T06:43:53.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:53.022+0000 7f9f8b9b9700 1 -- 172.21.15.46:0/758503620 wait complete. 2024-05-09T06:43:53.003 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 34 2024-05-09T06:43:53.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:53 smithi106 ceph-mon[81208]: pgmap v297: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:53.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:53 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/758503620' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-05-09T06:43:53.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:53 smithi046 ceph-mon[110713]: pgmap v297: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:53.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:53 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/758503620' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-05-09T06:43:53.712 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 35 2024-05-09T06:43:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:55.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:55 smithi046 ceph-mon[110713]: pgmap v298: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:55.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:55 smithi106 ceph-mon[81208]: pgmap v298: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 -- 172.21.15.46:0/277768210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 msgr2=0x7f27c00fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 --2- 172.21.15.46:0/277768210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c00fcdf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f27b0004940 tx=0x7f27b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 -- 172.21.15.46:0/277768210 shutdown_connections 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 --2- 172.21.15.46:0/277768210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c00fcdf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 --2- 172.21.15.46:0/277768210 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c0102de0 0x7f27c01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 -- 172.21.15.46:0/277768210 >> 172.21.15.46:0/277768210 conn(0x7f27c00f8990 msgr2=0x7f27c00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 -- 172.21.15.46:0/277768210 shutdown_connections 2024-05-09T06:43:55.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.614+0000 7f27c7c19700 1 -- 172.21.15.46:0/277768210 wait complete. 2024-05-09T06:43:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c7c19700 1 Processor -- start 2024-05-09T06:43:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c7c19700 1 -- start start 2024-05-09T06:43:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c7c19700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c0102de0 0x7f27c0113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c7c19700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c0113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c7c19700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01144e0 con 0x7f27c0103780 2024-05-09T06:43:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c7c19700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c010dae0 con 0x7f27c0102de0 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c51b4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c0113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c51b4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c0113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37956/0 (socket says 172.21.15.46:37956) 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c51b4700 1 -- 172.21.15.46:0/1754684854 learned_addr learned my addr 172.21.15.46:0/1754684854 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c59b5700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c0102de0 0x7f27c0113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c51b4700 1 -- 172.21.15.46:0/1754684854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c0102de0 msgr2=0x7f27c0113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c51b4700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c0102de0 0x7f27c0113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.615+0000 7f27c51b4700 1 -- 172.21.15.46:0/1754684854 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0005040 con 0x7f27c0103780 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.616+0000 7f27c51b4700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c0113e90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009180 tx=0x7f27b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.616+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b000e040 con 0x7f27c0103780 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.616+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27b000bbc0 con 0x7f27c0103780 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.616+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c010dd60 con 0x7f27c0103780 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.616+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b001c3f0 con 0x7f27c0103780 2024-05-09T06:43:55.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.616+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c010e320 con 0x7f27c0103780 2024-05-09T06:43:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.617+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00fe530 con 0x7f27c0103780 2024-05-09T06:43:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.617+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f27b000bd30 con 0x7f27c0103780 2024-05-09T06:43:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.618+0000 7f27b67fc700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f27ac078990 0x7f27ac07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.618+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f27b009b9b0 con 0x7f27c0103780 2024-05-09T06:43:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.618+0000 7f27c59b5700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f27ac078990 0x7f27ac07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.619+0000 7f27c59b5700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f27ac078990 0x7f27ac07ae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27bc007fd0 tx=0x7f27bc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:55.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.623+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f27b0063690 con 0x7f27c0103780 2024-05-09T06:43:55.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.886+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f27c004c710 con 0x7f27c0103780 2024-05-09T06:43:55.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.887+0000 7f27b67fc700 1 -- 172.21.15.46:0/1754684854 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5210 (secure 0 0 0) 0x7f27b0063030 con 0x7f27c0103780 2024-05-09T06:43:55.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-09T06:43:55.867 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi046.pkuwsr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1650120770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1650120770},{"type":"v1","addr":"172.21.15.46:6829","nonce":1650120770}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi106.fqgqkm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6825/958476339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":958476339},{"type":"v1","addr":"172.21.15.106:6825","nonce":958476339}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44317,"name":"cephfs.smithi106.ugnujp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6827/2800643990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2800643990},{"type":"v1","addr":"172.21.15.106:6827","nonce":2800643990}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T06:27:29.142337+0000","modified":"2024-05-09T06:40:59.389800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi046.easboa","rank":0,"incarnation":31,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6827/2862387261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2862387261},{"type":"v1","addr":"172.21.15.46:6827","nonce":2862387261}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34372,"qdb_cluster":[34372]},"id":1}]} 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f27ac078990 msgr2=0x7f27ac07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f27ac078990 0x7f27ac07ae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27bc007fd0 tx=0x7f27bc009040 comp rx=0 tx=0).stop 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 msgr2=0x7f27c0113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c0113e90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009180 tx=0x7f27b0009e30 comp rx=0 tx=0).stop 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 shutdown_connections 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f27ac078990 0x7f27ac07ae40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c0102de0 0x7f27c0113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 --2- 172.21.15.46:0/1754684854 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c0103780 0x7f27c0113e90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 >> 172.21.15.46:0/1754684854 conn(0x7f27c00f8990 msgr2=0x7f27c00f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 shutdown_connections 2024-05-09T06:43:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:55.890+0000 7f27c7c19700 1 -- 172.21.15.46:0/1754684854 wait complete. 2024-05-09T06:43:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 35 2024-05-09T06:43:56.485 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:56 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/1754684854' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-05-09T06:43:56.514 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T06:43:56.526 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T06:43:56.526 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:43:56.526 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:56.546 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-09T06:43:56.546 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:56.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:56 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/1754684854' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-05-09T06:43:56.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-09T06:43:56.918 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:43:57.571 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:57 smithi106 ceph-mon[81208]: pgmap v299: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:57.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:57 smithi106 ceph-mon[81208]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:57.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:57 smithi046 ceph-mon[110713]: pgmap v299: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:57.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:57 smithi046 ceph-mon[110713]: from='mgr.34104 172.21.15.46:0/2323947801' entity='mgr.smithi046.nvpcui' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 -- 172.21.15.46:0/462716984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fdde0 msgr2=0x7f8a880fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/462716984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fdde0 0x7f8a880fe1b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009ce0 tx=0x7f8a80004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 -- 172.21.15.46:0/462716984 shutdown_connections 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/462716984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a880fe780 0x7f8a88106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/462716984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fdde0 0x7f8a880fe1b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 -- 172.21.15.46:0/462716984 >> 172.21.15.46:0/462716984 conn(0x7f8a880f7890 msgr2=0x7f8a880f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 -- 172.21.15.46:0/462716984 shutdown_connections 2024-05-09T06:43:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.579+0000 7f8a8cf94700 1 -- 172.21.15.46:0/462716984 wait complete. 2024-05-09T06:43:58.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.580+0000 7f8a8cf94700 1 Processor -- start 2024-05-09T06:43:58.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.580+0000 7f8a8cf94700 1 -- start start 2024-05-09T06:43:58.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.580+0000 7f8a8cf94700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a880fdde0 0x7f8a88113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:58.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.580+0000 7f8a8cf94700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 0x7f8a881140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:58.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.580+0000 7f8a8cf94700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88114730 con 0x7f8a880fe780 2024-05-09T06:43:58.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.580+0000 7f8a8cf94700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8810db40 con 0x7f8a880fdde0 2024-05-09T06:43:58.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 0x7f8a881140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 0x7f8a881140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37972/0 (socket says 172.21.15.46:37972) 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 -- 172.21.15.46:0/3938732593 learned_addr learned my addr 172.21.15.46:0/3938732593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a8659c700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a880fdde0 0x7f8a88113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 -- 172.21.15.46:0/3938732593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a880fdde0 msgr2=0x7f8a88113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a880fdde0 0x7f8a88113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 -- 172.21.15.46:0/3938732593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80009940 con 0x7f8a880fe780 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a85d9b700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 0x7f8a881140e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c830 tx=0x7f8a70004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a700106f0 con 0x7f8a880fe780 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a70010d20 con 0x7f8a880fe780 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a700113a0 con 0x7f8a880fe780 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8810de20 con 0x7f8a880fe780 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.581+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8810e360 con 0x7f8a880fe780 2024-05-09T06:43:58.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.582+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a88066750 con 0x7f8a880fe780 2024-05-09T06:43:58.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.583+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f8a70012400 con 0x7f8a880fe780 2024-05-09T06:43:58.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.583+0000 7f8a7effd700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8a74078990 0x7f8a7407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:43:58.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.584+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8a7009a650 con 0x7f8a880fe780 2024-05-09T06:43:58.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.584+0000 7f8a8659c700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8a74078990 0x7f8a7407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:43:58.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.584+0000 7f8a8659c700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8a74078990 0x7f8a7407ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000b740 tx=0x7f8a80004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:43:58.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.588+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f8a70062330 con 0x7f8a880fe780 2024-05-09T06:43:58.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.819+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8a88109e70 con 0x7f8a880fe780 2024-05-09T06:43:58.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.819+0000 7f8a7effd700 1 -- 172.21.15.46:0/3938732593 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2438 (secure 0 0 0) 0x7f8a70061cd0 con 0x7f8a880fe780 2024-05-09T06:43:58.799 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6826/3262788331 2024-05-10T06:40:48.420408+0000 2024-05-09T06:43:58.799 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6824/2740455125 2024-05-10T06:40:23.286732+0000 2024-05-09T06:43:58.799 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6829/3210268761 2024-05-10T06:40:01.313928+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/490258124 2024-05-10T06:31:24.299817+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2842453392 2024-05-10T06:22:53.905250+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6827/3262788331 2024-05-10T06:40:48.420408+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3033779286 2024-05-10T06:21:35.084540+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2477328679 2024-05-10T06:35:12.092246+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2173261387 2024-05-10T06:22:53.905250+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6826/1263102272 2024-05-10T06:27:44.999075+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6825/2740455125 2024-05-10T06:40:23.286732+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/80466412 2024-05-10T06:35:12.092246+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/330461321 2024-05-10T06:29:51.942040+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3787163390 2024-05-10T06:21:04.123650+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2477328679 2024-05-10T06:35:12.092246+0000 2024-05-09T06:43:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6828/2678165061 2024-05-10T06:31:24.299817+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1959473186 2024-05-10T06:29:51.942040+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/394354124 2024-05-10T06:29:51.942040+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6827/1263102272 2024-05-10T06:27:44.999075+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3533277949 2024-05-10T06:29:51.942040+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/2131434767 2024-05-10T06:31:24.299817+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/544704645 2024-05-10T06:21:04.123650+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/394354124 2024-05-10T06:29:51.942040+0000 2024-05-09T06:43:58.801 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3381519426 2024-05-10T06:21:35.084540+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3381519426 2024-05-10T06:21:35.084540+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2668707255 2024-05-10T06:21:35.084540+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4009844881 2024-05-10T06:29:51.942040+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/2844326337 2024-05-10T06:31:24.299817+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/544704645 2024-05-10T06:21:04.123650+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3104818907 2024-05-10T06:21:35.084540+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/916656529 2024-05-10T06:22:53.905250+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6829/2678165061 2024-05-10T06:31:24.299817+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2570824935 2024-05-10T06:22:53.905250+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2570824935 2024-05-10T06:22:53.905250+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4203444221 2024-05-10T06:21:04.123650+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/1691381999 2024-05-10T06:31:24.299817+0000 2024-05-09T06:43:58.802 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3880060004 2024-05-10T06:35:12.092246+0000 2024-05-09T06:43:58.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/103396073 2024-05-10T06:21:04.123650+0000 2024-05-09T06:43:58.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3047770023 2024-05-10T06:35:12.092246+0000 2024-05-09T06:43:58.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1621340638 2024-05-10T06:35:12.092246+0000 2024-05-09T06:43:58.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6828/3210268761 2024-05-10T06:40:01.313928+0000 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.821+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8a74078990 msgr2=0x7f8a7407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.821+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8a74078990 0x7f8a7407ae40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000b740 tx=0x7f8a80004d10 comp rx=0 tx=0).stop 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.821+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 msgr2=0x7f8a881140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.821+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 0x7f8a881140e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c830 tx=0x7f8a70004470 comp rx=0 tx=0).stop 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 shutdown_connections 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f8a74078990 0x7f8a7407ae40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a880fdde0 0x7f8a88113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 --2- 172.21.15.46:0/3938732593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a880fe780 0x7f8a881140e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 >> 172.21.15.46:0/3938732593 conn(0x7f8a880f7890 msgr2=0x7f8a880f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 shutdown_connections 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:43:58.822+0000 7f8a8cf94700 1 -- 172.21.15.46:0/3938732593 wait complete. 2024-05-09T06:43:58.804 INFO:teuthology.orchestra.run.smithi046.stderr:listed 41 entries 2024-05-09T06:43:59.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:59 smithi046 ceph-mon[110713]: pgmap v300: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:59.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:43:59 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3938732593' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:43:59.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T06:43:59.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:59.449 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T06:43:59.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:43:59.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:43:59.483 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T06:43:59.550 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:43:59.550 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:59.571 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-09T06:43:59.571 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:43:59.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:59 smithi106 ceph-mon[81208]: pgmap v300: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:43:59.572 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:43:59 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3938732593' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:43:59.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-09T06:43:59.908 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/mon.smithi046/config 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 -- 172.21.15.46:0/933169379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4102e50 msgr2=0x7f55f4103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 --2- 172.21.15.46:0/933169379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4102e50 0x7f55f4103220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55e8004940 tx=0x7f55e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 -- 172.21.15.46:0/933169379 shutdown_connections 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 --2- 172.21.15.46:0/933169379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4065640 0x7f55f4065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 --2- 172.21.15.46:0/933169379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4102e50 0x7f55f4103220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 -- 172.21.15.46:0/933169379 >> 172.21.15.46:0/933169379 conn(0x7f55f4071d00 msgr2=0x7f55f4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 -- 172.21.15.46:0/933169379 shutdown_connections 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.544+0000 7f55faa6a700 1 -- 172.21.15.46:0/933169379 wait complete. 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55faa6a700 1 Processor -- start 2024-05-09T06:44:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55faa6a700 1 -- start start 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55faa6a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 0x7f55f4113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55faa6a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4102e50 0x7f55f41140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55faa6a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f4114710 con 0x7f55f4065640 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55faa6a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f410db00 con 0x7f55f4102e50 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55f8806700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 0x7f55f4113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55f8806700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 0x7f55f4113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40618/0 (socket says 172.21.15.46:40618) 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55f8806700 1 -- 172.21.15.46:0/3657936816 learned_addr learned my addr 172.21.15.46:0/3657936816 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.545+0000 7f55f3fff700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4102e50 0x7f55f41140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f8806700 1 -- 172.21.15.46:0/3657936816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4102e50 msgr2=0x7f55f41140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f8806700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4102e50 0x7f55f41140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f8806700 1 -- 172.21.15.46:0/3657936816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8005040 con 0x7f55f4065640 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f3fff700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4102e50 0x7f55f41140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f8806700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 0x7f55f4113b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55e800b3b0 tx=0x7f55e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:44:01.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e800e040 con 0x7f55f4065640 2024-05-09T06:44:01.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55e800bbc0 con 0x7f55f4065640 2024-05-09T06:44:01.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f410dd80 con 0x7f55f4065640 2024-05-09T06:44:01.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e801c3f0 con 0x7f55f4065640 2024-05-09T06:44:01.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.546+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f410e340 con 0x7f55f4065640 2024-05-09T06:44:01.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.547+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f4100100 con 0x7f55f4065640 2024-05-09T06:44:01.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.548+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 40) v1 ==== 100080+0+0 (secure 0 0 0) 0x7f55e800bd30 con 0x7f55f4065640 2024-05-09T06:44:01.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.548+0000 7f55f17fa700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f55e4078990 0x7f55e407ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:44:01.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.548+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f55e809ba00 con 0x7f55f4065640 2024-05-09T06:44:01.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.548+0000 7f55f3fff700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f55e4078990 0x7f55e407ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:44:01.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.549+0000 7f55f3fff700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f55e4078990 0x7f55e407ae40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009fd0 tx=0x7f55e0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:44:01.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.553+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+191963 (secure 0 0 0) 0x7f55e80635c0 con 0x7f55f4065640 2024-05-09T06:44:01.532 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:01 smithi046 ceph-mon[110713]: pgmap v301: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:44:01.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.784+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55f4100100 con 0x7f55f4065640 2024-05-09T06:44:01.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.784+0000 7f55f17fa700 1 -- 172.21.15.46:0/3657936816 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2438 (secure 0 0 0) 0x7f55e8062f60 con 0x7f55f4065640 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6826/3262788331 2024-05-10T06:40:48.420408+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6824/2740455125 2024-05-10T06:40:23.286732+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6829/3210268761 2024-05-10T06:40:01.313928+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/490258124 2024-05-10T06:31:24.299817+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2842453392 2024-05-10T06:22:53.905250+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6827/3262788331 2024-05-10T06:40:48.420408+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3033779286 2024-05-10T06:21:35.084540+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2477328679 2024-05-10T06:35:12.092246+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2173261387 2024-05-10T06:22:53.905250+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6826/1263102272 2024-05-10T06:27:44.999075+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6825/2740455125 2024-05-10T06:40:23.286732+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/80466412 2024-05-10T06:35:12.092246+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/330461321 2024-05-10T06:29:51.942040+0000 2024-05-09T06:44:01.764 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3787163390 2024-05-10T06:21:04.123650+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2477328679 2024-05-10T06:35:12.092246+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6828/2678165061 2024-05-10T06:31:24.299817+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1959473186 2024-05-10T06:29:51.942040+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/394354124 2024-05-10T06:29:51.942040+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6827/1263102272 2024-05-10T06:27:44.999075+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3533277949 2024-05-10T06:29:51.942040+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/2131434767 2024-05-10T06:31:24.299817+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/544704645 2024-05-10T06:21:04.123650+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/394354124 2024-05-10T06:29:51.942040+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3381519426 2024-05-10T06:21:35.084540+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3381519426 2024-05-10T06:21:35.084540+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2668707255 2024-05-10T06:21:35.084540+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4009844881 2024-05-10T06:29:51.942040+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/2844326337 2024-05-10T06:31:24.299817+0000 2024-05-09T06:44:01.765 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/544704645 2024-05-10T06:21:04.123650+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3104818907 2024-05-10T06:21:35.084540+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/916656529 2024-05-10T06:22:53.905250+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:6829/2678165061 2024-05-10T06:31:24.299817+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2570824935 2024-05-10T06:22:53.905250+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2570824935 2024-05-10T06:22:53.905250+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4203444221 2024-05-10T06:21:04.123650+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.106:0/1691381999 2024-05-10T06:31:24.299817+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3880060004 2024-05-10T06:35:12.092246+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/103396073 2024-05-10T06:21:04.123650+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3047770023 2024-05-10T06:35:12.092246+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1621340638 2024-05-10T06:35:12.092246+0000 2024-05-09T06:44:01.766 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6828/3210268761 2024-05-10T06:40:01.313928+0000 2024-05-09T06:44:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f55e4078990 msgr2=0x7f55e407ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:44:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f55e4078990 0x7f55e407ae40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009fd0 tx=0x7f55e0009ee0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 msgr2=0x7f55f4113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:44:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 0x7f55f4113b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55e800b3b0 tx=0x7f55e8009e30 comp rx=0 tx=0).stop 2024-05-09T06:44:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 shutdown_connections 2024-05-09T06:44:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:6800/120732432,v1:172.21.15.46:6801/120732432] conn(0x7f55e4078990 0x7f55e407ae40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55f4065640 0x7f55f4113b80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 --2- 172.21.15.46:0/3657936816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f4102e50 0x7f55f41140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:44:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 >> 172.21.15.46:0/3657936816 conn(0x7f55f4071d00 msgr2=0x7f55f40fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:44:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 shutdown_connections 2024-05-09T06:44:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-09T06:44:01.787+0000 7f55faa6a700 1 -- 172.21.15.46:0/3657936816 wait complete. 2024-05-09T06:44:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:listed 41 entries 2024-05-09T06:44:01.821 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:01 smithi106 ceph-mon[81208]: pgmap v301: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail 2024-05-09T06:44:02.397 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:02 smithi046 ceph-mon[110713]: from='client.? 172.21.15.46:0/3657936816' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:44:02.428 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-09T06:44:02.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.428 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-09T06:44:02.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-05-09T06:44:02.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.462 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T06:44:02.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.533 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-05-09T06:44:02.555 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T06:44:02.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T06:44:02.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-05-09T06:44:02.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.725 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-05-09T06:44:02.745 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T06:44:02.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T06:44:02.810 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:02 smithi106 ceph-mon[81208]: from='client.? 172.21.15.46:0/3657936816' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:44:02.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:44:02.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-05-09T06:44:02.907 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-09T06:44:02.918 INFO:tasks.cephadm:Teardown begin 2024-05-09T06:44:02.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:44:02.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:44:02.977 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-09T06:44:02.977 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:44:03.009 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:44:03.033 INFO:tasks.cephadm:Stopping all daemons... 2024-05-09T06:44:03.033 INFO:tasks.cephadm.mon.smithi046:Stopping mon.smithi046... 2024-05-09T06:44:03.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046 2024-05-09T06:44:03.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:03.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 ceph-mon[110713]: pgmap v302: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:44:03.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[110709]: 2024-05-09T06:44:03.386+0000 7f7829bd9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:03.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046[110709]: 2024-05-09T06:44:03.386+0000 7f7829bd9700 -1 mon.smithi046@0(leader) e3 *** Got Signal Terminated *** 2024-05-09T06:44:03.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 podman[153369]: 2024-05-09 06:44:03.447703146 +0000 UTC m=+0.175111387 container died f5a8b8e67820edd9fc9c7f1834774ac51331e5db405d1f26e50fdb7195386fe8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-09T06:44:03.821 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:03 smithi106 ceph-mon[81208]: pgmap v302: 65 pgs: 65 active+clean; 194 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-05-09T06:44:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 podman[153369]: 2024-05-09 06:44:03.830831222 +0000 UTC m=+0.558239463 container cleanup f5a8b8e67820edd9fc9c7f1834774ac51331e5db405d1f26e50fdb7195386fe8 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:May 09 06:44:03 smithi046 bash[153369]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi046 2024-05-09T06:44:04.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi046.service' 2024-05-09T06:44:04.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:04.275 INFO:tasks.cephadm.mon.smithi046:Stopped mon.smithi046 2024-05-09T06:44:04.276 INFO:tasks.cephadm.mon.smithi106:Stopping mon.smithi106... 2024-05-09T06:44:04.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106 2024-05-09T06:44:04.348 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:04 smithi106 systemd[1]: Stopping Ceph mon.smithi106 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:04.821 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:04 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106[81204]: 2024-05-09T06:44:04.589+0000 7faedd832700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi106 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:04.822 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:04 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106[81204]: 2024-05-09T06:44:04.589+0000 7faedd832700 -1 mon.smithi106@1(peon) e3 *** Got Signal Terminated *** 2024-05-09T06:44:05.094 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:04 smithi106 podman[113314]: 2024-05-09 06:44:04.854539822 +0000 UTC m=+0.365979363 container died 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:05.487 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:05 smithi106 podman[113314]: 2024-05-09 06:44:05.290259112 +0000 UTC m=+0.801698656 container cleanup 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9) 2024-05-09T06:44:05.487 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:05 smithi106 bash[113314]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106 2024-05-09T06:44:05.734 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106.service' 2024-05-09T06:44:05.757 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:05 smithi106 podman[113335]: 2024-05-09 06:44:05.508612447 +0000 UTC m=+0.647140708 container remove 4aba5ac7db1745758d8fc9e8688ac246a663356f9b8251e687389a878d9a4381 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-mon-smithi106, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:44:05.757 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:05 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106.service: Deactivated successfully. 2024-05-09T06:44:05.757 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:05 smithi106 systemd[1]: Stopped Ceph mon.smithi106 for 165d9e0a-0dcc-11ef-bc97-c7b262605968. 2024-05-09T06:44:05.757 INFO:journalctl@ceph.mon.smithi106.smithi106.stdout:May 09 06:44:05 smithi106 systemd[1]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@mon.smithi106.service: Consumed 4.721s CPU time. 2024-05-09T06:44:05.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:05.783 INFO:tasks.cephadm.mon.smithi106:Stopped mon.smithi106 2024-05-09T06:44:05.783 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-09T06:44:05.784 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.0 2024-05-09T06:44:06.073 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:05 smithi046 systemd[1]: Stopping Ceph osd.0 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:06.334 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:06 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[122034]: 2024-05-09T06:44:06.094+0000 7f11c865d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:06.334 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:06 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[122034]: 2024-05-09T06:44:06.094+0000 7f11c865d700 -1 osd.0 83 *** Got signal Terminated *** 2024-05-09T06:44:06.334 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:06 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0[122034]: 2024-05-09T06:44:06.094+0000 7f11c865d700 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:11.783 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:11 smithi046 podman[153500]: 2024-05-09 06:44:11.496130082 +0000 UTC m=+5.476829087 container died 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-09T06:44:12.084 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:11 smithi046 podman[153500]: 2024-05-09 06:44:11.902341444 +0000 UTC m=+5.883040449 container cleanup 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-05-09T06:44:12.084 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:11 smithi046 bash[153500]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0 2024-05-09T06:44:12.437 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:12 smithi046 podman[153520]: 2024-05-09 06:44:12.120210407 +0000 UTC m=+0.623741942 container remove 1aaa97258f184cf541d69bf7fb0ea9460a41b79899e4f82f6d925695d6cab119 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:44:12.727 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:12 smithi046 podman[153612]: 2024-05-09 06:44:12.362103637 +0000 UTC m=+0.018995111 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:12.727 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:12 smithi046 podman[153612]: 2024-05-09 06:44:12.462870271 +0000 UTC m=+0.119761741 container create 428b27308be0f7ad62d16b9cb43f4194c9dd2cea10b093971c5bf8873edb297c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-09T06:44:12.727 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:12 smithi046 podman[153612]: 2024-05-09 06:44:12.68269216 +0000 UTC m=+0.339583640 container init 428b27308be0f7ad62d16b9cb43f4194c9dd2cea10b093971c5bf8873edb297c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.license=GPLv2) 2024-05-09T06:44:12.727 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:12 smithi046 podman[153612]: 2024-05-09 06:44:12.686739923 +0000 UTC m=+0.343631402 container start 428b27308be0f7ad62d16b9cb43f4194c9dd2cea10b093971c5bf8873edb297c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T06:44:12.727 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:12 smithi046 podman[153612]: 2024-05-09 06:44:12.748674852 +0000 UTC m=+0.405566352 container attach 428b27308be0f7ad62d16b9cb43f4194c9dd2cea10b093971c5bf8873edb297c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:44:13.281 INFO:journalctl@ceph.osd.0.smithi046.stdout:May 09 06:44:13 smithi046 podman[153612]: 2024-05-09 06:44:13.003823986 +0000 UTC m=+0.660715466 container died 428b27308be0f7ad62d16b9cb43f4194c9dd2cea10b093971c5bf8873edb297c (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-0-deactivate, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:13.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.0.service' 2024-05-09T06:44:13.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:13.665 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-09T06:44:13.665 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-09T06:44:13.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.1 2024-05-09T06:44:14.010 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:13 smithi046 systemd[1]: Stopping Ceph osd.1 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:14.334 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:14 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[127423]: 2024-05-09T06:44:14.030+0000 7f267727a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:14.335 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:14 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[127423]: 2024-05-09T06:44:14.030+0000 7f267727a700 -1 osd.1 83 *** Got signal Terminated *** 2024-05-09T06:44:14.335 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:14 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1[127423]: 2024-05-09T06:44:14.030+0000 7f267727a700 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:19.660 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:19 smithi046 podman[153718]: 2024-05-09 06:44:19.381526093 +0000 UTC m=+5.454959438 container died 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-05-09T06:44:19.935 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:19 smithi046 podman[153718]: 2024-05-09 06:44:19.78017776 +0000 UTC m=+5.853611105 container cleanup 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, RELEASE=main-720f8e9, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T06:44:19.935 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:19 smithi046 bash[153718]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1 2024-05-09T06:44:20.334 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:19 smithi046 podman[153736]: 2024-05-09 06:44:19.956514255 +0000 UTC m=+0.571065928 container remove 1830d355141587b2e4e7e91188237d69e56e4c18d1cb6da6efbd0464625a8e3e (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:20.688 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:20 smithi046 podman[153828]: 2024-05-09 06:44:20.319627457 +0000 UTC m=+0.019116856 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:20.689 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:20 smithi046 podman[153828]: 2024-05-09 06:44:20.432577407 +0000 UTC m=+0.132066824 container create 45376e5e42f3e93e978bb0adf076079b6f6a82404be0a7098a392aae33fca262 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-09T06:44:20.689 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:20 smithi046 podman[153828]: 2024-05-09 06:44:20.635137943 +0000 UTC m=+0.334627320 container init 45376e5e42f3e93e978bb0adf076079b6f6a82404be0a7098a392aae33fca262 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-09T06:44:20.689 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:20 smithi046 podman[153828]: 2024-05-09 06:44:20.638730293 +0000 UTC m=+0.338219667 container start 45376e5e42f3e93e978bb0adf076079b6f6a82404be0a7098a392aae33fca262 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0) 2024-05-09T06:44:20.689 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:20 smithi046 podman[153828]: 2024-05-09 06:44:20.710093882 +0000 UTC m=+0.409583259 container attach 45376e5e42f3e93e978bb0adf076079b6f6a82404be0a7098a392aae33fca262 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T06:44:21.084 INFO:journalctl@ceph.osd.1.smithi046.stdout:May 09 06:44:20 smithi046 podman[153828]: 2024-05-09 06:44:20.946951421 +0000 UTC m=+0.646440807 container died 45376e5e42f3e93e978bb0adf076079b6f6a82404be0a7098a392aae33fca262 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-1-deactivate, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:21.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.1.service' 2024-05-09T06:44:21.584 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:21.584 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-09T06:44:21.584 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-09T06:44:21.584 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.2 2024-05-09T06:44:21.823 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:21 smithi046 systemd[1]: Stopping Ceph osd.2 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:22.084 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:21 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[133204]: 2024-05-09T06:44:21.968+0000 7f4278ba7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:22.084 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:21 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[133204]: 2024-05-09T06:44:21.968+0000 7f4278ba7700 -1 osd.2 83 *** Got signal Terminated *** 2024-05-09T06:44:22.084 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:21 smithi046 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2[133204]: 2024-05-09T06:44:21.968+0000 7f4278ba7700 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:27.639 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:27 smithi046 podman[153933]: 2024-05-09 06:44:27.405419604 +0000 UTC m=+5.553945189 container died 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:44:28.013 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:27 smithi046 podman[153933]: 2024-05-09 06:44:27.767150601 +0000 UTC m=+5.915676172 container cleanup 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-09T06:44:28.013 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:27 smithi046 bash[153933]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2 2024-05-09T06:44:28.334 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[153961]: 2024-05-09 06:44:28.034989063 +0000 UTC m=+0.621180409 container remove 017ad4ce8786622431ff15132192716882d6ae2635138243fabae39b5339ccca (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:44:28.692 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[154053]: 2024-05-09 06:44:28.309295581 +0000 UTC m=+0.018570267 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:28.692 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[154053]: 2024-05-09 06:44:28.419570893 +0000 UTC m=+0.128845637 container create f716e2c175cd4ced3820d3bd6b090452ca9c715066c0b113271133cb09de63a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_CLEAN=True) 2024-05-09T06:44:28.692 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[154053]: 2024-05-09 06:44:28.63849274 +0000 UTC m=+0.347767430 container init f716e2c175cd4ced3820d3bd6b090452ca9c715066c0b113271133cb09de63a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:28.693 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[154053]: 2024-05-09 06:44:28.642556354 +0000 UTC m=+0.351831040 container start f716e2c175cd4ced3820d3bd6b090452ca9c715066c0b113271133cb09de63a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:28.693 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[154053]: 2024-05-09 06:44:28.713349466 +0000 UTC m=+0.422624271 container attach f716e2c175cd4ced3820d3bd6b090452ca9c715066c0b113271133cb09de63a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:44:29.084 INFO:journalctl@ceph.osd.2.smithi046.stdout:May 09 06:44:28 smithi046 podman[154053]: 2024-05-09 06:44:28.942833939 +0000 UTC m=+0.652108618 container died f716e2c175cd4ced3820d3bd6b090452ca9c715066c0b113271133cb09de63a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-09T06:44:29.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.2.service' 2024-05-09T06:44:29.529 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:29.529 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-09T06:44:29.529 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-09T06:44:29.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.3 2024-05-09T06:44:29.822 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:29 smithi106 systemd[1]: Stopping Ceph osd.3 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:30.322 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:44:29.869+0000 7f8e7c1d2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:30.322 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:44:29.869+0000 7f8e7c1d2700 -1 osd.3 83 *** Got signal Terminated *** 2024-05-09T06:44:30.322 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:29 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:44:29.869+0000 7f8e7c1d2700 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:34.322 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:34 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3[90371]: 2024-05-09T06:44:34.115+0000 7f8e747be700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:10.244476+0000 front 2024-05-09T06:44:10.244520+0000 (oldest deadline 2024-05-09T06:44:33.144387+0000) 2024-05-09T06:44:34.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:33 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:33.902+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:34.824 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:34 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:34.440+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:35.243 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:34 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:34.926+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:35.516 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:35 smithi106 podman[113447]: 2024-05-09 06:44:35.264406958 +0000 UTC m=+5.516293988 container died 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-05-09T06:44:35.516 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:35 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:35.436+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:35.821 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:35 smithi106 podman[113447]: 2024-05-09 06:44:35.703135027 +0000 UTC m=+5.955022051 container cleanup 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T06:44:35.821 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:35 smithi106 bash[113447]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3 2024-05-09T06:44:36.276 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:35 smithi106 podman[113464]: 2024-05-09 06:44:35.888048965 +0000 UTC m=+0.614541360 container remove 47b9d1f58fbd89a3ffb11d2be342c550c8b0ff4e0cf4d41bcb0af21c79764075 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507) 2024-05-09T06:44:36.276 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:35 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:35.914+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:36.570 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:36 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:36.444+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:36.570 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:36 smithi106 podman[113556]: 2024-05-09 06:44:36.20058124 +0000 UTC m=+0.017776495 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:36.570 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:36 smithi106 podman[113556]: 2024-05-09 06:44:36.305504307 +0000 UTC m=+0.122699552 container create 617d14f3a657f9b9948d7dfb4f541c38681f7243b1474a5ab15bf1deb138c474 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:44:36.570 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:36 smithi106 podman[113556]: 2024-05-09 06:44:36.591629409 +0000 UTC m=+0.408824651 container init 617d14f3a657f9b9948d7dfb4f541c38681f7243b1474a5ab15bf1deb138c474 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:44:36.822 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:36 smithi106 podman[113556]: 2024-05-09 06:44:36.595420847 +0000 UTC m=+0.412616099 container start 617d14f3a657f9b9948d7dfb4f541c38681f7243b1474a5ab15bf1deb138c474 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-720f8e9) 2024-05-09T06:44:36.822 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:36 smithi106 podman[113556]: 2024-05-09 06:44:36.674919945 +0000 UTC m=+0.492115197 container attach 617d14f3a657f9b9948d7dfb4f541c38681f7243b1474a5ab15bf1deb138c474 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-09T06:44:37.148 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:36 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:36.961+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:37.148 INFO:journalctl@ceph.osd.3.smithi106.stdout:May 09 06:44:36 smithi106 podman[113556]: 2024-05-09 06:44:36.889367562 +0000 UTC m=+0.706562796 container died 617d14f3a657f9b9948d7dfb4f541c38681f7243b1474a5ab15bf1deb138c474 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-720f8e9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-09T06:44:37.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.3.service' 2024-05-09T06:44:37.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:37.514 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-09T06:44:37.514 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-09T06:44:37.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.4 2024-05-09T06:44:37.821 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:37 smithi106 systemd[1]: Stopping Ceph osd.4 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:37.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:37 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:37.465+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:38.321 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:37 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:37.872+0000 7fa2d7832700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:38.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:37 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:37.872+0000 7fa2d7832700 -1 osd.4 83 *** Got signal Terminated *** 2024-05-09T06:44:38.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:37 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:37.872+0000 7fa2d7832700 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:38.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:38 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:38.010+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:38.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:38 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:38.510+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:39.321 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:39 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:39.045+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:39.821 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:39 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:39.527+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:40.321 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:39 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:39.996+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:40.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:39 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:39.996+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.130125+0000 front 2024-05-09T06:44:14.130024+0000 (oldest deadline 2024-05-09T06:44:39.430026+0000) 2024-05-09T06:44:40.821 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:40 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:40.490+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:41.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:40 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:40.997+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:41.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:40 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:40.997+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.130125+0000 front 2024-05-09T06:44:14.130024+0000 (oldest deadline 2024-05-09T06:44:39.430026+0000) 2024-05-09T06:44:41.821 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:41 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:41.531+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:42.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:41 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:41.960+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.329380+0000 front 2024-05-09T06:44:08.329468+0000 (oldest deadline 2024-05-09T06:44:33.629241+0000) 2024-05-09T06:44:42.322 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:41 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4[95634]: 2024-05-09T06:44:41.960+0000 7fa2cfe1e700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.130125+0000 front 2024-05-09T06:44:14.130024+0000 (oldest deadline 2024-05-09T06:44:39.430026+0000) 2024-05-09T06:44:42.821 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:42 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:42.507+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:43.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:43 smithi106 podman[113662]: 2024-05-09 06:44:43.341027366 +0000 UTC m=+5.577528650 container died 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0) 2024-05-09T06:44:43.572 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:43 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:43.536+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:43.978 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:43 smithi106 podman[113662]: 2024-05-09 06:44:43.71534975 +0000 UTC m=+5.951851100 container cleanup 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:44:43.978 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:43 smithi106 bash[113662]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4 2024-05-09T06:44:44.315 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113679]: 2024-05-09 06:44:43.999998539 +0000 UTC m=+0.648919333 container remove 19b53c23db28199594b39151e03c0c17ef16a5bfe6e37f87b2353d844fccfb93 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-05-09T06:44:44.571 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:44 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:44.560+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:44.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113773]: 2024-05-09 06:44:44.240105861 +0000 UTC m=+0.017902663 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:44.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113773]: 2024-05-09 06:44:44.342586362 +0000 UTC m=+0.120383165 container create 155be31ca1de050da4a6da07f987b8fd7b8effd427918d26a9dd281139fffd75 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-09T06:44:44.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113773]: 2024-05-09 06:44:44.536757411 +0000 UTC m=+0.314554214 container init 155be31ca1de050da4a6da07f987b8fd7b8effd427918d26a9dd281139fffd75 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-09T06:44:44.572 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113773]: 2024-05-09 06:44:44.540159144 +0000 UTC m=+0.317955951 container start 155be31ca1de050da4a6da07f987b8fd7b8effd427918d26a9dd281139fffd75 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=main-720f8e9, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-09T06:44:45.071 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113773]: 2024-05-09 06:44:44.637011622 +0000 UTC m=+0.414808433 container attach 155be31ca1de050da4a6da07f987b8fd7b8effd427918d26a9dd281139fffd75 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=main-720f8e9, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:45.072 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 09 06:44:44 smithi106 podman[113773]: 2024-05-09 06:44:44.84358851 +0000 UTC m=+0.621385315 container died 155be31ca1de050da4a6da07f987b8fd7b8effd427918d26a9dd281139fffd75 (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:44:45.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.4.service' 2024-05-09T06:44:45.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:45.432 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-09T06:44:45.433 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-09T06:44:45.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.5 2024-05-09T06:44:45.765 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:45 smithi106 systemd[1]: Stopping Ceph osd.5 for 165d9e0a-0dcc-11ef-bc97-c7b262605968... 2024-05-09T06:44:45.765 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:45 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:45.555+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:45.765 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:45 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:45.555+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.952594+0000 front 2024-05-09T06:44:14.952478+0000 (oldest deadline 2024-05-09T06:44:44.952624+0000) 2024-05-09T06:44:46.071 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:45 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:45.785+0000 7f3c472fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:44:46.072 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:45 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:45.785+0000 7f3c472fb700 -1 osd.5 83 *** Got signal Terminated *** 2024-05-09T06:44:46.072 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:45 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:45.785+0000 7f3c472fb700 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:44:46.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:46 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:46.590+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:46.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:46 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:46.590+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.952594+0000 front 2024-05-09T06:44:14.952478+0000 (oldest deadline 2024-05-09T06:44:44.952624+0000) 2024-05-09T06:44:47.821 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:47 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:47.568+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:47.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:47 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:47.568+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.952594+0000 front 2024-05-09T06:44:14.952478+0000 (oldest deadline 2024-05-09T06:44:44.952624+0000) 2024-05-09T06:44:48.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:48 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:48.582+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:48.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:48 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:48.582+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.952594+0000 front 2024-05-09T06:44:14.952478+0000 (oldest deadline 2024-05-09T06:44:44.952624+0000) 2024-05-09T06:44:48.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:48 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:48.582+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-05-09T06:44:24.953157+0000 front 2024-05-09T06:44:24.953187+0000 (oldest deadline 2024-05-09T06:44:47.753298+0000) 2024-05-09T06:44:50.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:49 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:49.622+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:50.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:49 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:49.622+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.952594+0000 front 2024-05-09T06:44:14.952478+0000 (oldest deadline 2024-05-09T06:44:44.952624+0000) 2024-05-09T06:44:50.073 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:49 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:49.622+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-05-09T06:44:24.953157+0000 front 2024-05-09T06:44:24.953187+0000 (oldest deadline 2024-05-09T06:44:47.753298+0000) 2024-05-09T06:44:51.071 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:50 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:50.654+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-05-09T06:44:08.551618+0000 front 2024-05-09T06:44:08.551609+0000 (oldest deadline 2024-05-09T06:44:33.851472+0000) 2024-05-09T06:44:51.072 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:50 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:50.654+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-05-09T06:44:14.952594+0000 front 2024-05-09T06:44:14.952478+0000 (oldest deadline 2024-05-09T06:44:44.952624+0000) 2024-05-09T06:44:51.072 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:50 smithi106 ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5[100457]: 2024-05-09T06:44:50.654+0000 7f3c438ef700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.46:6822 osd.2 since back 2024-05-09T06:44:24.953157+0000 front 2024-05-09T06:44:24.953187+0000 (oldest deadline 2024-05-09T06:44:47.753298+0000) 2024-05-09T06:44:51.515 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:51 smithi106 podman[113878]: 2024-05-09 06:44:51.26125352 +0000 UTC m=+5.580643914 container died 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-09T06:44:51.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:51 smithi106 podman[113878]: 2024-05-09 06:44:51.610520219 +0000 UTC m=+5.929910620 container cleanup 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507) 2024-05-09T06:44:51.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:51 smithi106 bash[113878]: ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5 2024-05-09T06:44:51.822 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:51 smithi106 podman[113907]: 2024-05-09 06:44:51.778233572 +0000 UTC m=+0.508393653 container remove 45571448b3f73c1e54e767b60577fbd2db954fef74bfee537d1e9ed527efe12d (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-720f8e9, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:44:52.460 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:52 smithi106 podman[113999]: 2024-05-09 06:44:52.129736044 +0000 UTC m=+0.018006735 image pull 8ec306cbfbd6ea8f7da633747d6b911dd80f450c547465dc2e1c81379dbc94c4 quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc 2024-05-09T06:44:52.461 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:52 smithi106 podman[113999]: 2024-05-09 06:44:52.229173376 +0000 UTC m=+0.117444072 container create 72ec4259ee5aaa71247e8312fd88b7a66c643a7a05185c24dde3851a5b3ae8fb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=main-720f8e9, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:52.764 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:52 smithi106 podman[113999]: 2024-05-09 06:44:52.482128564 +0000 UTC m=+0.370399261 container init 72ec4259ee5aaa71247e8312fd88b7a66c643a7a05185c24dde3851a5b3ae8fb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=main-720f8e9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:52.764 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:52 smithi106 podman[113999]: 2024-05-09 06:44:52.485688698 +0000 UTC m=+0.373959390 container start 72ec4259ee5aaa71247e8312fd88b7a66c643a7a05185c24dde3851a5b3ae8fb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=main-720f8e9, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T06:44:52.764 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:52 smithi106 podman[113999]: 2024-05-09 06:44:52.565268727 +0000 UTC m=+0.453539428 container attach 72ec4259ee5aaa71247e8312fd88b7a66c643a7a05185c24dde3851a5b3ae8fb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-720f8e9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T06:44:53.055 INFO:journalctl@ceph.osd.5.smithi106.stdout:May 09 06:44:52 smithi106 podman[113999]: 2024-05-09 06:44:52.78578009 +0000 UTC m=+0.674050785 container died 72ec4259ee5aaa71247e8312fd88b7a66c643a7a05185c24dde3851a5b3ae8fb (image=quay.ceph.io/ceph-ci/ceph@sha256:129a7a0d73c6c1977dbc18592b50fb8ee6a723aff561af694c74878eb8169bdc, name=ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-720f8e9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-09T06:44:53.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-165d9e0a-0dcc-11ef-bc97-c7b262605968@osd.5.service' 2024-05-09T06:44:53.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:44:53.412 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-09T06:44:53.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:45:15.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:45:25.534 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:45:25.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:45:25.595 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-09T06:45:25.597 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/remote/smithi046/crash 2024-05-09T06:45:25.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:45:25.638 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:45:25.639 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:45:25.641 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/remote/smithi106/crash 2024-05-09T06:45:25.642 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:45:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:tar: /var/lib/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:45:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:45:25.667 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-09T06:45:25.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-09T06:45:25.719 INFO:tasks.cephadm:Compressing logs... 2024-05-09T06:45:25.719 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:45:25.762 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:45:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mgr.smithi106.nlgnpx.log 2024-05-09T06:45:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:: No such file or directory 2024-05-09T06:45:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:45:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mgr.smithi106.nlgnpx.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:45:25.787 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-09T06:45:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-09T06:45:25.788 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-09T06:45:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mon.smithi046.log 2024-05-09T06:45:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2024-05-09T06:45:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi046.pkuwsr.log 2024-05-09T06:45:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mon.smithi046.log: /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi046.pkuwsr.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi046.easboa.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi046.easboa.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mgr.smithi046.nvpcui.log 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.0.log: 87.6% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:45:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.5.log: /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi106.fqgqkm.log 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi106.fqgqkm.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mon.smithi106.log 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.cephadm.log: 87.6% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr: 85.4% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mon.smithi106.log: gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi106.ugnujp.log 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-volume.log: 91.2% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:45:25.797 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:45:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mgr.smithi046.nvpcui.log: 91.0% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:45:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:45:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.cephadm.log: 85.5% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:45:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:45:25.806 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi106.ugnujp.log: /var/log/ceph/cephadm.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:45:25.815 INFO:teuthology.orchestra.run.smithi106.stderr: 91.0% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:45:25.822 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:45:25.849 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:45:25.854 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mgr.smithi106.nlgnpx.log.gz 2024-05-09T06:45:26.183 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mgr.smithi046.nvpcui.log.gz 2024-05-09T06:45:26.193 INFO:teuthology.orchestra.run.smithi106.stderr: 92.6% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mon.smithi106.log.gz 2024-05-09T06:45:26.948 INFO:teuthology.orchestra.run.smithi046.stderr: 90.5% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mon.smithi046.log.gz 2024-05-09T06:45:31.030 INFO:teuthology.orchestra.run.smithi106.stderr: 94.8% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi106.fqgqkm.log.gz 2024-05-09T06:45:31.352 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-09T06:45:31.511 INFO:teuthology.orchestra.run.smithi046.stderr: 94.8% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi046.easboa.log.gz 2024-05-09T06:45:31.812 INFO:teuthology.orchestra.run.smithi106.stderr: 93.5% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-09T06:45:32.140 INFO:teuthology.orchestra.run.smithi106.stderr: 93.4% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-09T06:45:32.313 INFO:teuthology.orchestra.run.smithi106.stderr: 94.8% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi106.ugnujp.log.gz 2024-05-09T06:45:32.548 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-09T06:45:32.701 INFO:teuthology.orchestra.run.smithi106.stderr: 93.4% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-09T06:45:32.703 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-09T06:45:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m6.927s 2024-05-09T06:45:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m30.474s 2024-05-09T06:45:32.703 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m1.044s 2024-05-09T06:45:33.695 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-09T06:47:03.680 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/165d9e0a-0dcc-11ef-bc97-c7b262605968/ceph-mds.cephfs.smithi046.pkuwsr.log.gz 2024-05-09T06:47:03.683 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-09T06:47:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:real 1m37.905s 2024-05-09T06:47:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:user 2m1.777s 2024-05-09T06:47:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m3.404s 2024-05-09T06:47:03.684 INFO:tasks.cephadm:Archiving logs... 2024-05-09T06:47:03.684 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/remote/smithi046/log 2024-05-09T06:47:03.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:47:21.816 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/remote/smithi106/log 2024-05-09T06:47:21.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:47:25.913 INFO:tasks.cephadm:Removing cluster... 2024-05-09T06:47:25.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 --force 2024-05-09T06:47:26.566 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 165d9e0a-0dcc-11ef-bc97-c7b262605968 --force 2024-05-09T06:47:27.068 INFO:tasks.cephadm:Removing cephadm ... 2024-05-09T06:47:27.068 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:47:27.086 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:47:27.101 INFO:tasks.cephadm:Teardown complete 2024-05-09T06:47:27.101 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T06:47:27.112 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T06:47:27.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:47:27.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:47:27.215 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T06:47:27.225 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T06:47:27.225 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:47:27.228 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:47:27.241 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:47:27.241 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:47:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:47:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-05-09T06:47:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 33 +1568us[+1568us] +/- 39ms 2024-05-09T06:47:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 8 377 228 -750us[ -747us] +/- 60ms 2024-05-09T06:47:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -564us[ -564us] +/- 81ms 2024-05-09T06:47:27.248 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:47:27.250 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:47:27.250 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-09T06:47:27.250 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 35 +1202us[+1218us] +/- 39ms 2024-05-09T06:47:27.250 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -1074us[-1058us] +/- 63ms 2024-05-09T06:47:27.250 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -943us[ -927us] +/- 81ms 2024-05-09T06:47:27.250 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:47:27.250 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T06:47:27.261 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T06:47:27.261 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T06:47:27.334 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:47:27.419 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:47:27.491 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:47:27.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:47:27.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:47:27.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:47:27.550 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T06:47:27.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T06:47:27.571 INFO:teuthology.task.internal:Duration was 2093.463904 seconds 2024-05-09T06:47:27.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T06:47:27.582 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T06:47:27.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:47:27.585 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:47:27.622 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:47:27.628 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:47:27.876 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T06:47:27.876 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-05-09T06:47:27.877 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:47:27.938 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-05-09T06:47:27.938 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:47:27.960 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T06:47:27.960 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:47:27.980 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:47:28.026 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T06:47:28.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:47:28.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:47:28.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T06:47:28.758 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T06:47:28.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:47:28.785 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:47:28.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T06:47:28.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:28.827 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:28.849 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-05-09T06:47:28.876 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-05-09T06:47:28.889 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:28.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:47:28.917 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:47:28.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:47:28.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T06:47:28.957 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T06:47:28.958 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/remote/smithi046 2024-05-09T06:47:28.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:47:29.013 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-09_00:24:17-fs:upgrade:mds_upgrade_sequence-main-distro-default-smithi/7699440/remote/smithi106 2024-05-09T06:47:29.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:47:29.055 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T06:47:29.056 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:47:29.058 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:47:29.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T06:47:29.118 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T06:47:29.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T06:47:29.170 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T06:47:29.171 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:47:29.173 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:47:29.186 INFO:teuthology.orchestra.run.smithi046.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:47 /home/ubuntu/cephtest 2024-05-09T06:47:29.188 INFO:teuthology.orchestra.run.smithi106.stdout: 265307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:47 /home/ubuntu/cephtest 2024-05-09T06:47:29.189 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T06:47:29.203 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T06:47:29.230 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2093.4639043807983 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T06:47:29.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T06:47:29.306 INFO:teuthology.run:pass